2024-09-11T05:22:23.821 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T05:22:23.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T05:22:23.921 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900559 branch: squid description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} email: ceph-qa@ceph.com first_in_suite: false job_id: '7900559' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: rbd cache: true rbd cache policy: writeback global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd memory target: 1610612736 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: daaf78de334647fc0c800f4ac495cc9475a26bae owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6175 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 88/128 suite: rbd suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: daaf78de334647fc0c800f4ac495cc9475a26bae targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDlpD0lno+B0Nt2zoGmpPO/7yfX2B+ttXaSxD8HMOfkzmShNIntyFrn3ZxCqPCbktS5fg/xl+NnOSJerR7ejraY= smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLilpODZOGk/yt9u65wvfFbRtySye1ZJAFJAjdFToUVi6MiQ+WBJEkwVyMcc3TLx+Y/YhjpDZh7eLuQdY3Ynfyk= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_21:16:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T05:22:23.922 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa; will attempt to use it 2024-09-11T05:22:23.922 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa/tasks 2024-09-11T05:22:23.922 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T05:22:23.924 INFO:teuthology.task.internal:Checking packages... 2024-09-11T05:22:23.946 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T05:22:23.946 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T05:22:23.946 INFO:teuthology.packaging:ref: None 2024-09-11T05:22:23.946 INFO:teuthology.packaging:tag: None 2024-09-11T05:22:23.946 INFO:teuthology.packaging:branch: squid 2024-09-11T05:22:23.946 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T05:22:23.946 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-11T05:22:24.147 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-308.gdaaf78de 2024-09-11T05:22:24.148 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T05:22:24.155 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T05:22:24.155 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T05:22:24.183 INFO:teuthology.task.internal:Saving configuration 2024-09-11T05:22:24.197 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T05:22:24.203 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T05:22:24.229 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900559', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 05:17:25.686493', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDlpD0lno+B0Nt2zoGmpPO/7yfX2B+ttXaSxD8HMOfkzmShNIntyFrn3ZxCqPCbktS5fg/xl+NnOSJerR7ejraY='} 2024-09-11T05:22:24.252 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900559', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 05:17:25.688454', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLilpODZOGk/yt9u65wvfFbRtySye1ZJAFJAjdFToUVi6MiQ+WBJEkwVyMcc3TLx+Y/YhjpDZh7eLuQdY3Ynfyk='} 2024-09-11T05:22:24.252 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T05:22:24.259 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-11T05:22:24.259 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-11T05:22:24.259 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T05:22:24.320 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa4f8863400>, signals=[15]) 2024-09-11T05:22:24.321 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T05:22:24.327 INFO:teuthology.task.internal:Opening connections... 2024-09-11T05:22:24.327 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T05:22:24.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:22:24.405 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-09-11T05:22:24.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:22:24.514 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T05:22:24.521 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-09-11T05:22:24.540 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-09-11T05:22:24.540 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-09-11T05:22:24.597 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-09-11T05:22:24.597 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-09-11T05:22:24.598 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-09-11T05:22:24.598 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-09-11T05:22:24.598 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-09-11T05:22:24.598 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-09-11T05:22:24.598 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T05:22:24.598 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-09-11T05:22:24.598 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-09-11T05:22:24.598 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T05:22:24.598 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-09-11T05:22:24.598 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T05:22:24.598 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T05:22:24.598 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T05:22:24.599 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-09-11T05:22:24.624 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-09-11T05:22:24.642 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-09-11T05:22:24.642 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-09-11T05:22:24.700 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-09-11T05:22:24.700 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-09-11T05:22:24.700 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-09-11T05:22:24.700 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-09-11T05:22:24.700 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-09-11T05:22:24.700 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-09-11T05:22:24.700 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T05:22:24.701 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-09-11T05:22:24.701 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-09-11T05:22:24.701 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T05:22:24.701 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-09-11T05:22:24.701 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T05:22:24.701 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T05:22:24.701 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T05:22:24.701 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-09-11T05:22:24.724 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T05:22:24.734 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T05:22:24.739 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T05:22:24.739 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-09-11T05:22:24.742 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-09-11T05:22:24.759 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T05:22:24.765 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T05:22:24.766 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-09-11T05:22:24.800 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-09-11T05:22:24.891 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T05:22:24.948 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T05:22:24.961 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T05:22:24.962 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T05:22:24.962 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T05:22:24.962 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T05:22:24.979 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:22:24.979 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-11T05:22:24.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:22:24.980 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-09-11T05:22:25.037 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-503.el9.x86_64 2024-09-11T05:22:25.037 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.14.0-503.el9.x86_64 2024-09-11T05:22:25.037 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum install -y kernel 2024-09-11T05:22:25.039 INFO:teuthology.orchestra.run.smithi084.stdout:5.14.0-503.el9.x86_64 2024-09-11T05:22:25.039 INFO:teuthology.task.kernel:Running kernel on smithi084: 5.14.0-503.el9.x86_64 2024-09-11T05:22:25.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum install -y kernel 2024-09-11T05:22:27.491 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-11T05:22:28.527 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-11T05:22:30.502 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-11T05:22:30.834 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 20 MB 00:02 2024-09-11T05:22:35.251 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-11T05:22:35.878 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-11T05:22:36.851 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-11T05:22:37.303 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-11T05:22:38.289 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-11T05:22:38.290 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-11T05:22:43.654 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-11T05:22:43.711 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-11T05:22:45.668 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T05:22:45.669 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T05:22:45.733 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T05:22:45.733 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T05:22:45.767 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:22:45.774 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi084.stdout:Install 4 Packages 2024-09-11T05:22:45.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 79 M 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 126 M 2024-09-11T05:22:45.776 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:22:45.825 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:22:45.841 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:22:45.841 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-09-11T05:22:45.841 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:22:45.841 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:22:45.841 INFO:teuthology.orchestra.run.smithi070.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T05:22:45.841 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T05:22:45.841 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T05:22:45.842 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T05:22:45.842 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T05:22:45.842 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:22:45.842 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:22:45.842 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:22:45.842 INFO:teuthology.orchestra.run.smithi070.stdout:Install 4 Packages 2024-09-11T05:22:45.842 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:22:45.842 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 79 M 2024-09-11T05:22:45.843 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 126 M 2024-09-11T05:22:45.843 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:22:45.987 INFO:teuthology.orchestra.run.smithi070.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 230 kB/s | 23 kB 00:00 2024-09-11T05:22:45.988 INFO:teuthology.orchestra.run.smithi084.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 254 kB/s | 23 kB 00:00 2024-09-11T05:22:46.370 INFO:teuthology.orchestra.run.smithi070.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-11T05:22:46.754 INFO:teuthology.orchestra.run.smithi070.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-11T05:22:47.104 INFO:teuthology.orchestra.run.smithi070.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-11T05:22:47.104 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:22:47.104 INFO:teuthology.orchestra.run.smithi070.stdout:Total 62 MB/s | 79 MB 00:01 2024-09-11T05:22:47.781 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:22:48.147 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:22:48.147 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:22:49.118 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:22:49.119 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:22:49.921 INFO:teuthology.orchestra.run.smithi084.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:04 2024-09-11T05:22:51.581 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:22:52.219 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T05:22:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T05:22:53.029 INFO:teuthology.orchestra.run.smithi084.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 4.1 MB/s | 29 MB 00:07 2024-09-11T05:22:55.109 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T05:22:55.129 INFO:teuthology.orchestra.run.smithi084.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.7 MB/s | 35 MB 00:09 2024-09-11T05:22:55.129 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:22:55.129 INFO:teuthology.orchestra.run.smithi084.stdout:Total 8.4 MB/s | 79 MB 00:09 2024-09-11T05:22:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T05:22:55.808 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:22:56.175 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:22:56.175 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:22:57.162 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:22:57.162 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:22:59.608 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:23:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T05:23:00.199 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:23:00.267 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T05:23:00.364 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T05:23:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T05:23:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T05:23:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:23:08.154 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T05:23:08.250 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:23:13.130 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:23:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:23:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:23:43.471 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:23:43.471 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T05:23:43.471 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T05:23:43.471 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T05:23:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:23:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:23:44.283 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:23:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T05:23:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T05:23:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T05:23:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T05:23:44.283 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:23:44.284 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:23:44.597 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T05:23:44.724 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T05:23:44.725 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T05:23:44.725 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T05:23:44.725 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T05:23:44.725 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T05:23:44.725 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T05:23:44.725 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T05:23:44.726 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T05:23:44.784 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T05:23:44.784 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T05:23:44.784 DEBUG:teuthology.orchestra.run.smithi070:> sudo rpm -qi grub2-tools 2024-09-11T05:23:44.816 INFO:teuthology.orchestra.run.smithi070.stdout:Name : grub2-tools 2024-09-11T05:23:44.816 INFO:teuthology.orchestra.run.smithi070.stdout:Epoch : 1 2024-09-11T05:23:44.816 INFO:teuthology.orchestra.run.smithi070.stdout:Version : 2.06 2024-09-11T05:23:44.816 INFO:teuthology.orchestra.run.smithi070.stdout:Release : 82.el9 2024-09-11T05:23:44.816 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: x86_64 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:Group : Unspecified 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:Size : 8274670 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:License : GPLv3+ 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:Packager : builder@centos.org 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:Vendor : CentOS 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:Summary : Support tools for GRUB. 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:Description : 2024-09-11T05:23:44.817 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:23:44.818 INFO:teuthology.orchestra.run.smithi070.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T05:23:44.818 INFO:teuthology.orchestra.run.smithi070.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T05:23:44.818 INFO:teuthology.orchestra.run.smithi070.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T05:23:44.818 INFO:teuthology.orchestra.run.smithi070.stdout:hardware devices. 2024-09-11T05:23:44.818 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:23:44.818 INFO:teuthology.orchestra.run.smithi070.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T05:23:44.819 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T05:23:44.819 INFO:teuthology.task.kernel:Updating grub on smithi070 to boot 5.14.0-505.el9.x86_64 2024-09-11T05:23:44.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T05:23:45.468 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-09-11T05:23:46.811 INFO:teuthology.orchestra.run.smithi070.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T05:23:46.831 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-09-11T05:23:46.833 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-11T05:23:46.849 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.Vghai9neGh 2024-09-11T05:23:46.849 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Vghai9neGh 2024-09-11T05:23:46.915 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.Vghai9neGh 2024-09-11T05:23:47.060 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.Vghai9neGh is 6KB 2024-09-11T05:23:47.108 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.Vghai9neGh 2024-09-11T05:23:47.123 DEBUG:teuthology.orchestra.run.smithi070:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T05:23:47.186 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T05:23:47.186 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T05:23:47.186 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T05:23:47.187 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T05:23:47.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T05:23:47.344 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-09-11T05:23:51.507 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:23:51.547 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:23:51.922 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:23:51.922 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T05:23:51.922 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T05:23:51.922 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T05:23:52.800 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T05:23:52.800 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:23:52.800 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:23:52.800 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T05:23:52.800 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T05:23:52.801 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T05:23:52.801 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T05:23:52.801 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:23:52.801 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:23:53.147 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T05:23:53.242 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T05:23:53.242 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T05:23:53.242 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T05:23:53.242 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T05:23:53.242 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T05:23:53.242 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T05:23:53.242 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T05:23:53.243 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T05:23:53.301 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T05:23:53.302 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T05:23:53.302 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2024-09-11T05:23:53.343 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2024-09-11T05:23:53.343 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2024-09-11T05:23:53.344 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.06 2024-09-11T05:23:53.344 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 82.el9 2024-09-11T05:23:53.344 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2024-09-11T05:23:53.344 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T05:23:53.344 INFO:teuthology.orchestra.run.smithi084.stdout:Group : Unspecified 2024-09-11T05:23:53.344 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 8274670 2024-09-11T05:23:53.344 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2024-09-11T05:23:53.344 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T05:23:53.344 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T05:23:53.344 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T05:23:53.344 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T05:23:53.344 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : builder@centos.org 2024-09-11T05:23:53.344 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : CentOS 2024-09-11T05:23:53.345 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T05:23:53.345 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2024-09-11T05:23:53.345 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2024-09-11T05:23:53.345 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:23:53.345 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T05:23:53.345 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T05:23:53.345 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T05:23:53.345 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2024-09-11T05:23:53.345 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:23:53.345 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T05:23:53.346 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T05:23:53.346 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 5.14.0-505.el9.x86_64 2024-09-11T05:23:53.346 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T05:23:53.996 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2024-09-11T05:23:55.318 INFO:teuthology.orchestra.run.smithi084.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T05:23:55.363 INFO:teuthology.orchestra.run.smithi084.stderr:done 2024-09-11T05:23:55.365 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-09-11T05:23:55.380 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.RdJT41iJHV 2024-09-11T05:23:55.381 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.RdJT41iJHV 2024-09-11T05:23:55.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.RdJT41iJHV 2024-09-11T05:23:55.584 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.RdJT41iJHV is 6KB 2024-09-11T05:23:55.632 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.RdJT41iJHV 2024-09-11T05:23:55.649 DEBUG:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T05:23:55.709 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T05:23:55.710 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T05:23:55.710 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T05:23:55.710 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T05:23:55.711 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T05:23:55.864 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2024-09-11T05:24:17.369 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T05:24:17.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-11T05:24:17.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:24:25.873 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T05:24:25.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-11T05:24:25.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:24:35.773 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-11T05:24:44.221 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-09-11T05:24:44.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-11T05:24:44.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:24:47.841 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-11T05:24:53.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-11T05:24:53.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:24:56.285 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-09-11T05:24:59.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-11T05:24:59.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:25:08.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-11T05:25:08.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:25:31.747 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-11T05:25:32.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-11T05:25:32.088 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T05:25:32.088 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-11T05:25:32.103 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-505.el9.x86_64 2024-09-11T05:25:32.103 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T05:25:32.103 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T05:25:32.104 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T05:25:33.105 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T05:25:33.105 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T05:25:33.226 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-09-11T05:25:33.255 DEBUG:teuthology.parallel:result is None 2024-09-11T05:25:40.114 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-09-11T05:25:40.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-11T05:25:40.534 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-11T05:25:40.534 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-09-11T05:25:40.549 INFO:teuthology.orchestra.run.smithi084.stdout:5.14.0-505.el9.x86_64 2024-09-11T05:25:40.549 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T05:25:40.549 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T05:25:40.549 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T05:25:41.550 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T05:25:41.551 DEBUG:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T05:25:41.671 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2024-09-11T05:25:41.695 DEBUG:teuthology.parallel:result is None 2024-09-11T05:25:41.695 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T05:25:41.724 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T05:25:41.724 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T05:25:41.727 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T05:25:41.743 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T05:25:41.758 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T05:25:41.775 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T05:25:41.775 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T05:25:41.786 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T05:25:41.873 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T05:25:41.887 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T05:25:41.887 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T05:25:41.892 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T05:25:41.917 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T05:25:41.921 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T05:25:41.927 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T05:25:41.933 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T05:25:41.935 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T05:25:41.942 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T05:25:41.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T05:25:41.978 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T05:25:42.003 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T05:25:42.013 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T05:25:42.013 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T05:25:42.047 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T05:25:42.062 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T05:25:42.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T05:25:42.199 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T05:25:42.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T05:25:42.325 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:25:42.325 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T05:25:42.390 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T05:25:42.426 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T05:25:42.508 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T05:25:42.578 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T05:25:42.615 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:25:42.615 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T05:25:42.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-09-11T05:25:42.718 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-09-11T05:25:42.772 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T05:25:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T05:25:43.272 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T05:25:43.279 INFO:teuthology.task.internal:Starting timer... 2024-09-11T05:25:43.279 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T05:25:43.291 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T05:25:43.301 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-11T05:25:43.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2024-09-11T05:25:43.391 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2024-09-11T05:25:43.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2024-09-11T05:25:43.508 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2024-09-11T05:25:43.510 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T05:25:43.510 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2024-09-11T05:25:43.536 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2024-09-11T05:25:43.536 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2024-09-11T05:25:43.557 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2024-09-11T05:25:43.557 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi084.front.sepia.ceph.com': 'permissive'} 2024-09-11T05:25:43.557 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T05:25:43.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:25:43.605 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T05:25:43.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:25:43.631 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T05:25:43.631 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2024-09-11T05:25:43.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2024-09-11T05:25:43.709 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T05:25:43.718 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T05:25:43.721 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T05:25:43.827 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T05:25:43.838 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T05:25:43.838 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi084.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T05:29:24.254 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi084.front.sepia.ceph.com')] 2024-09-11T05:29:24.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-11T05:29:24.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:29:24.331 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-11T05:29:24.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-11T05:29:24.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-11T05:29:24.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T05:29:24.491 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-09-11T05:29:24.579 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-11T05:29:24.580 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T05:29:24.594 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T05:29:24.595 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T05:29:24.595 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T05:29:24.598 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T05:29:24.598 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T05:29:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T05:29:24.641 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T05:29:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T05:29:24.661 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T05:29:24.665 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2024-09-11T05:29:24.677 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2024-09-11T05:29:24.686 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2024-09-11T05:29:24.691 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T05:29:24.696 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2024-09-11T05:29:24.705 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T05:29:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T05:29:24.724 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T05:29:24.764 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-11T05:29:24.767 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T05:29:24.767 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-11T05:29:24.767 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:29:24.767 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:29:24.767 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:29:24.767 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:29:24.784 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-09-11T05:29:24.788 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T05:29:24.788 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-09-11T05:29:24.788 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:29:24.788 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:29:24.788 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:29:24.788 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:29:24.788 INFO:teuthology.run_tasks:Running task install... 2024-09-11T05:29:24.798 DEBUG:teuthology.task.install:project ceph 2024-09-11T05:29:24.798 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T05:29:24.798 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T05:29:24.798 INFO:teuthology.task.install:Using flavor: default 2024-09-11T05:29:24.807 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T05:29:24.808 INFO:teuthology.task.install:extra packages: [] 2024-09-11T05:29:24.808 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T05:29:24.809 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T05:29:24.810 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T05:29:24.811 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T05:29:24.959 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T05:29:24.959 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T05:29:24.974 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T05:29:24.974 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T05:29:25.070 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T05:29:25.070 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:29:25.070 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T05:29:25.086 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T05:29:25.087 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:29:25.087 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T05:29:25.098 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T05:29:25.098 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T05:29:25.113 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T05:29:25.113 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T05:29:25.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T05:29:25.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T05:29:25.239 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T05:29:25.253 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T05:29:25.303 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2024-09-11T05:29:25.305 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2024-09-11T05:29:25.317 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2024-09-11T05:29:25.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2024-09-11T05:29:25.541 INFO:teuthology.orchestra.run.smithi070.stdout:45 files removed 2024-09-11T05:29:25.562 INFO:teuthology.orchestra.run.smithi084.stdout:45 files removed 2024-09-11T05:29:25.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw 2024-09-11T05:29:25.589 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw 2024-09-11T05:29:26.128 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-09-11T05:29:26.136 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 319 kB/s | 84 kB 00:00 2024-09-11T05:29:26.420 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-11T05:29:26.437 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-11T05:29:26.688 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-11T05:29:26.695 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-11T05:29:27.346 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-11T05:29:29.387 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.2 MB 00:02 2024-09-11T05:29:32.797 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 20 MB 00:02 2024-09-11T05:29:35.429 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 2.9 MB/s | 20 MB 00:06 2024-09-11T05:29:38.055 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-11T05:29:39.731 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-11T05:29:40.179 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 6.5 MB 00:00 2024-09-11T05:29:40.834 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-11T05:29:41.988 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-11T05:29:42.834 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-11T05:29:46.273 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-11T05:29:48.298 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-11T05:29:48.691 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:29:48.714 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:29:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-11T05:29:48.714 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:29:48.714 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:29:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T05:29:48.714 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-09-11T05:29:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T05:29:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T05:29:48.714 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-11T05:29:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T05:29:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T05:29:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T05:29:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T05:29:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T05:29:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T05:29:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T05:29:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T05:29:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T05:29:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T05:29:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T05:29:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T05:29:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T05:29:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T05:29:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T05:29:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T05:29:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T05:29:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T05:29:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T05:29:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T05:29:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T05:29:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T05:29:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T05:29:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T05:29:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T05:29:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T05:29:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T05:29:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T05:29:48.717 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2024-09-11T05:29:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T05:29:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:29:48.717 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:29:48.717 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:29:48.718 INFO:teuthology.orchestra.run.smithi084.stdout:Install 30 Packages 2024-09-11T05:29:48.718 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 2 Packages 2024-09-11T05:29:48.718 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:29:48.718 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 60 M 2024-09-11T05:29:48.718 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:29:49.574 INFO:teuthology.orchestra.run.smithi084.stdout:(1/32): ceph-base-19.1.1-298.gb53b6d3e.el9.x86_ 9.5 MB/s | 5.4 MB 00:00 2024-09-11T05:29:49.624 INFO:teuthology.orchestra.run.smithi084.stdout:(2/32): ceph-selinux-19.1.1-298.gb53b6d3e.el9.x 505 kB/s | 25 kB 00:00 2024-09-11T05:29:49.724 INFO:teuthology.orchestra.run.smithi084.stdout:(3/32): libcephfs2-19.1.1-298.gb53b6d3e.el9.x86 7.4 MB/s | 752 kB 00:00 2024-09-11T05:29:49.841 INFO:teuthology.orchestra.run.smithi084.stdout:(4/32): ceph-radosgw-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 11 MB 00:00 2024-09-11T05:29:49.875 INFO:teuthology.orchestra.run.smithi084.stdout:(5/32): libradosstriper1-19.1.1-298.gb53b6d3e.e 3.3 MB/s | 506 kB 00:00 2024-09-11T05:29:49.925 INFO:teuthology.orchestra.run.smithi084.stdout:(6/32): python3-ceph-argparse-19.1.1-298.gb53b6 906 kB/s | 45 kB 00:00 2024-09-11T05:29:50.001 INFO:teuthology.orchestra.run.smithi084.stdout:(7/32): python3-ceph-common-19.1.1-298.gb53b6d3 1.8 MB/s | 136 kB 00:00 2024-09-11T05:29:50.101 INFO:teuthology.orchestra.run.smithi084.stdout:(8/32): librgw2-19.1.1-298.gb53b6d3e.el9.x86_64 21 MB/s | 5.3 MB 00:00 2024-09-11T05:29:50.151 INFO:teuthology.orchestra.run.smithi084.stdout:(9/32): python3-cephfs-19.1.1-298.gb53b6d3e.el9 1.1 MB/s | 162 kB 00:00 2024-09-11T05:29:50.185 INFO:teuthology.orchestra.run.smithi084.stdout:(10/32): python3-rados-19.1.1-298.gb53b6d3e.el9 3.8 MB/s | 321 kB 00:00 2024-09-11T05:29:50.218 INFO:teuthology.orchestra.run.smithi084.stdout:(11/32): python3-rbd-19.1.1-298.gb53b6d3e.el9.x 4.4 MB/s | 301 kB 00:00 2024-09-11T05:29:50.244 INFO:teuthology.orchestra.run.smithi084.stdout:(12/32): python3-rgw-19.1.1-298.gb53b6d3e.el9.x 1.7 MB/s | 100 kB 00:00 2024-09-11T05:29:50.452 INFO:teuthology.orchestra.run.smithi084.stdout:(13/32): ceph-common-19.1.1-298.gb53b6d3e.el9.x 15 MB/s | 21 MB 00:01 2024-09-11T05:29:50.602 INFO:teuthology.orchestra.run.smithi084.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 447 kB/s | 160 kB 00:00 2024-09-11T05:29:50.628 INFO:teuthology.orchestra.run.smithi084.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 259 kB/s | 45 kB 00:00 2024-09-11T05:29:50.653 INFO:teuthology.orchestra.run.smithi084.stdout:(16/32): boost-program-options-1.75.0-8.el9.x86 246 kB/s | 107 kB 00:00 2024-09-11T05:29:50.683 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:29:50.696 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:29:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T05:29:50.696 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:29:50.696 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:29:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T05:29:50.696 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2024-09-11T05:29:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T05:29:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T05:29:50.696 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T05:29:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T05:29:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T05:29:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T05:29:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T05:29:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T05:29:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T05:29:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T05:29:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T05:29:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T05:29:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T05:29:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T05:29:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T05:29:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T05:29:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T05:29:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T05:29:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T05:29:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T05:29:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T05:29:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T05:29:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T05:29:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T05:29:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T05:29:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T05:29:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T05:29:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T05:29:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T05:29:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T05:29:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T05:29:50.699 INFO:teuthology.orchestra.run.smithi070.stdout:Installing weak dependencies: 2024-09-11T05:29:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T05:29:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:29:50.699 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:29:50.699 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:29:50.699 INFO:teuthology.orchestra.run.smithi070.stdout:Install 30 Packages 2024-09-11T05:29:50.699 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 2 Packages 2024-09-11T05:29:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:29:50.701 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 60 M 2024-09-11T05:29:50.701 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:29:50.703 INFO:teuthology.orchestra.run.smithi084.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 847 kB/s | 42 kB 00:00 2024-09-11T05:29:50.745 INFO:teuthology.orchestra.run.smithi084.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-11T05:29:50.771 INFO:teuthology.orchestra.run.smithi084.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-11T05:29:50.796 INFO:teuthology.orchestra.run.smithi084.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-11T05:29:50.821 INFO:teuthology.orchestra.run.smithi084.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 476 kB/s | 36 kB 00:00 2024-09-11T05:29:50.846 INFO:teuthology.orchestra.run.smithi084.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-11T05:29:50.897 INFO:teuthology.orchestra.run.smithi084.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 3.0 MB/s | 309 kB 00:00 2024-09-11T05:29:50.922 INFO:teuthology.orchestra.run.smithi084.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-11T05:29:50.947 INFO:teuthology.orchestra.run.smithi084.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 300 kB/s | 26 kB 00:00 2024-09-11T05:29:50.972 INFO:teuthology.orchestra.run.smithi084.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-11T05:29:51.006 INFO:teuthology.orchestra.run.smithi084.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T05:29:51.048 INFO:teuthology.orchestra.run.smithi084.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-11T05:29:51.098 INFO:teuthology.orchestra.run.smithi084.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-11T05:29:51.190 INFO:teuthology.orchestra.run.smithi084.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-11T05:29:51.332 INFO:teuthology.orchestra.run.smithi084.stdout:(31/32): librados2-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 3.4 MB 00:00 2024-09-11T05:29:51.382 INFO:teuthology.orchestra.run.smithi084.stdout:(32/32): librbd1-19.1.1-298.gb53b6d3e.el9.x86_6 11 MB/s | 3.2 MB 00:00 2024-09-11T05:29:51.387 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:29:51.387 INFO:teuthology.orchestra.run.smithi084.stdout:Total 23 MB/s | 60 MB 00:02 2024-09-11T05:29:51.485 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:29:51.521 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:29:51.521 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:29:51.741 INFO:teuthology.orchestra.run.smithi070.stdout:(1/32): ceph-base-19.1.1-298.gb53b6d3e.el9.x86_ 9.9 MB/s | 5.4 MB 00:00 2024-09-11T05:29:51.791 INFO:teuthology.orchestra.run.smithi070.stdout:(2/32): ceph-selinux-19.1.1-298.gb53b6d3e.el9.x 505 kB/s | 25 kB 00:00 2024-09-11T05:29:51.891 INFO:teuthology.orchestra.run.smithi070.stdout:(3/32): libcephfs2-19.1.1-298.gb53b6d3e.el9.x86 7.3 MB/s | 752 kB 00:00 2024-09-11T05:29:52.033 INFO:teuthology.orchestra.run.smithi070.stdout:(4/32): ceph-radosgw-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 11 MB 00:00 2024-09-11T05:29:52.058 INFO:teuthology.orchestra.run.smithi070.stdout:(5/32): libradosstriper1-19.1.1-298.gb53b6d3e.e 3.0 MB/s | 506 kB 00:00 2024-09-11T05:29:52.133 INFO:teuthology.orchestra.run.smithi070.stdout:(6/32): python3-ceph-argparse-19.1.1-298.gb53b6 601 kB/s | 45 kB 00:00 2024-09-11T05:29:52.188 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:29:52.188 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:29:52.217 INFO:teuthology.orchestra.run.smithi070.stdout:(7/32): python3-ceph-common-19.1.1-298.gb53b6d3 1.6 MB/s | 136 kB 00:00 2024-09-11T05:29:52.318 INFO:teuthology.orchestra.run.smithi070.stdout:(8/32): librgw2-19.1.1-298.gb53b6d3e.el9.x86_64 19 MB/s | 5.3 MB 00:00 2024-09-11T05:29:52.343 INFO:teuthology.orchestra.run.smithi070.stdout:(9/32): python3-cephfs-19.1.1-298.gb53b6d3e.el9 1.3 MB/s | 162 kB 00:00 2024-09-11T05:29:52.368 INFO:teuthology.orchestra.run.smithi070.stdout:(10/32): python3-rados-19.1.1-298.gb53b6d3e.el9 6.3 MB/s | 321 kB 00:00 2024-09-11T05:29:52.568 INFO:teuthology.orchestra.run.smithi070.stdout:(11/32): ceph-common-19.1.1-298.gb53b6d3e.el9.x 15 MB/s | 21 MB 00:01 2024-09-11T05:29:52.593 INFO:teuthology.orchestra.run.smithi070.stdout:(12/32): python3-rgw-19.1.1-298.gb53b6d3e.el9.x 442 kB/s | 100 kB 00:00 2024-09-11T05:29:52.627 INFO:teuthology.orchestra.run.smithi070.stdout:(13/32): python3-rbd-19.1.1-298.gb53b6d3e.el9.x 1.0 MB/s | 301 kB 00:00 2024-09-11T05:29:52.786 INFO:teuthology.orchestra.run.smithi070.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 493 kB/s | 107 kB 00:00 2024-09-11T05:29:52.811 INFO:teuthology.orchestra.run.smithi070.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 246 kB/s | 45 kB 00:00 2024-09-11T05:29:52.836 INFO:teuthology.orchestra.run.smithi070.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 661 kB/s | 160 kB 00:00 2024-09-11T05:29:52.895 INFO:teuthology.orchestra.run.smithi070.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 723 kB/s | 42 kB 00:00 2024-09-11T05:29:52.954 INFO:teuthology.orchestra.run.smithi070.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-11T05:29:52.979 INFO:teuthology.orchestra.run.smithi070.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-11T05:29:53.004 INFO:teuthology.orchestra.run.smithi070.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 716 kB/s | 36 kB 00:00 2024-09-11T05:29:53.029 INFO:teuthology.orchestra.run.smithi070.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-11T05:29:53.054 INFO:teuthology.orchestra.run.smithi070.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-11T05:29:53.113 INFO:teuthology.orchestra.run.smithi070.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.8 MB/s | 309 kB 00:00 2024-09-11T05:29:53.139 INFO:teuthology.orchestra.run.smithi070.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-11T05:29:53.164 INFO:teuthology.orchestra.run.smithi070.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 278 kB/s | 26 kB 00:00 2024-09-11T05:29:53.189 INFO:teuthology.orchestra.run.smithi070.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-11T05:29:53.223 INFO:teuthology.orchestra.run.smithi070.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-11T05:29:53.281 INFO:teuthology.orchestra.run.smithi070.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-11T05:29:53.332 INFO:teuthology.orchestra.run.smithi070.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-11T05:29:53.415 INFO:teuthology.orchestra.run.smithi070.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-11T05:29:53.574 INFO:teuthology.orchestra.run.smithi070.stdout:(31/32): librados2-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 3.4 MB 00:00 2024-09-11T05:29:53.624 INFO:teuthology.orchestra.run.smithi070.stdout:(32/32): librbd1-19.1.1-298.gb53b6d3e.el9.x86_6 11 MB/s | 3.2 MB 00:00 2024-09-11T05:29:53.629 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:29:53.629 INFO:teuthology.orchestra.run.smithi070.stdout:Total 21 MB/s | 60 MB 00:02 2024-09-11T05:29:53.667 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:29:53.734 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:29:53.770 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:29:53.770 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:29:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-11T05:29:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-11T05:29:53.837 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-11T05:29:53.860 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-11T05:29:53.883 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-11T05:29:54.079 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-11T05:29:54.131 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-11T05:29:54.472 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:29:54.473 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:29:54.529 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-11T05:29:54.588 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T05:29:54.673 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T05:29:54.762 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/34 2024-09-11T05:29:54.790 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/34 2024-09-11T05:29:54.853 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/34 2024-09-11T05:29:54.890 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-11T05:29:54.934 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x 11/34 2024-09-11T05:29:55.003 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/34 2024-09-11T05:29:55.042 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T05:29:55.106 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T05:29:55.149 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-11T05:29:55.267 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-11T05:29:55.328 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-11T05:29:55.341 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-11T05:29:55.373 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-11T05:29:55.402 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-11T05:29:55.434 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-11T05:29:55.751 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-11T05:29:55.797 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 22/34 2024-09-11T05:29:55.888 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 22/34 2024-09-11T05:29:55.927 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/34 2024-09-11T05:29:55.963 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-11T05:29:55.992 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:29:56.066 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-11T05:29:56.095 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-11T05:29:56.121 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-11T05:29:56.143 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-11T05:29:56.166 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-11T05:29:56.364 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-11T05:29:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-11T05:29:56.452 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-11T05:29:56.483 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/34 2024-09-11T05:29:56.554 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/34 2024-09-11T05:29:56.632 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/34 2024-09-11T05:29:56.660 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86 28/34 2024-09-11T05:29:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-11T05:29:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T05:29:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T05:29:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/34 2024-09-11T05:29:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/34 2024-09-11T05:29:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/34 2024-09-11T05:29:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-11T05:29:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x 11/34 2024-09-11T05:29:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/34 2024-09-11T05:29:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T05:29:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T05:29:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-11T05:29:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-11T05:29:57.628 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-11T05:29:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-11T05:29:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-11T05:29:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-11T05:29:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-11T05:29:58.107 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-11T05:29:58.181 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 22/34 2024-09-11T05:29:58.275 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 22/34 2024-09-11T05:29:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/34 2024-09-11T05:29:58.350 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-11T05:29:58.830 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-11T05:29:58.862 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/34 2024-09-11T05:29:58.933 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/34 2024-09-11T05:29:58.971 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T05:29:59.002 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/34 2024-09-11T05:29:59.014 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T05:29:59.031 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86 28/34 2024-09-11T05:29:59.586 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T05:29:59.626 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 30/34 2024-09-11T05:29:59.720 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 30/34 2024-09-11T05:29:59.720 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T05:29:59.720 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T05:29:59.720 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:29:59.761 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T05:30:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T05:30:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T05:30:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T05:30:01.998 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 30/34 2024-09-11T05:30:02.088 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 30/34 2024-09-11T05:30:02.089 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T05:30:02.089 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T05:30:02.089 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:02.116 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T05:30:09.807 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T05:30:09.807 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2024-09-11T05:30:09.807 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2024-09-11T05:30:09.808 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2024-09-11T05:30:09.808 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2024-09-11T05:30:09.808 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2024-09-11T05:30:09.808 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /root 2024-09-11T05:30:09.808 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2024-09-11T05:30:09.808 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:10.792 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 32/34 2024-09-11T05:30:10.817 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 32/34 2024-09-11T05:30:10.817 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:30:10.818 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T05:30:10.818 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T05:30:10.818 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T05:30:10.818 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:10.819 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-11T05:30:10.902 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-11T05:30:10.903 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T05:30:11.980 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T05:30:11.981 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2024-09-11T05:30:11.981 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2024-09-11T05:30:11.981 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2024-09-11T05:30:11.981 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2024-09-11T05:30:11.981 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2024-09-11T05:30:11.981 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /root 2024-09-11T05:30:11.981 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2024-09-11T05:30:11.981 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:12.064 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T05:30:12.064 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/34 2024-09-11T05:30:12.064 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/34 2024-09-11T05:30:12.064 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/34 2024-09-11T05:30:12.064 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/34 2024-09-11T05:30:12.064 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 5/34 2024-09-11T05:30:12.064 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/34 2024-09-11T05:30:12.064 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T05:30:12.064 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x 8/34 2024-09-11T05:30:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86 9/34 2024-09-11T05:30:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/34 2024-09-11T05:30:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/34 2024-09-11T05:30:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/34 2024-09-11T05:30:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T05:30:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-11T05:30:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-11T05:30:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-11T05:30:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-11T05:30:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-11T05:30:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-11T05:30:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-11T05:30:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-11T05:30:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-11T05:30:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-11T05:30:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-11T05:30:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-11T05:30:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-11T05:30:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-11T05:30:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-11T05:30:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-11T05:30:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-11T05:30:12.067 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T05:30:12.067 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-11T05:30:12.067 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/34 2024-09-11T05:30:12.992 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T05:30:12.992 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:12.993 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-09-11T05:30:12.993 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.993 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.993 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:30:12.993 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T05:30:12.993 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.993 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.993 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.993 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.993 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T05:30:12.994 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T05:30:12.994 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T05:30:12.994 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.994 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T05:30:12.994 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T05:30:12.994 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T05:30:12.994 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.994 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T05:30:12.994 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.994 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T05:30:12.994 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T05:30:12.994 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T05:30:12.995 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.995 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.995 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.995 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T05:30:12.995 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.995 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.995 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:12.995 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T05:30:12.995 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T05:30:12.995 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T05:30:12.995 INFO:teuthology.orchestra.run.smithi084.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T05:30:12.995 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T05:30:12.996 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:12.996 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 32/34 2024-09-11T05:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 32/34 2024-09-11T05:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T05:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T05:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T05:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-11T05:30:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-11T05:30:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T05:30:13.339 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-test 2024-09-11T05:30:13.911 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:27 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:30:14.046 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:30:14.047 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:14.047 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-11T05:30:14.047 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:14.047 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:30:14.047 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T05:30:14.048 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-11T05:30:14.048 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T05:30:14.048 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T05:30:14.048 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T05:30:14.048 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:14.048 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:30:14.048 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:14.048 INFO:teuthology.orchestra.run.smithi084.stdout:Install 4 Packages 2024-09-11T05:30:14.048 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:14.049 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 49 M 2024-09-11T05:30:14.049 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 209 M 2024-09-11T05:30:14.049 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:30:14.197 INFO:teuthology.orchestra.run.smithi084.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.3 MB/s | 304 kB 00:00 2024-09-11T05:30:14.264 INFO:teuthology.orchestra.run.smithi084.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 956 kB/s | 64 kB 00:00 2024-09-11T05:30:14.289 INFO:teuthology.orchestra.run.smithi084.stdout:(3/4): libcephsqlite-19.1.1-298.gb53b6d3e.el9.x 745 kB/s | 163 kB 00:00 2024-09-11T05:30:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T05:30:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/34 2024-09-11T05:30:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/34 2024-09-11T05:30:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/34 2024-09-11T05:30:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/34 2024-09-11T05:30:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 5/34 2024-09-11T05:30:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/34 2024-09-11T05:30:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T05:30:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x 8/34 2024-09-11T05:30:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86 9/34 2024-09-11T05:30:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/34 2024-09-11T05:30:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/34 2024-09-11T05:30:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/34 2024-09-11T05:30:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T05:30:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-11T05:30:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-11T05:30:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-11T05:30:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-11T05:30:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-11T05:30:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-11T05:30:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-11T05:30:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-11T05:30:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-11T05:30:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-11T05:30:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-11T05:30:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-11T05:30:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-11T05:30:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-11T05:30:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-11T05:30:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-11T05:30:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-11T05:30:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T05:30:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-11T05:30:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/34 2024-09-11T05:30:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T05:30:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:15.397 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2024-09-11T05:30:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.397 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:30:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T05:30:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.397 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T05:30:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T05:30:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T05:30:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T05:30:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T05:30:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T05:30:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T05:30:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T05:30:15.398 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T05:30:15.399 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:15.400 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:30:15.656 INFO:teuthology.orchestra.run.smithi084.stdout:(4/4): ceph-test-19.1.1-298.gb53b6d3e.el9.x86_6 31 MB/s | 49 MB 00:01 2024-09-11T05:30:15.659 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:30:15.659 INFO:teuthology.orchestra.run.smithi084.stdout:Total 31 MB/s | 49 MB 00:01 2024-09-11T05:30:15.687 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:30:15.706 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:30:15.706 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:30:15.758 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-test 2024-09-11T05:30:16.087 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:30:16.087 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:30:16.321 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:28 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:30:16.453 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:30:16.453 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:16.453 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T05:30:16.454 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:16.454 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:30:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T05:30:16.454 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T05:30:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T05:30:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T05:30:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T05:30:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:16.454 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:30:16.454 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:16.454 INFO:teuthology.orchestra.run.smithi070.stdout:Install 4 Packages 2024-09-11T05:30:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:16.455 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 49 M 2024-09-11T05:30:16.455 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 209 M 2024-09-11T05:30:16.455 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:30:16.626 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:30:16.709 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-11T05:30:16.747 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-11T05:30:16.775 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/4 2024-09-11T05:30:16.794 INFO:teuthology.orchestra.run.smithi070.stdout:(1/4): libcephsqlite-19.1.1-298.gb53b6d3e.el9.x 750 kB/s | 163 kB 00:00 2024-09-11T05:30:16.828 INFO:teuthology.orchestra.run.smithi070.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-11T05:30:16.944 INFO:teuthology.orchestra.run.smithi070.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 425 kB/s | 64 kB 00:00 2024-09-11T05:30:18.078 INFO:teuthology.orchestra.run.smithi070.stdout:(4/4): ceph-test-19.1.1-298.gb53b6d3e.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-11T05:30:18.080 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:30:18.080 INFO:teuthology.orchestra.run.smithi070.stdout:Total 30 MB/s | 49 MB 00:01 2024-09-11T05:30:18.108 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:30:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:30:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:30:18.515 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:30:18.516 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:30:19.050 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:30:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-11T05:30:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-11T05:30:19.222 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/4 2024-09-11T05:30:21.405 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/4 2024-09-11T05:30:21.481 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/4 2024-09-11T05:30:23.846 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/4 2024-09-11T05:30:23.846 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/4 2024-09-11T05:30:23.846 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/4 2024-09-11T05:30:23.846 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-11T05:30:23.854 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/4 2024-09-11T05:30:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/4 2024-09-11T05:30:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-11T05:30:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:24.145 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:30:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T05:30:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T05:30:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:24.145 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:30:24.476 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph 2024-09-11T05:30:25.075 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:39 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:30:25.222 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:30:25.224 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:25.225 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-11T05:30:25.225 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:25.225 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:30:25.225 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T05:30:25.225 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-11T05:30:25.225 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T05:30:25.225 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T05:30:25.225 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T05:30:25.225 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T05:30:25.225 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T05:30:25.225 INFO:teuthology.orchestra.run.smithi084.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T05:30:25.225 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T05:30:25.225 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T05:30:25.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T05:30:25.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T05:30:25.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T05:30:25.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T05:30:25.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T05:30:25.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T05:30:25.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T05:30:25.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T05:30:25.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T05:30:25.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T05:30:25.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T05:30:25.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T05:30:25.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T05:30:25.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T05:30:25.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T05:30:25.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T05:30:25.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T05:30:25.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T05:30:25.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T05:30:25.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T05:30:25.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T05:30:25.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T05:30:25.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T05:30:25.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T05:30:25.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T05:30:25.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T05:30:25.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T05:30:25.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T05:30:25.228 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:25.228 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:30:25.228 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:25.228 INFO:teuthology.orchestra.run.smithi084.stdout:Install 37 Packages 2024-09-11T05:30:25.228 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:25.229 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 30 M 2024-09-11T05:30:25.229 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 108 M 2024-09-11T05:30:25.229 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:30:25.564 INFO:teuthology.orchestra.run.smithi084.stdout:(1/37): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.rp 55 kB/s | 6.5 kB 00:00 2024-09-11T05:30:25.781 INFO:teuthology.orchestra.run.smithi084.stdout:(2/37): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_6 4.5 MB/s | 1.5 MB 00:00 2024-09-11T05:30:25.823 INFO:teuthology.orchestra.run.smithi084.stdout:(3/37): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_6 6.3 MB/s | 2.4 MB 00:00 2024-09-11T05:30:25.898 INFO:teuthology.orchestra.run.smithi084.stdout:(4/37): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_6 14 MB/s | 4.7 MB 00:00 2024-09-11T05:30:25.932 INFO:teuthology.orchestra.run.smithi084.stdout:(5/37): ceph-mgr-modules-core-19.1.1-298.gb53b6 2.2 MB/s | 249 kB 00:00 2024-09-11T05:30:26.040 INFO:teuthology.orchestra.run.smithi084.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-11T05:30:26.082 INFO:teuthology.orchestra.run.smithi084.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-11T05:30:26.124 INFO:teuthology.orchestra.run.smithi084.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-11T05:30:26.183 INFO:teuthology.orchestra.run.smithi084.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-11T05:30:26.233 INFO:teuthology.orchestra.run.smithi084.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 4.1 MB/s | 1.2 MB 00:00 2024-09-11T05:30:26.258 INFO:teuthology.orchestra.run.smithi084.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-11T05:30:26.415 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/4 2024-09-11T05:30:26.477 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/4 2024-09-11T05:30:26.478 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/4 2024-09-11T05:30:26.478 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-11T05:30:26.478 INFO:teuthology.orchestra.run.smithi084.stdout:(12/37): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86_ 26 MB/s | 17 MB 00:00 2024-09-11T05:30:26.534 INFO:teuthology.orchestra.run.smithi084.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 627 kB/s | 188 kB 00:00 2024-09-11T05:30:26.559 INFO:teuthology.orchestra.run.smithi084.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 261 kB/s | 35 kB 00:00 2024-09-11T05:30:26.593 INFO:teuthology.orchestra.run.smithi084.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.3 MB/s | 77 kB 00:00 2024-09-11T05:30:26.618 INFO:teuthology.orchestra.run.smithi084.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 479 kB/s | 172 kB 00:00 2024-09-11T05:30:26.643 INFO:teuthology.orchestra.run.smithi084.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 607 kB/s | 51 kB 00:00 2024-09-11T05:30:26.668 INFO:teuthology.orchestra.run.smithi084.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-09-11T05:30:26.710 INFO:teuthology.orchestra.run.smithi084.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-11T05:30:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-11T05:30:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:26.723 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:30:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T05:30:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T05:30:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:26.724 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:30:26.735 INFO:teuthology.orchestra.run.smithi084.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 7.2 MB/s | 172 kB 00:00 2024-09-11T05:30:26.760 INFO:teuthology.orchestra.run.smithi084.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 472 kB/s | 43 kB 00:00 2024-09-11T05:30:26.786 INFO:teuthology.orchestra.run.smithi084.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 428 kB/s | 11 kB 00:00 2024-09-11T05:30:26.811 INFO:teuthology.orchestra.run.smithi084.stdout:(23/37): python3-cherrypy-18.6.1-2.el9.noarch.r 4.6 MB/s | 358 kB 00:00 2024-09-11T05:30:26.837 INFO:teuthology.orchestra.run.smithi084.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-11T05:30:26.862 INFO:teuthology.orchestra.run.smithi084.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-11T05:30:26.887 INFO:teuthology.orchestra.run.smithi084.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-11T05:30:26.912 INFO:teuthology.orchestra.run.smithi084.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-11T05:30:26.937 INFO:teuthology.orchestra.run.smithi084.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-11T05:30:26.963 INFO:teuthology.orchestra.run.smithi084.stdout:(29/37): lua-devel-5.4.4-4.el9.x86_64.rpm 65 kB/s | 22 kB 00:00 2024-09-11T05:30:26.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph 2024-09-11T05:30:26.988 INFO:teuthology.orchestra.run.smithi084.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-11T05:30:27.022 INFO:teuthology.orchestra.run.smithi084.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.3 MB/s | 90 kB 00:00 2024-09-11T05:30:27.047 INFO:teuthology.orchestra.run.smithi084.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-11T05:30:27.072 INFO:teuthology.orchestra.run.smithi084.stdout:(33/37): python3-portend-3.1.0-2.el9.noarch.rpm 150 kB/s | 16 kB 00:00 2024-09-11T05:30:27.098 INFO:teuthology.orchestra.run.smithi084.stdout:(34/37): python3-tempora-5.0.0-2.el9.noarch.rpm 484 kB/s | 36 kB 00:00 2024-09-11T05:30:27.131 INFO:teuthology.orchestra.run.smithi084.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 602 kB/s | 20 kB 00:00 2024-09-11T05:30:27.165 INFO:teuthology.orchestra.run.smithi084.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-11T05:30:27.190 INFO:teuthology.orchestra.run.smithi084.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-09-11T05:30:27.194 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:30:27.194 INFO:teuthology.orchestra.run.smithi084.stdout:Total 15 MB/s | 30 MB 00:01 2024-09-11T05:30:27.339 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:30:27.378 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:30:27.379 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:30:27.579 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:39 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:30:27.724 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:30:27.726 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T05:30:27.726 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:27.726 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:30:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T05:30:27.726 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T05:30:27.726 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T05:30:27.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T05:30:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T05:30:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T05:30:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T05:30:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T05:30:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T05:30:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T05:30:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T05:30:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T05:30:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T05:30:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T05:30:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T05:30:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T05:30:27.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T05:30:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T05:30:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T05:30:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T05:30:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T05:30:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T05:30:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T05:30:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T05:30:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T05:30:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:27.729 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:30:27.729 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:27.729 INFO:teuthology.orchestra.run.smithi070.stdout:Install 37 Packages 2024-09-11T05:30:27.729 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:27.730 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 30 M 2024-09-11T05:30:27.730 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 108 M 2024-09-11T05:30:27.730 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:30:27.864 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:30:27.865 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:30:28.271 INFO:teuthology.orchestra.run.smithi070.stdout:(1/37): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.rp 53 kB/s | 6.5 kB 00:00 2024-09-11T05:30:28.463 INFO:teuthology.orchestra.run.smithi070.stdout:(2/37): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_6 4.8 MB/s | 1.5 MB 00:00 2024-09-11T05:30:28.522 INFO:teuthology.orchestra.run.smithi070.stdout:(3/37): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_6 6.4 MB/s | 2.4 MB 00:00 2024-09-11T05:30:28.614 INFO:teuthology.orchestra.run.smithi070.stdout:(4/37): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_6 14 MB/s | 4.7 MB 00:00 2024-09-11T05:30:28.639 INFO:teuthology.orchestra.run.smithi070.stdout:(5/37): ceph-mgr-modules-core-19.1.1-298.gb53b6 2.1 MB/s | 249 kB 00:00 2024-09-11T05:30:29.006 INFO:teuthology.orchestra.run.smithi070.stdout:(6/37): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86_6 31 MB/s | 17 MB 00:00 2024-09-11T05:30:29.215 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:30:29.276 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T05:30:29.309 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T05:30:29.336 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T05:30:29.409 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T05:30:29.444 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T05:30:29.477 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T05:30:29.576 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T05:30:29.648 INFO:teuthology.orchestra.run.smithi070.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 245 kB/s | 253 kB 00:01 2024-09-11T05:30:29.672 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T05:30:29.702 INFO:teuthology.orchestra.run.smithi070.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 157 kB/s | 106 kB 00:00 2024-09-11T05:30:29.716 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T05:30:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T05:30:29.790 INFO:teuthology.orchestra.run.smithi070.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 1.1 MB/s | 1.2 MB 00:01 2024-09-11T05:30:29.805 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T05:30:29.840 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T05:30:29.873 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T05:30:29.914 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T05:30:29.957 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T05:30:30.000 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T05:30:30.048 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T05:30:30.080 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T05:30:30.153 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T05:30:30.291 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T05:30:30.380 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T05:30:30.399 INFO:teuthology.orchestra.run.smithi070.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 180 kB/s | 135 kB 00:00 2024-09-11T05:30:30.424 INFO:teuthology.orchestra.run.smithi070.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 172 kB/s | 125 kB 00:00 2024-09-11T05:30:30.432 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T05:30:30.480 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T05:30:30.537 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T05:30:30.540 INFO:teuthology.orchestra.run.smithi070.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 286 kB/s | 215 kB 00:00 2024-09-11T05:30:30.574 INFO:teuthology.orchestra.run.smithi070.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-11T05:30:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T05:30:30.600 INFO:teuthology.orchestra.run.smithi070.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 946 kB/s | 188 kB 00:00 2024-09-11T05:30:30.625 INFO:teuthology.orchestra.run.smithi070.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-11T05:30:30.650 INFO:teuthology.orchestra.run.smithi070.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-11T05:30:30.675 INFO:teuthology.orchestra.run.smithi070.stdout:(17/37): python3-markupsafe-1.1.1-12.el9.x86_64 259 kB/s | 35 kB 00:00 2024-09-11T05:30:30.701 INFO:teuthology.orchestra.run.smithi070.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 551 kB/s | 42 kB 00:00 2024-09-11T05:30:30.743 INFO:teuthology.orchestra.run.smithi070.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-11T05:30:30.768 INFO:teuthology.orchestra.run.smithi070.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 648 kB/s | 43 kB 00:00 2024-09-11T05:30:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T05:30:30.793 INFO:teuthology.orchestra.run.smithi070.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 156 kB/s | 22 kB 00:00 2024-09-11T05:30:30.819 INFO:teuthology.orchestra.run.smithi070.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.3 MB/s | 172 kB 00:00 2024-09-11T05:30:30.833 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T05:30:30.852 INFO:teuthology.orchestra.run.smithi070.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 685 kB/s | 18 kB 00:00 2024-09-11T05:30:30.877 INFO:teuthology.orchestra.run.smithi070.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 128 kB/s | 11 kB 00:00 2024-09-11T05:30:30.903 INFO:teuthology.orchestra.run.smithi070.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 480 kB/s | 23 kB 00:00 2024-09-11T05:30:30.919 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T05:30:30.928 INFO:teuthology.orchestra.run.smithi070.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-11T05:30:30.953 INFO:teuthology.orchestra.run.smithi070.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-11T05:30:30.979 INFO:teuthology.orchestra.run.smithi070.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-11T05:30:31.004 INFO:teuthology.orchestra.run.smithi070.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-11T05:30:31.009 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T05:30:31.029 INFO:teuthology.orchestra.run.smithi070.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-11T05:30:31.049 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T05:30:31.054 INFO:teuthology.orchestra.run.smithi070.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-11T05:30:31.080 INFO:teuthology.orchestra.run.smithi070.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-11T05:30:31.105 INFO:teuthology.orchestra.run.smithi070.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-11T05:30:31.130 INFO:teuthology.orchestra.run.smithi070.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-11T05:30:31.147 INFO:teuthology.orchestra.run.smithi070.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-11T05:30:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T05:30:31.172 INFO:teuthology.orchestra.run.smithi070.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-11T05:30:31.198 INFO:teuthology.orchestra.run.smithi070.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2024-09-11T05:30:31.203 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:30:31.203 INFO:teuthology.orchestra.run.smithi070.stdout:Total 8.7 MB/s | 30 MB 00:03 2024-09-11T05:30:31.330 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.n 32/37 2024-09-11T05:30:31.353 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:30:31.367 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/37 2024-09-11T05:30:31.393 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/37 2024-09-11T05:30:31.393 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:30:31.393 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T05:30:31.393 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T05:30:31.393 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T05:30:31.393 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:31.394 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:30:31.394 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:30:31.874 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:30:31.874 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:30:32.851 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 34/37 2024-09-11T05:30:32.878 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 34/37 2024-09-11T05:30:32.878 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:30:32.878 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T05:30:32.879 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T05:30:32.879 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T05:30:32.879 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:30:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T05:30:33.339 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 35/37 2024-09-11T05:30:33.363 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 35/37 2024-09-11T05:30:33.363 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:30:33.363 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T05:30:33.363 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T05:30:33.364 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T05:30:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:33.375 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T05:30:33.412 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T05:30:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T05:30:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T05:30:33.563 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T05:30:33.594 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/37 2024-09-11T05:30:33.617 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/37 2024-09-11T05:30:33.617 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:30:33.618 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T05:30:33.618 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T05:30:33.618 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T05:30:33.618 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:33.664 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T05:30:33.691 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 37/37 2024-09-11T05:30:33.750 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T05:30:33.792 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T05:30:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T05:30:33.857 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T05:30:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T05:30:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T05:30:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T05:30:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T05:30:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T05:30:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T05:30:34.132 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T05:30:34.204 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T05:30:34.342 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T05:30:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T05:30:34.485 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T05:30:34.532 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T05:30:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T05:30:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T05:30:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T05:30:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T05:30:34.980 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T05:30:35.068 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T05:30:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T05:30:35.229 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T05:30:35.393 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.n 32/37 2024-09-11T05:30:35.423 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/37 2024-09-11T05:30:35.449 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/37 2024-09-11T05:30:35.450 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:30:35.450 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T05:30:35.450 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T05:30:35.450 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T05:30:35.450 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:35.548 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 37/37 2024-09-11T05:30:35.548 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/37 2024-09-11T05:30:35.548 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/37 2024-09-11T05:30:35.548 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/37 2024-09-11T05:30:35.548 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/37 2024-09-11T05:30:35.548 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 5/37 2024-09-11T05:30:35.548 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.n 6/37 2024-09-11T05:30:35.548 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T05:30:35.548 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T05:30:35.548 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T05:30:35.548 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T05:30:35.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T05:30:35.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T05:30:35.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T05:30:35.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T05:30:35.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T05:30:35.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T05:30:35.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T05:30:35.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T05:30:35.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T05:30:35.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T05:30:35.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T05:30:35.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T05:30:35.549 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T05:30:35.550 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T05:30:35.550 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T05:30:35.550 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T05:30:35.550 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T05:30:35.550 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T05:30:35.551 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T05:30:35.551 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T05:30:35.551 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T05:30:35.551 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T05:30:35.551 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T05:30:35.551 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T05:30:35.551 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T05:30:35.552 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T05:30:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T05:30:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:30:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:30:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T05:30:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T05:30:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T05:30:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T05:30:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T05:30:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T05:30:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T05:30:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T05:30:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T05:30:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T05:30:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T05:30:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T05:30:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T05:30:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T05:30:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T05:30:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T05:30:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T05:30:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T05:30:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T05:30:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T05:30:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T05:30:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T05:30:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T05:30:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T05:30:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T05:30:36.710 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T05:30:36.710 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T05:30:36.710 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T05:30:36.710 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T05:30:36.710 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T05:30:36.710 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T05:30:36.710 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:30:36.907 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 34/37 2024-09-11T05:30:36.935 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 34/37 2024-09-11T05:30:36.935 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:30:36.935 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T05:30:36.935 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T05:30:36.935 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T05:30:36.935 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:37.127 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-base 2024-09-11T05:30:37.375 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 35/37 2024-09-11T05:30:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 35/37 2024-09-11T05:30:37.399 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:30:37.399 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T05:30:37.399 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T05:30:37.400 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T05:30:37.400 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/37 2024-09-11T05:30:37.649 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/37 2024-09-11T05:30:37.650 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:30:37.650 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T05:30:37.650 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T05:30:37.650 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T05:30:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:37.689 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:51 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:30:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 37/37 2024-09-11T05:30:37.778 INFO:teuthology.orchestra.run.smithi084.stdout:Package ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:30:37.820 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:30:37.821 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-09-11T05:30:37.821 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:30:37.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install cephadm 2024-09-11T05:30:38.450 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:52 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:30:38.582 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:30:38.582 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:38.583 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-11T05:30:38.583 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:38.583 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:30:38.583 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T05:30:38.583 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:38.583 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:30:38.583 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:38.583 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-09-11T05:30:38.583 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:38.583 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 765 k 2024-09-11T05:30:38.584 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 771 k 2024-09-11T05:30:38.584 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:30:38.851 INFO:teuthology.orchestra.run.smithi084.stdout:cephadm-19.1.1-298.gb53b6d3e.el9.noarch.rpm 2.8 MB/s | 765 kB 00:00 2024-09-11T05:30:38.852 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:30:38.852 INFO:teuthology.orchestra.run.smithi084.stdout:Total 2.8 MB/s | 765 kB 00:00 2024-09-11T05:30:38.852 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:30:38.857 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:30:38.858 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:30:38.863 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:30:38.864 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:30:38.935 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:30:39.341 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:30:39.421 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:30:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 37/37 2024-09-11T05:30:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/37 2024-09-11T05:30:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/37 2024-09-11T05:30:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/37 2024-09-11T05:30:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/37 2024-09-11T05:30:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 5/37 2024-09-11T05:30:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.n 6/37 2024-09-11T05:30:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T05:30:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T05:30:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T05:30:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T05:30:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T05:30:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T05:30:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T05:30:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T05:30:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T05:30:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T05:30:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T05:30:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T05:30:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T05:30:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T05:30:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T05:30:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T05:30:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T05:30:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T05:30:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T05:30:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T05:30:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T05:30:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T05:30:39.584 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T05:30:39.584 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T05:30:39.584 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T05:30:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T05:30:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T05:30:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T05:30:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T05:30:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T05:30:39.841 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:30:40.076 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:30:40.076 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:40.076 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:30:40.076 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:30:40.076 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:40.076 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:30:40.283 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T05:30:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T05:30:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:40.729 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:30:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:30:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T05:30:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T05:30:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T05:30:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T05:30:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T05:30:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T05:30:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T05:30:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T05:30:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T05:30:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T05:30:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T05:30:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T05:30:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T05:30:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T05:30:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T05:30:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T05:30:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T05:30:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T05:30:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:40.733 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:30:40.848 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:54 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:30:40.980 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:30:40.981 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:40.981 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2024-09-11T05:30:40.981 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:40.981 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:30:40.981 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T05:30:40.982 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:40.982 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:30:40.982 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:40.982 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-09-11T05:30:40.982 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:40.982 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 145 k 2024-09-11T05:30:40.982 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 435 k 2024-09-11T05:30:40.983 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:30:41.107 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-base 2024-09-11T05:30:41.198 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-immutable-object-cache-19.1.1-298.gb53b6d3 675 kB/s | 145 kB 00:00 2024-09-11T05:30:41.198 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:30:41.199 INFO:teuthology.orchestra.run.smithi084.stdout:Total 669 kB/s | 145 kB 00:00 2024-09-11T05:30:41.199 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:30:41.206 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:30:41.206 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:30:41.263 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:30:41.263 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:30:41.426 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:30:41.507 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T05:30:41.532 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T05:30:41.532 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:30:41.532 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T05:30:41.532 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:41.674 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:53 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:30:41.764 INFO:teuthology.orchestra.run.smithi070.stdout:Package ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:30:41.807 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:30:41.808 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T05:30:41.808 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:30:41.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install cephadm 2024-09-11T05:30:42.443 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:54 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:30:42.465 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T05:30:42.465 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:42.465 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:30:42.465 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:42.465 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:42.465 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:30:42.575 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:30:42.576 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T05:30:42.576 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:42.576 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:30:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T05:30:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:42.576 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:30:42.576 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:42.576 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T05:30:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:42.577 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 765 k 2024-09-11T05:30:42.577 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 771 k 2024-09-11T05:30:42.577 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:30:42.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr 2024-09-11T05:30:42.833 INFO:teuthology.orchestra.run.smithi070.stdout:cephadm-19.1.1-298.gb53b6d3e.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-11T05:30:42.834 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:30:42.834 INFO:teuthology.orchestra.run.smithi070.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-11T05:30:42.834 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:30:42.839 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:30:42.839 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:30:42.845 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:30:42.845 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:30:42.913 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:30:43.279 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:57 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:30:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:30:43.372 INFO:teuthology.orchestra.run.smithi084.stdout:Package ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:30:43.414 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:30:43.415 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-09-11T05:30:43.415 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:30:43.458 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:30:43.483 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T05:30:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:30:44.038 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:58 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:30:44.096 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:30:44.096 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:44.097 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:30:44.097 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:30:44.097 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:44.097 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:30:44.171 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:30:44.172 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:44.173 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-11T05:30:44.173 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:44.173 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:30:44.173 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T05:30:44.173 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-11T05:30:44.173 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T05:30:44.173 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T05:30:44.173 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T05:30:44.173 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T05:30:44.173 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T05:30:44.174 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T05:30:44.174 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T05:30:44.174 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T05:30:44.174 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T05:30:44.174 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T05:30:44.174 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T05:30:44.174 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:44.174 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:30:44.174 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:30:44.174 INFO:teuthology.orchestra.run.smithi084.stdout:Install 12 Packages 2024-09-11T05:30:44.175 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:44.175 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 8.7 M 2024-09-11T05:30:44.175 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 104 M 2024-09-11T05:30:44.175 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:30:44.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T05:30:44.874 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:56 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:30:44.975 INFO:teuthology.orchestra.run.smithi084.stdout:(1/12): ceph-grafana-dashboards-19.1.1-298.gb53 241 kB/s | 32 kB 00:00 2024-09-11T05:30:45.001 INFO:teuthology.orchestra.run.smithi084.stdout:(2/12): ceph-prometheus-alerts-19.1.1-298.gb53b 105 kB/s | 16 kB 00:00 2024-09-11T05:30:45.007 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:30:45.008 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:45.008 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repo Size 2024-09-11T05:30:45.008 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:45.008 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:30:45.008 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T05:30:45.008 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:45.008 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:30:45.008 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:45.008 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T05:30:45.009 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:45.009 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 145 k 2024-09-11T05:30:45.009 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 435 k 2024-09-11T05:30:45.009 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:30:45.209 INFO:teuthology.orchestra.run.smithi084.stdout:(3/12): ceph-mgr-dashboard-19.1.1-298.gb53b6d3e 9.7 MB/s | 3.6 MB 00:00 2024-09-11T05:30:45.214 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-immutable-object-cache-19.1.1-298.gb53b6d3 707 kB/s | 145 kB 00:00 2024-09-11T05:30:45.215 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:30:45.215 INFO:teuthology.orchestra.run.smithi070.stdout:Total 702 kB/s | 145 kB 00:00 2024-09-11T05:30:45.215 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:30:45.223 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:30:45.223 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:30:45.234 INFO:teuthology.orchestra.run.smithi084.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-11T05:30:45.280 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:30:45.280 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:30:45.301 INFO:teuthology.orchestra.run.smithi084.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 8.0 MB/s | 548 kB 00:00 2024-09-11T05:30:45.335 INFO:teuthology.orchestra.run.smithi084.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 582 kB/s | 19 kB 00:00 2024-09-11T05:30:45.377 INFO:teuthology.orchestra.run.smithi084.stdout:(7/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.5 MB/s | 1.0 MB 00:00 2024-09-11T05:30:45.442 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:30:45.452 INFO:teuthology.orchestra.run.smithi084.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 17 MB/s | 2.0 MB 00:00 2024-09-11T05:30:45.477 INFO:teuthology.orchestra.run.smithi084.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.4 MB/s | 144 kB 00:00 2024-09-11T05:30:45.503 INFO:teuthology.orchestra.run.smithi084.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 613 kB/s | 31 kB 00:00 2024-09-11T05:30:45.515 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T05:30:45.536 INFO:teuthology.orchestra.run.smithi084.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-11T05:30:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T05:30:45.540 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:30:45.540 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T05:30:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:45.594 INFO:teuthology.orchestra.run.smithi084.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.2 MB/s | 863 kB 00:00 2024-09-11T05:30:45.598 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:30:45.598 INFO:teuthology.orchestra.run.smithi084.stdout:Total 6.1 MB/s | 8.7 MB 00:01 2024-09-11T05:30:45.648 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:30:45.665 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:30:45.665 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:30:45.874 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:30:45.874 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:30:46.410 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:30:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T05:30:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:46.475 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:30:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:30:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:46.475 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:30:46.495 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-11T05:30:46.530 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-11T05:30:46.577 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-11T05:30:46.616 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-11T05:30:46.702 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr 2024-09-11T05:30:46.716 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-11T05:30:46.841 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-11T05:30:46.944 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-11T05:30:46.995 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-11T05:30:47.032 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-11T05:30:47.063 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9. 10/12 2024-09-11T05:30:47.277 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:59 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:30:47.369 INFO:teuthology.orchestra.run.smithi070.stdout:Package ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:30:47.412 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:30:47.413 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T05:30:47.413 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:30:47.478 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T05:30:48.043 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:00 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:30:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9 11/12 2024-09-11T05:30:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 12/12 2024-09-11T05:30:48.176 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:30:48.177 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:48.177 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T05:30:48.177 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:48.177 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:30:48.177 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T05:30:48.177 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T05:30:48.177 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T05:30:48.178 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T05:30:48.178 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T05:30:48.178 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T05:30:48.178 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T05:30:48.178 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T05:30:48.178 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T05:30:48.178 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T05:30:48.178 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T05:30:48.178 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T05:30:48.178 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T05:30:48.178 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:48.178 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:30:48.179 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:30:48.179 INFO:teuthology.orchestra.run.smithi070.stdout:Install 12 Packages 2024-09-11T05:30:48.179 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:48.179 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 8.7 M 2024-09-11T05:30:48.179 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 104 M 2024-09-11T05:30:48.180 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:30:48.928 INFO:teuthology.orchestra.run.smithi070.stdout:(1/12): ceph-prometheus-alerts-19.1.1-298.gb53b 103 kB/s | 16 kB 00:00 2024-09-11T05:30:48.945 INFO:teuthology.orchestra.run.smithi070.stdout:(2/12): ceph-grafana-dashboards-19.1.1-298.gb53 179 kB/s | 32 kB 00:00 2024-09-11T05:30:49.162 INFO:teuthology.orchestra.run.smithi070.stdout:(3/12): ceph-mgr-dashboard-19.1.1-298.gb53b6d3e 9.0 MB/s | 3.6 MB 00:00 2024-09-11T05:30:49.196 INFO:teuthology.orchestra.run.smithi070.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-11T05:30:49.245 INFO:teuthology.orchestra.run.smithi070.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-11T05:30:49.288 INFO:teuthology.orchestra.run.smithi070.stdout:(6/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.8 MB/s | 1.0 MB 00:00 2024-09-11T05:30:49.313 INFO:teuthology.orchestra.run.smithi070.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 290 kB/s | 19 kB 00:00 2024-09-11T05:30:49.346 INFO:teuthology.orchestra.run.smithi070.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.5 MB/s | 144 kB 00:00 2024-09-11T05:30:49.372 INFO:teuthology.orchestra.run.smithi070.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.3 MB/s | 31 kB 00:00 2024-09-11T05:30:49.414 INFO:teuthology.orchestra.run.smithi070.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-11T05:30:49.447 INFO:teuthology.orchestra.run.smithi070.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 3.0 MB/s | 863 kB 00:00 2024-09-11T05:30:49.509 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 12/12 2024-09-11T05:30:49.509 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9 1/12 2024-09-11T05:30:49.509 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 2/12 2024-09-11T05:30:49.509 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9. 3/12 2024-09-11T05:30:49.509 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-11T05:30:49.509 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-11T05:30:49.509 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-11T05:30:49.509 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-11T05:30:49.509 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-11T05:30:49.509 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-11T05:30:49.510 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-11T05:30:49.510 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-11T05:30:49.531 INFO:teuthology.orchestra.run.smithi070.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 8.4 MB/s | 2.0 MB 00:00 2024-09-11T05:30:49.535 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:30:49.535 INFO:teuthology.orchestra.run.smithi070.stdout:Total 6.4 MB/s | 8.7 MB 00:01 2024-09-11T05:30:49.585 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:30:49.604 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:30:49.604 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:30:49.801 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:30:49.801 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:30:49.824 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-11T05:30:49.824 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:49.824 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:30:49.824 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T05:30:49.824 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:30:49.825 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:30:49.825 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:30:49.825 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T05:30:49.825 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T05:30:49.825 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T05:30:49.825 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T05:30:49.825 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T05:30:49.825 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T05:30:49.825 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T05:30:49.825 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T05:30:49.825 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:49.825 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:30:50.070 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T05:30:50.346 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:30:50.431 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-11T05:30:50.475 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-11T05:30:50.529 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-11T05:30:50.560 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-11T05:30:50.629 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:04 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:30:50.648 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-11T05:30:50.761 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:30:50.762 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================== 2024-09-11T05:30:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-11T05:30:50.763 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================== 2024-09-11T05:30:50.763 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:30:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T05:30:50.763 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-11T05:30:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T05:30:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T05:30:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T05:30:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T05:30:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T05:30:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T05:30:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T05:30:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T05:30:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T05:30:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T05:30:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T05:30:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:50.764 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:30:50.764 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================== 2024-09-11T05:30:50.764 INFO:teuthology.orchestra.run.smithi084.stdout:Install 12 Packages 2024-09-11T05:30:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:30:50.765 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 38 M 2024-09-11T05:30:50.765 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 212 M 2024-09-11T05:30:50.765 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:30:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-11T05:30:50.879 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-11T05:30:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-11T05:30:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-11T05:30:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9. 10/12 2024-09-11T05:30:51.618 INFO:teuthology.orchestra.run.smithi084.stdout:(1/12): ceph-mgr-diskprediction-local-19.1.1-29 16 MB/s | 7.4 MB 00:00 2024-09-11T05:30:51.735 INFO:teuthology.orchestra.run.smithi084.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 281 kB/s | 33 kB 00:00 2024-09-11T05:30:51.985 INFO:teuthology.orchestra.run.smithi084.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 233 kB/s | 191 kB 00:00 2024-09-11T05:30:52.044 INFO:teuthology.orchestra.run.smithi084.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.7 MB/s | 3.0 MB 00:00 2024-09-11T05:30:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9 11/12 2024-09-11T05:30:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 12/12 2024-09-11T05:30:52.102 INFO:teuthology.orchestra.run.smithi084.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 662 kB/s | 38 kB 00:00 2024-09-11T05:30:52.127 INFO:teuthology.orchestra.run.smithi084.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 128 kB/s | 18 kB 00:00 2024-09-11T05:30:52.161 INFO:teuthology.orchestra.run.smithi084.stdout:(7/12): libgfortran-11.5.0-2.el9.x86_64.rpm 803 kB/s | 801 kB 00:00 2024-09-11T05:30:52.278 INFO:teuthology.orchestra.run.smithi084.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-11T05:30:52.336 INFO:teuthology.orchestra.run.smithi084.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-09-11T05:30:52.437 INFO:teuthology.orchestra.run.smithi084.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 15 MB/s | 4.9 MB 00:00 2024-09-11T05:30:52.695 INFO:teuthology.orchestra.run.smithi084.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.6 MB/s | 5.1 MB 00:00 2024-09-11T05:30:53.129 INFO:teuthology.orchestra.run.smithi084.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-11T05:30:53.130 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:30:53.130 INFO:teuthology.orchestra.run.smithi084.stdout:Total 16 MB/s | 38 MB 00:02 2024-09-11T05:30:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 12/12 2024-09-11T05:30:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9 1/12 2024-09-11T05:30:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 2/12 2024-09-11T05:30:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9. 3/12 2024-09-11T05:30:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-11T05:30:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-11T05:30:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-11T05:30:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-11T05:30:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-11T05:30:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-11T05:30:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-11T05:30:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-11T05:30:53.484 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:30:53.510 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:30:53.510 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:30:53.717 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-11T05:30:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:53.718 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:30:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T05:30:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:30:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:30:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:30:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T05:30:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T05:30:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T05:30:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T05:30:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T05:30:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T05:30:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T05:30:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T05:30:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:53.719 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:30:53.934 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:30:53.934 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:30:54.011 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T05:30:54.568 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:06 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:30:54.693 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:30:54.701 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:30:54.702 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-11T05:30:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T05:30:54.703 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-11T05:30:54.703 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:30:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T05:30:54.703 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T05:30:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T05:30:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T05:30:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T05:30:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T05:30:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T05:30:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T05:30:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T05:30:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T05:30:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T05:30:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T05:30:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T05:30:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:54.704 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:30:54.704 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-11T05:30:54.704 INFO:teuthology.orchestra.run.smithi070.stdout:Install 12 Packages 2024-09-11T05:30:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:30:54.704 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 38 M 2024-09-11T05:30:54.705 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 212 M 2024-09-11T05:30:54.705 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:30:54.768 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T05:30:54.810 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T05:30:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T05:30:54.953 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T05:30:55.137 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T05:30:55.160 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T05:30:55.244 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T05:30:55.481 INFO:teuthology.orchestra.run.smithi070.stdout:(1/12): ceph-mgr-diskprediction-local-19.1.1-29 16 MB/s | 7.4 MB 00:00 2024-09-11T05:30:55.589 INFO:teuthology.orchestra.run.smithi070.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 303 kB/s | 33 kB 00:00 2024-09-11T05:30:55.848 INFO:teuthology.orchestra.run.smithi070.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 233 kB/s | 191 kB 00:00 2024-09-11T05:30:55.930 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T05:30:55.931 INFO:teuthology.orchestra.run.smithi070.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 219 kB/s | 18 kB 00:00 2024-09-11T05:30:55.999 INFO:teuthology.orchestra.run.smithi070.stdout:(5/12): libgfortran-11.5.0-2.el9.x86_64.rpm 825 kB/s | 801 kB 00:00 2024-09-11T05:30:56.024 INFO:teuthology.orchestra.run.smithi070.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 419 kB/s | 38 kB 00:00 2024-09-11T05:30:56.049 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T05:30:56.216 INFO:teuthology.orchestra.run.smithi070.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-11T05:30:56.384 INFO:teuthology.orchestra.run.smithi070.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.8 MB/s | 3.0 MB 00:00 2024-09-11T05:30:56.483 INFO:teuthology.orchestra.run.smithi070.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 250 kB 00:00 2024-09-11T05:30:57.075 INFO:teuthology.orchestra.run.smithi070.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.6 MB/s | 4.9 MB 00:01 2024-09-11T05:30:57.304 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T05:30:57.417 INFO:teuthology.orchestra.run.smithi070.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-09-11T05:30:58.336 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T05:30:58.366 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 12/12 2024-09-11T05:30:58.950 INFO:teuthology.orchestra.run.smithi070.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.6 MB/s | 16 MB 00:02 2024-09-11T05:30:58.951 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:30:58.951 INFO:teuthology.orchestra.run.smithi070.stdout:Total 9.0 MB/s | 38 MB 00:04 2024-09-11T05:30:59.310 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:30:59.337 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:30:59.337 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:30:59.764 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:30:59.764 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:31:00.552 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:31:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T05:31:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T05:31:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T05:31:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T05:31:00.875 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 12/12 2024-09-11T05:31:00.875 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 1/12 2024-09-11T05:31:00.875 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T05:31:00.875 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T05:31:00.875 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T05:31:00.875 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T05:31:00.875 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T05:31:00.875 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T05:31:00.875 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T05:31:00.875 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T05:31:00.876 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T05:31:00.876 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T05:31:01.017 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T05:31:01.049 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T05:31:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T05:31:01.291 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T05:31:01.291 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:01.291 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:31:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:31:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T05:31:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T05:31:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T05:31:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T05:31:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T05:31:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T05:31:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T05:31:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T05:31:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T05:31:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T05:31:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T05:31:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:01.293 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:01.660 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-rook 2024-09-11T05:31:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T05:31:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T05:31:02.232 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:16 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:02.365 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-11T05:31:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:31:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T05:31:02.366 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-11T05:31:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T05:31:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T05:31:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T05:31:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T05:31:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T05:31:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T05:31:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T05:31:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T05:31:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T05:31:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T05:31:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T05:31:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T05:31:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:02.368 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:31:02.368 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:02.368 INFO:teuthology.orchestra.run.smithi084.stdout:Install 13 Packages 2024-09-11T05:31:02.368 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:02.368 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 2.2 M 2024-09-11T05:31:02.368 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 26 M 2024-09-11T05:31:02.369 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:31:02.667 INFO:teuthology.orchestra.run.smithi084.stdout:(1/13): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el9. 312 kB/s | 49 kB 00:00 2024-09-11T05:31:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 38 kB/s | 19 kB 00:00 2024-09-11T05:31:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 47 kB/s | 26 kB 00:00 2024-09-11T05:31:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T05:31:03.492 INFO:teuthology.orchestra.run.smithi084.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 269 kB/s | 222 kB 00:00 2024-09-11T05:31:03.734 INFO:teuthology.orchestra.run.smithi084.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 221 kB/s | 159 kB 00:00 2024-09-11T05:31:03.784 INFO:teuthology.orchestra.run.smithi084.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 764 kB/s | 32 kB 00:00 2024-09-11T05:31:03.810 INFO:teuthology.orchestra.run.smithi084.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 562 kB/s | 14 kB 00:00 2024-09-11T05:31:03.843 INFO:teuthology.orchestra.run.smithi084.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 356 kB/s | 279 kB 00:00 2024-09-11T05:31:03.877 INFO:teuthology.orchestra.run.smithi084.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 3.2 MB/s | 220 kB 00:00 2024-09-11T05:31:03.902 INFO:teuthology.orchestra.run.smithi084.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-11T05:31:03.927 INFO:teuthology.orchestra.run.smithi084.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-11T05:31:03.969 INFO:teuthology.orchestra.run.smithi084.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 8.2 MB/s | 1.0 MB 00:00 2024-09-11T05:31:04.169 INFO:teuthology.orchestra.run.smithi084.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 79 kB/s | 54 kB 00:00 2024-09-11T05:31:04.173 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:04.173 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.2 MB/s | 2.2 MB 00:01 2024-09-11T05:31:04.189 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T05:31:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 12/12 2024-09-11T05:31:04.240 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:31:04.255 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:31:04.255 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:31:04.347 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:31:04.347 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:31:04.853 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:31:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T05:31:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T05:31:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T05:31:05.197 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T05:31:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T05:31:05.356 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T05:31:05.466 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T05:31:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T05:31:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T05:31:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T05:31:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T05:31:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T05:31:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 13/13 2024-09-11T05:31:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 12/12 2024-09-11T05:31:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 1/12 2024-09-11T05:31:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T05:31:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T05:31:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T05:31:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T05:31:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T05:31:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T05:31:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T05:31:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T05:31:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T05:31:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T05:31:07.092 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 13/13 2024-09-11T05:31:07.093 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 1/13 2024-09-11T05:31:07.093 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T05:31:07.093 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T05:31:07.093 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T05:31:07.093 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T05:31:07.093 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T05:31:07.093 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T05:31:07.093 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T05:31:07.093 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T05:31:07.093 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T05:31:07.093 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T05:31:07.094 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T05:31:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T05:31:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:07.327 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:31:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:31:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T05:31:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T05:31:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T05:31:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T05:31:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T05:31:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T05:31:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T05:31:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T05:31:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T05:31:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T05:31:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T05:31:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:07.328 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:07.439 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T05:31:07.439 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:07.439 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:31:07.439 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:31:07.439 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T05:31:07.439 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T05:31:07.439 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T05:31:07.439 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T05:31:07.439 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T05:31:07.439 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T05:31:07.440 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T05:31:07.440 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T05:31:07.440 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T05:31:07.440 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T05:31:07.440 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T05:31:07.440 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T05:31:07.440 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:07.440 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:07.716 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T05:31:07.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr-rook 2024-09-11T05:31:08.281 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:22 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:08.305 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:20 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:08.414 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:08.415 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:08.415 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-11T05:31:08.415 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:08.415 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:31:08.415 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T05:31:08.415 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-11T05:31:08.415 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T05:31:08.416 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T05:31:08.416 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T05:31:08.416 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T05:31:08.416 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T05:31:08.416 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:08.416 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:31:08.416 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:08.416 INFO:teuthology.orchestra.run.smithi084.stdout:Install 6 Packages 2024-09-11T05:31:08.417 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:08.417 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 7.0 M 2024-09-11T05:31:08.417 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 33 M 2024-09-11T05:31:08.417 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:31:08.438 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:08.440 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:08.440 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T05:31:08.440 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:08.440 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:31:08.440 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T05:31:08.440 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T05:31:08.440 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T05:31:08.441 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T05:31:08.441 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T05:31:08.441 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T05:31:08.441 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T05:31:08.441 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T05:31:08.441 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T05:31:08.441 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T05:31:08.441 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T05:31:08.441 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T05:31:08.441 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T05:31:08.441 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T05:31:08.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:08.442 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:31:08.442 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:08.442 INFO:teuthology.orchestra.run.smithi070.stdout:Install 13 Packages 2024-09-11T05:31:08.442 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:08.442 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 2.2 M 2024-09-11T05:31:08.442 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 26 M 2024-09-11T05:31:08.442 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:31:08.813 INFO:teuthology.orchestra.run.smithi084.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-11T05:31:08.838 INFO:teuthology.orchestra.run.smithi084.stdout:(2/6): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e.el 664 kB/s | 146 kB 00:00 2024-09-11T05:31:08.841 INFO:teuthology.orchestra.run.smithi070.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 211 kB/s | 26 kB 00:00 2024-09-11T05:31:08.866 INFO:teuthology.orchestra.run.smithi070.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 131 kB/s | 19 kB 00:00 2024-09-11T05:31:08.888 INFO:teuthology.orchestra.run.smithi084.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-11T05:31:08.891 INFO:teuthology.orchestra.run.smithi070.stdout:(3/13): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el9. 287 kB/s | 49 kB 00:00 2024-09-11T05:31:08.938 INFO:teuthology.orchestra.run.smithi084.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-11T05:31:08.964 INFO:teuthology.orchestra.run.smithi084.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.6 MB/s | 548 kB 00:00 2024-09-11T05:31:09.001 INFO:teuthology.orchestra.run.smithi070.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-11T05:31:09.026 INFO:teuthology.orchestra.run.smithi070.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-11T05:31:09.060 INFO:teuthology.orchestra.run.smithi070.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 913 kB/s | 54 kB 00:00 2024-09-11T05:31:09.064 INFO:teuthology.orchestra.run.smithi084.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-11T05:31:09.066 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:09.067 INFO:teuthology.orchestra.run.smithi084.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-11T05:31:09.093 INFO:teuthology.orchestra.run.smithi070.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-11T05:31:09.135 INFO:teuthology.orchestra.run.smithi070.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-09-11T05:31:09.138 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:31:09.150 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:31:09.150 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:31:09.160 INFO:teuthology.orchestra.run.smithi070.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 143 kB/s | 14 kB 00:00 2024-09-11T05:31:09.194 INFO:teuthology.orchestra.run.smithi070.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2024-09-11T05:31:09.227 INFO:teuthology.orchestra.run.smithi070.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.6 MB/s | 220 kB 00:00 2024-09-11T05:31:09.251 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:31:09.251 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:31:09.253 INFO:teuthology.orchestra.run.smithi070.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-11T05:31:09.294 INFO:teuthology.orchestra.run.smithi070.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.4 MB/s | 1.0 MB 00:00 2024-09-11T05:31:09.297 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:09.298 INFO:teuthology.orchestra.run.smithi070.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-09-11T05:31:09.362 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:31:09.377 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:31:09.377 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:31:09.466 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:31:09.467 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:31:09.563 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:31:09.738 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T05:31:09.781 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T05:31:09.989 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:31:10.148 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T05:31:10.212 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T05:31:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T05:31:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T05:31:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T05:31:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T05:31:10.418 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T05:31:10.457 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T05:31:10.489 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T05:31:10.519 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 6/6 2024-09-11T05:31:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T05:31:10.607 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T05:31:11.275 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 6/6 2024-09-11T05:31:11.275 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/6 2024-09-11T05:31:11.275 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T05:31:11.275 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T05:31:11.275 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T05:31:11.275 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T05:31:11.323 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T05:31:11.371 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T05:31:11.404 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T05:31:11.452 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T05:31:11.474 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 13/13 2024-09-11T05:31:11.545 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T05:31:11.545 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:11.545 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:31:11.546 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:31:11.546 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T05:31:11.546 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T05:31:11.546 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T05:31:11.546 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T05:31:11.546 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T05:31:11.546 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:11.546 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:11.812 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-fuse 2024-09-11T05:31:12.315 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 13/13 2024-09-11T05:31:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 1/13 2024-09-11T05:31:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T05:31:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T05:31:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T05:31:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T05:31:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T05:31:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T05:31:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T05:31:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T05:31:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T05:31:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T05:31:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T05:31:12.372 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:26 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:12.505 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:12.505 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:12.506 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-11T05:31:12.506 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:12.506 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:31:12.506 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T05:31:12.506 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-11T05:31:12.506 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T05:31:12.506 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:12.506 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:31:12.506 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:12.506 INFO:teuthology.orchestra.run.smithi084.stdout:Install 2 Packages 2024-09-11T05:31:12.506 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:12.507 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 977 k 2024-09-11T05:31:12.507 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 2.9 M 2024-09-11T05:31:12.507 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:31:12.647 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T05:31:12.647 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:12.647 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:31:12.647 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:31:12.648 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T05:31:12.648 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T05:31:12.648 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T05:31:12.648 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T05:31:12.648 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T05:31:12.648 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T05:31:12.648 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T05:31:12.648 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T05:31:12.648 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T05:31:12.648 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T05:31:12.648 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T05:31:12.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T05:31:12.649 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:12.649 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:12.649 INFO:teuthology.orchestra.run.smithi084.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 838 kB/s | 80 kB 00:00 2024-09-11T05:31:12.840 INFO:teuthology.orchestra.run.smithi084.stdout:(2/2): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86_6 3.1 MB/s | 897 kB 00:00 2024-09-11T05:31:12.841 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:12.841 INFO:teuthology.orchestra.run.smithi084.stdout:Total 2.9 MB/s | 977 kB 00:00 2024-09-11T05:31:12.852 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:31:12.873 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:31:12.873 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:31:12.926 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T05:31:12.953 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:31:12.953 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:31:13.147 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:31:13.292 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T05:31:13.355 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/2 2024-09-11T05:31:13.488 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:25 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:13.622 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:13.623 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:13.623 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T05:31:13.623 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:13.624 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:31:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T05:31:13.624 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T05:31:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T05:31:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T05:31:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T05:31:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T05:31:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T05:31:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:13.624 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:31:13.624 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:13.624 INFO:teuthology.orchestra.run.smithi070.stdout:Install 6 Packages 2024-09-11T05:31:13.624 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:13.625 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 7.0 M 2024-09-11T05:31:13.625 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 33 M 2024-09-11T05:31:13.625 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:31:13.873 INFO:teuthology.orchestra.run.smithi070.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-11T05:31:13.907 INFO:teuthology.orchestra.run.smithi070.stdout:(2/6): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e.el 714 kB/s | 146 kB 00:00 2024-09-11T05:31:13.957 INFO:teuthology.orchestra.run.smithi070.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-11T05:31:13.982 INFO:teuthology.orchestra.run.smithi070.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.2 MB/s | 74 kB 00:00 2024-09-11T05:31:13.999 INFO:teuthology.orchestra.run.smithi070.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 639 kB/s | 58 kB 00:00 2024-09-11T05:31:14.026 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/2 2024-09-11T05:31:14.027 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/2 2024-09-11T05:31:14.099 INFO:teuthology.orchestra.run.smithi070.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-11T05:31:14.101 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:14.102 INFO:teuthology.orchestra.run.smithi070.stdout:Total 15 MB/s | 7.0 MB 00:00 2024-09-11T05:31:14.172 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:31:14.182 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:31:14.183 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:31:14.282 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:31:14.284 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:31:14.318 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T05:31:14.318 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:14.319 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:31:14.319 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T05:31:14.319 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:14.319 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:31:14.636 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-volume 2024-09-11T05:31:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T05:31:14.826 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T05:31:15.220 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:29 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:15.355 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:15.355 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:15.355 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-11T05:31:15.355 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:15.356 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:31:15.356 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T05:31:15.356 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:15.356 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:31:15.356 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:15.356 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-09-11T05:31:15.356 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:15.356 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 285 k 2024-09-11T05:31:15.356 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 1.3 M 2024-09-11T05:31:15.356 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:31:15.359 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T05:31:15.438 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T05:31:15.510 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T05:31:15.538 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 6/6 2024-09-11T05:31:15.560 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-volume-19.1.1-298.gb53b6d3e.el9.noarch.rpm 1.4 MB/s | 285 kB 00:00 2024-09-11T05:31:15.561 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:15.561 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.4 MB/s | 285 kB 00:00 2024-09-11T05:31:15.561 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:31:15.570 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:31:15.570 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:31:15.600 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:31:15.600 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:31:15.823 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:31:15.888 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:31:15.903 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:31:15.903 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:31:15.903 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T05:31:15.904 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:16.354 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 6/6 2024-09-11T05:31:16.354 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/6 2024-09-11T05:31:16.355 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T05:31:16.355 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T05:31:16.355 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T05:31:16.355 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T05:31:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T05:31:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:16.639 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:31:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:31:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T05:31:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T05:31:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T05:31:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T05:31:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T05:31:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:16.640 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:16.912 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:31:16.912 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:16.912 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:31:16.912 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:31:16.912 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:16.912 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:17.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-fuse 2024-09-11T05:31:17.215 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install librados-devel 2024-09-11T05:31:17.570 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:29 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:17.703 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:17.704 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:17.704 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T05:31:17.704 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:17.704 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:31:17.704 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T05:31:17.704 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T05:31:17.704 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T05:31:17.704 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:17.704 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:31:17.704 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:17.705 INFO:teuthology.orchestra.run.smithi070.stdout:Install 2 Packages 2024-09-11T05:31:17.705 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:17.705 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 977 k 2024-09-11T05:31:17.705 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 2.9 M 2024-09-11T05:31:17.705 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:31:17.803 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:31 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:17.893 INFO:teuthology.orchestra.run.smithi070.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 568 kB/s | 80 kB 00:00 2024-09-11T05:31:17.941 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:17.941 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:17.941 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2024-09-11T05:31:17.942 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:17.942 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:31:17.942 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T05:31:17.942 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:17.942 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:31:17.942 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:17.942 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-09-11T05:31:17.942 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:17.942 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 127 k 2024-09-11T05:31:17.942 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 456 k 2024-09-11T05:31:17.942 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:31:18.035 INFO:teuthology.orchestra.run.smithi070.stdout:(2/2): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86_6 3.1 MB/s | 897 kB 00:00 2024-09-11T05:31:18.036 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:18.036 INFO:teuthology.orchestra.run.smithi070.stdout:Total 2.9 MB/s | 977 kB 00:00 2024-09-11T05:31:18.047 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:31:18.069 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:31:18.069 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:31:18.150 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:31:18.151 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:31:18.156 INFO:teuthology.orchestra.run.smithi084.stdout:librados-devel-19.1.1-298.gb53b6d3e.el9.x86_64. 592 kB/s | 127 kB 00:00 2024-09-11T05:31:18.157 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:18.157 INFO:teuthology.orchestra.run.smithi084.stdout:Total 588 kB/s | 127 kB 00:00 2024-09-11T05:31:18.157 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:31:18.163 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:31:18.163 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:31:18.228 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:31:18.228 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:31:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:31:18.381 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:31:18.487 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:18.504 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T05:31:18.568 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/2 2024-09-11T05:31:18.935 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:19.227 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:31:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:31:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:19.227 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:19.254 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/2 2024-09-11T05:31:19.255 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/2 2024-09-11T05:31:19.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install libcephfs2 2024-09-11T05:31:19.530 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T05:31:19.531 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:19.531 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:31:19.531 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T05:31:19.531 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:19.531 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:19.857 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-volume 2024-09-11T05:31:20.066 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:20.158 INFO:teuthology.orchestra.run.smithi084.stdout:Package libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:20.202 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:20.203 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-09-11T05:31:20.203 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:20.277 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install libcephfs-devel 2024-09-11T05:31:20.429 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:32 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:20.565 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:20.566 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:20.566 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T05:31:20.566 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:20.566 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:31:20.566 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T05:31:20.566 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:20.566 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:31:20.566 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:20.566 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T05:31:20.566 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:20.566 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 285 k 2024-09-11T05:31:20.567 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 1.3 M 2024-09-11T05:31:20.567 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:31:20.799 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-volume-19.1.1-298.gb53b6d3e.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-11T05:31:20.799 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:20.799 INFO:teuthology.orchestra.run.smithi070.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-11T05:31:20.800 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:31:20.807 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:31:20.808 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:31:20.834 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:31:20.835 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:31:20.839 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:20.971 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:20.972 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:20.972 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2024-09-11T05:31:20.972 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:20.972 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:31:20.972 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T05:31:20.972 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:20.972 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:31:20.973 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:20.973 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-09-11T05:31:20.973 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:20.973 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 32 k 2024-09-11T05:31:20.973 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 142 k 2024-09-11T05:31:20.973 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:31:21.051 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:31:21.117 INFO:teuthology.orchestra.run.smithi084.stdout:libcephfs-devel-19.1.1-298.gb53b6d3e.el9.x86_64 220 kB/s | 32 kB 00:00 2024-09-11T05:31:21.117 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:21.118 INFO:teuthology.orchestra.run.smithi084.stdout:Total 218 kB/s | 32 kB 00:00 2024-09-11T05:31:21.118 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:31:21.121 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:31:21.121 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:31:21.126 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:31:21.142 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:31:21.142 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:31:21.143 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T05:31:21.143 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:21.144 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:31:21.144 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:31:21.237 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:31:21.348 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:21.716 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:21.950 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:21.950 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:21.950 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:31:21.950 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:31:21.950 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:21.950 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:22.147 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install librados2 2024-09-11T05:31:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T05:31:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:22.228 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:31:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T05:31:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:22.228 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:22.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install librados-devel 2024-09-11T05:31:22.702 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:36 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:22.793 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:22.836 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:22.837 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-09-11T05:31:22.837 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:22.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install librbd1 2024-09-11T05:31:23.130 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:35 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:23.266 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:23.266 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repo Size 2024-09-11T05:31:23.266 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:23.266 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:31:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T05:31:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:23.267 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:31:23.267 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:23.267 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T05:31:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:23.267 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 127 k 2024-09-11T05:31:23.267 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 456 k 2024-09-11T05:31:23.267 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:31:23.462 INFO:teuthology.orchestra.run.smithi070.stdout:librados-devel-19.1.1-298.gb53b6d3e.el9.x86_64. 652 kB/s | 127 kB 00:00 2024-09-11T05:31:23.462 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:23.463 INFO:teuthology.orchestra.run.smithi070.stdout:Total 646 kB/s | 127 kB 00:00 2024-09-11T05:31:23.463 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:31:23.468 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:31:23.468 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:31:23.472 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:37 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:23.534 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:31:23.534 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:31:23.562 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:23.606 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:23.607 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-09-11T05:31:23.607 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:23.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rados 2024-09-11T05:31:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:31:23.793 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:24.245 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:38 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:24.335 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:24.378 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:24.379 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-09-11T05:31:24.379 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:24.450 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rgw 2024-09-11T05:31:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:24.497 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:31:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:31:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:24.497 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:24.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install libcephfs2 2024-09-11T05:31:25.010 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:39 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:25.100 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:25.142 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:25.143 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-09-11T05:31:25.143 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:25.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-cephfs 2024-09-11T05:31:25.329 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:37 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:25.421 INFO:teuthology.orchestra.run.smithi070.stdout:Package libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:25.465 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:25.466 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T05:31:25.466 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:25.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install libcephfs-devel 2024-09-11T05:31:25.779 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:39 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:25.869 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:25.912 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:25.913 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-09-11T05:31:25.913 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:25.985 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rbd 2024-09-11T05:31:26.111 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:38 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:26.244 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:26.245 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:26.245 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repo Size 2024-09-11T05:31:26.245 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:26.245 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:31:26.245 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T05:31:26.245 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:26.245 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:31:26.245 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:26.245 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T05:31:26.245 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:26.246 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 32 k 2024-09-11T05:31:26.246 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 142 k 2024-09-11T05:31:26.246 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:31:26.390 INFO:teuthology.orchestra.run.smithi070.stdout:libcephfs-devel-19.1.1-298.gb53b6d3e.el9.x86_64 219 kB/s | 32 kB 00:00 2024-09-11T05:31:26.391 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:26.391 INFO:teuthology.orchestra.run.smithi070.stdout:Total 217 kB/s | 32 kB 00:00 2024-09-11T05:31:26.391 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:31:26.394 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:31:26.395 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:31:26.417 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:31:26.417 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:31:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:31:26.550 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:40 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:26.630 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:26.638 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:26.682 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:26.682 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-09-11T05:31:26.682 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:26.748 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-fuse 2024-09-11T05:31:26.983 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:27.228 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:27.228 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:27.228 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:31:27.228 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:31:27.228 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:27.228 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:27.309 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:41 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:27.431 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install librados2 2024-09-11T05:31:27.443 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:27.444 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:27.444 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-09-11T05:31:27.444 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:27.444 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:31:27.444 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T05:31:27.444 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:27.444 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:31:27.444 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:27.444 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-09-11T05:31:27.445 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:27.445 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 85 k 2024-09-11T05:31:27.445 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 231 k 2024-09-11T05:31:27.445 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:31:27.645 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 426 kB/s | 85 kB 00:00 2024-09-11T05:31:27.645 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:27.645 INFO:teuthology.orchestra.run.smithi084.stdout:Total 423 kB/s | 85 kB 00:00 2024-09-11T05:31:27.646 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:31:27.652 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:31:27.652 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:31:27.715 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:31:27.716 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:31:27.856 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:31:27.968 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:27.995 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:39 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:28.086 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:28.129 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:28.130 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T05:31:28.130 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:28.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install librbd1 2024-09-11T05:31:28.329 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:28.576 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:28.576 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:28.576 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:31:28.576 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:31:28.576 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:28.576 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:28.761 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:40 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:28.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-mirror 2024-09-11T05:31:28.851 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:28.894 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:28.895 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T05:31:28.895 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:28.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install python3-rados 2024-09-11T05:31:29.421 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:43 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:29.518 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:41 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:29.557 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:29.558 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:29.558 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2024-09-11T05:31:29.558 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:29.558 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:31:29.558 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T05:31:29.558 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:29.558 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:31:29.558 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:29.558 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-09-11T05:31:29.558 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:29.559 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 3.1 M 2024-09-11T05:31:29.559 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 13 M 2024-09-11T05:31:29.559 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:31:29.608 INFO:teuthology.orchestra.run.smithi070.stdout:Package python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:29.652 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:29.653 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T05:31:29.653 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:29.717 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install python3-rgw 2024-09-11T05:31:29.907 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-mirror-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 8.9 MB/s | 3.1 MB 00:00 2024-09-11T05:31:29.907 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:29.908 INFO:teuthology.orchestra.run.smithi084.stdout:Total 8.9 MB/s | 3.1 MB 00:00 2024-09-11T05:31:29.908 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:31:29.917 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:31:29.917 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:31:29.998 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:31:29.999 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:31:30.279 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:42 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:30.370 INFO:teuthology.orchestra.run.smithi070.stdout:Package python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:30.412 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:30.413 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T05:31:30.413 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:30.446 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:31:30.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install python3-cephfs 2024-09-11T05:31:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:30.641 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:31:30.641 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T05:31:30.641 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T05:31:30.642 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T05:31:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:31.046 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:43 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:31.136 INFO:teuthology.orchestra.run.smithi070.stdout:Package python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:31.179 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:31.179 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T05:31:31.180 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:31.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install python3-rbd 2024-09-11T05:31:31.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:31.655 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:31.656 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:31:31.656 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:31:31.656 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:31.656 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:31.813 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:43 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:31.900 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-nbd 2024-09-11T05:31:31.903 INFO:teuthology.orchestra.run.smithi070.stdout:Package python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T05:31:31.947 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:31.948 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T05:31:31.948 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:32.020 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install rbd-fuse 2024-09-11T05:31:32.481 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:46 ago on Wed 11 Sep 2024 05:29:46 AM UTC. 2024-09-11T05:31:32.582 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:44 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:32.617 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-11T05:31:32.618 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:32.618 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-09-11T05:31:32.618 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:32.619 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-11T05:31:32.619 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T05:31:32.619 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:32.619 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-11T05:31:32.619 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-11T05:31:32.619 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-09-11T05:31:32.619 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:32.619 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 171 k 2024-09-11T05:31:32.619 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 494 k 2024-09-11T05:31:32.619 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-11T05:31:32.714 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:32.715 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-09-11T05:31:32.715 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:32.715 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:31:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T05:31:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:32.716 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:31:32.716 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:32.716 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T05:31:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:32.716 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 85 k 2024-09-11T05:31:32.716 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 231 k 2024-09-11T05:31:32.716 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:31:32.835 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 794 kB/s | 171 kB 00:00 2024-09-11T05:31:32.835 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:32.835 INFO:teuthology.orchestra.run.smithi084.stdout:Total 788 kB/s | 171 kB 00:00 2024-09-11T05:31:32.836 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-11T05:31:32.843 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-11T05:31:32.843 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-11T05:31:32.908 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-11T05:31:32.908 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-11T05:31:32.910 INFO:teuthology.orchestra.run.smithi070.stdout:rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 439 kB/s | 85 kB 00:00 2024-09-11T05:31:32.910 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:32.911 INFO:teuthology.orchestra.run.smithi070.stdout:Total 436 kB/s | 85 kB 00:00 2024-09-11T05:31:32.911 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:31:32.918 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:31:32.918 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:31:32.981 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:31:32.981 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:31:33.064 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-11T05:31:33.127 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:31:33.174 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:33.215 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:33.607 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:33.868 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:33.868 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:33.868 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:31:33.869 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:31:33.869 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:33.869 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:33.870 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-11T05:31:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:31:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:33.870 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-11T05:31:34.146 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install rbd-mirror 2024-09-11T05:31:34.155 DEBUG:teuthology.parallel:result is None 2024-09-11T05:31:34.734 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:46 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:34.875 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:34.876 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repo Size 2024-09-11T05:31:34.877 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:34.877 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:31:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T05:31:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:34.877 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:31:34.877 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:34.877 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T05:31:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:34.877 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 3.1 M 2024-09-11T05:31:34.877 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 13 M 2024-09-11T05:31:34.877 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:31:35.223 INFO:teuthology.orchestra.run.smithi070.stdout:rbd-mirror-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 9.0 MB/s | 3.1 MB 00:00 2024-09-11T05:31:35.223 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:35.224 INFO:teuthology.orchestra.run.smithi070.stdout:Total 8.9 MB/s | 3.1 MB 00:00 2024-09-11T05:31:35.224 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:31:35.233 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:31:35.233 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:31:35.317 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:31:35.317 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:31:35.761 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:31:35.824 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:35.850 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:35.850 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T05:31:35.850 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T05:31:35.850 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T05:31:35.851 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T05:31:35.851 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:37.019 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:37.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:37.020 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:31:37.020 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:31:37.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:37.020 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:37.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install rbd-nbd 2024-09-11T05:31:37.848 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:49 ago on Wed 11 Sep 2024 05:29:48 AM UTC. 2024-09-11T05:31:37.984 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T05:31:37.984 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-09-11T05:31:37.985 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:37.985 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T05:31:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T05:31:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:37.985 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T05:31:37.985 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T05:31:37.985 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T05:31:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:37.986 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 171 k 2024-09-11T05:31:37.986 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 494 k 2024-09-11T05:31:37.986 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T05:31:38.494 INFO:teuthology.orchestra.run.smithi070.stdout:rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 336 kB/s | 171 kB 00:00 2024-09-11T05:31:38.494 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T05:31:38.495 INFO:teuthology.orchestra.run.smithi070.stdout:Total 335 kB/s | 171 kB 00:00 2024-09-11T05:31:38.495 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T05:31:38.502 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T05:31:38.503 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T05:31:38.567 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T05:31:38.567 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T05:31:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T05:31:38.824 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T05:31:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:39.514 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T05:31:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T05:31:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:39.514 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T05:31:39.799 DEBUG:teuthology.parallel:result is None 2024-09-11T05:31:39.799 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T05:31:39.941 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T05:31:39.963 INFO:teuthology.orchestra.run.smithi070.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T05:31:39.964 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T05:31:39.965 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T05:31:39.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T05:31:40.105 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T05:31:40.130 INFO:teuthology.orchestra.run.smithi084.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T05:31:40.131 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T05:31:40.131 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T05:31:40.133 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T05:31:40.133 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:31:40.133 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T05:31:40.159 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:31:40.159 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T05:31:40.201 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T05:31:40.202 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:31:40.202 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T05:31:40.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T05:31:40.291 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:31:40.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T05:31:40.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T05:31:40.388 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T05:31:40.389 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:31:40.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T05:31:40.413 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T05:31:40.478 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:31:40.478 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T05:31:40.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T05:31:40.571 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T05:31:40.571 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:31:40.571 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T05:31:40.596 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T05:31:40.661 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:31:40.661 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T05:31:40.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T05:31:40.752 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T05:31:40.829 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T05:31:40.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2024-09-11T05:31:40.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2024-09-11T05:31:40.856 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T05:31:40.856 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T05:31:40.897 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T05:31:40.920 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T05:31:40.921 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T05:31:40.961 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T05:31:40.994 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T05:31:40.995 INFO:tasks.ceph:config {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writeback'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T05:31:40.995 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900559', 'branch': 'squid', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7900559', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writeback'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6175, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '88/128', 'suite': 'rbd', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae', 'targets': {'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDlpD0lno+B0Nt2zoGmpPO/7yfX2B+ttXaSxD8HMOfkzmShNIntyFrn3ZxCqPCbktS5fg/xl+NnOSJerR7ejraY=', 'smithi084.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLilpODZOGk/yt9u65wvfFbRtySye1ZJAFJAjdFToUVi6MiQ+WBJEkwVyMcc3TLx+Y/YhjpDZh7eLuQdY3Ynfyk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_21:16:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T05:31:40.995 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T05:31:41.026 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T05:31:41.041 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T05:31:41.082 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T05:31:41.106 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:31:41.106 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T05:31:41.160 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T05:31:41.160 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-09-11T05:31:41.214 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T05:31:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:31:41.215 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-11T05:31:41.215 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:31:41.215 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:31:41.215 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-11 05:31:36.105788881 +0000 2024-09-11T05:31:41.215 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-11 05:29:04.204700040 +0000 2024-09-11T05:31:41.215 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-11 05:29:04.204700040 +0000 2024-09-11T05:31:41.215 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-11 05:29:04.204700040 +0000 2024-09-11T05:31:41.215 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T05:31:41.277 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-11T05:31:41.278 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-11T05:31:41.278 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000103027 s, 5.0 MB/s 2024-09-11T05:31:41.279 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T05:31:41.335 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-09-11T05:31:41.390 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T05:31:41.391 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:31:41.391 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-11T05:31:41.391 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:31:41.391 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:31:41.391 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-11 05:31:36.105788881 +0000 2024-09-11T05:31:41.391 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-11 05:29:04.525690624 +0000 2024-09-11T05:31:41.391 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-11 05:29:04.525690624 +0000 2024-09-11T05:31:41.391 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-11 05:29:04.525690624 +0000 2024-09-11T05:31:41.391 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T05:31:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-11T05:31:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-11T05:31:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000100934 s, 5.1 MB/s 2024-09-11T05:31:41.454 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T05:31:41.510 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-09-11T05:31:41.565 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T05:31:41.566 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:31:41.566 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-11T05:31:41.566 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:31:41.566 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:31:41.566 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-11 05:31:36.105788881 +0000 2024-09-11T05:31:41.566 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-11 05:29:04.838681442 +0000 2024-09-11T05:31:41.566 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-11 05:29:04.838681442 +0000 2024-09-11T05:31:41.566 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-11 05:29:04.838681442 +0000 2024-09-11T05:31:41.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T05:31:41.628 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-11T05:31:41.628 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-11T05:31:41.628 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 8.256e-05 s, 6.2 MB/s 2024-09-11T05:31:41.630 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T05:31:41.686 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-09-11T05:31:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T05:31:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:31:41.741 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T05:31:41.742 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:31:41.742 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:31:41.742 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-11 05:31:36.106788852 +0000 2024-09-11T05:31:41.742 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-11 05:29:05.146672406 +0000 2024-09-11T05:31:41.742 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-11 05:29:05.146672406 +0000 2024-09-11T05:31:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-11 05:29:05.146672406 +0000 2024-09-11T05:31:41.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T05:31:41.804 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-11T05:31:41.804 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-11T05:31:41.804 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 9.9083e-05 s, 5.2 MB/s 2024-09-11T05:31:41.805 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T05:31:41.861 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T05:31:41.862 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:31:41.862 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T05:31:41.878 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T05:31:41.878 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-09-11T05:31:41.934 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T05:31:41.934 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:31:41.934 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-11T05:31:41.934 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:31:41.934 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:31:41.934 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-11 05:31:30.917022533 +0000 2024-09-11T05:31:41.934 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-11 05:29:04.209684929 +0000 2024-09-11T05:31:41.934 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-11 05:29:04.209684929 +0000 2024-09-11T05:31:41.934 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-11 05:29:04.209684929 +0000 2024-09-11T05:31:41.935 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T05:31:41.997 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-11T05:31:41.997 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-11T05:31:41.997 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000266578 s, 1.9 MB/s 2024-09-11T05:31:41.999 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T05:31:42.055 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-09-11T05:31:42.110 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T05:31:42.110 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:31:42.110 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T05:31:42.110 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:31:42.110 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:31:42.110 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-11 05:31:30.917022533 +0000 2024-09-11T05:31:42.110 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-11 05:29:04.547678896 +0000 2024-09-11T05:31:42.110 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-11 05:29:04.547678896 +0000 2024-09-11T05:31:42.111 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-11 05:29:04.547678896 +0000 2024-09-11T05:31:42.111 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T05:31:42.173 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-11T05:31:42.173 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-11T05:31:42.173 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000247362 s, 2.1 MB/s 2024-09-11T05:31:42.174 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T05:31:42.229 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-09-11T05:31:42.285 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T05:31:42.285 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:31:42.285 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-11T05:31:42.286 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:31:42.286 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:31:42.286 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-11 05:31:30.918022515 +0000 2024-09-11T05:31:42.286 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-11 05:29:04.855673398 +0000 2024-09-11T05:31:42.286 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-11 05:29:04.855673398 +0000 2024-09-11T05:31:42.286 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-11 05:29:04.855673398 +0000 2024-09-11T05:31:42.286 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T05:31:42.348 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-11T05:31:42.348 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-11T05:31:42.348 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000188632 s, 2.7 MB/s 2024-09-11T05:31:42.349 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T05:31:42.405 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-09-11T05:31:42.460 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T05:31:42.460 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T05:31:42.460 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T05:31:42.460 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T05:31:42.460 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T05:31:42.461 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-11 05:31:30.918022515 +0000 2024-09-11T05:31:42.461 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-11 05:29:05.165667865 +0000 2024-09-11T05:31:42.461 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-11 05:29:05.165667865 +0000 2024-09-11T05:31:42.461 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-11 05:29:05.165667865 +0000 2024-09-11T05:31:42.461 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T05:31:42.523 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-11T05:31:42.523 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-11T05:31:42.523 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000181757 s, 2.8 MB/s 2024-09-11T05:31:42.524 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T05:31:42.580 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T05:31:42.580 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T05:31:42.580 INFO:tasks.ceph:Generating config... 2024-09-11T05:31:42.581 INFO:tasks.ceph:[client] rbd cache = True 2024-09-11T05:31:42.581 INFO:tasks.ceph:[client] rbd cache policy = writeback 2024-09-11T05:31:42.581 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-11T05:31:42.581 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-11T05:31:42.582 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-11T05:31:42.582 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T05:31:42.582 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T05:31:42.582 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T05:31:42.582 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T05:31:42.582 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T05:31:42.582 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-11T05:31:42.582 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-11T05:31:42.582 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T05:31:42.582 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T05:31:42.582 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-11T05:31:42.582 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-11T05:31:42.582 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T05:31:42.582 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T05:31:42.582 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-11T05:31:42.583 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T05:31:42.583 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T05:31:42.583 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T05:31:42.583 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-11T05:31:42.583 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T05:31:42.583 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-11T05:31:42.583 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2024-09-11T05:31:42.583 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T05:31:42.583 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-11T05:31:42.583 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T05:31:42.583 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T05:31:42.640 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T05:31:42.642 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T05:31:42.686 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T05:31:42.751 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.70'), ('mon.c', '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]'), ('mon.b', '172.21.15.84')] 2024-09-11T05:31:42.752 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.84', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd cache': True, 'rbd cache policy': 'writeback'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-11T05:31:42.752 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:31:42.752 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T05:31:42.806 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.70 --addv c '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]' --add b 172.21.15.84 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:31:42.892 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:31:42.892 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: generated fsid eb5ff116-0384-4170-94d3-d3ddcb9c254f 2024-09-11T05:31:42.892 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = quincy 2024-09-11T05:31:42.893 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 0 2024-09-11T05:31:42.893 INFO:teuthology.orchestra.run.smithi070.stdout:fsid eb5ff116-0384-4170-94d3-d3ddcb9c254f 2024-09-11T05:31:42.893 INFO:teuthology.orchestra.run.smithi070.stdout:last_changed 2024-09-11T05:31:42.892721+0000 2024-09-11T05:31:42.893 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-11T05:31:42.892721+0000 2024-09-11T05:31:42.893 INFO:teuthology.orchestra.run.smithi070.stdout:min_mon_release 17 (quincy) 2024-09-11T05:31:42.893 INFO:teuthology.orchestra.run.smithi070.stdout:election_strategy: 1 2024-09-11T05:31:42.893 INFO:teuthology.orchestra.run.smithi070.stdout:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-11T05:31:42.893 INFO:teuthology.orchestra.run.smithi070.stdout:1: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2024-09-11T05:31:42.893 INFO:teuthology.orchestra.run.smithi070.stdout:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-11T05:31:42.893 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-11T05:31:42.894 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T05:31:42.910 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID eb5ff116-0384-4170-94d3-d3ddcb9c254f... 2024-09-11T05:31:42.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T05:31:42.952 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T05:31:42.992 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-09-11T05:31:42.993 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-09-11T05:31:42.993 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T05:31:42.993 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-09-11T05:31:42.993 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.993 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-09-11T05:31:42.993 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.993 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-09-11T05:31:42.993 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.993 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-09-11T05:31:42.993 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-09-11T05:31:42.993 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.994 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-09-11T05:31:42.994 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-09-11T05:31:42.994 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.994 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T05:31:42.994 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-09-11T05:31:42.994 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.994 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T05:31:42.994 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T05:31:42.994 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.994 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-09-11T05:31:42.994 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.995 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-09-11T05:31:42.995 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-09-11T05:31:42.995 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-09-11T05:31:42.995 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-09-11T05:31:42.995 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-09-11T05:31:42.995 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-09-11T05:31:42.995 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-09-11T05:31:42.995 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T05:31:42.995 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T05:31:42.995 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-09-11T05:31:42.995 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.995 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T05:31:42.995 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.996 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-09-11T05:31:42.996 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.996 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-09-11T05:31:42.996 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.996 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-09-11T05:31:42.996 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-09-11T05:31:42.996 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-09-11T05:31:42.996 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.84" 2024-09-11T05:31:42.996 INFO:teuthology.orchestra.run.smithi070.stdout: mon client directed command retry = 5 2024-09-11T05:31:42.996 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on pool no app = False 2024-09-11T05:31:42.996 INFO:teuthology.orchestra.run.smithi070.stdout: ms inject socket failures = 5000 2024-09-11T05:31:42.996 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = eb5ff116-0384-4170-94d3-d3ddcb9c254f 2024-09-11T05:31:42.996 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.997 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-09-11T05:31:42.997 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-09-11T05:31:42.997 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.997 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-09-11T05:31:42.997 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-09-11T05:31:42.997 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-09-11T05:31:42.997 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.997 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-09-11T05:31:42.997 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-09-11T05:31:42.997 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.997 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-09-11T05:31:42.997 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-09-11T05:31:42.997 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-09-11T05:31:42.998 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug trim objects = true 2024-09-11T05:31:42.998 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.998 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-09-11T05:31:42.998 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-09-11T05:31:42.998 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.998 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-09-11T05:31:42.998 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.998 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-09-11T05:31:42.998 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.998 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-09-11T05:31:42.998 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.998 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-09-11T05:31:42.998 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: bdev async discard = True 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: bdev enable discard = True 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T05:31:42.999 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2024-09-11T05:31:43.000 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2024-09-11T05:31:43.000 INFO:teuthology.orchestra.run.smithi070.stdout: osd blocked scrub grace period = 3600 2024-09-11T05:31:43.000 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2024-09-11T05:31:43.000 INFO:teuthology.orchestra.run.smithi070.stdout: osd max markdown count = 1000 2024-09-11T05:31:43.000 INFO:teuthology.orchestra.run.smithi070.stdout: osd memory target = 1610612736 2024-09-11T05:31:43.000 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2024-09-11T05:31:43.000 INFO:teuthology.orchestra.run.smithi070.stdout: osd shutdown pgref assert = True 2024-09-11T05:31:43.000 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:43.000 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-09-11T05:31:43.000 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-11T05:31:43.000 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-09-11T05:31:43.000 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-11T05:31:43.000 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-11T05:31:43.001 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-11T05:31:43.001 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-11T05:31:43.001 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-09-11T05:31:43.001 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:43.001 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-09-11T05:31:43.001 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-11T05:31:43.001 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-11T05:31:43.001 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-09-11T05:31:43.001 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-11T05:31:43.001 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-09-11T05:31:43.001 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-09-11T05:31:43.001 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-11T05:31:43.001 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-09-11T05:31:43.002 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:43.003 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-09-11T05:31:43.003 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:31:43.003 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-09-11T05:31:43.003 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-09-11T05:31:43.003 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2024-09-11T05:31:43.003 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-09-11T05:31:43.003 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T05:31:43.003 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T05:31:43.003 INFO:teuthology.orchestra.run.smithi070.stdout: rbd cache = True 2024-09-11T05:31:43.003 INFO:teuthology.orchestra.run.smithi070.stdout: rbd cache policy = writeback 2024-09-11T05:31:43.003 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-09-11T05:31:43.003 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2024-09-11T05:31:43.003 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2024-09-11T05:31:43.004 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-09-11T05:31:43.004 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2024-09-11T05:31:43.004 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T05:31:43.004 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2024-09-11T05:31:43.004 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.004 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2024-09-11T05:31:43.004 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2024-09-11T05:31:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2024-09-11T05:31:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2024-09-11T05:31:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2024-09-11T05:31:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2024-09-11T05:31:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T05:31:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2024-09-11T05:31:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T05:31:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2024-09-11T05:31:43.006 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.84" 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: mon client directed command retry = 5 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on pool no app = False 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject socket failures = 5000 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = eb5ff116-0384-4170-94d3-d3ddcb9c254f 2024-09-11T05:31:43.007 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2024-09-11T05:31:43.008 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug trim objects = true 2024-09-11T05:31:43.009 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.009 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2024-09-11T05:31:43.009 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2024-09-11T05:31:43.009 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.009 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2024-09-11T05:31:43.009 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.009 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2024-09-11T05:31:43.009 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.009 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2024-09-11T05:31:43.009 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.009 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2024-09-11T05:31:43.009 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2024-09-11T05:31:43.009 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.010 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2024-09-11T05:31:43.010 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2024-09-11T05:31:43.010 INFO:teuthology.orchestra.run.smithi084.stdout: bdev async discard = True 2024-09-11T05:31:43.010 INFO:teuthology.orchestra.run.smithi084.stdout: bdev enable discard = True 2024-09-11T05:31:43.010 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2024-09-11T05:31:43.010 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2024-09-11T05:31:43.010 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 1/20 2024-09-11T05:31:43.010 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 1/20 2024-09-11T05:31:43.010 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-09-11T05:31:43.011 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2024-09-11T05:31:43.011 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 4/10 2024-09-11T05:31:43.011 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T05:31:43.011 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2024-09-11T05:31:43.011 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2024-09-11T05:31:43.011 INFO:teuthology.orchestra.run.smithi084.stdout: osd blocked scrub grace period = 3600 2024-09-11T05:31:43.011 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2024-09-11T05:31:43.011 INFO:teuthology.orchestra.run.smithi084.stdout: osd max markdown count = 1000 2024-09-11T05:31:43.011 INFO:teuthology.orchestra.run.smithi084.stdout: osd memory target = 1610612736 2024-09-11T05:31:43.011 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2024-09-11T05:31:43.011 INFO:teuthology.orchestra.run.smithi084.stdout: osd shutdown pgref assert = True 2024-09-11T05:31:43.011 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.011 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2024-09-11T05:31:43.012 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-09-11T05:31:43.012 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2024-09-11T05:31:43.012 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-09-11T05:31:43.012 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-09-11T05:31:43.012 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-09-11T05:31:43.012 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-09-11T05:31:43.012 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2024-09-11T05:31:43.012 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.012 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2024-09-11T05:31:43.012 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-09-11T05:31:43.012 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-09-11T05:31:43.012 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2024-09-11T05:31:43.012 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-09-11T05:31:43.013 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2024-09-11T05:31:43.013 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2024-09-11T05:31:43.013 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-09-11T05:31:43.013 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2024-09-11T05:31:43.013 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2024-09-11T05:31:43.013 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-09-11T05:31:43.013 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.013 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T05:31:43.013 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T05:31:43.013 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T05:31:43.013 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.013 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T05:31:43.013 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: rbd cache = True 2024-09-11T05:31:43.014 INFO:teuthology.orchestra.run.smithi084.stdout: rbd cache policy = writeback 2024-09-11T05:31:43.015 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2024-09-11T05:31:43.015 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2024-09-11T05:31:43.015 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2024-09-11T05:31:43.016 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T05:31:43.016 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T05:31:43.109 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T05:31:43.110 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:31:43.110 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T05:31:43.125 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:31:43.125 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T05:31:43.180 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T05:31:43.181 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:31:43.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T05:31:43.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T05:31:43.255 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:31:43.255 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:31:43.310 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2024-09-11T05:31:43.310 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:31:43.311 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T05:31:43.311 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T05:31:43.345 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:31:43.345 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:31:43.401 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T05:31:43.401 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T05:31:43.401 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T05:31:43.451 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T05:31:43.454 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T05:31:43.512 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T05:31:43.515 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T05:31:43.515 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T05:31:43.515 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T05:31:43.555 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T05:31:43.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T05:31:43.608 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T05:31:43.621 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T05:31:43.621 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T05:31:43.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T05:31:43.645 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T05:31:43.646 INFO:tasks.ceph:role: osd.0 2024-09-11T05:31:43.646 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T05:31:43.646 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T05:31:43.709 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:31:43.710 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:31:43.710 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:31:43.710 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:31:43.710 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:31:43.710 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:31:43.710 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:31:43.710 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:31:43.710 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:31:43.710 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:31:43.742 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-11T05:31:43.744 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-11T05:31:43.744 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T05:31:43.814 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T05:31:43.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T05:31:43.949 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T05:31:43.949 INFO:tasks.ceph:role: osd.1 2024-09-11T05:31:43.949 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T05:31:43.949 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T05:31:44.013 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:31:44.013 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:31:44.013 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:31:44.013 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:31:44.013 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:31:44.014 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:31:44.014 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:31:44.014 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:31:44.014 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:31:44.014 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:31:44.045 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-11T05:31:44.047 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-11T05:31:44.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T05:31:44.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T05:31:44.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T05:31:44.249 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T05:31:44.249 INFO:tasks.ceph:role: osd.2 2024-09-11T05:31:44.249 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T05:31:44.249 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T05:31:44.314 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:31:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:31:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:31:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:31:44.314 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:31:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:31:44.314 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:31:44.314 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:31:44.314 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:31:44.314 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:31:44.346 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-11T05:31:44.348 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-11T05:31:44.348 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T05:31:44.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T05:31:44.484 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T05:31:44.549 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T05:31:44.549 INFO:tasks.ceph:role: osd.3 2024-09-11T05:31:44.549 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T05:31:44.549 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T05:31:44.613 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:31:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:31:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:31:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:31:44.613 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:31:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:31:44.614 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:31:44.614 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:31:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:31:44.614 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:31:44.649 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-11T05:31:44.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-11T05:31:44.651 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-11T05:31:44.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T05:31:44.794 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:31:44.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:44.887+0000 7f1424424640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T05:31:44.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:44.887+0000 7f1424424640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T05:31:44.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:44.887+0000 7f1424424640 -1 bdev(0x5635ec8f5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T05:31:44.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:44.887+0000 7f1424424640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T05:31:48.785 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T05:31:48.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:31:48.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:48.908+0000 7effcc80d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T05:31:48.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:48.908+0000 7effcc80d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T05:31:48.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:48.908+0000 7effcc80d640 -1 bdev(0x55df9cee9800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T05:31:48.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:48.908+0000 7effcc80d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T05:31:52.314 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T05:31:52.344 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:31:52.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:52.435+0000 7fb52fddd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T05:31:52.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:52.435+0000 7fb52fddd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T05:31:52.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:52.435+0000 7fb52fddd640 -1 bdev(0x55912e4f9800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T05:31:52.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:52.435+0000 7fb52fddd640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T05:31:55.841 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T05:31:55.871 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:31:55.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:55.963+0000 7eff3e41c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-11T05:31:55.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:55.963+0000 7eff3e41c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-11T05:31:55.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:55.963+0000 7eff3e41c640 -1 bdev(0x5582f8899800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-11T05:31:55.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T05:31:55.963+0000 7eff3e41c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-11T05:31:59.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T05:31:59.897 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-11T05:31:59.928 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T05:31:59.928 INFO:tasks.ceph:role: osd.4 2024-09-11T05:31:59.928 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2024-09-11T05:31:59.928 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T05:32:00.004 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:32:00.004 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:32:00.004 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:32:00.004 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:32:00.004 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:32:00.004 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:32:00.004 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:32:00.004 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:32:00.004 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:32:00.005 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:32:00.502 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-09-11T05:32:00.505 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-09-11T05:32:00.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-11T05:32:00.625 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-11T05:32:00.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-11T05:32:00.723 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T05:32:00.723 INFO:tasks.ceph:role: osd.5 2024-09-11T05:32:00.724 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2024-09-11T05:32:00.724 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T05:32:00.797 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:32:00.798 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:32:00.798 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:32:00.798 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:32:00.798 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:32:00.798 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:32:00.798 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:32:00.798 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:32:00.798 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:32:00.798 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:32:01.266 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-09-11T05:32:01.268 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-09-11T05:32:01.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-11T05:32:01.352 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-11T05:32:01.421 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-11T05:32:01.485 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T05:32:01.485 INFO:tasks.ceph:role: osd.6 2024-09-11T05:32:01.486 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2024-09-11T05:32:01.486 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T05:32:01.557 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:32:01.557 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:32:01.557 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:32:01.557 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:32:01.558 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:32:01.558 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:32:01.558 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:32:01.558 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:32:01.558 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:32:01.558 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:32:02.043 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-09-11T05:32:02.045 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-09-11T05:32:02.045 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-11T05:32:02.147 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-11T05:32:02.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-11T05:32:02.243 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T05:32:02.243 INFO:tasks.ceph:role: osd.7 2024-09-11T05:32:02.243 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2024-09-11T05:32:02.243 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T05:32:02.315 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T05:32:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T05:32:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T05:32:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T05:32:02.315 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T05:32:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-09-11T05:32:02.315 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T05:32:02.316 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T05:32:02.316 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T05:32:02.316 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T05:32:02.806 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-09-11T05:32:02.808 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-09-11T05:32:02.809 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-11T05:32:02.936 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-11T05:32:02.971 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:32:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:03.070+0000 7fd06981c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-11T05:32:03.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:03.071+0000 7fd06981c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-11T05:32:03.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:03.071+0000 7fd06981c640 -1 bdev(0x55b065d65800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-11T05:32:03.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:03.072+0000 7fd06981c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-11T05:32:06.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T05:32:06.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:32:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:06.849+0000 7f6fa5e1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-11T05:32:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:06.849+0000 7f6fa5e1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-11T05:32:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:06.849+0000 7f6fa5e1e640 -1 bdev(0x563d65deb800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-11T05:32:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:06.849+0000 7f6fa5e1e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-11T05:32:10.510 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T05:32:10.538 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:32:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:10.626+0000 7f9b49a1f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-11T05:32:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:10.626+0000 7f9b49a1f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-11T05:32:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:10.626+0000 7f9b49a1f640 -1 bdev(0x5628bdd89800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-11T05:32:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:10.626+0000 7f9b49a1f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-11T05:32:14.520 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-11T05:32:14.550 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:32:14.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:14.639+0000 7fd80f60c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-11T05:32:14.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:14.640+0000 7fd80f60c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-11T05:32:14.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:14.640+0000 7fd80f60c640 -1 bdev(0x55a7391a9800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-11T05:32:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-11T05:32:14.640+0000 7fd80f60c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-11T05:32:18.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-11T05:32:18.567 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T05:32:18.567 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:32:18.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-11T05:32:18.597 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:32:18.598 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T05:32:18.665 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:32:18.666 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T05:32:18.733 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:32:18.733 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T05:32:18.800 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:32:18.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T05:32:18.867 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:32:18.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T05:32:18.897 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:32:18.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-11T05:32:18.967 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:32:18.967 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-11T05:32:19.037 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:32:19.037 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-11T05:32:19.106 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:32:19.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-11T05:32:19.174 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:32:19.175 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T05:32:19.193 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:32:19.193 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T05:32:19.231 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T05:32:19.231 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T05:32:19.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T05:32:19.274 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2024-09-11T05:32:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA/K+FmmDPzGhAATCjNBhAvhUQIM61OtkSmsw== 2024-09-11T05:32:19.275 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2024-09-11T05:32:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBAK+FmRIv0NBAAfX+wJoemhjkB13hbFb3a5A== 2024-09-11T05:32:19.275 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2024-09-11T05:32:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBEK+FmsMcvNhAAzbDL3VhDIxahs+CouThp8g== 2024-09-11T05:32:19.275 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2024-09-11T05:32:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBIK+Fm/kv7GRAASNwV23uRSVV9HRjehCX1Cw== 2024-09-11T05:32:19.275 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.3] 2024-09-11T05:32:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBLK+Fm3rF2ORAAXzBtawwMqcsFlENOj1dwhg== 2024-09-11T05:32:19.275 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2024-09-11T05:32:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA/K+Fm5paQHhAAHYnpHi8DIfjNTwLeAFgS3A== 2024-09-11T05:32:19.275 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.4] 2024-09-11T05:32:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBTK+FmSmxABBAAVZwB6a5V1H0crq84I7BO+g== 2024-09-11T05:32:19.276 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.5] 2024-09-11T05:32:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBWK+Fm1kyoMhAAWIC1bDCoHl5LeHeS0lF7DQ== 2024-09-11T05:32:19.276 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.6] 2024-09-11T05:32:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBaK+FmkkNYJRAAd7jo2YGYfEKKjinyhZi88Q== 2024-09-11T05:32:19.276 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.7] 2024-09-11T05:32:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBeK+Fmd3ssJhAAGcdEs2b8iE6DSrw9Ax/zKQ== 2024-09-11T05:32:19.276 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-09-11T05:32:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA/K+FmOqooIRAAtBeuCNu1Cn3WNBWNpdrtBQ== 2024-09-11T05:32:19.276 INFO:teuthology.orchestra.run.smithi070.stdout:[client.1] 2024-09-11T05:32:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA/K+FmODNNJBAA5qQmCFw+soPx/efjuX0dsA== 2024-09-11T05:32:19.295 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2024-09-11T05:32:19.296 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQA/K+FmmDPzGhAATCjNBhAvhUQIM61OtkSmsw== 2024-09-11T05:32:19.296 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2024-09-11T05:32:19.296 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBAK+FmRIv0NBAAfX+wJoemhjkB13hbFb3a5A== 2024-09-11T05:32:19.296 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2024-09-11T05:32:19.296 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBEK+FmsMcvNhAAzbDL3VhDIxahs+CouThp8g== 2024-09-11T05:32:19.296 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2024-09-11T05:32:19.296 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBIK+Fm/kv7GRAASNwV23uRSVV9HRjehCX1Cw== 2024-09-11T05:32:19.296 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2024-09-11T05:32:19.296 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBLK+Fm3rF2ORAAXzBtawwMqcsFlENOj1dwhg== 2024-09-11T05:32:19.296 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2024-09-11T05:32:19.296 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQA/K+Fm5paQHhAAHYnpHi8DIfjNTwLeAFgS3A== 2024-09-11T05:32:19.297 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2024-09-11T05:32:19.297 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBTK+FmSmxABBAAVZwB6a5V1H0crq84I7BO+g== 2024-09-11T05:32:19.297 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2024-09-11T05:32:19.297 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBWK+Fm1kyoMhAAWIC1bDCoHl5LeHeS0lF7DQ== 2024-09-11T05:32:19.297 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2024-09-11T05:32:19.297 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBaK+FmkkNYJRAAd7jo2YGYfEKKjinyhZi88Q== 2024-09-11T05:32:19.297 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2024-09-11T05:32:19.297 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBeK+Fmd3ssJhAAGcdEs2b8iE6DSrw9Ax/zKQ== 2024-09-11T05:32:19.297 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-09-11T05:32:19.297 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQA/K+FmOqooIRAAtBeuCNu1Cn3WNBWNpdrtBQ== 2024-09-11T05:32:19.298 INFO:teuthology.orchestra.run.smithi084.stdout:[client.1] 2024-09-11T05:32:19.298 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQA/K+FmODNNJBAA5qQmCFw+soPx/efjuX0dsA== 2024-09-11T05:32:19.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T05:32:19.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T05:32:19.393 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.551 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.554 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.605 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T05:32:19.608 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T05:32:19.658 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.661 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.714 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.766 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.820 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T05:32:19.871 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T05:32:19.873 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T05:32:19.926 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T05:32:19.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T05:32:19.982 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T05:32:19.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T05:32:20.007 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T05:32:20.102 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T05:32:20.127 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-11T05:32:20.192 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T05:32:20.287 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-11T05:32:20.312 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-11T05:32:20.338 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T05:32:20.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-11T05:32:20.457 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:32:20.460 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T05:32:20.513 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T05:32:20.513 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T05:32:20.513 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T05:32:20.516 INFO:tasks.ceph.mon.a:Started 2024-09-11T05:32:20.516 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-11T05:32:20.516 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-11T05:32:20.518 INFO:tasks.ceph.mon.c:Started 2024-09-11T05:32:20.518 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T05:32:20.518 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T05:32:20.555 INFO:tasks.ceph.mon.b:Started 2024-09-11T05:32:20.555 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T05:32:20.556 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-11T05:32:20.556 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-11T05:32:20.558 INFO:tasks.ceph.mgr.y:Started 2024-09-11T05:32:20.558 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T05:32:20.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T05:32:20.560 INFO:tasks.ceph.mgr.x:Started 2024-09-11T05:32:20.560 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T05:32:20.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T05:32:25.934 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:25.934+0000 7f520ed20040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T05:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2024-09-11T05:32:25.976 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:25.976+0000 7f520ed20040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T05:32:25.979 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T05:32:25.979 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T05:32:25.979 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:32:25.979 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T05:32:25.987 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:25.987+0000 7f6beff2e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T05:32:26.004 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:32:26.004 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T05:32:26.030 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:26.030+0000 7f6beff2e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T05:32:26.055 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:32:26.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T05:32:26.115 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:26.115+0000 7f520ed20040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T05:32:26.120 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T05:32:26.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T05:32:26.164 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:26.164+0000 7f520ed20040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T05:32:26.175 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:26.174+0000 7f6beff2e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T05:32:26.185 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:32:26.185 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-11T05:32:26.210 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:32:26.210 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-11T05:32:26.227 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:26.227+0000 7f6beff2e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T05:32:26.274 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:32:26.274 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-11T05:32:26.336 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:26.336+0000 7f520ed20040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T05:32:26.338 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-11T05:32:26.338 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-11T05:32:26.389 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:26.389+0000 7f6beff2e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T05:32:26.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 6ef7487b-9326-4062-8fe4-ef39030252bd 0 2024-09-11T05:32:26.451 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:26.451+0000 7f520ed20040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T05:32:26.499 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:26.498+0000 7f6beff2e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T05:32:26.624 INFO:teuthology.orchestra.run.smithi084.stdout:0 2024-09-11T05:32:26.635 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 3e0d8348-6e1b-4d63-b0f1-c20d90d73760 1 2024-09-11T05:32:26.801 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:26.801+0000 7f520ed20040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T05:32:26.824 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:26.823+0000 7f6beff2e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T05:32:26.854 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:26.854+0000 7f520ed20040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T05:32:26.859 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-09-11T05:32:26.870 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 38bbb42f-85e2-4064-8f55-e0385aff07d4 2 2024-09-11T05:32:26.880 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:26.880+0000 7f6beff2e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T05:32:27.013 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:27.012+0000 7f520ed20040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T05:32:27.030 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:27.029+0000 7f6beff2e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T05:32:27.053 INFO:teuthology.orchestra.run.smithi084.stdout:2 2024-09-11T05:32:27.064 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new e96ca529-f3b3-4f7e-bd59-1e9872a5efab 3 2024-09-11T05:32:27.247 INFO:teuthology.orchestra.run.smithi084.stdout:3 2024-09-11T05:32:27.258 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new dbbde660-d90e-4e02-9a01-16b0f76aa2b8 4 2024-09-11T05:32:27.439 INFO:teuthology.orchestra.run.smithi084.stdout:4 2024-09-11T05:32:27.450 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 2dc1a002-3ec0-4b4d-b84d-e684fa8a9131 5 2024-09-11T05:32:27.630 INFO:teuthology.orchestra.run.smithi084.stdout:5 2024-09-11T05:32:27.641 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a 6 2024-09-11T05:32:27.825 INFO:teuthology.orchestra.run.smithi084.stdout:6 2024-09-11T05:32:27.837 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 5fef4450-317c-4e1f-b05b-80740b9538f1 7 2024-09-11T05:32:27.992 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:27.991+0000 7f6beff2e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T05:32:28.014 INFO:teuthology.orchestra.run.smithi084.stdout:7 2024-09-11T05:32:28.023 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:28.022+0000 7f520ed20040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T05:32:28.025 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T05:32:28.025 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T05:32:28.028 INFO:tasks.ceph.osd.0:Started 2024-09-11T05:32:28.028 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T05:32:28.028 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T05:32:28.030 INFO:tasks.ceph.osd.1:Started 2024-09-11T05:32:28.031 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T05:32:28.031 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T05:32:28.033 INFO:tasks.ceph.osd.2:Started 2024-09-11T05:32:28.033 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T05:32:28.033 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-11T05:32:28.035 INFO:tasks.ceph.osd.3:Started 2024-09-11T05:32:28.035 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-11T05:32:28.035 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-11T05:32:28.037 INFO:tasks.ceph.osd.4:Started 2024-09-11T05:32:28.038 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-11T05:32:28.038 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-11T05:32:28.039 INFO:tasks.ceph.osd.5:Started 2024-09-11T05:32:28.040 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-11T05:32:28.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-11T05:32:28.042 INFO:tasks.ceph.osd.6:Started 2024-09-11T05:32:28.042 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-11T05:32:28.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-11T05:32:28.044 INFO:tasks.ceph.osd.7:Started 2024-09-11T05:32:28.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T05:32:28.052 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:28.052+0000 7f6beff2e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T05:32:28.102 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:28.101+0000 7f520ed20040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T05:32:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:32:28.233 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":10,"fsid":"eb5ff116-0384-4170-94d3-d3ddcb9c254f","created":"2024-09-11T05:32:25.817911+0000","modified":"2024-09-11T05:32:28.012774+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T05:32:28.012774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6ef7487b-9326-4062-8fe4-ef39030252bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3e0d8348-6e1b-4d63-b0f1-c20d90d73760","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"38bbb42f-85e2-4064-8f55-e0385aff07d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e96ca529-f3b3-4f7e-bd59-1e9872a5efab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"dbbde660-d90e-4e02-9a01-16b0f76aa2b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2dc1a002-3ec0-4b4d-b84d-e684fa8a9131","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fef4450-317c-4e1f-b05b-80740b9538f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:32:28.244 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T05:32:28.244 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T05:32:28.456 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:28.455+0000 7f6beff2e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T05:32:28.479 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:28.478+0000 7f520ed20040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T05:32:28.540 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:28.540+0000 7f6beff2e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T05:32:28.563 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:28.562+0000 7f520ed20040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T05:32:28.645 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:28.644+0000 7f6beff2e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T05:32:28.669 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:28.668+0000 7f520ed20040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T05:32:28.692 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:28.692+0000 7f6beff2e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T05:32:28.717 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:28.716+0000 7f520ed20040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T05:32:28.806 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:28.805+0000 7f6beff2e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T05:32:28.832 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:28.831+0000 7f520ed20040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T05:32:28.860 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:28.860+0000 7f6beff2e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T05:32:28.885 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:28.884+0000 7f520ed20040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T05:32:28.905 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:28.904+0000 7f6beff2e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T05:32:28.930 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:28.928+0000 7f520ed20040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T05:32:29.018 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:29.018+0000 7f6beff2e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T05:32:29.043 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:29.041+0000 7f520ed20040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T05:32:29.050 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T05:32:29.068 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:29.068+0000 7f6beff2e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T05:32:29.092 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:29.091+0000 7f520ed20040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T05:32:29.122 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:29.122+0000 7f6beff2e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T05:32:29.143 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:29.142+0000 7f520ed20040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T05:32:29.194 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:29.193+0000 7f6beff2e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T05:32:29.209 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-11T05:32:29.209 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":10,"fsid":"eb5ff116-0384-4170-94d3-d3ddcb9c254f","created":"2024-09-11T05:32:25.817911+0000","modified":"2024-09-11T05:32:28.012774+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T05:32:28.012774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6ef7487b-9326-4062-8fe4-ef39030252bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3e0d8348-6e1b-4d63-b0f1-c20d90d73760","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"38bbb42f-85e2-4064-8f55-e0385aff07d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e96ca529-f3b3-4f7e-bd59-1e9872a5efab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"dbbde660-d90e-4e02-9a01-16b0f76aa2b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2dc1a002-3ec0-4b4d-b84d-e684fa8a9131","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fef4450-317c-4e1f-b05b-80740b9538f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:32:29.212 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:29.211+0000 7f520ed20040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T05:32:29.219 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T05:32:29.241 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:29.240+0000 7f6beff2e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T05:32:29.258 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:29.257+0000 7f520ed20040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T05:32:29.286 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:29.286+0000 7f6beff2e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T05:32:29.302 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:29.301+0000 7f520ed20040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T05:32:29.481 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:29.479+0000 7f2d23414640 -1 Falling back to public interface 2024-09-11T05:32:29.764 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:32:29.762+0000 7fd5a4c19640 -1 Falling back to public interface 2024-09-11T05:32:29.768 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:32:29.767+0000 7f4c12db9640 -1 Falling back to public interface 2024-09-11T05:32:29.787 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:32:29.786+0000 7f0ffa40f640 -1 Falling back to public interface 2024-09-11T05:32:29.939 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:29.938+0000 7f6beff2e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T05:32:29.959 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-09-11T05:32:29.958+0000 7f520ed20040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T05:32:30.004 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:32:30.003+0000 7f97e2818640 -1 Falling back to public interface 2024-09-11T05:32:30.007 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:32:30.006+0000 7f86e221d640 -1 Falling back to public interface 2024-09-11T05:32:30.025 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:32:30.024+0000 7f82b8814640 -1 Falling back to public interface 2024-09-11T05:32:30.028 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:32:30.027+0000 7f9e8c040640 -1 Falling back to public interface 2024-09-11T05:32:30.952 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:30.951+0000 7f6b8fdb5640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-11T05:32:30.952 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T05:32:30.952+0000 7f6b8fdb5640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-11T05:32:33.290 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:33.288+0000 7f2d23414640 -1 osd.6 0 log_to_monitors true 2024-09-11T05:32:33.859 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:32:33.857+0000 7fd5a4c19640 -1 osd.7 0 log_to_monitors true 2024-09-11T05:32:34.095 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:32:34.095+0000 7f9e8c040640 -1 osd.3 0 log_to_monitors true 2024-09-11T05:32:34.136 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:32:34.136+0000 7f82b8814640 -1 osd.0 0 log_to_monitors true 2024-09-11T05:32:34.232 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:32:34.230+0000 7f97e2818640 -1 osd.2 0 log_to_monitors true 2024-09-11T05:32:34.281 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:32:34.279+0000 7f86e221d640 -1 osd.5 0 log_to_monitors true 2024-09-11T05:32:34.321 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:32:34.320+0000 7f4c12db9640 -1 osd.4 0 log_to_monitors true 2024-09-11T05:32:34.361 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:32:34.361+0000 7f0ffa40f640 -1 osd.1 0 log_to_monitors true 2024-09-11T05:32:36.026 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T05:32:36.372 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-11T05:32:36.372 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":13,"fsid":"eb5ff116-0384-4170-94d3-d3ddcb9c254f","created":"2024-09-11T05:32:25.817911+0000","modified":"2024-09-11T05:32:35.961192+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T05:32:28.012774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6ef7487b-9326-4062-8fe4-ef39030252bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3e0d8348-6e1b-4d63-b0f1-c20d90d73760","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"38bbb42f-85e2-4064-8f55-e0385aff07d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e96ca529-f3b3-4f7e-bd59-1e9872a5efab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"dbbde660-d90e-4e02-9a01-16b0f76aa2b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2dc1a002-3ec0-4b4d-b84d-e684fa8a9131","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fef4450-317c-4e1f-b05b-80740b9538f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:32:36.385 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T05:32:36.514 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:36.512+0000 7f2d1e601640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T05:32:36.561 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:36.560+0000 7f2d16c33640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:32:36.588 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:32:36.587+0000 7fd5a0e15640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T05:32:36.611 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:32:36.610+0000 7fd598410640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:32:37.300 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:32:37.298+0000 7f86de3fc640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T05:32:37.322 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:32:37.321+0000 7f86d59f7640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:32:37.348 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:32:37.347+0000 7f4c0f55c640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T05:32:37.366 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:32:37.365+0000 7f4c06b57640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:32:37.381 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:32:37.380+0000 7f0ff5463640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T05:32:37.392 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:32:37.392+0000 7f0feda95640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:32:37.431 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:32:37.431+0000 7f9e887e3640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T05:32:37.433 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:32:37.432+0000 7f97de98e640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T05:32:37.451 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:32:37.450+0000 7f9e7fdde640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:32:37.451 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:32:37.450+0000 7f82b3957640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T05:32:37.454 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:32:37.454+0000 7f97d5f89640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:32:37.470 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:32:37.470+0000 7f82abf89640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:32:43.192 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T05:32:43.475 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-11T05:32:43.475 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":17,"fsid":"eb5ff116-0384-4170-94d3-d3ddcb9c254f","created":"2024-09-11T05:32:25.817911+0000","modified":"2024-09-11T05:32:40.548175+0000","last_up_change":"2024-09-11T05:32:37.539498+0000","last_in_change":"2024-09-11T05:32:28.012774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T05:32:37.977484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef7487b-9326-4062-8fe4-ef39030252bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6819","nonce":4108497907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6821","nonce":4108497907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6825","nonce":4108497907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6823","nonce":4108497907}]},"public_addr":"172.21.15.70:6819/4108497907","cluster_addr":"172.21.15.70:6821/4108497907","heartbeat_back_addr":"172.21.15.70:6825/4108497907","heartbeat_front_addr":"172.21.15.70:6823/4108497907","state":["exists","up"]},{"osd":1,"uuid":"3e0d8348-6e1b-4d63-b0f1-c20d90d73760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6801","nonce":3979396531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6803","nonce":3979396531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6807","nonce":3979396531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6805","nonce":3979396531}]},"public_addr":"172.21.15.70:6801/3979396531","cluster_addr":"172.21.15.70:6803/3979396531","heartbeat_back_addr":"172.21.15.70:6807/3979396531","heartbeat_front_addr":"172.21.15.70:6805/3979396531","state":["exists","up"]},{"osd":2,"uuid":"38bbb42f-85e2-4064-8f55-e0385aff07d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6811","nonce":4053894977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6813","nonce":4053894977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6817","nonce":4053894977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6815","nonce":4053894977}]},"public_addr":"172.21.15.70:6811/4053894977","cluster_addr":"172.21.15.70:6813/4053894977","heartbeat_back_addr":"172.21.15.70:6817/4053894977","heartbeat_front_addr":"172.21.15.70:6815/4053894977","state":["exists","up"]},{"osd":3,"uuid":"e96ca529-f3b3-4f7e-bd59-1e9872a5efab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6827","nonce":2067624829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6829","nonce":2067624829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6833","nonce":2067624829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6831","nonce":2067624829}]},"public_addr":"172.21.15.70:6827/2067624829","cluster_addr":"172.21.15.70:6829/2067624829","heartbeat_back_addr":"172.21.15.70:6833/2067624829","heartbeat_front_addr":"172.21.15.70:6831/2067624829","state":["exists","up"]},{"osd":4,"uuid":"dbbde660-d90e-4e02-9a01-16b0f76aa2b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1743986256},{"type":"v1","addr":"172.21.15.84:6817","nonce":1743986256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1743986256},{"type":"v1","addr":"172.21.15.84:6819","nonce":1743986256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1743986256},{"type":"v1","addr":"172.21.15.84:6823","nonce":1743986256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1743986256},{"type":"v1","addr":"172.21.15.84:6821","nonce":1743986256}]},"public_addr":"172.21.15.84:6817/1743986256","cluster_addr":"172.21.15.84:6819/1743986256","heartbeat_back_addr":"172.21.15.84:6823/1743986256","heartbeat_front_addr":"172.21.15.84:6821/1743986256","state":["exists","up"]},{"osd":5,"uuid":"2dc1a002-3ec0-4b4d-b84d-e684fa8a9131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6825","nonce":2732588656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6827","nonce":2732588656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6831","nonce":2732588656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6829","nonce":2732588656}]},"public_addr":"172.21.15.84:6825/2732588656","cluster_addr":"172.21.15.84:6827/2732588656","heartbeat_back_addr":"172.21.15.84:6831/2732588656","heartbeat_front_addr":"172.21.15.84:6829/2732588656","state":["exists","up"]},{"osd":6,"uuid":"4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6801","nonce":372011645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6803","nonce":372011645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6807","nonce":372011645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6805","nonce":372011645}]},"public_addr":"172.21.15.84:6801/372011645","cluster_addr":"172.21.15.84:6803/372011645","heartbeat_back_addr":"172.21.15.84:6807/372011645","heartbeat_front_addr":"172.21.15.84:6805/372011645","state":["exists","up"]},{"osd":7,"uuid":"5fef4450-317c-4e1f-b05b-80740b9538f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6809","nonce":583221652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6811","nonce":583221652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6815","nonce":583221652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6813","nonce":583221652}]},"public_addr":"172.21.15.84:6809/583221652","cluster_addr":"172.21.15.84:6811/583221652","heartbeat_back_addr":"172.21.15.84:6815/583221652","heartbeat_front_addr":"172.21.15.84:6813/583221652","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.130019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.339373+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.204705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.075490+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.279790+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.287168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:34.320448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:34.838001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:32:43.486 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-11T05:32:43.486 INFO:tasks.ceph:Creating RBD pool 2024-09-11T05:32:43.486 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-11T05:32:44.573 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'rbd' created 2024-09-11T05:32:44.591 DEBUG:teuthology.orchestra.run.smithi070:> rbd --cluster ceph pool init rbd 2024-09-11T05:32:47.603 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T05:32:47.604 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T05:32:47.604 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T05:32:47.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T05:32:47.604 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T05:32:47.939 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:32:47.950 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1794321953},{"type":"v1","addr":"172.21.15.70:6809","nonce":1794321953}]},"active_addr":"172.21.15.70:6809/1794321953","active_change":"2024-09-11T05:32:29.940495+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2667119382}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1729383482}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":241859379}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3526308507}]}]} 2024-09-11T05:32:47.954 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T05:32:47.954 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T05:32:47.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T05:32:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:32:48.233 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"eb5ff116-0384-4170-94d3-d3ddcb9c254f","created":"2024-09-11T05:32:25.817911+0000","modified":"2024-09-11T05:32:47.586220+0000","last_up_change":"2024-09-11T05:32:37.539498+0000","last_in_change":"2024-09-11T05:32:28.012774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T05:32:37.977484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T05:32:43.780723+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef7487b-9326-4062-8fe4-ef39030252bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6819","nonce":4108497907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6821","nonce":4108497907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6825","nonce":4108497907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6823","nonce":4108497907}]},"public_addr":"172.21.15.70:6819/4108497907","cluster_addr":"172.21.15.70:6821/4108497907","heartbeat_back_addr":"172.21.15.70:6825/4108497907","heartbeat_front_addr":"172.21.15.70:6823/4108497907","state":["exists","up"]},{"osd":1,"uuid":"3e0d8348-6e1b-4d63-b0f1-c20d90d73760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6801","nonce":3979396531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6803","nonce":3979396531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6807","nonce":3979396531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6805","nonce":3979396531}]},"public_addr":"172.21.15.70:6801/3979396531","cluster_addr":"172.21.15.70:6803/3979396531","heartbeat_back_addr":"172.21.15.70:6807/3979396531","heartbeat_front_addr":"172.21.15.70:6805/3979396531","state":["exists","up"]},{"osd":2,"uuid":"38bbb42f-85e2-4064-8f55-e0385aff07d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6811","nonce":4053894977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6813","nonce":4053894977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6817","nonce":4053894977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6815","nonce":4053894977}]},"public_addr":"172.21.15.70:6811/4053894977","cluster_addr":"172.21.15.70:6813/4053894977","heartbeat_back_addr":"172.21.15.70:6817/4053894977","heartbeat_front_addr":"172.21.15.70:6815/4053894977","state":["exists","up"]},{"osd":3,"uuid":"e96ca529-f3b3-4f7e-bd59-1e9872a5efab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6827","nonce":2067624829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6829","nonce":2067624829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6833","nonce":2067624829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6831","nonce":2067624829}]},"public_addr":"172.21.15.70:6827/2067624829","cluster_addr":"172.21.15.70:6829/2067624829","heartbeat_back_addr":"172.21.15.70:6833/2067624829","heartbeat_front_addr":"172.21.15.70:6831/2067624829","state":["exists","up"]},{"osd":4,"uuid":"dbbde660-d90e-4e02-9a01-16b0f76aa2b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1743986256},{"type":"v1","addr":"172.21.15.84:6817","nonce":1743986256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1743986256},{"type":"v1","addr":"172.21.15.84:6819","nonce":1743986256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1743986256},{"type":"v1","addr":"172.21.15.84:6823","nonce":1743986256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1743986256},{"type":"v1","addr":"172.21.15.84:6821","nonce":1743986256}]},"public_addr":"172.21.15.84:6817/1743986256","cluster_addr":"172.21.15.84:6819/1743986256","heartbeat_back_addr":"172.21.15.84:6823/1743986256","heartbeat_front_addr":"172.21.15.84:6821/1743986256","state":["exists","up"]},{"osd":5,"uuid":"2dc1a002-3ec0-4b4d-b84d-e684fa8a9131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6825","nonce":2732588656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6827","nonce":2732588656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6831","nonce":2732588656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6829","nonce":2732588656}]},"public_addr":"172.21.15.84:6825/2732588656","cluster_addr":"172.21.15.84:6827/2732588656","heartbeat_back_addr":"172.21.15.84:6831/2732588656","heartbeat_front_addr":"172.21.15.84:6829/2732588656","state":["exists","up"]},{"osd":6,"uuid":"4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6801","nonce":372011645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6803","nonce":372011645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6807","nonce":372011645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6805","nonce":372011645}]},"public_addr":"172.21.15.84:6801/372011645","cluster_addr":"172.21.15.84:6803/372011645","heartbeat_back_addr":"172.21.15.84:6807/372011645","heartbeat_front_addr":"172.21.15.84:6805/372011645","state":["exists","up"]},{"osd":7,"uuid":"5fef4450-317c-4e1f-b05b-80740b9538f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6809","nonce":583221652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6811","nonce":583221652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6815","nonce":583221652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6813","nonce":583221652}]},"public_addr":"172.21.15.84:6809/583221652","cluster_addr":"172.21.15.84:6811/583221652","heartbeat_back_addr":"172.21.15.84:6815/583221652","heartbeat_front_addr":"172.21.15.84:6813/583221652","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.130019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.339373+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.204705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.075490+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.279790+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.287168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:34.320448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:34.838001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:32:48.245 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T05:32:48.245 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T05:32:48.526 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:32:48.526 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"eb5ff116-0384-4170-94d3-d3ddcb9c254f","created":"2024-09-11T05:32:25.817911+0000","modified":"2024-09-11T05:32:47.586220+0000","last_up_change":"2024-09-11T05:32:37.539498+0000","last_in_change":"2024-09-11T05:32:28.012774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T05:32:37.977484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T05:32:43.780723+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef7487b-9326-4062-8fe4-ef39030252bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6819","nonce":4108497907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6821","nonce":4108497907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6825","nonce":4108497907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6823","nonce":4108497907}]},"public_addr":"172.21.15.70:6819/4108497907","cluster_addr":"172.21.15.70:6821/4108497907","heartbeat_back_addr":"172.21.15.70:6825/4108497907","heartbeat_front_addr":"172.21.15.70:6823/4108497907","state":["exists","up"]},{"osd":1,"uuid":"3e0d8348-6e1b-4d63-b0f1-c20d90d73760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6801","nonce":3979396531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6803","nonce":3979396531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6807","nonce":3979396531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6805","nonce":3979396531}]},"public_addr":"172.21.15.70:6801/3979396531","cluster_addr":"172.21.15.70:6803/3979396531","heartbeat_back_addr":"172.21.15.70:6807/3979396531","heartbeat_front_addr":"172.21.15.70:6805/3979396531","state":["exists","up"]},{"osd":2,"uuid":"38bbb42f-85e2-4064-8f55-e0385aff07d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6811","nonce":4053894977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6813","nonce":4053894977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6817","nonce":4053894977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6815","nonce":4053894977}]},"public_addr":"172.21.15.70:6811/4053894977","cluster_addr":"172.21.15.70:6813/4053894977","heartbeat_back_addr":"172.21.15.70:6817/4053894977","heartbeat_front_addr":"172.21.15.70:6815/4053894977","state":["exists","up"]},{"osd":3,"uuid":"e96ca529-f3b3-4f7e-bd59-1e9872a5efab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6827","nonce":2067624829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6829","nonce":2067624829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6833","nonce":2067624829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6831","nonce":2067624829}]},"public_addr":"172.21.15.70:6827/2067624829","cluster_addr":"172.21.15.70:6829/2067624829","heartbeat_back_addr":"172.21.15.70:6833/2067624829","heartbeat_front_addr":"172.21.15.70:6831/2067624829","state":["exists","up"]},{"osd":4,"uuid":"dbbde660-d90e-4e02-9a01-16b0f76aa2b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1743986256},{"type":"v1","addr":"172.21.15.84:6817","nonce":1743986256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1743986256},{"type":"v1","addr":"172.21.15.84:6819","nonce":1743986256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1743986256},{"type":"v1","addr":"172.21.15.84:6823","nonce":1743986256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1743986256},{"type":"v1","addr":"172.21.15.84:6821","nonce":1743986256}]},"public_addr":"172.21.15.84:6817/1743986256","cluster_addr":"172.21.15.84:6819/1743986256","heartbeat_back_addr":"172.21.15.84:6823/1743986256","heartbeat_front_addr":"172.21.15.84:6821/1743986256","state":["exists","up"]},{"osd":5,"uuid":"2dc1a002-3ec0-4b4d-b84d-e684fa8a9131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6825","nonce":2732588656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6827","nonce":2732588656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6831","nonce":2732588656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6829","nonce":2732588656}]},"public_addr":"172.21.15.84:6825/2732588656","cluster_addr":"172.21.15.84:6827/2732588656","heartbeat_back_addr":"172.21.15.84:6831/2732588656","heartbeat_front_addr":"172.21.15.84:6829/2732588656","state":["exists","up"]},{"osd":6,"uuid":"4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6801","nonce":372011645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6803","nonce":372011645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6807","nonce":372011645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6805","nonce":372011645}]},"public_addr":"172.21.15.84:6801/372011645","cluster_addr":"172.21.15.84:6803/372011645","heartbeat_back_addr":"172.21.15.84:6807/372011645","heartbeat_front_addr":"172.21.15.84:6805/372011645","state":["exists","up"]},{"osd":7,"uuid":"5fef4450-317c-4e1f-b05b-80740b9538f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6809","nonce":583221652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6811","nonce":583221652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6815","nonce":583221652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6813","nonce":583221652}]},"public_addr":"172.21.15.84:6809/583221652","cluster_addr":"172.21.15.84:6811/583221652","heartbeat_back_addr":"172.21.15.84:6815/583221652","heartbeat_front_addr":"172.21.15.84:6813/583221652","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.130019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.339373+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.204705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.075490+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.279790+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.287168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:34.320448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:34.838001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:32:48.539 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T05:32:48.539 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T05:32:48.540 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T05:32:48.540 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T05:32:48.541 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T05:32:48.541 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T05:32:48.541 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T05:32:48.542 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T05:32:48.772 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-11T05:32:48.773 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T05:32:48.776 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-11T05:32:48.776 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T05:32:48.781 INFO:teuthology.orchestra.run.smithi070.stdout:60129542150 2024-09-11T05:32:48.781 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T05:32:48.784 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-11T05:32:48.784 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T05:32:48.786 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-11T05:32:48.786 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-11T05:32:48.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T05:32:48.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T05:32:48.788 INFO:teuthology.orchestra.run.smithi070.stdout:60129542150 2024-09-11T05:32:48.789 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T05:32:48.790 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-11T05:32:48.791 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T05:32:49.357 INFO:teuthology.orchestra.run.smithi070.stdout:60129542147 2024-09-11T05:32:49.370 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-11T05:32:49.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.0 2024-09-11T05:32:49.380 INFO:teuthology.orchestra.run.smithi070.stdout:60129542146 2024-09-11T05:32:49.382 INFO:teuthology.orchestra.run.smithi070.stdout:60129542146 2024-09-11T05:32:49.383 INFO:teuthology.orchestra.run.smithi070.stdout:60129542146 2024-09-11T05:32:49.384 INFO:teuthology.orchestra.run.smithi070.stdout:60129542146 2024-09-11T05:32:49.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.6 2024-09-11T05:32:49.392 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-11T05:32:49.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542146 for osd.2 2024-09-11T05:32:49.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542146 for osd.5 2024-09-11T05:32:49.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542146 for osd.1 2024-09-11T05:32:49.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542146 for osd.4 2024-09-11T05:32:49.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.7 2024-09-11T05:32:49.409 INFO:teuthology.orchestra.run.smithi070.stdout:60129542147 2024-09-11T05:32:49.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.3 2024-09-11T05:32:50.378 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T05:32:50.393 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T05:32:50.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T05:32:50.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T05:32:50.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T05:32:50.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T05:32:50.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T05:32:50.423 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T05:32:50.944 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-11T05:32:50.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-11T05:32:50.963 DEBUG:teuthology.parallel:result is None 2024-09-11T05:32:50.989 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-11T05:32:51.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.5 2024-09-11T05:32:51.002 DEBUG:teuthology.parallel:result is None 2024-09-11T05:32:51.013 INFO:teuthology.orchestra.run.smithi070.stdout:60129542150 2024-09-11T05:32:51.015 INFO:teuthology.orchestra.run.smithi070.stdout:60129542150 2024-09-11T05:32:51.027 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-11T05:32:51.030 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-11T05:32:51.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-11T05:32:51.031 DEBUG:teuthology.parallel:result is None 2024-09-11T05:32:51.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-09-11T05:32:51.033 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-11T05:32:51.033 DEBUG:teuthology.parallel:result is None 2024-09-11T05:32:51.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2024-09-11T05:32:51.045 DEBUG:teuthology.parallel:result is None 2024-09-11T05:32:51.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-09-11T05:32:51.048 DEBUG:teuthology.parallel:result is None 2024-09-11T05:32:51.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.4 2024-09-11T05:32:51.051 DEBUG:teuthology.parallel:result is None 2024-09-11T05:32:51.056 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-11T05:32:51.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-11T05:32:51.070 DEBUG:teuthology.parallel:result is None 2024-09-11T05:32:51.070 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T05:32:51.070 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:32:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:32:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:32:51.397 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-11T05:32:49.947672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235728,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738992,"statfs":{"total":773094113280,"available":772852727808,"internally_reserved":0,"allocated":2899968,"data_stored":1753582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.373331"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.598023+0000","last_change":"2024-09-11T05:32:47.598023+0000","last_active":"2024-09-11T05:32:47.598023+0000","last_peered":"2024-09-11T05:32:47.598023+0000","last_clean":"2024-09-11T05:32:47.598023+0000","last_became_active":"2024-09-11T05:32:45.702003+0000","last_became_peered":"2024-09-11T05:32:45.702003+0000","last_unstale":"2024-09-11T05:32:47.598023+0000","last_undegraded":"2024-09-11T05:32:47.598023+0000","last_fullsized":"2024-09-11T05:32:47.598023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:08.654916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.594128+0000","last_change":"2024-09-11T05:32:47.594128+0000","last_active":"2024-09-11T05:32:47.594128+0000","last_peered":"2024-09-11T05:32:47.594128+0000","last_clean":"2024-09-11T05:32:47.594128+0000","last_became_active":"2024-09-11T05:32:45.702044+0000","last_became_peered":"2024-09-11T05:32:45.702044+0000","last_unstale":"2024-09-11T05:32:47.594128+0000","last_undegraded":"2024-09-11T05:32:47.594128+0000","last_fullsized":"2024-09-11T05:32:47.594128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:48:32.373840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038977499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.597274+0000","last_change":"2024-09-11T05:32:47.597274+0000","last_active":"2024-09-11T05:32:47.597274+0000","last_peered":"2024-09-11T05:32:47.597274+0000","last_clean":"2024-09-11T05:32:47.597274+0000","last_became_active":"2024-09-11T05:32:45.582056+0000","last_became_peered":"2024-09-11T05:32:45.582056+0000","last_unstale":"2024-09-11T05:32:47.597274+0000","last_undegraded":"2024-09-11T05:32:47.597274+0000","last_fullsized":"2024-09-11T05:32:47.597274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:44:01.356958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.727035+0000","last_change":"2024-09-11T05:32:47.727035+0000","last_active":"2024-09-11T05:32:47.727035+0000","last_peered":"2024-09-11T05:32:47.727035+0000","last_clean":"2024-09-11T05:32:47.727035+0000","last_became_active":"2024-09-11T05:32:45.702510+0000","last_became_peered":"2024-09-11T05:32:45.702510+0000","last_unstale":"2024-09-11T05:32:47.727035+0000","last_undegraded":"2024-09-11T05:32:47.727035+0000","last_fullsized":"2024-09-11T05:32:47.727035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:35:31.635413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.598588+0000","last_change":"2024-09-11T05:32:47.597956+0000","last_active":"2024-09-11T05:32:47.598588+0000","last_peered":"2024-09-11T05:32:47.598588+0000","last_clean":"2024-09-11T05:32:47.598588+0000","last_became_active":"2024-09-11T05:32:45.702439+0000","last_became_peered":"2024-09-11T05:32:45.702439+0000","last_unstale":"2024-09-11T05:32:47.598588+0000","last_undegraded":"2024-09-11T05:32:47.598588+0000","last_fullsized":"2024-09-11T05:32:47.598588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:27:05.110151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195137,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.726973+0000","last_change":"2024-09-11T05:32:47.726973+0000","last_active":"2024-09-11T05:32:47.726973+0000","last_peered":"2024-09-11T05:32:47.726973+0000","last_clean":"2024-09-11T05:32:47.726973+0000","last_became_active":"2024-09-11T05:32:45.585103+0000","last_became_peered":"2024-09-11T05:32:45.585103+0000","last_unstale":"2024-09-11T05:32:47.726973+0000","last_undegraded":"2024-09-11T05:32:47.726973+0000","last_fullsized":"2024-09-11T05:32:47.726973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:07:32.584388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039722200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.597556+0000","last_change":"2024-09-11T05:32:47.597556+0000","last_active":"2024-09-11T05:32:47.597556+0000","last_peered":"2024-09-11T05:32:47.597556+0000","last_clean":"2024-09-11T05:32:47.597556+0000","last_became_active":"2024-09-11T05:32:45.585150+0000","last_became_peered":"2024-09-11T05:32:45.585150+0000","last_unstale":"2024-09-11T05:32:47.597556+0000","last_undegraded":"2024-09-11T05:32:47.597556+0000","last_fullsized":"2024-09-11T05:32:47.597556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:57:16.674978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077988099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.597195+0000","last_change":"2024-09-11T05:32:47.597195+0000","last_active":"2024-09-11T05:32:47.597195+0000","last_peered":"2024-09-11T05:32:47.597195+0000","last_clean":"2024-09-11T05:32:47.597195+0000","last_became_active":"2024-09-11T05:32:45.582294+0000","last_became_peered":"2024-09-11T05:32:45.582294+0000","last_unstale":"2024-09-11T05:32:47.597195+0000","last_undegraded":"2024-09-11T05:32:47.597195+0000","last_fullsized":"2024-09-11T05:32:47.597195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:49:22.206673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045578900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.726114+0000","last_change":"2024-09-11T05:32:39.551254+0000","last_active":"2024-09-11T05:32:47.726114+0000","last_peered":"2024-09-11T05:32:47.726114+0000","last_clean":"2024-09-11T05:32:47.726114+0000","last_became_active":"2024-09-11T05:32:39.550968+0000","last_became_peered":"2024-09-11T05:32:39.550968+0000","last_unstale":"2024-09-11T05:32:47.726114+0000","last_undegraded":"2024-09-11T05:32:47.726114+0000","last_fullsized":"2024-09-11T05:32:47.726114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:09.466849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":661969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":71620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":661969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:32:51.398 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:32:51.673 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:32:51.674 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:32:51.686 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-11T05:32:49.947672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235728,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738992,"statfs":{"total":773094113280,"available":772852727808,"internally_reserved":0,"allocated":2899968,"data_stored":1753582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.373331"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.598023+0000","last_change":"2024-09-11T05:32:47.598023+0000","last_active":"2024-09-11T05:32:47.598023+0000","last_peered":"2024-09-11T05:32:47.598023+0000","last_clean":"2024-09-11T05:32:47.598023+0000","last_became_active":"2024-09-11T05:32:45.702003+0000","last_became_peered":"2024-09-11T05:32:45.702003+0000","last_unstale":"2024-09-11T05:32:47.598023+0000","last_undegraded":"2024-09-11T05:32:47.598023+0000","last_fullsized":"2024-09-11T05:32:47.598023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:08.654916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.594128+0000","last_change":"2024-09-11T05:32:47.594128+0000","last_active":"2024-09-11T05:32:47.594128+0000","last_peered":"2024-09-11T05:32:47.594128+0000","last_clean":"2024-09-11T05:32:47.594128+0000","last_became_active":"2024-09-11T05:32:45.702044+0000","last_became_peered":"2024-09-11T05:32:45.702044+0000","last_unstale":"2024-09-11T05:32:47.594128+0000","last_undegraded":"2024-09-11T05:32:47.594128+0000","last_fullsized":"2024-09-11T05:32:47.594128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:48:32.373840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038977499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.597274+0000","last_change":"2024-09-11T05:32:47.597274+0000","last_active":"2024-09-11T05:32:47.597274+0000","last_peered":"2024-09-11T05:32:47.597274+0000","last_clean":"2024-09-11T05:32:47.597274+0000","last_became_active":"2024-09-11T05:32:45.582056+0000","last_became_peered":"2024-09-11T05:32:45.582056+0000","last_unstale":"2024-09-11T05:32:47.597274+0000","last_undegraded":"2024-09-11T05:32:47.597274+0000","last_fullsized":"2024-09-11T05:32:47.597274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:44:01.356958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.727035+0000","last_change":"2024-09-11T05:32:47.727035+0000","last_active":"2024-09-11T05:32:47.727035+0000","last_peered":"2024-09-11T05:32:47.727035+0000","last_clean":"2024-09-11T05:32:47.727035+0000","last_became_active":"2024-09-11T05:32:45.702510+0000","last_became_peered":"2024-09-11T05:32:45.702510+0000","last_unstale":"2024-09-11T05:32:47.727035+0000","last_undegraded":"2024-09-11T05:32:47.727035+0000","last_fullsized":"2024-09-11T05:32:47.727035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:35:31.635413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.598588+0000","last_change":"2024-09-11T05:32:47.597956+0000","last_active":"2024-09-11T05:32:47.598588+0000","last_peered":"2024-09-11T05:32:47.598588+0000","last_clean":"2024-09-11T05:32:47.598588+0000","last_became_active":"2024-09-11T05:32:45.702439+0000","last_became_peered":"2024-09-11T05:32:45.702439+0000","last_unstale":"2024-09-11T05:32:47.598588+0000","last_undegraded":"2024-09-11T05:32:47.598588+0000","last_fullsized":"2024-09-11T05:32:47.598588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:27:05.110151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195137,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.726973+0000","last_change":"2024-09-11T05:32:47.726973+0000","last_active":"2024-09-11T05:32:47.726973+0000","last_peered":"2024-09-11T05:32:47.726973+0000","last_clean":"2024-09-11T05:32:47.726973+0000","last_became_active":"2024-09-11T05:32:45.585103+0000","last_became_peered":"2024-09-11T05:32:45.585103+0000","last_unstale":"2024-09-11T05:32:47.726973+0000","last_undegraded":"2024-09-11T05:32:47.726973+0000","last_fullsized":"2024-09-11T05:32:47.726973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:07:32.584388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039722200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.597556+0000","last_change":"2024-09-11T05:32:47.597556+0000","last_active":"2024-09-11T05:32:47.597556+0000","last_peered":"2024-09-11T05:32:47.597556+0000","last_clean":"2024-09-11T05:32:47.597556+0000","last_became_active":"2024-09-11T05:32:45.585150+0000","last_became_peered":"2024-09-11T05:32:45.585150+0000","last_unstale":"2024-09-11T05:32:47.597556+0000","last_undegraded":"2024-09-11T05:32:47.597556+0000","last_fullsized":"2024-09-11T05:32:47.597556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:57:16.674978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077988099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.597195+0000","last_change":"2024-09-11T05:32:47.597195+0000","last_active":"2024-09-11T05:32:47.597195+0000","last_peered":"2024-09-11T05:32:47.597195+0000","last_clean":"2024-09-11T05:32:47.597195+0000","last_became_active":"2024-09-11T05:32:45.582294+0000","last_became_peered":"2024-09-11T05:32:45.582294+0000","last_unstale":"2024-09-11T05:32:47.597195+0000","last_undegraded":"2024-09-11T05:32:47.597195+0000","last_fullsized":"2024-09-11T05:32:47.597195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:49:22.206673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045578900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.726114+0000","last_change":"2024-09-11T05:32:39.551254+0000","last_active":"2024-09-11T05:32:47.726114+0000","last_peered":"2024-09-11T05:32:47.726114+0000","last_clean":"2024-09-11T05:32:47.726114+0000","last_became_active":"2024-09-11T05:32:39.550968+0000","last_became_peered":"2024-09-11T05:32:39.550968+0000","last_unstale":"2024-09-11T05:32:47.726114+0000","last_undegraded":"2024-09-11T05:32:47.726114+0000","last_fullsized":"2024-09-11T05:32:47.726114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:09.466849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":661969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":71620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":661969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:32:51.687 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T05:32:51.687 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T05:32:51.687 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T05:32:51.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T05:32:51.997 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:32:51.997 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T05:32:52.010 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T05:32:52.010 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-11T05:32:52.021 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-11T05:32:52.021 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writeback'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae'}} 2024-09-11T05:32:52.021 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-11T05:32:52.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-11T05:32:52.314 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-11T05:32:52.315 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T05:32:52.315 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:32:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:32:52.588 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:32:52.600 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-11T05:32:51.947974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235728,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738992,"statfs":{"total":773094113280,"available":772852727808,"internally_reserved":0,"allocated":2899968,"data_stored":1753582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.371935"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.598023+0000","last_change":"2024-09-11T05:32:47.598023+0000","last_active":"2024-09-11T05:32:47.598023+0000","last_peered":"2024-09-11T05:32:47.598023+0000","last_clean":"2024-09-11T05:32:47.598023+0000","last_became_active":"2024-09-11T05:32:45.702003+0000","last_became_peered":"2024-09-11T05:32:45.702003+0000","last_unstale":"2024-09-11T05:32:47.598023+0000","last_undegraded":"2024-09-11T05:32:47.598023+0000","last_fullsized":"2024-09-11T05:32:47.598023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:08.654916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.594128+0000","last_change":"2024-09-11T05:32:47.594128+0000","last_active":"2024-09-11T05:32:47.594128+0000","last_peered":"2024-09-11T05:32:47.594128+0000","last_clean":"2024-09-11T05:32:47.594128+0000","last_became_active":"2024-09-11T05:32:45.702044+0000","last_became_peered":"2024-09-11T05:32:45.702044+0000","last_unstale":"2024-09-11T05:32:47.594128+0000","last_undegraded":"2024-09-11T05:32:47.594128+0000","last_fullsized":"2024-09-11T05:32:47.594128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:48:32.373840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038977499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.597274+0000","last_change":"2024-09-11T05:32:47.597274+0000","last_active":"2024-09-11T05:32:47.597274+0000","last_peered":"2024-09-11T05:32:47.597274+0000","last_clean":"2024-09-11T05:32:47.597274+0000","last_became_active":"2024-09-11T05:32:45.582056+0000","last_became_peered":"2024-09-11T05:32:45.582056+0000","last_unstale":"2024-09-11T05:32:47.597274+0000","last_undegraded":"2024-09-11T05:32:47.597274+0000","last_fullsized":"2024-09-11T05:32:47.597274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:44:01.356958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.727035+0000","last_change":"2024-09-11T05:32:47.727035+0000","last_active":"2024-09-11T05:32:47.727035+0000","last_peered":"2024-09-11T05:32:47.727035+0000","last_clean":"2024-09-11T05:32:47.727035+0000","last_became_active":"2024-09-11T05:32:45.702510+0000","last_became_peered":"2024-09-11T05:32:45.702510+0000","last_unstale":"2024-09-11T05:32:47.727035+0000","last_undegraded":"2024-09-11T05:32:47.727035+0000","last_fullsized":"2024-09-11T05:32:47.727035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:35:31.635413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.598588+0000","last_change":"2024-09-11T05:32:47.597956+0000","last_active":"2024-09-11T05:32:47.598588+0000","last_peered":"2024-09-11T05:32:47.598588+0000","last_clean":"2024-09-11T05:32:47.598588+0000","last_became_active":"2024-09-11T05:32:45.702439+0000","last_became_peered":"2024-09-11T05:32:45.702439+0000","last_unstale":"2024-09-11T05:32:47.598588+0000","last_undegraded":"2024-09-11T05:32:47.598588+0000","last_fullsized":"2024-09-11T05:32:47.598588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:27:05.110151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195137,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.726973+0000","last_change":"2024-09-11T05:32:47.726973+0000","last_active":"2024-09-11T05:32:47.726973+0000","last_peered":"2024-09-11T05:32:47.726973+0000","last_clean":"2024-09-11T05:32:47.726973+0000","last_became_active":"2024-09-11T05:32:45.585103+0000","last_became_peered":"2024-09-11T05:32:45.585103+0000","last_unstale":"2024-09-11T05:32:47.726973+0000","last_undegraded":"2024-09-11T05:32:47.726973+0000","last_fullsized":"2024-09-11T05:32:47.726973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:07:32.584388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039722200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.597556+0000","last_change":"2024-09-11T05:32:47.597556+0000","last_active":"2024-09-11T05:32:47.597556+0000","last_peered":"2024-09-11T05:32:47.597556+0000","last_clean":"2024-09-11T05:32:47.597556+0000","last_became_active":"2024-09-11T05:32:45.585150+0000","last_became_peered":"2024-09-11T05:32:45.585150+0000","last_unstale":"2024-09-11T05:32:47.597556+0000","last_undegraded":"2024-09-11T05:32:47.597556+0000","last_fullsized":"2024-09-11T05:32:47.597556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:57:16.674978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077988099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.597195+0000","last_change":"2024-09-11T05:32:47.597195+0000","last_active":"2024-09-11T05:32:47.597195+0000","last_peered":"2024-09-11T05:32:47.597195+0000","last_clean":"2024-09-11T05:32:47.597195+0000","last_became_active":"2024-09-11T05:32:45.582294+0000","last_became_peered":"2024-09-11T05:32:45.582294+0000","last_unstale":"2024-09-11T05:32:47.597195+0000","last_undegraded":"2024-09-11T05:32:47.597195+0000","last_fullsized":"2024-09-11T05:32:47.597195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:49:22.206673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045578900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.726114+0000","last_change":"2024-09-11T05:32:39.551254+0000","last_active":"2024-09-11T05:32:47.726114+0000","last_peered":"2024-09-11T05:32:47.726114+0000","last_clean":"2024-09-11T05:32:47.726114+0000","last_became_active":"2024-09-11T05:32:39.550968+0000","last_became_peered":"2024-09-11T05:32:39.550968+0000","last_unstale":"2024-09-11T05:32:47.726114+0000","last_undegraded":"2024-09-11T05:32:47.726114+0000","last_fullsized":"2024-09-11T05:32:47.726114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:09.466849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":661969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":71620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":661969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:32:52.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:32:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:32:52.874 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:32:52.886 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-11T05:32:51.947974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235728,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738992,"statfs":{"total":773094113280,"available":772852727808,"internally_reserved":0,"allocated":2899968,"data_stored":1753582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.371935"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.598023+0000","last_change":"2024-09-11T05:32:47.598023+0000","last_active":"2024-09-11T05:32:47.598023+0000","last_peered":"2024-09-11T05:32:47.598023+0000","last_clean":"2024-09-11T05:32:47.598023+0000","last_became_active":"2024-09-11T05:32:45.702003+0000","last_became_peered":"2024-09-11T05:32:45.702003+0000","last_unstale":"2024-09-11T05:32:47.598023+0000","last_undegraded":"2024-09-11T05:32:47.598023+0000","last_fullsized":"2024-09-11T05:32:47.598023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:08.654916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.594128+0000","last_change":"2024-09-11T05:32:47.594128+0000","last_active":"2024-09-11T05:32:47.594128+0000","last_peered":"2024-09-11T05:32:47.594128+0000","last_clean":"2024-09-11T05:32:47.594128+0000","last_became_active":"2024-09-11T05:32:45.702044+0000","last_became_peered":"2024-09-11T05:32:45.702044+0000","last_unstale":"2024-09-11T05:32:47.594128+0000","last_undegraded":"2024-09-11T05:32:47.594128+0000","last_fullsized":"2024-09-11T05:32:47.594128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:48:32.373840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038977499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.597274+0000","last_change":"2024-09-11T05:32:47.597274+0000","last_active":"2024-09-11T05:32:47.597274+0000","last_peered":"2024-09-11T05:32:47.597274+0000","last_clean":"2024-09-11T05:32:47.597274+0000","last_became_active":"2024-09-11T05:32:45.582056+0000","last_became_peered":"2024-09-11T05:32:45.582056+0000","last_unstale":"2024-09-11T05:32:47.597274+0000","last_undegraded":"2024-09-11T05:32:47.597274+0000","last_fullsized":"2024-09-11T05:32:47.597274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:44:01.356958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.727035+0000","last_change":"2024-09-11T05:32:47.727035+0000","last_active":"2024-09-11T05:32:47.727035+0000","last_peered":"2024-09-11T05:32:47.727035+0000","last_clean":"2024-09-11T05:32:47.727035+0000","last_became_active":"2024-09-11T05:32:45.702510+0000","last_became_peered":"2024-09-11T05:32:45.702510+0000","last_unstale":"2024-09-11T05:32:47.727035+0000","last_undegraded":"2024-09-11T05:32:47.727035+0000","last_fullsized":"2024-09-11T05:32:47.727035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:35:31.635413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.598588+0000","last_change":"2024-09-11T05:32:47.597956+0000","last_active":"2024-09-11T05:32:47.598588+0000","last_peered":"2024-09-11T05:32:47.598588+0000","last_clean":"2024-09-11T05:32:47.598588+0000","last_became_active":"2024-09-11T05:32:45.702439+0000","last_became_peered":"2024-09-11T05:32:45.702439+0000","last_unstale":"2024-09-11T05:32:47.598588+0000","last_undegraded":"2024-09-11T05:32:47.598588+0000","last_fullsized":"2024-09-11T05:32:47.598588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:27:05.110151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195137,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.726973+0000","last_change":"2024-09-11T05:32:47.726973+0000","last_active":"2024-09-11T05:32:47.726973+0000","last_peered":"2024-09-11T05:32:47.726973+0000","last_clean":"2024-09-11T05:32:47.726973+0000","last_became_active":"2024-09-11T05:32:45.585103+0000","last_became_peered":"2024-09-11T05:32:45.585103+0000","last_unstale":"2024-09-11T05:32:47.726973+0000","last_undegraded":"2024-09-11T05:32:47.726973+0000","last_fullsized":"2024-09-11T05:32:47.726973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:07:32.584388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039722200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.597556+0000","last_change":"2024-09-11T05:32:47.597556+0000","last_active":"2024-09-11T05:32:47.597556+0000","last_peered":"2024-09-11T05:32:47.597556+0000","last_clean":"2024-09-11T05:32:47.597556+0000","last_became_active":"2024-09-11T05:32:45.585150+0000","last_became_peered":"2024-09-11T05:32:45.585150+0000","last_unstale":"2024-09-11T05:32:47.597556+0000","last_undegraded":"2024-09-11T05:32:47.597556+0000","last_fullsized":"2024-09-11T05:32:47.597556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:57:16.674978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077988099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.597195+0000","last_change":"2024-09-11T05:32:47.597195+0000","last_active":"2024-09-11T05:32:47.597195+0000","last_peered":"2024-09-11T05:32:47.597195+0000","last_clean":"2024-09-11T05:32:47.597195+0000","last_became_active":"2024-09-11T05:32:45.582294+0000","last_became_peered":"2024-09-11T05:32:45.582294+0000","last_unstale":"2024-09-11T05:32:47.597195+0000","last_undegraded":"2024-09-11T05:32:47.597195+0000","last_fullsized":"2024-09-11T05:32:47.597195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:49:22.206673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045578900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T05:32:47.726114+0000","last_change":"2024-09-11T05:32:39.551254+0000","last_active":"2024-09-11T05:32:47.726114+0000","last_peered":"2024-09-11T05:32:47.726114+0000","last_clean":"2024-09-11T05:32:47.726114+0000","last_became_active":"2024-09-11T05:32:39.550968+0000","last_became_peered":"2024-09-11T05:32:39.550968+0000","last_unstale":"2024-09-11T05:32:47.726114+0000","last_undegraded":"2024-09-11T05:32:47.726114+0000","last_fullsized":"2024-09-11T05:32:47.726114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:09.466849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":661969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":71620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":661969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":212992,"data_stored":71601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:32:52.887 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T05:32:52.887 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-11T05:32:53.161 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 21 2024-09-11T05:32:53.162 INFO:teuthology.orchestra.run.smithi070.stdout:fsid eb5ff116-0384-4170-94d3-d3ddcb9c254f 2024-09-11T05:32:53.162 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-11T05:32:25.817911+0000 2024-09-11T05:32:53.162 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-09-11T05:32:47.586220+0000 2024-09-11T05:32:53.162 INFO:teuthology.orchestra.run.smithi070.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T05:32:53.162 INFO:teuthology.orchestra.run.smithi070.stdout:crush_version 5 2024-09-11T05:32:53.162 INFO:teuthology.orchestra.run.smithi070.stdout:full_ratio 0.95 2024-09-11T05:32:53.162 INFO:teuthology.orchestra.run.smithi070.stdout:backfillfull_ratio 0.9 2024-09-11T05:32:53.162 INFO:teuthology.orchestra.run.smithi070.stdout:nearfull_ratio 0.85 2024-09-11T05:32:53.162 INFO:teuthology.orchestra.run.smithi070.stdout:require_min_compat_client luminous 2024-09-11T05:32:53.162 INFO:teuthology.orchestra.run.smithi070.stdout:min_compat_client jewel 2024-09-11T05:32:53.162 INFO:teuthology.orchestra.run.smithi070.stdout:require_osd_release squid 2024-09-11T05:32:53.163 INFO:teuthology.orchestra.run.smithi070.stdout:stretch_mode_enabled false 2024-09-11T05:32:53.163 INFO:teuthology.orchestra.run.smithi070.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-11T05:32:53.163 INFO:teuthology.orchestra.run.smithi070.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 21 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 4.98 2024-09-11T05:32:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: removed_snaps_queue [2~1] 2024-09-11T05:32:53.163 INFO:teuthology.orchestra.run.smithi070.stdout:max_osd 8 2024-09-11T05:32:53.163 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6818/4108497907,v1:172.21.15.70:6819/4108497907] [v2:172.21.15.70:6820/4108497907,v1:172.21.15.70:6821/4108497907] exists,up 6ef7487b-9326-4062-8fe4-ef39030252bd 2024-09-11T05:32:53.163 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 up in weight 1 up_from 14 up_thru 15 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6800/3979396531,v1:172.21.15.70:6801/3979396531] [v2:172.21.15.70:6802/3979396531,v1:172.21.15.70:6803/3979396531] exists,up 3e0d8348-6e1b-4d63-b0f1-c20d90d73760 2024-09-11T05:32:53.163 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6810/4053894977,v1:172.21.15.70:6811/4053894977] [v2:172.21.15.70:6812/4053894977,v1:172.21.15.70:6813/4053894977] exists,up 38bbb42f-85e2-4064-8f55-e0385aff07d4 2024-09-11T05:32:53.163 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6826/2067624829,v1:172.21.15.70:6827/2067624829] [v2:172.21.15.70:6828/2067624829,v1:172.21.15.70:6829/2067624829] exists,up e96ca529-f3b3-4f7e-bd59-1e9872a5efab 2024-09-11T05:32:53.163 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6816/1743986256,v1:172.21.15.84:6817/1743986256] [v2:172.21.15.84:6818/1743986256,v1:172.21.15.84:6819/1743986256] exists,up dbbde660-d90e-4e02-9a01-16b0f76aa2b8 2024-09-11T05:32:53.163 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6824/2732588656,v1:172.21.15.84:6825/2732588656] [v2:172.21.15.84:6826/2732588656,v1:172.21.15.84:6827/2732588656] exists,up 2dc1a002-3ec0-4b4d-b84d-e684fa8a9131 2024-09-11T05:32:53.163 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6800/372011645,v1:172.21.15.84:6801/372011645] [v2:172.21.15.84:6802/372011645,v1:172.21.15.84:6803/372011645] exists,up 4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a 2024-09-11T05:32:53.163 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6808/583221652,v1:172.21.15.84:6809/583221652] [v2:172.21.15.84:6810/583221652,v1:172.21.15.84:6811/583221652] exists,up 5fef4450-317c-4e1f-b05b-80740b9538f1 2024-09-11T05:32:53.174 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6818/4108497907,v1:172.21.15.70:6819/4108497907] [v2:172.21.15.70:6820/4108497907,v1:172.21.15.70:6821/4108497907] exists,up 6ef7487b-9326-4062-8fe4-ef39030252bd', 'osd.1 up in weight 1 up_from 14 up_thru 15 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6800/3979396531,v1:172.21.15.70:6801/3979396531] [v2:172.21.15.70:6802/3979396531,v1:172.21.15.70:6803/3979396531] exists,up 3e0d8348-6e1b-4d63-b0f1-c20d90d73760', 'osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6810/4053894977,v1:172.21.15.70:6811/4053894977] [v2:172.21.15.70:6812/4053894977,v1:172.21.15.70:6813/4053894977] exists,up 38bbb42f-85e2-4064-8f55-e0385aff07d4', 'osd.3 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6826/2067624829,v1:172.21.15.70:6827/2067624829] [v2:172.21.15.70:6828/2067624829,v1:172.21.15.70:6829/2067624829] exists,up e96ca529-f3b3-4f7e-bd59-1e9872a5efab', 'osd.4 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6816/1743986256,v1:172.21.15.84:6817/1743986256] [v2:172.21.15.84:6818/1743986256,v1:172.21.15.84:6819/1743986256] exists,up dbbde660-d90e-4e02-9a01-16b0f76aa2b8', 'osd.5 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6824/2732588656,v1:172.21.15.84:6825/2732588656] [v2:172.21.15.84:6826/2732588656,v1:172.21.15.84:6827/2732588656] exists,up 2dc1a002-3ec0-4b4d-b84d-e684fa8a9131', 'osd.6 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6800/372011645,v1:172.21.15.84:6801/372011645] [v2:172.21.15.84:6802/372011645,v1:172.21.15.84:6803/372011645] exists,up 4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a', 'osd.7 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6808/583221652,v1:172.21.15.84:6809/583221652] [v2:172.21.15.84:6810/583221652,v1:172.21.15.84:6811/583221652] exists,up 5fef4450-317c-4e1f-b05b-80740b9538f1'] 2024-09-11T05:32:53.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-11T05:32:53.272 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:32:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mon.a", 2024-09-11T05:32:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster": "ceph", 2024-09-11T05:32:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-11T05:32:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "admin_socket_mode": "", 2024-09-11T05:32:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-11T05:32:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_client_required": "cephx, none", 2024-09-11T05:32:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_cluster_required": "cephx", 2024-09-11T05:32:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_debug": "true", 2024-09-11T05:32:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-11T05:32:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-11T05:32:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_service_required": "cephx", 2024-09-11T05:32:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-11T05:32:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_supported": "cephx", 2024-09-11T05:32:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio": "true", 2024-09-11T05:32:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-11T05:32:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_poll_ms": "250", 2024-09-11T05:32:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_reap_max": "16", 2024-09-11T05:32:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_async_discard": "false", 2024-09-11T05:32:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_block_size": "4096", 2024-09-11T05:32:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio": "false", 2024-09-11T05:32:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-11T05:32:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-11T05:32:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_inflight_ios": "false", 2024-09-11T05:32:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_enable_discard": "false", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_flock_retry": "3", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_inject_crash": "0", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring": "false", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring_hipri": "false", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_type": "", 2024-09-11T05:32:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_alloc_size": "1048576", 2024-09-11T05:32:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_allocator": "hybrid", 2024-09-11T05:32:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_buffered_io": "true", 2024-09-11T05:32:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_for_zeros": "false", 2024-09-11T05:32:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-11T05:32:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-11T05:32:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_compact_log_sync": "false", 2024-09-11T05:32:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-11T05:32:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-11T05:32:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-11T05:32:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-11T05:32:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_max_log_runway": "4194304", 2024-09-11T05:32:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_max_prefetch": "1048576", 2024-09-11T05:32:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_min_flush_size": "524288", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_min_log_runway": "1048576", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_replay_recovery": "false", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_sync_write": "false", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_allocation_from_file": "true", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_allocator": "hybrid", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-11T05:32:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bdev_label_multi": "true", 2024-09-11T05:32:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-11T05:32:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-11T05:32:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-11T05:32:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-11T05:32:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-11T05:32:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_create": "true", 2024-09-11T05:32:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_create": "false", 2024-09-11T05:32:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_path": "", 2024-09-11T05:32:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_size": "0", 2024-09-11T05:32:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_path": "", 2024-09-11T05:32:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_preallocate_file": "false", 2024-09-11T05:32:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_size": "107374182400", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_create": "false", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_path": "", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_size": "100663296", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs": "true", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_autotune": "true", 2024-09-11T05:32:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size": "0", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_type": "2q", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_clone_cow": "true", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-11T05:32:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-11T05:32:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-11T05:32:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-11T05:32:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-11T05:32:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-11T05:32:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_mode": "none", 2024-09-11T05:32:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-11T05:32:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_csum_type": "crc32c", 2024-09-11T05:32:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-11T05:32:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_freelist": "false", 2024-09-11T05:32:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-11T05:32:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-11T05:32:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-11T05:32:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_small_allocations": "0", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_default_buffered_read": "true", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_default_buffered_write": "false", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-11T05:32:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fail_eio": "false", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-11T05:32:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-11T05:32:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mount": "false", 2024-09-11T05:32:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-11T05:32:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_umount": "false", 2024-09-11T05:32:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-11T05:32:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-11T05:32:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-11T05:32:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-11T05:32:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-11T05:32:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-11T05:32:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-11T05:32:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-11T05:32:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_ignore_data_csum": "false", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_op_age": "5.000000", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_alloc_size": "0", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size": "0", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_deferred_txc": "32", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size": "0", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-11T05:32:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_nid_prealloc": "1024", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_retry_disk_reads": "3", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_cf": "true", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-11T05:32:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_mem": "512", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_tracing": "false", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-11T05:32:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-11T05:32:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-11T05:32:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-11T05:32:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-11T05:32:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-11T05:32:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-11T05:32:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_zero_block_detection": "false", 2024-09-11T05:32:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-11T05:32:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-11T05:32:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-11T05:32:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-11T05:32:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-11T05:32:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-11T05:32:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_cluster_require_signatures": "false", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_cluster_require_version": "2", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_require_signatures": "false", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_require_version": "2", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_service_require_signatures": "false", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_service_require_version": "2", 2024-09-11T05:32:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_sign_messages": "true", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "chdir": "", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_acl_type": "", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_asio_thread_count": "2", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_cache_mid": "0.750000", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_cache_size": "16384", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_caps_release_delay": "5", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_check_pool_perm": "true", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_force_sync_read": "false", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_getattr_caps": "false", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_inject_features": "", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_inject_tick_delay": "0", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-11T05:32:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_die_on_failed_remount": "false", 2024-09-11T05:32:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_dirsize_rbytes": "true", 2024-09-11T05:32:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_force_lazyio": "false", 2024-09-11T05:32:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_fs": "", 2024-09-11T05:32:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-11T05:32:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_inject_release_failure": "false", 2024-09-11T05:32:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_max_inline_size": "4096", 2024-09-11T05:32:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-11T05:32:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mds_namespace": "", 2024-09-11T05:32:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_metadata": "", 2024-09-11T05:32:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_gid": "-1", 2024-09-11T05:32:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_timeout": "300", 2024-09-11T05:32:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_uid": "-1", 2024-09-11T05:32:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mountpoint": "/", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_notify_timeout": "10", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc": "true", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_dirty": "104857600", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_objects": "1000", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_size": "209715200", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_target_dirty": "8388608", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_permissions": "true", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_quota": "true", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_quota_df": "true", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_max_bytes": "0", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_max_periods": "4", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_min": "131072", 2024-09-11T05:32:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_reconnect_stale": "false", 2024-09-11T05:32:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_shutdown_timeout": "30", 2024-09-11T05:32:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_snapdir": ".snap", 2024-09-11T05:32:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_tick_interval": "1", 2024-09-11T05:32:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_trace": "", 2024-09-11T05:32:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_try_dentry_invalidate": "false", 2024-09-11T05:32:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_use_faked_inos": "false", 2024-09-11T05:32:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_use_random_mds": "false", 2024-09-11T05:32:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog": "false", 2024-09-11T05:32:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-11T05:32:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog_port": "12201", 2024-09-11T05:32:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_monitors": "default=true", 2024-09-11T05:32:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog": "false", 2024-09-11T05:32:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-11T05:32:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog_level": "info", 2024-09-11T05:32:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "-", 2024-09-11T05:32:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_network": "", 2024-09-11T05:32:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_network_interface": "", 2024-09-11T05:32:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_isal": "false", 2024-09-11T05:32:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_level": "5", 2024-09-11T05:32:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_winsize": "-15", 2024-09-11T05:32:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zstd_level": "1", 2024-09-11T05:32:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-11T05:32:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-11T05:32:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_alien_op_num_threads": "6", 2024-09-11T05:32:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-11T05:32:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-11T05:32:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-11T05:32:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_stat_interval": "0", 2024-09-11T05:32:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_seastar_cpu_cores": "", 2024-09-11T05:32:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_seastar_num_threads": "0", 2024-09-11T05:32:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location": "", 2024-09-11T05:32:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location_hook": "", 2024-09-11T05:32:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location_hook_timeout": "10", 2024-09-11T05:32:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "daemonize": "false", 2024-09-11T05:32:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "daos_pool": "tank", 2024-09-11T05:32:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-11T05:32:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-11T05:32:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-11T05:32:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_alienstore": "0/5", 2024-09-11T05:32:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_allow_any_pool_priority": "false", 2024-09-11T05:32:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asok": "1/5", 2024-09-11T05:32:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asok_assert_abort": "false", 2024-09-11T05:32:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asserts_on_shutdown": "true", 2024-09-11T05:32:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_auth": "20/20", 2024-09-11T05:32:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bdev": "1/3", 2024-09-11T05:32:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bluefs": "1/5", 2024-09-11T05:32:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bluestore": "1/5", 2024-09-11T05:32:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_buffer": "0/1", 2024-09-11T05:32:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_ceph_exporter": "1/5", 2024-09-11T05:32:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cephfs_mirror": "0/5", 2024-09-11T05:32:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cephsqlite": "0/5", 2024-09-11T05:32:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_client": "0/5", 2024-09-11T05:32:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_compressor": "1/5", 2024-09-11T05:32:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_context": "0/1", 2024-09-11T05:32:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crimson_interrupt": "0/5", 2024-09-11T05:32:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crush": "1/1", 2024-09-11T05:32:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crypto": "1/5", 2024-09-11T05:32:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cyanstore": "0/5", 2024-09-11T05:32:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_deliberately_leak_memory": "false", 2024-09-11T05:32:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_disable_randomized_ping": "false", 2024-09-11T05:32:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_dpdk": "1/5", 2024-09-11T05:32:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_eventtrace": "1/5", 2024-09-11T05:32:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_filer": "0/1", 2024-09-11T05:32:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_filestore": "1/3", 2024-09-11T05:32:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_finisher": "1/1", 2024-09-11T05:32:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_fuse": "1/5", 2024-09-11T05:32:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_heartbeat_testing_span": "0", 2024-09-11T05:32:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_heartbeatmap": "1/5", 2024-09-11T05:32:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-11T05:32:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_javaclient": "1/5", 2024-09-11T05:32:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_journal": "1/3", 2024-09-11T05:32:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_journaler": "0/5", 2024-09-11T05:32:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_kstore": "1/5", 2024-09-11T05:32:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_lockdep": "0/1", 2024-09-11T05:32:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mclock": "1/5", 2024-09-11T05:32:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds": "1/5", 2024-09-11T05:32:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_balancer": "1/5", 2024-09-11T05:32:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_locker": "1/5", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_log": "1/5", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_log_expire": "1/5", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_migrator": "1/5", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_quiesce": "3/5", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_memstore": "1/5", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mgr": "2/5", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mgrc": "1/5", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mon": "20/20", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_monc": "0/10", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_ms": "1/1", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_none": "0/5", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objclass": "0/5", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objectcacher": "0/5", 2024-09-11T05:32:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objecter": "0/1", 2024-09-11T05:32:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_optracker": "0/5", 2024-09-11T05:32:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_osd": "1/5", 2024-09-11T05:32:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_paxos": "20/20", 2024-09-11T05:32:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_perfcounter": "1/5", 2024-09-11T05:32:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_prioritycache": "1/5", 2024-09-11T05:32:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rados": "0/5", 2024-09-11T05:32:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd": "0/5", 2024-09-11T05:32:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_mirror": "0/5", 2024-09-11T05:32:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_pwl": "0/5", 2024-09-11T05:32:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_replay": "0/5", 2024-09-11T05:32:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_refs": "0/0", 2024-09-11T05:32:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_reserver": "1/1", 2024-09-11T05:32:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw": "1/5", 2024-09-11T05:32:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_access": "1/5", 2024-09-11T05:32:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_datacache": "1/5", 2024-09-11T05:32:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_dbstore": "1/5", 2024-09-11T05:32:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_flight": "1/5", 2024-09-11T05:32:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-11T05:32:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_sync": "1/5", 2024-09-11T05:32:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rocksdb": "4/5", 2024-09-11T05:32:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore": "0/5", 2024-09-11T05:32:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_backref": "0/5", 2024-09-11T05:32:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_cache": "0/5", 2024-09-11T05:32:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_cleaner": "0/5", 2024-09-11T05:32:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_device": "0/5", 2024-09-11T05:32:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_epm": "0/5", 2024-09-11T05:32:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-11T05:32:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_journal": "0/5", 2024-09-11T05:32:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_lba": "0/5", 2024-09-11T05:32:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_odata": "0/5", 2024-09-11T05:32:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_omap": "0/5", 2024-09-11T05:32:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_onode": "0/5", 2024-09-11T05:32:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_t": "0/5", 2024-09-11T05:32:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_tm": "0/5", 2024-09-11T05:32:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_striper": "0/1", 2024-09-11T05:32:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_test": "0/5", 2024-09-11T05:32:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_throttle": "1/1", 2024-09-11T05:32:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_timer": "0/1", 2024-09-11T05:32:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_tp": "0/5", 2024-09-11T05:32:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_trace": "1/5", 2024-09-11T05:32:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-11T05:32:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "device_failure_prediction_mode": "none", 2024-09-11T05:32:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-11T05:32:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-11T05:32:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_graylog": "false", 2024-09-11T05:32:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_journald": "false", 2024-09-11T05:32:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_stderr": "true", 2024-09-11T05:32:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_syslog": "false", 2024-09-11T05:32:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event_tracing": "false", 2024-09-11T05:32:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_addr": "0.0.0.0", 2024-09-11T05:32:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_http_port": "9926", 2024-09-11T05:32:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_prio_limit": "5", 2024-09-11T05:32:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-11T05:32:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_sort_metrics": "true", 2024-09-11T05:32:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_stats_period": "5", 2024-09-11T05:32:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "fake_statfs_for_testing": "0", 2024-09-11T05:32:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "fatal_signal_handlers": "true", 2024-09-11T05:32:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "filer_max_purge_ops": "10", 2024-09-11T05:32:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "filer_max_truncate_ops": "128", 2024-09-11T05:32:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_apply_finisher_threads": "1", 2024-09-11T05:32:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_blackhole": "false", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_btrfs_clone_range": "true", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_btrfs_snap": "true", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_caller_concurrency": "10", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_collect_device_partition_information": "true", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_commit_timeout": "600.000000", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_inject_read_err": "false", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_omap_check": "false", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_verify_split": "false", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_dump_file": "", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fadvise": "true", 2024-09-11T05:32:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fail_eio": "true", 2024-09-11T05:32:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fd_cache_shards": "16", 2024-09-11T05:32:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fd_cache_size": "128", 2024-09-11T05:32:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fiemap": "false", 2024-09-11T05:32:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fiemap_threshold": "4096", 2024-09-11T05:32:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-11T05:32:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-11T05:32:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_inject_stall": "0", 2024-09-11T05:32:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_parallel": "false", 2024-09-11T05:32:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_trailing": "false", 2024-09-11T05:32:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_writeahead": "false", 2024-09-11T05:32:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_kill_at": "0", 2024-09-11T05:32:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-11T05:32:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs": "0", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size": "0", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_merge_threshold": "-10", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-11T05:32:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_odsync_write": "false", 2024-09-11T05:32:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_backend": "rocksdb", 2024-09-11T05:32:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_backend_path": "", 2024-09-11T05:32:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-11T05:32:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-11T05:32:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-11T05:32:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_thread_timeout": "60", 2024-09-11T05:32:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_threads": "2", 2024-09-11T05:32:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_punch_hole": "false", 2024-09-11T05:32:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-11T05:32:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-11T05:32:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-11T05:32:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-11T05:32:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-11T05:32:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-11T05:32:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-11T05:32:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-11T05:32:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-11T05:32:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_ops": "50", 2024-09-11T05:32:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-11T05:32:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_seek_data_hole": "false", 2024-09-11T05:32:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_sloppy_crc": "false", 2024-09-11T05:32:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-11T05:32:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_splice": "false", 2024-09-11T05:32:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_split_multiple": "2", 2024-09-11T05:32:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_split_rand_factor": "20", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_update_to": "1000", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_enable": "true", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-11T05:32:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-11T05:32:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_xfs_extsize": "false", 2024-09-11T05:32:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_zfs_snap": "false", 2024-09-11T05:32:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "fio_dir": "/tmp/fio", 2024-09-11T05:32:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "eb5ff116-0384-4170-94d3-d3ddcb9c254f", 2024-09-11T05:32:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_allow_other": "true", 2024-09-11T05:32:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_atomic_o_trunc": "true", 2024-09-11T05:32:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_big_writes": "true", 2024-09-11T05:32:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_debug": "false", 2024-09-11T05:32:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_default_permissions": "false", 2024-09-11T05:32:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_disable_pagecache": "false", 2024-09-11T05:32:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_max_write": "0", 2024-09-11T05:32:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_multithreaded": "true", 2024-09-11T05:32:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_require_active_mds": "true", 2024-09-11T05:32:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_set_user_groups": "true", 2024-09-11T05:32:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_move": "true", 2024-09-11T05:32:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_read": "true", 2024-09-11T05:32:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_write": "true", 2024-09-11T05:32:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-11T05:32:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_use_invalidate_cb": "true", 2024-09-11T05:32:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-11T05:32:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "gss_target_name": "ceph", 2024-09-11T05:32:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_file": "", 2024-09-11T05:32:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_inject_failure": "0", 2024-09-11T05:32:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_interval": "5", 2024-09-11T05:32:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "host": "smithi070", 2024-09-11T05:32:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-11T05:32:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-11T05:32:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-11T05:32:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-11T05:32:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-11T05:32:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-11T05:32:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-11T05:32:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-11T05:32:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-11T05:32:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-11T05:32:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-11T05:32:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-11T05:32:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-11T05:32:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "inject_early_sigterm": "false", 2024-09-11T05:32:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "jaeger_agent_port": "6799", 2024-09-11T05:32:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "jaeger_tracing_enable": "false", 2024-09-11T05:32:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_aio": "true", 2024-09-11T05:32:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_align_min_size": "65536", 2024-09-11T05:32:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_block_align": "true", 2024-09-11T05:32:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_block_size": "4096", 2024-09-11T05:32:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_dio": "true", 2024-09-11T05:32:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_discard": "false", 2024-09-11T05:32:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_force_aio": "false", 2024-09-11T05:32:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_ignore_corruption": "false", 2024-09-11T05:32:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_max_write_bytes": "10485760", 2024-09-11T05:32:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_max_write_entries": "100", 2024-09-11T05:32:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_replay_from": "0", 2024-09-11T05:32:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-11T05:32:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-11T05:32:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-11T05:32:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-11T05:32:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_write_header_frequency": "0", 2024-09-11T05:32:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_zero_on_create": "false", 2024-09-11T05:32:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_prefetch_periods": "10", 2024-09-11T05:32:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_prezero_periods": "5", 2024-09-11T05:32:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_write_head_interval": "15", 2024-09-11T05:32:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "", 2024-09-11T05:32:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "keyfile": "", 2024-09-11T05:32:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-11T05:32:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_backend": "rocksdb", 2024-09-11T05:32:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_default_stripe_size": "65536", 2024-09-11T05:32:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_fsck_on_mount": "false", 2024-09-11T05:32:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-11T05:32:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_max_bytes": "67108864", 2024-09-11T05:32:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_max_ops": "512", 2024-09-11T05:32:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_nid_prealloc": "1024", 2024-09-11T05:32:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_onode_map_size": "1024", 2024-09-11T05:32:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-11T05:32:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_sync_submit_transaction": "false", 2024-09-11T05:32:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_sync_transaction": "false", 2024-09-11T05:32:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "librados_thread_count": "2", 2024-09-11T05:32:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "lockdep": "false", 2024-09-11T05:32:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "lockdep_force_backtrace": "false", 2024-09-11T05:32:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "log_coarse_timestamps": "true", 2024-09-11T05:32:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-11T05:32:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "log_flush_on_exit": "false", 2024-09-11T05:32:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "log_graylog_host": "127.0.0.1", 2024-09-11T05:32:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "log_graylog_port": "12201", 2024-09-11T05:32:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "log_max_new": "1000", 2024-09-11T05:32:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "log_max_recent": "10000", 2024-09-11T05:32:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "log_stderr_prefix": "", 2024-09-11T05:32:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "log_stop_at_utilization": "0.970000", 2024-09-11T05:32:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": "true", 2024-09-11T05:32:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_graylog": "false", 2024-09-11T05:32:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_journald": "false", 2024-09-11T05:32:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_stderr": "false", 2024-09-11T05:32:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_syslog": "false", 2024-09-11T05:32:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "max_rotating_auth_attempts": "10", 2024-09-11T05:32:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-11T05:32:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_action_on_write_error": "1", 2024-09-11T05:32:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_alternate_name_max": "8192", 2024-09-11T05:32:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_asio_thread_count": "2", 2024-09-11T05:32:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_export_pin": "true", 2024-09-11T05:32:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_dirs": "true", 2024-09-11T05:32:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-11T05:32:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_interval": "5", 2024-09-11T05:32:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-11T05:32:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-11T05:32:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_interval": "10", 2024-09-11T05:32:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_max": "-1", 2024-09-11T05:32:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_max_until": "-1", 2024-09-11T05:32:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_merge_size": "50", 2024-09-11T05:32:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_midchunk": "0.300000", 2024-09-11T05:32:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-11T05:32:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_min_start": "0.200000", 2024-09-11T05:32:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_minchunk": "0.001000", 2024-09-11T05:32:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_mode": "0", 2024-09-11T05:32:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_need_max": "1.200000", 2024-09-11T05:32:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_need_min": "0.800000", 2024-09-11T05:32:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_overload_epochs": "2", 2024-09-11T05:32:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-11T05:32:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-11T05:32:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_bits": "3", 2024-09-11T05:32:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-11T05:32:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_size": "10000", 2024-09-11T05:32:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-11T05:32:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_target_decay": "10.000000", 2024-09-11T05:32:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-11T05:32:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_grace": "15.000000", 2024-09-11T05:32:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_interval": "4.000000", 2024-09-11T05:32:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-11T05:32:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-11T05:32:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_mid": "0.700000", 2024-09-11T05:32:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-11T05:32:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_delay": "0", 2024-09-11T05:32:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-11T05:32:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-11T05:32:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_release_free_interval": "10", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_reservation": "0.050000", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_interval": "1", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_threshold": "262144", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_prealloc_inos": "1000", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_connect_bootstrapping": "false", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_damage_table_max_entries": "10000", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_auth_pins": "false", 2024-09-11T05:32:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_frag": "false", 2024-09-11T05:32:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_scatterstat": "false", 2024-09-11T05:32:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_subtrees": "false", 2024-09-11T05:32:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_decay_halflife": "5.000000", 2024-09-11T05:32:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_default_dir_hash": "2", 2024-09-11T05:32:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_defer_session_stale": "true", 2024-09-11T05:32:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_deny_all_reconnect": "false", 2024-09-11T05:32:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_keys_per_op": "16384", 2024-09-11T05:32:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_max_commit_size": "10", 2024-09-11T05:32:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_max_entries": "0", 2024-09-11T05:32:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_prefetch": "true", 2024-09-11T05:32:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-11T05:32:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-11T05:32:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_on_map": "false", 2024-09-11T05:32:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-11T05:32:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-11T05:32:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_early_reply": "true", 2024-09-11T05:32:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_enable_op_tracker": "true", 2024-09-11T05:32:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_enforce_unique_name": "true", 2024-09-11T05:32:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-11T05:32:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-11T05:32:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_random": "true", 2024-09-11T05:32:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-11T05:32:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-11T05:32:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-11T05:32:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-11T05:32:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-11T05:32:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-11T05:32:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-11T05:32:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-11T05:32:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_health_summarize_threshold": "10", 2024-09-11T05:32:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-11T05:32:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-11T05:32:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_health_dummy": "false", 2024-09-11T05:32:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-11T05:32:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_migrator_session_race": "false", 2024-09-11T05:32:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-11T05:32:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-11T05:32:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-11T05:32:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_join_fs": "", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_journal_format": "1", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_create_at": "0", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_export_at": "0", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_import_at": "0", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_at": "0", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_expire_at": "0", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_replay_at": "0", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_link_at": "0", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_mdstable_at": "0", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_openc_at": "0", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_rename_at": "0", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_shutdown_at": "0", 2024-09-11T05:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_event_large_threshold": "524288", 2024-09-11T05:32:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_events_per_segment": "1024", 2024-09-11T05:32:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-11T05:32:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_max_events": "-1", 2024-09-11T05:32:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_max_segments": "128", 2024-09-11T05:32:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_pause": "false", 2024-09-11T05:32:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_segment_size": "0", 2024-09-11T05:32:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-11T05:32:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-11T05:32:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-11T05:32:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_trim_threshold": "128", 2024-09-11T05:32:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-11T05:32:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_warn_factor": "2.000000", 2024-09-11T05:32:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_caps_per_client": "1048576", 2024-09-11T05:32:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_completed_flushes": "100000", 2024-09-11T05:32:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_completed_requests": "100000", 2024-09-11T05:32:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_export_size": "20971520", 2024-09-11T05:32:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_file_recover": "32", 2024-09-11T05:32:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_files": "64", 2024-09-11T05:32:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_ops": "8192", 2024-09-11T05:32:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-11T05:32:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-11T05:32:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_snaps_per_dir": "100", 2024-09-11T05:32:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_metrics_update_interval": "2", 2024-09-11T05:32:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_min_caps_per_client": "100", 2024-09-11T05:32:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_min_caps_working_set": "10000", 2024-09-11T05:32:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_numa_node": "-1", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_complaint_time": "30.000000", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_duration": "600", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_size": "20", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_slow_op_size": "20", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_log_threshold": "5", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_ping_grace": "15", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_ping_interval": "5", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_caps": "30000", 2024-09-11T05:32:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-11T05:32:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-11T05:32:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-11T05:32:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_warning_threshold": "262144", 2024-09-11T05:32:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-11T05:32:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_replay_interval": "1.000000", 2024-09-11T05:32:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-11T05:32:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-11T05:32:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_root_ino_gid": "0", 2024-09-11T05:32:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_root_ino_uid": "0", 2024-09-11T05:32:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-11T05:32:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-11T05:32:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-11T05:32:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-11T05:32:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-11T05:32:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-11T05:32:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-11T05:32:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-11T05:32:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-11T05:32:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-11T05:32:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_shutdown_check": "0", 2024-09-11T05:32:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_skip_ino": "0", 2024-09-11T05:32:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-11T05:32:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_max_uid": "4294967294", 2024-09-11T05:32:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_min_uid": "0", 2024-09-11T05:32:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_rstat": "false", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_standby_replay_damaged": "false", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_symlink_recovery": "true", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_thrash_exports": "0", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_thrash_fragments": "0", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_tick_interval": "5.000000", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_valgrind_exit": "false", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_verify_backtrace": "1", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_verify_scatter": "false", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_wipe_sessions": "false", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool_debug": "false", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-11T05:32:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_device_bytes": "1073741824", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_page_set": "false", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_page_size": "65536", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_bytes": "134217728", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_messages": "512", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_disabled_modules": "", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_enable_op_tracker": "true", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_max_pg_num_change": "128", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mds_bytes": "134217728", 2024-09-11T05:32:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mds_messages": "128", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mon_bytes": "134217728", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mon_messages": "128", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_duration": "600", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_size": "20", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_log_threshold": "5", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_osd_bytes": "536870912", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_osd_messages": "8192", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_pool": "true", 2024-09-11T05:32:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-11T05:32:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_standby_modules": "true", 2024-09-11T05:32:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_stats_period": "5", 2024-09-11T05:32:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_stats_threshold": "5", 2024-09-11T05:32:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_tick_period": "2", 2024-09-11T05:32:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-11T05:32:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-11T05:32:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_allow_pool_delete": "true", 2024-09-11T05:32:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_allow_pool_size_one": "true", 2024-09-11T05:32:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_auth_validate_all_caps": "true", 2024-09-11T05:32:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-11T05:32:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-11T05:32:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_bytes": "104857600", 2024-09-11T05:32:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_directed_command_retry": "5", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_parallel": "3", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_log_interval": "1.000000", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_ping_interval": "10.000000", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_target_rank": "-1", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-11T05:32:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_file_level": "debug", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_file": "true", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_journald": "false", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_bootstrap": "false", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_start": "false", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_trim": "true", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-11T05:32:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cpu_threads": "4", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_crush_min_required_version": "hammer", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_daemon_bytes": "419430400", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_avail_crit": "5", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_avail_warn": "5", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_size_warn": "16106127360", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_json": "false", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_transactions": "false", 2024-09-11T05:32:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_extra_checks": "false", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_reef": "false", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_squid": "false", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_down_mkfs_grace": "120", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_down_uptime_grace": "60", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_election_default_strategy": "1", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_election_timeout": "5.000000", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ping_divisor": "2", 2024-09-11T05:32:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_enable_op_tracker": "true", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_fake_pool_delete": "false", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_force_quorum_join": "false", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_globalid_prealloc": "10000", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_detail_to_clog": "false", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_log_update_period": "5", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_max_detail": "50", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog": "true", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog_interval": "600", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_host": "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.84", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_host_override": "", 2024-09-11T05:32:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_initial_members": "", 2024-09-11T05:32:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-11T05:32:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-11T05:32:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-11T05:32:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-11T05:32:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-11T05:32:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease": "5.000000", 2024-09-11T05:32:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-11T05:32:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-11T05:32:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_full_interval": "50", 2024-09-11T05:32:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_max": "10000", 2024-09-11T05:32:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_max_summary": "50", 2024-09-11T05:32:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-11T05:32:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_log_epochs": "500", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_osd": "10000", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_pg_per_osd": "10000", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_pool_pg_num": "65536", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_force_trim_to": "0", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_skip_sanity": "false", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_memory_autotune": "true", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_memory_target": "2147483648", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_beacon_grace": "30", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-11T05:32:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_digest_period": "5", 2024-09-11T05:32:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_inactive_grace": "60", 2024-09-11T05:32:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-11T05:32:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-11T05:32:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_min_osdmap_epochs": "500", 2024-09-11T05:32:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_complaint_time": "30", 2024-09-11T05:32:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_duration": "600", 2024-09-11T05:32:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_size": "20", 2024-09-11T05:32:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_slow_op_size": "20", 2024-09-11T05:32:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-11T05:32:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_log_threshold": "5", 2024-09-11T05:32:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-11T05:32:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-11T05:32:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-11T05:32:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_in": "false", 2024-09-11T05:32:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-11T05:32:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-11T05:32:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-11T05:32:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_cache_size": "500", 2024-09-11T05:32:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-11T05:32:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-11T05:32:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-11T05:32:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_down_out_interval": "600", 2024-09-11T05:32:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-11T05:32:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-11T05:32:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_force_trim_to": "0", 2024-09-11T05:32:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-11T05:32:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-11T05:32:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-11T05:32:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-11T05:32:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-11T05:32:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-11T05:32:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-11T05:32:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-11T05:32:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_down_reporters": "2", 2024-09-11T05:32:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-11T05:32:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-11T05:32:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-11T05:32:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-11T05:32:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-11T05:32:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-11T05:32:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_report_timeout": "900", 2024-09-11T05:32:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-11T05:32:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-11T05:32:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-11T05:32:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-11T05:32:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-11T05:32:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-11T05:32:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-11T05:32:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-11T05:32:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-11T05:32:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_stuck_threshold": "60", 2024-09-11T05:32:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-11T05:32:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-11T05:32:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-11T05:32:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-11T05:32:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-11T05:32:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-11T05:32:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_probe_timeout": "2.000000", 2024-09-11T05:32:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_max_change": "0.050000", 2024-09-11T05:32:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_max_osds": "4", 2024-09-11T05:32:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-11T05:32:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-11T05:32:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-11T05:32:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-11T05:32:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-11T05:32:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_interval": "86400", 2024-09-11T05:32:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_max_keys": "100", 2024-09-11T05:32:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_timeout": "300", 2024-09-11T05:32:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_session_timeout": "300", 2024-09-11T05:32:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_smart_report_timeout": "5", 2024-09-11T05:32:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stat_smooth_intervals": "6", 2024-09-11T05:32:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-11T05:32:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_pool_min_size": "2", 2024-09-11T05:32:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_pool_size": "4", 2024-09-11T05:32:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-11T05:32:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-11T05:32:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_debug": "false", 2024-09-11T05:32:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-11T05:32:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-11T05:32:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_provider_kill_at": "0", 2024-09-11T05:32:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_requester_kill_at": "0", 2024-09-11T05:32:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_timeout": "60.000000", 2024-09-11T05:32:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_target_pg_per_osd": "100", 2024-09-11T05:32:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_tick_interval": "5", 2024-09-11T05:32:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_timecheck_interval": "300.000000", 2024-09-11T05:32:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-11T05:32:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_use_min_delay_socket": "false", 2024-09-11T05:32:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_older_version_delay": "604800", 2024-09-11T05:32:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-11T05:32:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-11T05:32:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-11T05:32:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-11T05:32:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-11T05:32:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-11T05:32:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-11T05:32:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_misplaced": "false", 2024-09-11T05:32:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-11T05:32:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_older_version": "true", 2024-09-11T05:32:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-11T05:32:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-11T05:32:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-11T05:32:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-11T05:32:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-11T05:32:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-11T05:32:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-11T05:32:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-11T05:32:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-11T05:32:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "monmap": "", 2024-09-11T05:32:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-11T05:32:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-11T05:32:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-11T05:32:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-11T05:32:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-11T05:32:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-11T05:32:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_tracing_enabled": "false", 2024-09-11T05:32:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_op_threads": "3", 2024-09-11T05:32:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-11T05:32:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_cm": "false", 2024-09-11T05:32:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_device_name": "", 2024-09-11T05:32:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_dscp": "96", 2024-09-11T05:32:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-11T05:32:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-11T05:32:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_local_gid": "", 2024-09-11T05:32:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-11T05:32:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_port_num": "1", 2024-09-11T05:32:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-11T05:32:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-11T05:32:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-11T05:32:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-11T05:32:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_sl": "3", 2024-09-11T05:32:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_support_srq": "true", 2024-09-11T05:32:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_type": "ib", 2024-09-11T05:32:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_reap_threshold": "5", 2024-09-11T05:32:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_before_connect": "false", 2024-09-11T05:32:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_ipv4": "true", 2024-09-11T05:32:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_ipv6": "false", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_msgr1": "true", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_msgr2": "true", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_port_max": "7568", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_port_min": "6800", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_retry_count": "3", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_retry_delay": "5", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_client": "false", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mds": "false", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mgr": "false", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mon": "false", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_osd": "false", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_client_mode": "crc secure", 2024-09-11T05:32:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_cluster_mode": "crc secure", 2024-09-11T05:32:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_cluster_type": "", 2024-09-11T05:32:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_compress_secure": "false", 2024-09-11T05:32:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_connection_idle_timeout": "900", 2024-09-11T05:32:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_connection_ready_timeout": "10", 2024-09-11T05:32:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_crc_data": "true", 2024-09-11T05:32:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_crc_header": "true", 2024-09-11T05:32:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_bad_msg": "false", 2024-09-11T05:32:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_bug": "true", 2024-09-11T05:32:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_old_message": "true", 2024-09-11T05:32:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_skipped_message": "false", 2024-09-11T05:32:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-11T05:32:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-11T05:32:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_coremask": "0xF", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_enable_tso": "true", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hugepages": "", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_lro": "true", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_memory_channel": "4", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_pmd": "", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_port_id": "0", 2024-09-11T05:32:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-11T05:32:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-11T05:32:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dump_on_send": "false", 2024-09-11T05:32:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_initial_backoff": "0.200000", 2024-09-11T05:32:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_max": "1.000000", 2024-09-11T05:32:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-11T05:32:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_type": "", 2024-09-11T05:32:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-11T05:32:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_network_congestion": "0", 2024-09-11T05:32:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_socket_failures": "5000", 2024-09-11T05:32:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_learn_addr_from_peer": "true", 2024-09-11T05:32:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_max_accept_failures": "4", 2024-09-11T05:32:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_max_backoff": "15.000000", 2024-09-11T05:32:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_client_mode": "secure crc", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_service_mode": "secure crc", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compress_min_size": "1024", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compress_mode": "none", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_pq_min_cost": "65536", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_public_type": "", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_service_mode": "crc secure", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_listen_backlog": "512", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_nodelay": "true", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_rcvbuf": "0", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_type": "async+posix", 2024-09-11T05:32:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "no_config_file": "false", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_completion_locks_per_session": "32", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inflight_ops": "1024", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_tick_interval": "5.000000", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_timeout": "10.000000", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "objectstore_blackhole": "false", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "openssl_engine_opts": "", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_delay_time": "5.000000", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_hist_halflife": "1000", 2024-09-11T05:32:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_max_low_ops": "2", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_max_ops": "4", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_slop": "0.020000", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_asio_thread_count": "2", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_async_recovery_min_cost": "100", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_scan_max": "512", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_scan_min": "64", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_degraded": "false", 2024-09-11T05:32:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_peering": "false", 2024-09-11T05:32:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_unfound": "true", 2024-09-11T05:32:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_beacon_report_interval": "300", 2024-09-11T05:32:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_duration": "30", 2024-09-11T05:32:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-11T05:32:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_max_block_size": "67108864", 2024-09-11T05:32:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-11T05:32:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_blkin_trace_all": "false", 2024-09-11T05:32:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-11T05:32:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-11T05:32:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-11T05:32:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-11T05:32:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_check_for_log_corruption": "false", 2024-09-11T05:32:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_update_on_start": "true", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_message_cap": "256", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_message_size_cap": "524288000", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_op_priority": "63", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_watch_timeout": "30", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_command_max_records": "256", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_compact_on_start": "false", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-11T05:32:53.362 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_update_on_start": "true", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_update_weight_set": "true", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_feed_pullee": "-1", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_misdirected_ops": "false", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_no_acting_change": "false", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_no_purge_strays": "false", 2024-09-11T05:32:53.363 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_op_order": "false", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_shutdown": "false", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_trim_objects": "false", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_snaps": "false", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-11T05:32:53.364 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_keys": "1024", 2024-09-11T05:32:53.365 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-11T05:32:53.365 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-11T05:32:53.365 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-11T05:32:53.365 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_stride": "524288", 2024-09-11T05:32:53.365 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-11T05:32:53.365 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-11T05:32:53.365 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_default_notify_timeout": "30", 2024-09-11T05:32:53.365 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep": "0.000000", 2024-09-11T05:32:53.365 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-11T05:32:53.365 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-11T05:32:53.365 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-11T05:32:53.365 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_discard_disconnected_ops": "true", 2024-09-11T05:32:53.365 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_enable_op_tracker": "true", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_info": "true", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown": "true", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_function_tracing": "false", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_grace": "20", 2024-09-11T05:32:53.366 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_interval": "6", 2024-09-11T05:32:53.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-11T05:32:53.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_peers": "10", 2024-09-11T05:32:53.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_size": "2000", 2024-09-11T05:32:53.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_stale": "600", 2024-09-11T05:32:53.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-11T05:32:53.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_max_size": "100000", 2024-09-11T05:32:53.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_min_size": "1000", 2024-09-11T05:32:53.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-11T05:32:53.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-11T05:32:53.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-11T05:32:53.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-11T05:32:53.367 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-11T05:32:53.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-11T05:32:53.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal_size": "5120", 2024-09-11T05:32:53.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_kill_backfill_at": "0", 2024-09-11T05:32:53.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-11T05:32:53.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_cache_size": "50", 2024-09-11T05:32:53.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_dedup": "true", 2024-09-11T05:32:53.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_message_max": "40", 2024-09-11T05:32:53.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-11T05:32:53.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_share_max_epochs": "40", 2024-09-11T05:32:53.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_attr_name_len": "100", 2024-09-11T05:32:53.368 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_attr_size": "0", 2024-09-11T05:32:53.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_backfills": "1", 2024-09-11T05:32:53.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_markdown_count": "5", 2024-09-11T05:32:53.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_markdown_period": "600", 2024-09-11T05:32:53.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_name_len": "2048", 2024-09-11T05:32:53.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_namespace_len": "256", 2024-09-11T05:32:53.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_size": "134217728", 2024-09-11T05:32:53.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-11T05:32:53.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-11T05:32:53.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_blocked_by": "16", 2024-09-11T05:32:53.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_log_entries": "10000", 2024-09-11T05:32:53.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-11T05:32:53.369 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pgls": "1024", 2024-09-11T05:32:53.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_push_cost": "8388608", 2024-09-11T05:32:53.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_push_objects": "10", 2024-09-11T05:32:53.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_scrubs": "3", 2024-09-11T05:32:53.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-11T05:32:53.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_trimming_pgs": "2", 2024-09-11T05:32:53.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_write_op_reply_len": "64", 2024-09-11T05:32:53.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_write_size": "90", 2024-09-11T05:32:53.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-11T05:32:53.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-11T05:32:53.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-11T05:32:53.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-11T05:32:53.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-11T05:32:53.370 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-11T05:32:53.371 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-11T05:32:53.371 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-11T05:32:53.371 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_profile": "balanced", 2024-09-11T05:32:53.371 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-11T05:32:53.371 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-11T05:32:53.371 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-11T05:32:53.371 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-11T05:32:53.371 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-11T05:32:53.371 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-11T05:32:53.371 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-11T05:32:53.371 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-11T05:32:53.371 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-11T05:32:53.372 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-11T05:32:53.372 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-11T05:32:53.372 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_base": "805306368", 2024-09-11T05:32:53.372 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_cache_min": "134217728", 2024-09-11T05:32:53.372 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-11T05:32:53.372 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-11T05:32:53.372 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target": "4294967296", 2024-09-11T05:32:53.372 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target_autotune": "false", 2024-09-11T05:32:53.372 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-11T05:32:53.372 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_min_pg_log_entries": "250", 2024-09-11T05:32:53.372 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_min_recovery_priority": "0", 2024-09-11T05:32:53.372 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-11T05:32:53.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-11T05:32:53.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_report_interval": "5", 2024-09-11T05:32:53.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-11T05:32:53.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-11T05:32:53.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_num_cache_shards": "32", 2024-09-11T05:32:53.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_num_op_tracker_shard": "32", 2024-09-11T05:32:53.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_auto_affinity": "true", 2024-09-11T05:32:53.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_node": "-1", 2024-09-11T05:32:53.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_prefer_iface": "true", 2024-09-11T05:32:53.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-11T05:32:53.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objecter_finishers": "1", 2024-09-11T05:32:53.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore": "bluestore", 2024-09-11T05:32:53.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore_fuse": "false", 2024-09-11T05:32:53.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore_tracing": "false", 2024-09-11T05:32:53.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_complaint_time": "30.000000", 2024-09-11T05:32:53.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_duration": "600", 2024-09-11T05:32:53.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_size": "20", 2024-09-11T05:32:53.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_slow_op_size": "20", 2024-09-11T05:32:53.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-11T05:32:53.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_log_threshold": "5", 2024-09-11T05:32:53.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards": "0", 2024-09-11T05:32:53.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards_hdd": "5", 2024-09-11T05:32:53.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards_ssd": "8", 2024-09-11T05:32:53.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-11T05:32:53.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-11T05:32:53.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_pq_min_cost": "65536", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_queue_cut_off": "high", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_thread_timeout": "15", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_open_classes_on_start": "true", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_os_flags": "0", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_peering_op_priority": "255", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_delete_cost": "1048576", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_delete_priority": "5", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-11T05:32:53.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-11T05:32:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_trim_max": "10000", 2024-09-11T05:32:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_trim_min": "100", 2024-09-11T05:32:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-11T05:32:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-11T05:32:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-11T05:32:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-11T05:32:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-11T05:32:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-11T05:32:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-11T05:32:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-11T05:32:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-11T05:32:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-11T05:32:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_crimson": "false", 2024-09-11T05:32:53.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-11T05:32:53.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-11T05:32:53.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-11T05:32:53.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-11T05:32:53.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-11T05:32:53.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-11T05:32:53.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-11T05:32:53.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-11T05:32:53.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flags": "0", 2024-09-11T05:32:53.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-11T05:32:53.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_min_size": "0", 2024-09-11T05:32:53.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-11T05:32:53.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pg_num": "32", 2024-09-11T05:32:53.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pgp_num": "0", 2024-09-11T05:32:53.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-11T05:32:53.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_read_ratio": "70", 2024-09-11T05:32:53.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_size": "2", 2024-09-11T05:32:53.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_type": "replicated", 2024-09-11T05:32:53.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-11T05:32:53.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-11T05:32:53.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_push_per_object_cost": "1000", 2024-09-11T05:32:53.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-11T05:32:53.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recover_clone_overlap": "true", 2024-09-11T05:32:53.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-11T05:32:53.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_cost": "20971520", 2024-09-11T05:32:53.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-11T05:32:53.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active": "0", 2024-09-11T05:32:53.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-11T05:32:53.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-11T05:32:53.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-11T05:32:53.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-11T05:32:53.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_single_start": "1", 2024-09-11T05:32:53.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_op_priority": "3", 2024-09-11T05:32:53.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-11T05:32:53.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_priority": "5", 2024-09-11T05:32:53.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-11T05:32:53.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep": "0.000000", 2024-09-11T05:32:53.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-11T05:32:53.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-11T05:32:53.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-11T05:32:53.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_repair_during_recovery": "false", 2024-09-11T05:32:53.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_requested_scrub_priority": "120", 2024-09-11T05:32:53.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-11T05:32:53.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-11T05:32:53.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_auto_repair": "false", 2024-09-11T05:32:53.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-11T05:32:53.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-11T05:32:53.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_begin_hour": "0", 2024-09-11T05:32:53.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_begin_week_day": "0", 2024-09-11T05:32:53.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_chunk_max": "25", 2024-09-11T05:32:53.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_chunk_min": "5", 2024-09-11T05:32:53.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_cost": "52428800", 2024-09-11T05:32:53.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-11T05:32:53.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_during_recovery": "false", 2024-09-11T05:32:53.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_end_hour": "0", 2024-09-11T05:32:53.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_end_week_day": "0", 2024-09-11T05:32:53.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_event_cost": "4096", 2024-09-11T05:32:53.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-11T05:32:53.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-11T05:32:53.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_invalid_stats": "true", 2024-09-11T05:32:53.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-11T05:32:53.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-11T05:32:53.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_max_preemptions": "5", 2024-09-11T05:32:53.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-11T05:32:53.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_priority": "5", 2024-09-11T05:32:53.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_sleep": "0.000000", 2024-09-11T05:32:53.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-11T05:32:53.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-11T05:32:53.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-11T05:32:53.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_skip_data_digest": "false", 2024-09-11T05:32:53.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_smart_report_timeout": "5", 2024-09-11T05:32:53.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_cost": "1048576", 2024-09-11T05:32:53.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_priority": "5", 2024-09-11T05:32:53.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-11T05:32:53.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-11T05:32:53.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-11T05:32:53.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-11T05:32:53.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-11T05:32:53.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-11T05:32:53.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-11T05:32:53.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_target_transaction_size": "30", 2024-09-11T05:32:53.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-11T05:32:53.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-11T05:32:53.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-11T05:32:53.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-11T05:32:53.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-11T05:32:53.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-11T05:32:53.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-11T05:32:53.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-11T05:32:53.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-11T05:32:53.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-11T05:32:53.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tracing": "false", 2024-09-11T05:32:53.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_use_stale_snap": "false", 2024-09-11T05:32:53.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-11T05:32:53.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osdc_blkin_trace_all": "false", 2024-09-11T05:32:53.384 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_kill_at": "0", 2024-09-11T05:32:53.384 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_max_join_drift": "10", 2024-09-11T05:32:53.384 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_min": "500", 2024-09-11T05:32:53.384 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_min_wait": "0.050000", 2024-09-11T05:32:53.384 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_propose_interval": "1.000000", 2024-09-11T05:32:53.385 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_max": "500", 2024-09-11T05:32:53.385 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-11T05:32:53.385 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_min": "250", 2024-09-11T05:32:53.385 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_stash_full_interval": "25", 2024-09-11T05:32:53.385 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_trim_max": "500", 2024-09-11T05:32:53.385 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_trim_min": "250", 2024-09-11T05:32:53.385 INFO:teuthology.orchestra.run.smithi070.stdout: "perf": "true", 2024-09-11T05:32:53.385 INFO:teuthology.orchestra.run.smithi070.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-11T05:32:53.385 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-11T05:32:53.385 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-11T05:32:53.385 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "-", 2024-09-11T05:32:53.385 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrv": "", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "public_bind_addr": "-", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "public_network": "", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "public_network_interface": "", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_busy_polling": "false", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_enabled": "false", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_session_max_number": "256", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_mon_op_timeout": "0", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_osd_op_timeout": "0", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_tracing": "false", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_atime_update_interval": "60", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_balance_parent_reads": "false", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_balance_snap_reads": "false", 2024-09-11T05:32:53.386 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blkin_trace_all": "false", 2024-09-11T05:32:53.387 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-11T05:32:53.387 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-11T05:32:53.387 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache": "true", 2024-09-11T05:32:53.387 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-11T05:32:53.387 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-11T05:32:53.387 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-11T05:32:53.387 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-11T05:32:53.387 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_policy": "writearound", 2024-09-11T05:32:53.387 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_size": "33554432", 2024-09-11T05:32:53.387 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-11T05:32:53.387 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-11T05:32:53.387 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_clone_copy_on_read": "false", 2024-09-11T05:32:53.387 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_compression_hint": "none", 2024-09-11T05:32:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_concurrent_management_ops": "10", 2024-09-11T05:32:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-11T05:32:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_clone_format": "auto", 2024-09-11T05:32:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_data_pool": "", 2024-09-11T05:32:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_features": "61", 2024-09-11T05:32:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_format": "2", 2024-09-11T05:32:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_map_options": "", 2024-09-11T05:32:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_order": "22", 2024-09-11T05:32:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_pool": "rbd", 2024-09-11T05:32:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-11T05:32:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_stripe_count": "0", 2024-09-11T05:32:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_stripe_unit": "0", 2024-09-11T05:32:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-11T05:32:53.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-11T05:32:53.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-11T05:32:53.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_enable_alloc_hint": "true", 2024-09-11T05:32:53.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-11T05:32:53.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_io_scheduler": "simple", 2024-09-11T05:32:53.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-11T05:32:53.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-11T05:32:53.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-11T05:32:53.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-11T05:32:53.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-11T05:32:53.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-11T05:32:53.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-11T05:32:53.389 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-11T05:32:53.390 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-11T05:32:53.390 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_order": "24", 2024-09-11T05:32:53.390 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_pool": "", 2024-09-11T05:32:53.390 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_splay_width": "4", 2024-09-11T05:32:53.390 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_localize_parent_reads": "false", 2024-09-11T05:32:53.390 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_localize_snap_reads": "false", 2024-09-11T05:32:53.390 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-11T05:32:53.390 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-11T05:32:53.390 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-11T05:32:53.390 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-11T05:32:53.390 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-11T05:32:53.390 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-11T05:32:53.390 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-11T05:32:53.391 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-11T05:32:53.391 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-11T05:32:53.391 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-11T05:32:53.391 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-11T05:32:53.391 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-11T05:32:53.391 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-11T05:32:53.391 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-11T05:32:53.391 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-11T05:32:53.391 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-11T05:32:53.391 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-11T05:32:53.391 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-11T05:32:53.391 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-11T05:32:53.391 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-11T05:32:53.392 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-11T05:32:53.392 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-11T05:32:53.392 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-11T05:32:53.392 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-11T05:32:53.392 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-11T05:32:53.392 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-11T05:32:53.392 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-11T05:32:53.392 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-11T05:32:53.392 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-11T05:32:53.392 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-11T05:32:53.392 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-11T05:32:53.393 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mtime_update_interval": "60", 2024-09-11T05:32:53.393 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_non_blocking_aio": "true", 2024-09-11T05:32:53.393 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_op_thread_timeout": "60", 2024-09-11T05:32:53.393 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_op_threads": "1", 2024-09-11T05:32:53.393 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_parent_cache_enabled": "false", 2024-09-11T05:32:53.393 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-11T05:32:53.393 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-11T05:32:53.393 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-11T05:32:53.393 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_plugins": "", 2024-09-11T05:32:53.393 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_burst": "0", 2024-09-11T05:32:53.393 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-11T05:32:53.393 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_limit": "0", 2024-09-11T05:32:53.393 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_exclude_ops": "0", 2024-09-11T05:32:53.394 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_burst": "0", 2024-09-11T05:32:53.394 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-11T05:32:53.394 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_limit": "0", 2024-09-11T05:32:53.394 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-11T05:32:53.394 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-11T05:32:53.394 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-11T05:32:53.394 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-11T05:32:53.394 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-11T05:32:53.394 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-11T05:32:53.394 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-11T05:32:53.394 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-11T05:32:53.394 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-11T05:32:53.395 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-11T05:32:53.395 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-11T05:32:53.395 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-11T05:32:53.395 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-11T05:32:53.395 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-11T05:32:53.395 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_read_from_replica_policy": "default", 2024-09-11T05:32:53.395 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-11T05:32:53.395 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-11T05:32:53.395 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-11T05:32:53.395 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-11T05:32:53.395 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_skip_partial_discard": "true", 2024-09-11T05:32:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-11T05:32:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_tracing": "false", 2024-09-11T05:32:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_validate_names": "true", 2024-09-11T05:32:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_validate_pool": "true", 2024-09-11T05:32:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: "restapi_base_url": "", 2024-09-11T05:32:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: "restapi_log_level": "", 2024-09-11T05:32:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-11T05:32:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-11T05:32:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_acl_grants_max_num": "100", 2024-09-11T05:32:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_admin_entry": "admin", 2024-09-11T05:32:53.396 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-11T05:32:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_backend_store": "rados", 2024-09-11T05:32:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_barbican_url": "", 2024-09-11T05:32:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_beast_enable_async": "true", 2024-09-11T05:32:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_counters_cache": "false", 2024-09-11T05:32:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-11T05:32:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-11T05:32:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-11T05:32:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-11T05:32:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-11T05:32:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-11T05:32:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-11T05:32:53.397 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-11T05:32:53.398 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_enabled": "true", 2024-09-11T05:32:53.398 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_expiry_interval": "900", 2024-09-11T05:32:53.398 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_lru_size": "25000", 2024-09-11T05:32:53.398 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_config_store": "rados", 2024-09-11T05:32:53.398 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_content_length_compat": "false", 2024-09-11T05:32:53.398 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_copy_obj_progress": "true", 2024-09-11T05:32:53.398 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-11T05:32:53.398 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cors_rules_max_num": "100", 2024-09-11T05:32:53.398 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cross_domain_policy": "", 2024-09-11T05:32:53.398 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-11T05:32:53.398 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_addr": "", 2024-09-11T05:32:53.398 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-11T05:32:53.399 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-11T05:32:53.399 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-11T05:32:53.399 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-11T05:32:53.399 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_password": "", 2024-09-11T05:32:53.399 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-11T05:32:53.399 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_username": "", 2024-09-11T05:32:53.399 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_require_ssl": "true", 2024-09-11T05:32:53.399 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-11T05:32:53.399 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-11T05:32:53.399 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-11T05:32:53.399 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-11T05:32:53.399 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-11T05:32:53.400 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-11T05:32:53.400 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-11T05:32:53.400 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-11T05:32:53.400 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-11T05:32:53.400 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-11T05:32:53.400 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-11T05:32:53.400 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-11T05:32:53.400 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-11T05:32:53.400 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-11T05:32:53.400 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-11T05:32:53.400 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_addr": "", 2024-09-11T05:32:53.400 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_auth": "token", 2024-09-11T05:32:53.400 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_namespace": "", 2024-09-11T05:32:53.401 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_prefix": "", 2024-09-11T05:32:53.401 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-11T05:32:53.401 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-11T05:32:53.401 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-11T05:32:53.401 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-11T05:32:53.401 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_token_file": "", 2024-09-11T05:32:53.401 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-11T05:32:53.401 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_buffersize": "524288", 2024-09-11T05:32:53.401 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-11T05:32:53.401 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_low_speed_time": "300", 2024-09-11T05:32:53.401 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-11T05:32:53.401 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-11T05:32:53.401 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-11T05:32:53.402 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-11T05:32:53.402 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-11T05:32:53.402 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-11T05:32:53.402 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-11T05:32:53.402 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-11T05:32:53.402 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-11T05:32:53.402 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-11T05:32:53.402 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-11T05:32:53.402 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_port": "6379", 2024-09-11T05:32:53.402 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-11T05:32:53.402 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_changes_size": "1000", 2024-09-11T05:32:53.402 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_num_shards": "128", 2024-09-11T05:32:53.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-11T05:32:53.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_window": "30", 2024-09-11T05:32:53.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-11T05:32:53.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-11T05:32:53.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-11T05:32:53.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-11T05:32:53.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-11T05:32:53.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-11T05:32:53.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-11T05:32:53.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-11T05:32:53.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-11T05:32:53.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-11T05:32:53.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-11T05:32:53.404 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-11T05:32:53.404 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-11T05:32:53.404 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-11T05:32:53.404 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-11T05:32:53.404 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-11T05:32:53.404 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-11T05:32:53.404 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-11T05:32:53.404 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-11T05:32:53.404 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-11T05:32:53.404 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-11T05:32:53.404 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-11T05:32:53.404 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-11T05:32:53.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-11T05:32:53.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-11T05:32:53.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dns_name": "", 2024-09-11T05:32:53.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dns_s3website_name": "", 2024-09-11T05:32:53.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dynamic_resharding": "true", 2024-09-11T05:32:53.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-11T05:32:53.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_gc_threads": "true", 2024-09-11T05:32:53.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_lc_threads": "true", 2024-09-11T05:32:53.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_ops_log": "false", 2024-09-11T05:32:53.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_quota_threads": "true", 2024-09-11T05:32:53.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_static_website": "false", 2024-09-11T05:32:53.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_usage_log": "false", 2024-09-11T05:32:53.405 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enforce_swift_acls": "true", 2024-09-11T05:32:53.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_exit_timeout_secs": "120", 2024-09-11T05:32:53.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_expose_bucket": "false", 2024-09-11T05:32:53.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_extended_http_attrs": "", 2024-09-11T05:32:53.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_filter": "none", 2024-09-11T05:32:53.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-11T05:32:53.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_frontends": "beast port=7480", 2024-09-11T05:32:53.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-11T05:32:53.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_deferred": "50", 2024-09-11T05:32:53.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-11T05:32:53.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_objs": "32", 2024-09-11T05:32:53.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-11T05:32:53.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-11T05:32:53.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-11T05:32:53.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-11T05:32:53.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_processor_period": "3600", 2024-09-11T05:32:53.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-11T05:32:53.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-11T05:32:53.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-11T05:32:53.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-11T05:32:53.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_init_timeout": "300", 2024-09-11T05:32:53.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-11T05:32:53.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-11T05:32:53.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_kafka_connection_idle": "300", 2024-09-11T05:32:53.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-11T05:32:53.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-11T05:32:53.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-11T05:32:53.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-11T05:32:53.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-11T05:32:53.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_domain": "", 2024-09-11T05:32:53.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_password": "", 2024-09-11T05:32:53.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_password_path": "", 2024-09-11T05:32:53.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_project": "", 2024-09-11T05:32:53.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_tenant": "", 2024-09-11T05:32:53.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_token": "", 2024-09-11T05:32:53.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_token_path": "", 2024-09-11T05:32:53.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_user": "", 2024-09-11T05:32:53.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_api_version": "2", 2024-09-11T05:32:53.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_domain": "", 2024-09-11T05:32:53.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_password": "", 2024-09-11T05:32:53.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_project": "", 2024-09-11T05:32:53.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-11T05:32:53.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_user": "", 2024-09-11T05:32:53.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-11T05:32:53.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-11T05:32:53.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-11T05:32:53.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-11T05:32:53.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-11T05:32:53.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_url": "", 2024-09-11T05:32:53.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-11T05:32:53.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_debug_interval": "-1", 2024-09-11T05:32:53.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_lock_max_time": "90", 2024-09-11T05:32:53.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_objs": "32", 2024-09-11T05:32:53.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_rules": "1000", 2024-09-11T05:32:53.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_worker": "3", 2024-09-11T05:32:53.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-11T05:32:53.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_thread_delay": "0", 2024-09-11T05:32:53.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-11T05:32:53.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_dnattr": "uid", 2024-09-11T05:32:53.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-11T05:32:53.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_searchfilter": "", 2024-09-11T05:32:53.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-11T05:32:53.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_uri": "", 2024-09-11T05:32:53.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-11T05:32:53.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-11T05:32:53.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-11T05:32:53.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_http_headers": "", 2024-09-11T05:32:53.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-11T05:32:53.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-11T05:32:53.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_object_name_utc": "false", 2024-09-11T05:32:53.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-11T05:32:53.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-11T05:32:53.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attr_name_len": "0", 2024-09-11T05:32:53.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attr_size": "0", 2024-09-11T05:32:53.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-11T05:32:53.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_chunk_size": "4194304", 2024-09-11T05:32:53.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-11T05:32:53.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-11T05:32:53.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-11T05:32:53.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_listing_results": "1000", 2024-09-11T05:32:53.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_notify_retries": "10", 2024-09-11T05:32:53.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-11T05:32:53.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_put_param_size": "1048576", 2024-09-11T05:32:53.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_put_size": "5368709120", 2024-09-11T05:32:53.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_slo_entries": "1000", 2024-09-11T05:32:53.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_md_log_max_shards": "64", 2024-09-11T05:32:53.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-11T05:32:53.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-11T05:32:53.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-11T05:32:53.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-11T05:32:53.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_mp_lock_max_time": "600", 2024-09-11T05:32:53.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-11T05:32:53.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-11T05:32:53.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-11T05:32:53.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-11T05:32:53.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-11T05:32:53.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-11T05:32:53.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-11T05:32:53.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-11T05:32:53.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_max_gc": "300", 2024-09-11T05:32:53.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-11T05:32:53.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-11T05:32:53.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-11T05:32:53.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-11T05:32:53.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-11T05:32:53.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-11T05:32:53.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-11T05:32:53.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_num_async_rados_threads": "32", 2024-09-11T05:32:53.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_num_control_oids": "8", 2024-09-11T05:32:53.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_numa_node": "-1", 2024-09-11T05:32:53.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-11T05:32:53.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-11T05:32:53.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_chunk_size": "100", 2024-09-11T05:32:53.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_gc_interval": "600", 2024-09-11T05:32:53.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-11T05:32:53.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-11T05:32:53.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-11T05:32:53.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_thread_timeout": "600", 2024-09-11T05:32:53.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_tracing": "false", 2024-09-11T05:32:53.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_token": "", 2024-09-11T05:32:53.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_url": "", 2024-09-11T05:32:53.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_verify_ssl": "true", 2024-09-11T05:32:53.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-11T05:32:53.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-11T05:32:53.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_rados": "false", 2024-09-11T05:32:53.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_socket_path": "", 2024-09-11T05:32:53.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-11T05:32:53.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-11T05:32:53.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-11T05:32:53.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_push_interval": "2.000000", 2024-09-11T05:32:53.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-11T05:32:53.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-11T05:32:53.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-11T05:32:53.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-11T05:32:53.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_lanes": "3", 2024-09-11T05:32:53.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-11T05:32:53.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-11T05:32:53.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_partitions": "3", 2024-09-11T05:32:53.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-11T05:32:53.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_print_continue": "true", 2024-09-11T05:32:53.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-11T05:32:53.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-11T05:32:53.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-11T05:32:53.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-11T05:32:53.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-11T05:32:53.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_tracing": "false", 2024-09-11T05:32:53.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm": "", 2024-09-11T05:32:53.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm_id": "", 2024-09-11T05:32:53.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-11T05:32:53.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_region": "", 2024-09-11T05:32:53.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-11T05:32:53.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-11T05:32:53.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-11T05:32:53.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-11T05:32:53.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_request_uri": "", 2024-09-11T05:32:53.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_batch_size": "64", 2024-09-11T05:32:53.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-11T05:32:53.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_max_aio": "128", 2024-09-11T05:32:53.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_num_logs": "16", 2024-09-11T05:32:53.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_thread_interval": "600", 2024-09-11T05:32:53.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_resolve_cname": "false", 2024-09-11T05:32:53.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-11T05:32:53.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_run_sync_thread": "true", 2024-09-11T05:32:53.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-11T05:32:53.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-11T05:32:53.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-11T05:32:53.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-11T05:32:53.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-11T05:32:53.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-11T05:32:53.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-11T05:32:53.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-11T05:32:53.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-11T05:32:53.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_scheduler_type": "throttler", 2024-09-11T05:32:53.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_script_uri": "", 2024-09-11T05:32:53.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_service_provider_name": "", 2024-09-11T05:32:53.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-11T05:32:53.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_client_id": "", 2024-09-11T05:32:53.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_client_secret": "", 2024-09-11T05:32:53.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_entry": "sts", 2024-09-11T05:32:53.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_key": "sts", 2024-09-11T05:32:53.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-11T05:32:53.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_min_session_duration": "900", 2024-09-11T05:32:53.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_token_introspection_url": "", 2024-09-11T05:32:53.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_account_in_url": "false", 2024-09-11T05:32:53.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_auth_entry": "auth", 2024-09-11T05:32:53.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_auth_url": "", 2024-09-11T05:32:53.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_custom_header": "", 2024-09-11T05:32:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-11T05:32:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_need_stats": "true", 2024-09-11T05:32:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_tenant_name": "", 2024-09-11T05:32:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_token_expiration": "86400", 2024-09-11T05:32:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_url": "", 2024-09-11T05:32:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_url_prefix": "swift", 2024-09-11T05:32:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-11T05:32:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-11T05:32:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-11T05:32:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_lease_period": "120", 2024-09-11T05:32:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-11T05:32:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-11T05:32:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-11T05:32:53.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-11T05:32:53.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-11T05:32:53.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-11T05:32:53.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-11T05:32:53.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-11T05:32:53.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-11T05:32:53.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_thread_pool_size": "512", 2024-09-11T05:32:53.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-11T05:32:53.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-11T05:32:53.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-11T05:32:53.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-11T05:32:53.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_comment": "", 2024-09-11T05:32:53.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_createby": "", 2024-09-11T05:32:53.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_encoding": "", 2024-09-11T05:32:53.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_flag": "false", 2024-09-11T05:32:53.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-11T05:32:53.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_origin": "", 2024-09-11T05:32:53.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-11T05:32:53.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_tracker": "", 2024-09-11T05:32:53.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_trust_forwarded_https": "false", 2024-09-11T05:32:53.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-11T05:32:53.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-11T05:32:53.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_max_shards": "32", 2024-09-11T05:32:53.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_max_user_shards": "1", 2024-09-11T05:32:53.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_use_opa_authz": "false", 2024-09-11T05:32:53.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_counters_cache": "false", 2024-09-11T05:32:53.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-11T05:32:53.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-11T05:32:53.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-11T05:32:53.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_max_buckets": "1000", 2024-09-11T05:32:53.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_policies_max_num": "100", 2024-09-11T05:32:53.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-11T05:32:53.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-11T05:32:53.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-11T05:32:53.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-11T05:32:53.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_unique_email": "true", 2024-09-11T05:32:53.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_verify_ssl": "true", 2024-09-11T05:32:53.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-11T05:32:53.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone": "", 2024-09-11T05:32:53.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone_id": "", 2024-09-11T05:32:53.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-11T05:32:53.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup": "", 2024-09-11T05:32:53.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup_id": "", 2024-09-11T05:32:53.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-11T05:32:53.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgwlc_auto_session_clear": "true", 2024-09-11T05:32:53.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-11T05:32:53.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_block_size": "4096", 2024-09-11T05:32:53.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-11T05:32:53.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-11T05:32:53.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-11T05:32:53.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-11T05:32:53.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-11T05:32:53.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_size": "536870912", 2024-09-11T05:32:53.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-11T05:32:53.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-11T05:32:53.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-11T05:32:53.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-11T05:32:53.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-11T05:32:53.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-11T05:32:53.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-11T05:32:53.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-11T05:32:53.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_index_type": "binary_search", 2024-09-11T05:32:53.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-11T05:32:53.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-11T05:32:53.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_partition_filters": "false", 2024-09-11T05:32:53.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_perf": "false", 2024-09-11T05:32:53.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-11T05:32:53.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-11T05:32:53.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-11T05:32:53.427 INFO:teuthology.orchestra.run.smithi070.stdout: "run_dir": "/var/run/ceph", 2024-09-11T05:32:53.427 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_block_create": "true", 2024-09-11T05:32:53.427 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_cache_lru_size": "67108864", 2024-09-11T05:32:53.427 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-11T05:32:53.427 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-11T05:32:53.427 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_default_max_object_size": "16777216", 2024-09-11T05:32:53.428 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-11T05:32:53.428 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_device_size": "53687091200", 2024-09-11T05:32:53.428 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-11T05:32:53.428 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_full_integrity_check": "false", 2024-09-11T05:32:53.428 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_capacity": "16", 2024-09-11T05:32:53.428 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-11T05:32:53.428 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-11T05:32:53.428 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-11T05:32:53.428 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_main_device_type": "SSD", 2024-09-11T05:32:53.428 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-11T05:32:53.428 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-11T05:32:53.428 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-11T05:32:53.428 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-11T05:32:53.429 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-11T05:32:53.429 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-11T05:32:53.429 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_segment_size": "67108864", 2024-09-11T05:32:53.429 INFO:teuthology.orchestra.run.smithi070.stdout: "set_keepcaps": "false", 2024-09-11T05:32:53.429 INFO:teuthology.orchestra.run.smithi070.stdout: "setgroup": "", 2024-09-11T05:32:53.429 INFO:teuthology.orchestra.run.smithi070.stdout: "setuser": "", 2024-09-11T05:32:53.429 INFO:teuthology.orchestra.run.smithi070.stdout: "setuser_match_path": "", 2024-09-11T05:32:53.429 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-11T05:32:53.429 INFO:teuthology.orchestra.run.smithi070.stdout: "thp": "false", 2024-09-11T05:32:53.429 INFO:teuthology.orchestra.run.smithi070.stdout: "threadpool_default_timeout": "60", 2024-09-11T05:32:53.429 INFO:teuthology.orchestra.run.smithi070.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-11T05:32:53.429 INFO:teuthology.orchestra.run.smithi070.stdout: "throttler_perf_counter": "true" 2024-09-11T05:32:53.430 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:32:53.432 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-11T05:32:53.543 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a: {} 2024-09-11T05:32:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T05:32:53.553 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b: {} 2024-09-11T05:32:53.553 INFO:teuthology.orchestra.run.smithi070.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T05:32:53.561 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c: {} 2024-09-11T05:32:53.561 INFO:teuthology.orchestra.run.smithi070.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T05:32:53.572 DEBUG:teuthology.orchestra.run.smithi084:> type ceph-objectstore-tool 2024-09-11T05:32:53.590 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T05:32:53.590 DEBUG:teuthology.orchestra.run.smithi070:> type ceph-objectstore-tool 2024-09-11T05:32:53.604 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T05:32:53.604 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-11T05:32:53.614 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-11T05:32:53.615 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-11T05:32:53.615 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:32:53.615 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:32:53.615 INFO:tasks.thrashosds.thrasher:Removing osd 4, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:32:53.615 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 4 2024-09-11T05:32:53.615 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-11T05:32:53.616 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-11T05:32:53.616 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:32:53.616 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-11T05:32:53.616 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:32:53.617 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-11T05:32:53.617 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:32:53.617 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-09-11T05:32:53.646 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:32:53.645+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:32:53.682 INFO:teuthology.orchestra.run.smithi070.stdout:mapped writes DISABLED 2024-09-11T05:32:53.683 INFO:teuthology.orchestra.run.smithi070.stdout:mapped reads DISABLED 2024-09-11T05:32:53.683 INFO:teuthology.orchestra.run.smithi070.stdout:Seed set to 1665 2024-09-11T05:32:53.723 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:32:53.723+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:32:53.768 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:32:53.768 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:32:53.768 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:32:53.768 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:32:53.779 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:32:53.780 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:32:53.781 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:32:53.799 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:32:53.799 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:32:53.816 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:32:53.816 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:32:53.818 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:32:53.818+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:32:53.834 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:32:53.834 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:32:53.866 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:32:53.866 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:32:53.883 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:32:53.884 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:32:53.886 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:53.887 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:53.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:32:53.912 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:32:53.913 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:32:53.919 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:32:53.918+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:32:53.930 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:32:53.930 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:32:53.993 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-11T05:32:53.993+0000 7fc03b8fe640 -1 mon.a@0(leader).osd e21 definitely_dead 0 2024-09-11T05:32:54.018 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:54.018 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:54.019 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:32:54.019+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:32:54.027 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:32:54.120 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:32:54.120+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:32:54.171 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:54.171 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:54.179 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:32:54.222 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:32:54.221+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:32:54.283 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:54.283 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:54.291 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:32:54.335 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:32:54.335+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:32:54.394 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:54.394 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:54.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:32:54.423 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:54.423+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:32:54.524 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:32:54.523+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:32:54.545 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:54.545 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:54.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:32:54.627 INFO:teuthology.orchestra.run.smithi070.stderr:marked out osd.4. 2024-09-11T05:32:54.627 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:32:54.627+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:32:54.634 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T05:32:54.705 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:54.705 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:54.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:32:54.725 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:32:54.725+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:32:54.818 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:54.818 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:54.826 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:32:54.825+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:32:54.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:32:54.927 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:32:54.926+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:32:54.970 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:54.970 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:54.980 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:32:55.027 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:32:55.027+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:32:55.082 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:55.082 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:55.092 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:32:55.133 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:32:55.133+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:32:55.229 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:32:55.229+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:32:55.235 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:55.235 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:55.244 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:32:55.330 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:32:55.329+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:32:55.360 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:55.360 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:55.370 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:32:55.431 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:32:55.431+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:32:55.514 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:55.515 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:55.523 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:32:55.532 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:32:55.531+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:32:55.632 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:32:55.631+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:32:55.634 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:55.634 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:55.643 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:32:55.733 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:32:55.733+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:32:55.787 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:55.788 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:55.796 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:32:55.834 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:32:55.833+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:32:55.935 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:32:55.935+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:32:55.939 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:55.939 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:55.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:32:55.948 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:32:56.036 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:56.036+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:32:56.051 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:56.051 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:56.060 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:32:56.071 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:32:56.071 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:32:56.088 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:32:56.088 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:32:56.104 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:32:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:32:56.120 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:32:56.120 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:32:56.137 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:32:56.137 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:32:56.144 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:32:56.144+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:32:56.153 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:32:56.154 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:32:56.170 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:32:56.170 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:32:56.186 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:32:56.187 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:32:56.204 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:32:56.205 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:32:56.205 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:32:56.205 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:32:56.214 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:32:56.255 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:32:56.255+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:32:56.338 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:56.338+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:32:56.357 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:32:56.357 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:32:56.357 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:32:56.357 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:32:56.357 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:32:56.366 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:32:56.439 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:32:56.439+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:32:56.509 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:32:56.509 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:32:56.509 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:32:56.510 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:32:56.510 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.510 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4235.0:5 2.2 e20/18 2:5cea7035:::rbd_info:head v 20'1, mlcod=0'0)", 2024-09-11T05:32:56.510 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:46.590196+0000", 2024-09-11T05:32:56.510 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 9.919457585, 2024-09-11T05:32:56.510 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0010544790000000001, 2024-09-11T05:32:56.510 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:32:56.510 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:32:56.510 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:56.510 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:32:56.510 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.510 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:32:56.510 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:46.590196+0000", 2024-09-11T05:32:56.511 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:32:56.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.511 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.511 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:32:56.511 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:46.590196+0000", 2024-09-11T05:32:56.511 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:32:56.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.511 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.511 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:32:56.511 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:46.590197+0000", 2024-09-11T05:32:56.511 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3099999999999999e-07 2024-09-11T05:32:56.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.511 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.512 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:32:56.512 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:46.590205+0000", 2024-09-11T05:32:56.512 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.721e-06 2024-09-11T05:32:56.512 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.512 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.512 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:32:56.512 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:46.590219+0000", 2024-09-11T05:32:56.512 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3336000000000001e-05 2024-09-11T05:32:56.512 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.512 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.512 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:32:56.512 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:46.590233+0000", 2024-09-11T05:32:56.513 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.4073999999999999e-05 2024-09-11T05:32:56.513 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.513 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.513 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:32:56.513 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:46.590303+0000", 2024-09-11T05:32:56.513 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0326000000000004e-05 2024-09-11T05:32:56.513 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.513 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.513 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:32:56.513 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:46.590333+0000", 2024-09-11T05:32:56.513 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.989e-05 2024-09-11T05:32:56.513 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:46.591201+0000", 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00086787300000000002 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:46.591251+0000", 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0028000000000003e-05 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.514 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.515 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4235.0:7 2.2 e21/18 2:5cea7035:::rbd_info:head v 21'2, mlcod=0'0)", 2024-09-11T05:32:56.515 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:47.597506+0000", 2024-09-11T05:32:56.515 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.9121475490000002, 2024-09-11T05:32:56.515 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00093621100000000005, 2024-09-11T05:32:56.515 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:32:56.515 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:32:56.515 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:56.515 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:32:56.515 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.515 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:32:56.515 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:47.597506+0000", 2024-09-11T05:32:56.515 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:32:56.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.516 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.516 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:32:56.516 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:47.597506+0000", 2024-09-11T05:32:56.516 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:32:56.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.516 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.516 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:32:56.516 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:47.597507+0000", 2024-09-11T05:32:56.516 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:32:56.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.516 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:32:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:47.597514+0000", 2024-09-11T05:32:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2409999999999998e-06 2024-09-11T05:32:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:32:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:47.597530+0000", 2024-09-11T05:32:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5981000000000002e-05 2024-09-11T05:32:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:32:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:47.597543+0000", 2024-09-11T05:32:56.517 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3427e-05 2024-09-11T05:32:56.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.518 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.518 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:32:56.518 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:47.597626+0000", 2024-09-11T05:32:56.518 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3020000000000001e-05 2024-09-11T05:32:56.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.518 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.518 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:32:56.518 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:47.597653+0000", 2024-09-11T05:32:56.518 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6446000000000001e-05 2024-09-11T05:32:56.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.518 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.518 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:32:56.519 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:47.598389+0000", 2024-09-11T05:32:56.519 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00073645099999999995 2024-09-11T05:32:56.519 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:32:56.519 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:32:56.519 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:32:56.519 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:47.598443+0000", 2024-09-11T05:32:56.519 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3245000000000003e-05 2024-09-11T05:32:56.519 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:32:56.519 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:32:56.519 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:32:56.519 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:32:56.519 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:32:56.519 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:32:56.520 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:32:56.540 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:32:56.540+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:32:56.624 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:32:56.624 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:32:56.624 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:32:56.624 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:32:56.634 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:32:56.652 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:32:56.677 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:56.677+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:32:56.736 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:32:56.736 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:32:56.736 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:32:56.737 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:32:56.737 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:32:56.742 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:32:56.742+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:32:56.745 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:32:56.843 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:32:56.843+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:32:56.889 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:32:56.889 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:32:56.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:32:56.889 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:32:56.889 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:32:56.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:32:56.945 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:32:56.944+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:32:57.001 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:32:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:32:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:32:57.001 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:32:57.011 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:32:57.054 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:32:57.054+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:32:57.113 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:32:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:32:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:32:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:32:57.114 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:32:57.122 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:32:57.163 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:32:57.163+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:32:57.247 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:32:57.247+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:32:57.265 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:32:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:32:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:32:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [] 2024-09-11T05:32:57.266 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:32:57.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:32:57.348 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:32:57.348+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:32:57.417 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:32:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:32:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:32:57.418 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:32:57.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:32:57.470 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:32:57.470+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:32:57.528 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:32:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:32:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:32:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:32:57.529 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:32:57.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:32:57.550 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:32:57.550+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:32:57.604 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T05:32:57.662 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:32:57.662+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:32:57.690 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:32:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:32:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:32:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:32:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 512~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.609921+0000", 2024-09-11T05:32:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.077975550000001, 2024-09-11T05:32:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072317420000000002, 2024-09-11T05:32:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 68 2024-09-11T05:32:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609921+0000", 2024-09-11T05:32:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609921+0000", 2024-09-11T05:32:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609922+0000", 2024-09-11T05:32:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:32:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609924+0000", 2024-09-11T05:32:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:32:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609929+0000", 2024-09-11T05:32:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:32:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609932+0000", 2024-09-11T05:32:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.101e-06 2024-09-11T05:32:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.610475+0000", 2024-09-11T05:32:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000542974 2024-09-11T05:32:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.610558+0000", 2024-09-11T05:32:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2736000000000002e-05 2024-09-11T05:32:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.610689+0000", 2024-09-11T05:32:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013081099999999999 2024-09-11T05:32:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.612277+0000", 2024-09-11T05:32:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015886100000000001 2024-09-11T05:32:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.617058+0000", 2024-09-11T05:32:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047804880000000003 2024-09-11T05:32:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.617111+0000", 2024-09-11T05:32:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3513000000000001e-05 2024-09-11T05:32:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.617153+0000", 2024-09-11T05:32:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1828e-05 2024-09-11T05:32:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.609938+0000", 2024-09-11T05:32:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.077958617, 2024-09-11T05:32:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010332035, 2024-09-11T05:32:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 69 2024-09-11T05:32:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609938+0000", 2024-09-11T05:32:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609938+0000", 2024-09-11T05:32:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609939+0000", 2024-09-11T05:32:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.22e-07 2024-09-11T05:32:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609976+0000", 2024-09-11T05:32:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7932999999999997e-05 2024-09-11T05:32:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609985+0000", 2024-09-11T05:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1210000000000007e-06 2024-09-11T05:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609988+0000", 2024-09-11T05:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8909999999999997e-06 2024-09-11T05:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.611041+0000", 2024-09-11T05:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010522299999999999 2024-09-11T05:32:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.611118+0000", 2024-09-11T05:32:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6890000000000004e-05 2024-09-11T05:32:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.611250+0000", 2024-09-11T05:32:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132652 2024-09-11T05:32:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.612282+0000", 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010313060000000001 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620157+0000", 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078758409999999997 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620232+0000", 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4506999999999997e-05 2024-09-11T05:32:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620270+0000", 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8442000000000002e-05 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.609995+0000", 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.077901698000002, 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010369461999999999, 2024-09-11T05:32:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 70 2024-09-11T05:32:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609995+0000", 2024-09-11T05:32:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609995+0000", 2024-09-11T05:32:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609996+0000", 2024-09-11T05:32:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:32:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609999+0000", 2024-09-11T05:32:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5219999999999999e-06 2024-09-11T05:32:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.610003+0000", 2024-09-11T05:32:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5190000000000001e-06 2024-09-11T05:32:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.610006+0000", 2024-09-11T05:32:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4410000000000002e-06 2024-09-11T05:32:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.611743+0000", 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017366949999999999 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.611830+0000", 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6822000000000003e-05 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.611967+0000", 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000137727 2024-09-11T05:32:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.612574+0000", 2024-09-11T05:32:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060694799999999995 2024-09-11T05:32:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620301+0000", 2024-09-11T05:32:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007727233 2024-09-11T05:32:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620340+0000", 2024-09-11T05:32:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8546e-05 2024-09-11T05:32:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620365+0000", 2024-09-11T05:32:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4640000000000001e-05 2024-09-11T05:32:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:73 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.620617+0000", 2024-09-11T05:32:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.067279893999999, 2024-09-11T05:32:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075323109999999999, 2024-09-11T05:32:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 73 2024-09-11T05:32:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620617+0000", 2024-09-11T05:32:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620617+0000", 2024-09-11T05:32:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620617+0000", 2024-09-11T05:32:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6199999999999998e-07 2024-09-11T05:32:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620666+0000", 2024-09-11T05:32:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8328999999999998e-05 2024-09-11T05:32:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620671+0000", 2024-09-11T05:32:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8099999999999997e-06 2024-09-11T05:32:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620674+0000", 2024-09-11T05:32:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-06 2024-09-11T05:32:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.621664+0000", 2024-09-11T05:32:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099063199999999997 2024-09-11T05:32:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.621738+0000", 2024-09-11T05:32:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3903e-05 2024-09-11T05:32:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.621866+0000", 2024-09-11T05:32:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012760399999999999 2024-09-11T05:32:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.622608+0000", 2024-09-11T05:32:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074244299999999997 2024-09-11T05:32:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.628070+0000", 2024-09-11T05:32:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054610730000000003 2024-09-11T05:32:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.628116+0000", 2024-09-11T05:32:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6247e-05 2024-09-11T05:32:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.628149+0000", 2024-09-11T05:32:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3568000000000001e-05 2024-09-11T05:32:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:74 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.620681+0000", 2024-09-11T05:32:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.06721641, 2024-09-11T05:32:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075794, 2024-09-11T05:32:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 74 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620681+0000", 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620681+0000", 2024-09-11T05:32:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620681+0000", 2024-09-11T05:32:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:32:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620684+0000", 2024-09-11T05:32:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.988e-06 2024-09-11T05:32:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620687+0000", 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.484e-06 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620690+0000", 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7889999999999999e-06 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.622168+0000", 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014780450000000001 2024-09-11T05:32:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.622262+0000", 2024-09-11T05:32:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3522000000000003e-05 2024-09-11T05:32:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.622381+0000", 2024-09-11T05:32:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011957500000000001 2024-09-11T05:32:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.622871+0000", 2024-09-11T05:32:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048961800000000004 2024-09-11T05:32:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.628195+0000", 2024-09-11T05:32:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053237950000000001 2024-09-11T05:32:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.628235+0000", 2024-09-11T05:32:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0568999999999997e-05 2024-09-11T05:32:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.628260+0000", 2024-09-11T05:32:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4672e-05 2024-09-11T05:32:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.634010+0000", 2024-09-11T05:32:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.053887095, 2024-09-11T05:32:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00551543, 2024-09-11T05:32:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 88 2024-09-11T05:32:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.634010+0000", 2024-09-11T05:32:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.634010+0000", 2024-09-11T05:32:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.634010+0000", 2024-09-11T05:32:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T05:32:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.634012+0000", 2024-09-11T05:32:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2199999999999999e-06 2024-09-11T05:32:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.634016+0000", 2024-09-11T05:32:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3979999999999999e-06 2024-09-11T05:32:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.634019+0000", 2024-09-11T05:32:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T05:32:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.637231+0000", 2024-09-11T05:32:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032122790000000002 2024-09-11T05:32:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.637274+0000", 2024-09-11T05:32:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3356999999999998e-05 2024-09-11T05:32:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.637357+0000", 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3147999999999997e-05 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.637830+0000", 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047218200000000003 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.639471+0000", 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016410680000000001 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.639502+0000", 2024-09-11T05:32:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1096999999999997e-05 2024-09-11T05:32:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.639525+0000", 2024-09-11T05:32:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3550999999999999e-05 2024-09-11T05:32:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.844425+0000", 2024-09-11T05:32:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.843471951000001, 2024-09-11T05:32:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058303729999999998, 2024-09-11T05:32:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 113 2024-09-11T05:32:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844425+0000", 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844425+0000", 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844426+0000", 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6199999999999998e-07 2024-09-11T05:32:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844431+0000", 2024-09-11T05:32:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T05:32:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844436+0000", 2024-09-11T05:32:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-06 2024-09-11T05:32:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844439+0000", 2024-09-11T05:32:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.14e-06 2024-09-11T05:32:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.848519+0000", 2024-09-11T05:32:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040796929999999997 2024-09-11T05:32:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.848560+0000", 2024-09-11T05:32:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1108e-05 2024-09-11T05:32:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.848637+0000", 2024-09-11T05:32:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7577999999999995e-05 2024-09-11T05:32:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849351+0000", 2024-09-11T05:32:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071328600000000004 2024-09-11T05:32:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850202+0000", 2024-09-11T05:32:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085104099999999997 2024-09-11T05:32:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850233+0000", 2024-09-11T05:32:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1498999999999998e-05 2024-09-11T05:32:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850255+0000", 2024-09-11T05:32:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089000000000001e-05 2024-09-11T05:32:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.844444+0000", 2024-09-11T05:32:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.843452461999998, 2024-09-11T05:32:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059512999999999996, 2024-09-11T05:32:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 114 2024-09-11T05:32:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844444+0000", 2024-09-11T05:32:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844444+0000", 2024-09-11T05:32:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844445+0000", 2024-09-11T05:32:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5499999999999999e-07 2024-09-11T05:32:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844447+0000", 2024-09-11T05:32:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:32:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844450+0000", 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2310000000000001e-06 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844453+0000", 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.757e-06 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.848861+0000", 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044080250000000003 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.848902+0000", 2024-09-11T05:32:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1245999999999998e-05 2024-09-11T05:32:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.848974+0000", 2024-09-11T05:32:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1670999999999999e-05 2024-09-11T05:32:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850300+0000", 2024-09-11T05:32:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013267540000000001 2024-09-11T05:32:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850312+0000", 2024-09-11T05:32:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1987999999999999e-05 2024-09-11T05:32:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850360+0000", 2024-09-11T05:32:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7991000000000002e-05 2024-09-11T05:32:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850396+0000", 2024-09-11T05:32:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5298e-05 2024-09-11T05:32:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.844461+0000", 2024-09-11T05:32:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.843435661000001, 2024-09-11T05:32:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010378596, 2024-09-11T05:32:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 115 2024-09-11T05:32:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844461+0000", 2024-09-11T05:32:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844461+0000", 2024-09-11T05:32:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844462+0000", 2024-09-11T05:32:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.48e-07 2024-09-11T05:32:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844506+0000", 2024-09-11T05:32:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4079000000000003e-05 2024-09-11T05:32:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844510+0000", 2024-09-11T05:32:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1779999999999996e-06 2024-09-11T05:32:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844513+0000", 2024-09-11T05:32:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0280000000000001e-06 2024-09-11T05:32:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849366+0000", 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048535100000000001 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849408+0000", 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1315e-05 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849477+0000", 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9334999999999999e-05 2024-09-11T05:32:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850402+0000", 2024-09-11T05:32:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092514099999999998 2024-09-11T05:32:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.854783+0000", 2024-09-11T05:32:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043809679999999998 2024-09-11T05:32:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.854818+0000", 2024-09-11T05:32:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5131e-05 2024-09-11T05:32:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.854840+0000", 2024-09-11T05:32:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1662999999999999e-05 2024-09-11T05:32:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.844518+0000", 2024-09-11T05:32:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.843379023000001, 2024-09-11T05:32:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013241591, 2024-09-11T05:32:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116 2024-09-11T05:32:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844518+0000", 2024-09-11T05:32:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844518+0000", 2024-09-11T05:32:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844518+0000", 2024-09-11T05:32:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:32:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844520+0000", 2024-09-11T05:32:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.204e-06 2024-09-11T05:32:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844525+0000", 2024-09-11T05:32:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3930000000000001e-06 2024-09-11T05:32:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844530+0000", 2024-09-11T05:32:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2769999999999996e-06 2024-09-11T05:32:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849772+0000", 2024-09-11T05:32:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052415789999999997 2024-09-11T05:32:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849821+0000", 2024-09-11T05:32:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9144999999999998e-05 2024-09-11T05:32:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849885+0000", 2024-09-11T05:32:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4601e-05 2024-09-11T05:32:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850706+0000", 2024-09-11T05:32:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082021299999999998 2024-09-11T05:32:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.857705+0000", 2024-09-11T05:32:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069997990000000001 2024-09-11T05:32:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.857736+0000", 2024-09-11T05:32:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0518000000000002e-05 2024-09-11T05:32:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.857759+0000", 2024-09-11T05:32:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3561e-05 2024-09-11T05:32:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.844534+0000", 2024-09-11T05:32:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.843362713000001, 2024-09-11T05:32:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013318656, 2024-09-11T05:32:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844534+0000", 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844534+0000", 2024-09-11T05:32:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844534+0000", 2024-09-11T05:32:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-07 2024-09-11T05:32:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844537+0000", 2024-09-11T05:32:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-11T05:32:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844540+0000", 2024-09-11T05:32:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-06 2024-09-11T05:32:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844542+0000", 2024-09-11T05:32:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.61e-06 2024-09-11T05:32:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850420+0000", 2024-09-11T05:32:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058780819999999998 2024-09-11T05:32:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850466+0000", 2024-09-11T05:32:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5961000000000003e-05 2024-09-11T05:32:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850539+0000", 2024-09-11T05:32:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2465000000000005e-05 2024-09-11T05:32:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850901+0000", 2024-09-11T05:32:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036213400000000001 2024-09-11T05:32:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.857791+0000", 2024-09-11T05:32:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068895989999999997 2024-09-11T05:32:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.857831+0000", 2024-09-11T05:32:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0763000000000003e-05 2024-09-11T05:32:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.857853+0000", 2024-09-11T05:32:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1557e-05 2024-09-11T05:32:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186716+0000", 2024-09-11T05:32:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.501181022000001, 2024-09-11T05:32:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071667160000000001, 2024-09-11T05:32:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 134 2024-09-11T05:32:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186716+0000", 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186716+0000", 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186716+0000", 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7999999999999995e-07 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186796+0000", 2024-09-11T05:32:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9555999999999995e-05 2024-09-11T05:32:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186816+0000", 2024-09-11T05:32:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9712e-05 2024-09-11T05:32:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186822+0000", 2024-09-11T05:32:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9529999999999996e-06 2024-09-11T05:32:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.189573+0000", 2024-09-11T05:32:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002751664 2024-09-11T05:32:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.189642+0000", 2024-09-11T05:32:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8780000000000002e-05 2024-09-11T05:32:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.189759+0000", 2024-09-11T05:32:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116834 2024-09-11T05:32:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.191163+0000", 2024-09-11T05:32:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014038500000000001 2024-09-11T05:32:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193829+0000", 2024-09-11T05:32:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026666390000000002 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193860+0000", 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0543999999999998e-05 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193883+0000", 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2603999999999999e-05 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186841+0000", 2024-09-11T05:32:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.501055686000001, 2024-09-11T05:32:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007183053, 2024-09-11T05:32:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 135 2024-09-11T05:32:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186841+0000", 2024-09-11T05:32:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186841+0000", 2024-09-11T05:32:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186842+0000", 2024-09-11T05:32:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9100000000000004e-07 2024-09-11T05:32:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186845+0000", 2024-09-11T05:32:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.366e-06 2024-09-11T05:32:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186852+0000", 2024-09-11T05:32:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-09-11T05:32:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186855+0000", 2024-09-11T05:32:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9490000000000001e-06 2024-09-11T05:32:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.190263+0000", 2024-09-11T05:32:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034079290000000001 2024-09-11T05:32:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.190327+0000", 2024-09-11T05:32:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4387000000000005e-05 2024-09-11T05:32:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.190400+0000", 2024-09-11T05:32:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3356999999999996e-05 2024-09-11T05:32:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192283+0000", 2024-09-11T05:32:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001882641 2024-09-11T05:32:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193937+0000", 2024-09-11T05:32:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001654336 2024-09-11T05:32:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193987+0000", 2024-09-11T05:32:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9497999999999999e-05 2024-09-11T05:32:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194024+0000", 2024-09-11T05:32:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7530000000000002e-05 2024-09-11T05:32:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186859+0000", 2024-09-11T05:32:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.501037629999999, 2024-09-11T05:32:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072504070000000004, 2024-09-11T05:32:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 136 2024-09-11T05:32:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186859+0000", 2024-09-11T05:32:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186859+0000", 2024-09-11T05:32:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186860+0000", 2024-09-11T05:32:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7799999999999997e-07 2024-09-11T05:32:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186861+0000", 2024-09-11T05:32:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.753e-06 2024-09-11T05:32:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186865+0000", 2024-09-11T05:32:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000001e-06 2024-09-11T05:32:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186868+0000", 2024-09-11T05:32:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8909999999999999e-06 2024-09-11T05:32:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.190752+0000", 2024-09-11T05:32:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003884116 2024-09-11T05:32:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.190806+0000", 2024-09-11T05:32:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4011999999999997e-05 2024-09-11T05:32:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.190879+0000", 2024-09-11T05:32:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2366999999999993e-05 2024-09-11T05:32:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193310+0000", 2024-09-11T05:32:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024310769999999998 2024-09-11T05:32:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194061+0000", 2024-09-11T05:32:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075133899999999996 2024-09-11T05:32:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194089+0000", 2024-09-11T05:32:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8212e-05 2024-09-11T05:32:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194110+0000", 2024-09-11T05:32:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0392000000000001e-05 2024-09-11T05:32:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186872+0000", 2024-09-11T05:32:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.501025036000001, 2024-09-11T05:32:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073548989999999998, 2024-09-11T05:32:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 137 2024-09-11T05:32:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186872+0000", 2024-09-11T05:32:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186872+0000", 2024-09-11T05:32:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186872+0000", 2024-09-11T05:32:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.35e-07 2024-09-11T05:32:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186915+0000", 2024-09-11T05:32:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2830999999999997e-05 2024-09-11T05:32:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186920+0000", 2024-09-11T05:32:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3789999999999997e-06 2024-09-11T05:32:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186923+0000", 2024-09-11T05:32:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.078e-06 2024-09-11T05:32:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.191196+0000", 2024-09-11T05:32:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042726170000000003 2024-09-11T05:32:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.191279+0000", 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3244000000000005e-05 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.191394+0000", 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115146 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193313+0000", 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019188040000000001 2024-09-11T05:32:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194145+0000", 2024-09-11T05:32:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083171299999999998 2024-09-11T05:32:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194191+0000", 2024-09-11T05:32:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6521999999999999e-05 2024-09-11T05:32:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194227+0000", 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5330000000000002e-05 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186929+0000", 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.500968399000001, 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073793499999999998, 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138 2024-09-11T05:32:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186929+0000", 2024-09-11T05:32:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186929+0000", 2024-09-11T05:32:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186929+0000", 2024-09-11T05:32:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:32:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186931+0000", 2024-09-11T05:32:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.108e-06 2024-09-11T05:32:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186935+0000", 2024-09-11T05:32:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3830000000000002e-06 2024-09-11T05:32:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186938+0000", 2024-09-11T05:32:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7690000000000001e-06 2024-09-11T05:32:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.191919+0000", 2024-09-11T05:32:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049811009999999999 2024-09-11T05:32:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.191964+0000", 2024-09-11T05:32:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5206000000000001e-05 2024-09-11T05:32:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192042+0000", 2024-09-11T05:32:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7404999999999995e-05 2024-09-11T05:32:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193890+0000", 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018477330000000001 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194261+0000", 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000371839 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194287+0000", 2024-09-11T05:32:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5554e-05 2024-09-11T05:32:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194308+0000", 2024-09-11T05:32:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0944000000000001e-05 2024-09-11T05:32:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186942+0000", 2024-09-11T05:32:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.500954682, 2024-09-11T05:32:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074930750000000001, 2024-09-11T05:32:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139 2024-09-11T05:32:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186942+0000", 2024-09-11T05:32:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186942+0000", 2024-09-11T05:32:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186942+0000", 2024-09-11T05:32:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.28e-07 2024-09-11T05:32:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186946+0000", 2024-09-11T05:32:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6270000000000002e-06 2024-09-11T05:32:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186949+0000", 2024-09-11T05:32:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1690000000000001e-06 2024-09-11T05:32:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186952+0000", 2024-09-11T05:32:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5339999999999998e-06 2024-09-11T05:32:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192317+0000", 2024-09-11T05:32:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053653900000000003 2024-09-11T05:32:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192390+0000", 2024-09-11T05:32:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2336999999999995e-05 2024-09-11T05:32:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192505+0000", 2024-09-11T05:32:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115784 2024-09-11T05:32:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193893+0000", 2024-09-11T05:32:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001387421 2024-09-11T05:32:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194355+0000", 2024-09-11T05:32:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046241000000000001 2024-09-11T05:32:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194402+0000", 2024-09-11T05:32:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6780000000000003e-05 2024-09-11T05:32:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194435+0000", 2024-09-11T05:32:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3395000000000001e-05 2024-09-11T05:32:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186955+0000", 2024-09-11T05:32:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.500941658999999, 2024-09-11T05:32:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075532510000000004, 2024-09-11T05:32:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 140 2024-09-11T05:32:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186955+0000", 2024-09-11T05:32:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186955+0000", 2024-09-11T05:32:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186955+0000", 2024-09-11T05:32:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:32:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186999+0000", 2024-09-11T05:32:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3760000000000001e-05 2024-09-11T05:32:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187003+0000", 2024-09-11T05:32:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:32:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187006+0000", 2024-09-11T05:32:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-11T05:32:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192816+0000", 2024-09-11T05:32:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058095350000000002 2024-09-11T05:32:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192864+0000", 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7709e-05 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192935+0000", 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1657999999999997e-05 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194116+0000", 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011812470000000001 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194462+0000", 2024-09-11T05:32:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034602999999999999 2024-09-11T05:32:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194489+0000", 2024-09-11T05:32:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6363000000000002e-05 2024-09-11T05:32:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194509+0000", 2024-09-11T05:32:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9712e-05 2024-09-11T05:32:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.187011+0000", 2024-09-11T05:32:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.500885543999999, 2024-09-11T05:32:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076080940000000001, 2024-09-11T05:32:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 141 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187011+0000", 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187011+0000", 2024-09-11T05:32:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187012+0000", 2024-09-11T05:32:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:32:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187015+0000", 2024-09-11T05:32:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0630000000000002e-06 2024-09-11T05:32:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187020+0000", 2024-09-11T05:32:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6999999999999999e-06 2024-09-11T05:32:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187022+0000", 2024-09-11T05:32:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8779999999999998e-06 2024-09-11T05:32:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193357+0000", 2024-09-11T05:32:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063344559999999996 2024-09-11T05:32:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193428+0000", 2024-09-11T05:32:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0726e-05 2024-09-11T05:32:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193545+0000", 2024-09-11T05:32:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117151 2024-09-11T05:32:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194314+0000", 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076884900000000005 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194543+0000", 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022956699999999999 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194588+0000", 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4715000000000001e-05 2024-09-11T05:32:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194619+0000", 2024-09-11T05:32:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1606999999999997e-05 2024-09-11T05:32:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:32:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.639164+0000", 2024-09-11T05:32:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.048733039999998, 2024-09-11T05:32:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055682639999999999, 2024-09-11T05:32:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:32:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:32:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:32:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 159 2024-09-11T05:32:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.639164+0000", 2024-09-11T05:32:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.639164+0000", 2024-09-11T05:32:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.639164+0000", 2024-09-11T05:32:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7000000000000001e-07 2024-09-11T05:32:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.639166+0000", 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0999999999999998e-06 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.639170+0000", 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.639172+0000", 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.509e-06 2024-09-11T05:32:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.642617+0000", 2024-09-11T05:32:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034451070000000002 2024-09-11T05:32:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.642666+0000", 2024-09-11T05:32:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8668999999999998e-05 2024-09-11T05:32:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:32:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.642735+0000", 2024-09-11T05:32:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8707000000000005e-05 2024-09-11T05:32:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:32:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.643250+0000", 2024-09-11T05:32:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051594499999999997 2024-09-11T05:32:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:32:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.644683+0000", 2024-09-11T05:32:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001432427 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.644711+0000", 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8481000000000001e-05 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.644732+0000", 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0750999999999998e-05 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:57.818 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:32:57.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:32:57.820 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:32:57.818+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:32:57.920 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:32:57.920+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:32:57.968 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:32:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:32:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:32:57.968 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:32:57.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:32:58.021 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:32:58.021+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:32:58.121 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:32:58.121+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:32:58.122 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:32:58.122 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:32:58.122 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:32:58.122 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:32:58.122 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:32:58.131 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:32:58.198 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:32:58.236 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:32:58.237 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:32:58.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:32:58.237 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:32:58.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:58.237 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4235.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-11T05:32:58.237 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.586901+0000", 2024-09-11T05:32:58.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.649520144, 2024-09-11T05:32:58.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00061607100000000004, 2024-09-11T05:32:58.237 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:32:58.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:32:58.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:32:58.238 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:32:58.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:58.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:32:58.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.586901+0000", 2024-09-11T05:32:58.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:58.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:58.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:58.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:32:58.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.586901+0000", 2024-09-11T05:32:58.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:32:58.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:58.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:58.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:32:58.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.586901+0000", 2024-09-11T05:32:58.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:32:58.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:58.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:58.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:32:58.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.586908+0000", 2024-09-11T05:32:58.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.486e-06 2024-09-11T05:32:58.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:58.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:58.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:32:58.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.586923+0000", 2024-09-11T05:32:58.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.431e-05 2024-09-11T05:32:58.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:58.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:58.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:32:58.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.586933+0000", 2024-09-11T05:32:58.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0158e-05 2024-09-11T05:32:58.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:58.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:58.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:32:58.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.586979+0000", 2024-09-11T05:32:58.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6174000000000002e-05 2024-09-11T05:32:58.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:58.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:58.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:32:58.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.587011+0000", 2024-09-11T05:32:58.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2058999999999999e-05 2024-09-11T05:32:58.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:58.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:58.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:32:58.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.587480+0000", 2024-09-11T05:32:58.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046879300000000001 2024-09-11T05:32:58.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:32:58.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:32:58.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:32:58.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.587517+0000", 2024-09-11T05:32:58.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6887000000000001e-05 2024-09-11T05:32:58.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:58.242 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:58.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:58.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:32:58.243 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:32:58.243 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:32:58.243 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:32:58.236+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:32:58.245 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:32:58.323 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:32:58.323 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:32:58.324 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:32:58.323+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:32:58.340 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:32:58.340 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:32:58.358 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:32:58.358 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:32:58.374 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:32:58.374 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:32:58.391 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:32:58.391 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:32:58.392 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:58.392 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:58.401 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:32:58.408 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:32:58.409 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:32:58.424 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:58.424+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:32:58.425 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:32:58.426 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:32:58.442 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:32:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:32:58.514 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:58.515 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:58.524 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:32:58.525 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:32:58.524+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:32:58.626 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:32:58.626+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:32:58.628 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:58.628 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:58.638 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:32:58.728 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:58.728+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:32:58.753 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:58.753 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:58.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:32:58.846 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:58.846+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:32:58.906 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:58.906 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:58.915 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:32:58.929 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:32:58.929+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:32:59.030 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:32:59.030+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:32:59.058 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:59.058 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:59.067 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:32:59.131 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:32:59.131+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:32:59.169 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:59.169 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:59.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:32:59.233 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:32:59.232+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:32:59.295 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:32:59.310 INFO:teuthology.orchestra.run.smithi070.stdout:2 write 0x7d6bd62 thru 0x7d7b0f7 (0xf396 bytes) 2024-09-11T05:32:59.313 INFO:teuthology.orchestra.run.smithi070.stdout:3 write 0x1728158 thru 0x172c826 (0x46cf bytes) 2024-09-11T05:32:59.316 INFO:teuthology.orchestra.run.smithi070.stdout:5 read 0x5453aee thru 0x545fc5d (0xc170 bytes) 2024-09-11T05:32:59.316 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:32:59.316 INFO:teuthology.orchestra.run.smithi070.stdout:truncating to largest ever: 0x774d8f3 2024-09-11T05:32:59.317 INFO:teuthology.orchestra.run.smithi070.stdout:7 trunc from 0x7d7b0f8 to 0x774d8f3 2024-09-11T05:32:59.326 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:59.326 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:59.328 INFO:teuthology.orchestra.run.smithi070.stdout:8 read 0xc66b87 thru 0xc707ed (0x9c67 bytes) 2024-09-11T05:32:59.328 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:32:59.328 INFO:teuthology.orchestra.run.smithi070.stdout:11 read 0x3453cf6 thru 0x3457f7d (0x4288 bytes) 2024-09-11T05:32:59.334 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:59.334+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:32:59.335 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:32:59.342 INFO:teuthology.orchestra.run.smithi070.stdout:12 writesame 0xea1dd38 thru 0xea200a4 data_size 0x1(0x236d bytes) 2024-09-11T05:32:59.343 INFO:teuthology.orchestra.run.smithi070.stdout:14 write 0xc14abe1 thru 0xc14ec90 (0x40b0 bytes) 2024-09-11T05:32:59.345 INFO:teuthology.orchestra.run.smithi070.stdout:15 write 0x362ca3e thru 0x363b32b (0xe8ee bytes) 2024-09-11T05:32:59.349 INFO:teuthology.orchestra.run.smithi070.stdout:16 writesame 0x8a0a1f thru 0x8adfc3 data_size 0x67(0xd5a5 bytes) 2024-09-11T05:32:59.352 INFO:teuthology.orchestra.run.smithi070.stdout:17 writesame 0x5145f83 thru 0x5153335 data_size 0x5(0xd3b3 bytes) 2024-09-11T05:32:59.362 INFO:teuthology.orchestra.run.smithi070.stdout:22 read 0x6f1cc17 thru 0x6f26f88 (0xa372 bytes) 2024-09-11T05:32:59.362 INFO:teuthology.orchestra.run.smithi070.stdout:23 read 0x8cac862 thru 0x8cb7c1d (0xb3bc bytes) 2024-09-11T05:32:59.362 INFO:teuthology.orchestra.run.smithi070.stdout:24 writesame 0x6c1d4f6 thru 0x6c24c36 data_size 0x1(0x7741 bytes) 2024-09-11T05:32:59.381 INFO:teuthology.orchestra.run.smithi070.stdout:26 write 0x439e36 thru 0x4484bd (0xe688 bytes) 2024-09-11T05:32:59.385 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:32:59.385 INFO:teuthology.orchestra.run.smithi070.stdout:28 read 0x3408160 thru 0x3410111 (0x7fb2 bytes) 2024-09-11T05:32:59.385 INFO:teuthology.orchestra.run.smithi070.stdout:29 punch from 0x8cbc3aa to 0x8cc2100, (0x5d56 bytes) 2024-09-11T05:32:59.385 INFO:teuthology.orchestra.run.smithi070.stdout:30 read 0xa4325fa thru 0xa435df5 (0x37fc bytes) 2024-09-11T05:32:59.396 INFO:teuthology.orchestra.run.smithi070.stdout:31 trunc from 0xea200a5 to 0x52ab813 2024-09-11T05:32:59.409 INFO:teuthology.orchestra.run.smithi070.stdout:33 read 0x357d63 thru 0x35e594 (0x6832 bytes) 2024-09-11T05:32:59.415 INFO:teuthology.orchestra.run.smithi070.stdout:34 write 0x6566d55 thru 0x65767f5 (0xfaa1 bytes) 2024-09-11T05:32:59.419 INFO:teuthology.orchestra.run.smithi070.stdout:truncating to largest ever: 0xcd6ec5e 2024-09-11T05:32:59.427 INFO:teuthology.orchestra.run.smithi070.stdout:36 trunc from 0x65767f6 to 0xcd6ec5e 2024-09-11T05:32:59.435 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:32:59.435+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:32:59.439 INFO:teuthology.orchestra.run.smithi070.stdout:38 write 0xe221ae6 thru 0xe225e06 (0x4321 bytes) 2024-09-11T05:32:59.449 INFO:teuthology.orchestra.run.smithi070.stdout:39 trunc from 0xe225e07 to 0x84a4b93 2024-09-11T05:32:59.458 INFO:teuthology.orchestra.run.smithi070.stdout:40 writesame 0x4a63dcf thru 0x4a6c0cf data_size 0x7(0x8301 bytes) 2024-09-11T05:32:59.476 INFO:teuthology.orchestra.run.smithi070.stdout:41 write 0xe813e26 thru 0xe81beff (0x80da bytes) 2024-09-11T05:32:59.479 INFO:teuthology.orchestra.run.smithi070.stdout:45 write 0x5c8aaa3 thru 0x5c8adfe (0x35c bytes) 2024-09-11T05:32:59.481 INFO:teuthology.orchestra.run.smithi070.stdout:47 write 0x4f0d761 thru 0x4f0e338 (0xbd8 bytes) 2024-09-11T05:32:59.483 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:32:59.484 INFO:teuthology.orchestra.run.smithi070.stdout:49 writesame 0xbecb6b3 thru 0xbecf5ab data_size 0x2f(0x3ef9 bytes) 2024-09-11T05:32:59.486 INFO:teuthology.orchestra.run.smithi070.stdout:50 write 0x4bb47ee thru 0x4bc1e82 (0xd695 bytes) 2024-09-11T05:32:59.487 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:59.487 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:59.488 INFO:teuthology.orchestra.run.smithi070.stdout:51 writesame 0x3560284 thru 0x3564668 data_size 0xd(0x43e5 bytes) 2024-09-11T05:32:59.490 INFO:teuthology.orchestra.run.smithi070.stdout:52 writesame 0x196deef thru 0x1970549 data_size 0x3(0x265b bytes) 2024-09-11T05:32:59.494 INFO:teuthology.orchestra.run.smithi070.stdout:53 writesame 0x9bb8ad5 thru 0x9bc01a9 data_size 0x1(0x76d5 bytes) 2024-09-11T05:32:59.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:32:59.512 INFO:teuthology.orchestra.run.smithi070.stdout:54 writesame 0xa7cb9c3 thru 0xa7d7246 data_size 0x2(0xb884 bytes) 2024-09-11T05:32:59.526 INFO:teuthology.orchestra.run.smithi070.stdout:55 punch from 0x7173b4c to 0x71788f2, (0x4da6 bytes) 2024-09-11T05:32:59.526 INFO:teuthology.orchestra.run.smithi070.stdout:56 writesame 0x4f62463 thru 0x4f6c4a3 data_size 0x19(0xa041 bytes) 2024-09-11T05:32:59.528 INFO:teuthology.orchestra.run.smithi070.stdout:58 punch from 0x181d3f2 to 0x1823f61, (0x6b6f bytes) 2024-09-11T05:32:59.528 INFO:teuthology.orchestra.run.smithi070.stdout:60 read 0x6673197 thru 0x6675276 (0x20e0 bytes) 2024-09-11T05:32:59.529 INFO:teuthology.orchestra.run.smithi070.stdout:61 read 0x5785b9 thru 0x5834ca (0xaf12 bytes) 2024-09-11T05:32:59.529 INFO:teuthology.orchestra.run.smithi070.stdout:62 read 0x203da94 thru 0x2041c0f (0x417c bytes) 2024-09-11T05:32:59.529 INFO:teuthology.orchestra.run.smithi070.stdout:63 read 0x19d2f thru 0x2254a (0x881c bytes) 2024-09-11T05:32:59.536 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:32:59.535+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:32:59.539 INFO:teuthology.orchestra.run.smithi070.stdout:64 trunc from 0xe81bf00 to 0x6480ee4 2024-09-11T05:32:59.558 INFO:teuthology.orchestra.run.smithi070.stdout:65 read 0x317ca85 thru 0x31860fc (0x9678 bytes) 2024-09-11T05:32:59.558 INFO:teuthology.orchestra.run.smithi070.stdout:66 read 0x348815b thru 0x3489d56 (0x1bfc bytes) 2024-09-11T05:32:59.572 INFO:teuthology.orchestra.run.smithi070.stdout:67 writesame 0xd01d5df thru 0xd024aac data_size 0x1(0x74ce bytes) 2024-09-11T05:32:59.572 INFO:teuthology.orchestra.run.smithi070.stdout:68 read 0xaf60162 thru 0xaf676f8 (0x7597 bytes) 2024-09-11T05:32:59.572 INFO:teuthology.orchestra.run.smithi070.stdout:69 read 0x9e34dd4 thru 0x9e3b0e7 (0x6314 bytes) 2024-09-11T05:32:59.572 INFO:teuthology.orchestra.run.smithi070.stdout:70 writesame 0x4a8482a thru 0x4a904bc data_size 0x5(0xbc93 bytes) 2024-09-11T05:32:59.579 INFO:teuthology.orchestra.run.smithi070.stdout:73 write 0xb758b65 thru 0xb75b1dd (0x2679 bytes) 2024-09-11T05:32:59.582 INFO:teuthology.orchestra.run.smithi070.stdout:75 punch from 0xa35c8ec to 0xa35ed3c, (0x2450 bytes) 2024-09-11T05:32:59.582 INFO:teuthology.orchestra.run.smithi070.stdout:76 read 0x2ebfc87 thru 0x2ec4197 (0x4511 bytes) 2024-09-11T05:32:59.587 INFO:teuthology.orchestra.run.smithi070.stdout:77 trunc from 0xd024aad to 0x8cd2c41 2024-09-11T05:32:59.596 INFO:teuthology.orchestra.run.smithi070.stdout:78 read 0x734cc67 thru 0x734f368 (0x2702 bytes) 2024-09-11T05:32:59.597 INFO:teuthology.orchestra.run.smithi070.stdout:79 read 0x646d111 thru 0x6472757 (0x5647 bytes) 2024-09-11T05:32:59.597 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:32:59.597 INFO:teuthology.orchestra.run.smithi070.stdout:81 punch from 0x501fbcc to 0x50256ba, (0x5aee bytes) 2024-09-11T05:32:59.609 INFO:teuthology.orchestra.run.smithi070.stdout:82 writesame 0xdc2139f thru 0xdc292a7 data_size 0x1(0x7f09 bytes) 2024-09-11T05:32:59.609 INFO:teuthology.orchestra.run.smithi070.stdout:86 read 0xbfca32 thru 0xc01e78 (0x5447 bytes) 2024-09-11T05:32:59.609 INFO:teuthology.orchestra.run.smithi070.stdout:88 punch from 0x23941db to 0x239a2c6, (0x60eb bytes) 2024-09-11T05:32:59.609 INFO:teuthology.orchestra.run.smithi070.stdout:89 write 0x5d0b7f2 thru 0x5d1a72e (0xef3d bytes) 2024-09-11T05:32:59.611 INFO:teuthology.orchestra.run.smithi070.stdout:91 punch from 0x4b2603a to 0x4b27883, (0x1849 bytes) 2024-09-11T05:32:59.611 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:32:59.611 INFO:teuthology.orchestra.run.smithi070.stdout:93 write 0xd2f2599 thru 0xd2fc9ef (0xa457 bytes) 2024-09-11T05:32:59.614 INFO:teuthology.orchestra.run.smithi070.stdout:95 write 0x97bb7ea thru 0x97c3005 (0x781c bytes) 2024-09-11T05:32:59.616 INFO:teuthology.orchestra.run.smithi070.stdout:96 writesame 0x40b7ed0 thru 0x40c4fe2 data_size 0x39(0xd113 bytes) 2024-09-11T05:32:59.620 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:32:59.621 INFO:teuthology.orchestra.run.smithi070.stdout:98 read 0xac04102 thru 0xac0d808 (0x9707 bytes) 2024-09-11T05:32:59.621 INFO:teuthology.orchestra.run.smithi070.stdout:99 writesame 0x1ea0d4e thru 0x1ea5c99 data_size 0x1(0x4f4c bytes) 2024-09-11T05:32:59.622 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:32:59.633 INFO:teuthology.orchestra.run.smithi070.stdout:100 punch from 0x7aeef02 to 0x7aefe4c, (0xf4a bytes) 2024-09-11T05:32:59.633 INFO:teuthology.orchestra.run.smithi070.stdout:101 write 0x1839f2f thru 0x1846504 (0xc5d6 bytes) 2024-09-11T05:32:59.634 INFO:teuthology.orchestra.run.smithi070.stdout:104 read 0x47a387c thru 0x47a5a09 (0x218e bytes) 2024-09-11T05:32:59.634 INFO:teuthology.orchestra.run.smithi070.stdout:105 writesame 0x50484a0 thru 0x5051087 data_size 0x16(0x8be8 bytes) 2024-09-11T05:32:59.636 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:32:59.636+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:32:59.647 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:59.647 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:59.648 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:32:59.648 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:32:59.648 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T05:32:59.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T05:32:59.654 INFO:teuthology.orchestra.run.smithi070.stdout:106 trunc from 0xdc292a8 to 0x94eaa 2024-09-11T05:32:59.656 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:32:59.669 INFO:teuthology.orchestra.run.smithi070.stdout:107 read 0x8b8b8 thru 0x94ea9 (0x95f2 bytes) 2024-09-11T05:32:59.682 INFO:teuthology.orchestra.run.smithi070.stdout:108 trunc from 0x94eaa to 0xba4e0db 2024-09-11T05:32:59.694 INFO:teuthology.orchestra.run.smithi070.stdout:109 trunc from 0xba4e0db to 0x74c8269 2024-09-11T05:32:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:110 read 0x43ffb82 thru 0x44096f5 (0x9b74 bytes) 2024-09-11T05:32:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:112 writesame 0x688957a thru 0x689259f data_size 0x1(0x9026 bytes) 2024-09-11T05:32:59.728 INFO:teuthology.orchestra.run.smithi070.stdout:113 read 0x45670 thru 0x496ee (0x407f bytes) 2024-09-11T05:32:59.736 INFO:teuthology.orchestra.run.smithi070.stdout:114 trunc from 0x74c8269 to 0xc1929e 2024-09-11T05:32:59.737 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:32:59.737+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:32:59.763 INFO:teuthology.orchestra.run.smithi070.stdout:115 trunc from 0xc1929e to 0xbb044b8 2024-09-11T05:32:59.763 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:59.763 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:59.773 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:32:59.777 INFO:teuthology.orchestra.run.smithi070.stdout:117 write 0xe6c15d6 thru 0xe6ce8c4 (0xd2ef bytes) 2024-09-11T05:32:59.780 INFO:teuthology.orchestra.run.smithi070.stdout:118 write 0x2eb7095 thru 0x2ec0cbd (0x9c29 bytes) 2024-09-11T05:32:59.783 INFO:teuthology.orchestra.run.smithi070.stdout:119 write 0x25fe247 thru 0x2609ae6 (0xb8a0 bytes) 2024-09-11T05:32:59.787 INFO:teuthology.orchestra.run.smithi070.stdout:121 punch from 0x72e3243 to 0x72edc6b, (0xaa28 bytes) 2024-09-11T05:32:59.787 INFO:teuthology.orchestra.run.smithi070.stdout:122 writesame 0x7595bd6 thru 0x75a4eda data_size 0x1(0xf305 bytes) 2024-09-11T05:32:59.834 INFO:teuthology.orchestra.run.smithi070.stdout:124 writesame 0xa801cca thru 0xa80f01b data_size 0xb(0xd352 bytes) 2024-09-11T05:32:59.843 INFO:teuthology.orchestra.run.smithi070.stdout:125 punch from 0x37275ca to 0x3736c39, (0xf66f bytes) 2024-09-11T05:32:59.843 INFO:teuthology.orchestra.run.smithi070.stdout:129 writesame 0xb1f570d thru 0xb1f5ae2 data_size 0x1(0x3d6 bytes) 2024-09-11T05:32:59.847 INFO:teuthology.orchestra.run.smithi070.stdout:130 writesame 0x879b393 thru 0x879cf65 data_size 0x1(0x1bd3 bytes) 2024-09-11T05:32:59.854 INFO:teuthology.orchestra.run.smithi070.stdout:131 punch from 0xa241a87 to 0xa251688, (0xfc01 bytes) 2024-09-11T05:32:59.854 INFO:teuthology.orchestra.run.smithi070.stdout:132 write 0x2ed3e06 thru 0x2edf7be (0xb9b9 bytes) 2024-09-11T05:32:59.856 INFO:teuthology.orchestra.run.smithi070.stdout:133 writesame 0x3d6a837 thru 0x3d7990c data_size 0x1d(0xf0d6 bytes) 2024-09-11T05:32:59.858 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:59.858+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:32:59.860 INFO:teuthology.orchestra.run.smithi070.stdout:135 punch from 0xa1d0c16 to 0xa1d56c6, (0x4ab0 bytes) 2024-09-11T05:32:59.860 INFO:teuthology.orchestra.run.smithi070.stdout:137 writesame 0x7b7dcc2 thru 0x7b86c0e data_size 0x73(0x8f4d bytes) 2024-09-11T05:32:59.863 INFO:teuthology.orchestra.run.smithi070.stdout:138 writesame 0xa6c444c thru 0xa6d394b data_size 0x62(0xf500 bytes) 2024-09-11T05:32:59.867 INFO:teuthology.orchestra.run.smithi070.stdout:139 write 0xac824fe thru 0xac87d37 (0x583a bytes) 2024-09-11T05:32:59.870 INFO:teuthology.orchestra.run.smithi070.stdout:140 writesame 0x2d4cd57 thru 0x2d4e1cf data_size 0x1(0x1479 bytes) 2024-09-11T05:32:59.875 INFO:teuthology.orchestra.run.smithi070.stdout:141 punch from 0xbed5b68 to 0xbee3f5b, (0xe3f3 bytes) 2024-09-11T05:32:59.875 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:32:59.875 INFO:teuthology.orchestra.run.smithi070.stdout:143 punch from 0x6766eca to 0x676eb1d, (0x7c53 bytes) 2024-09-11T05:32:59.876 INFO:teuthology.orchestra.run.smithi070.stdout:144 write 0xa9e6633 thru 0xa9eb5a4 (0x4f72 bytes) 2024-09-11T05:32:59.877 INFO:teuthology.orchestra.run.smithi070.stdout:145 read 0xbab56c0 thru 0xbabcb23 (0x7464 bytes) 2024-09-11T05:32:59.877 INFO:teuthology.orchestra.run.smithi070.stdout:146 writesame 0xa1126a6 thru 0xa11e4d4 data_size 0x1(0xbe2f bytes) 2024-09-11T05:32:59.912 INFO:teuthology.orchestra.run.smithi070.stdout:147 write 0x4ae2ca2 thru 0x4ae922b (0x658a bytes) 2024-09-11T05:32:59.918 INFO:teuthology.orchestra.run.smithi070.stdout:148 read 0x48936a6 thru 0x48a1227 (0xdb82 bytes) 2024-09-11T05:32:59.919 INFO:teuthology.orchestra.run.smithi070.stdout:150 punch from 0x63a5ff5 to 0x63b4006, (0xe011 bytes) 2024-09-11T05:32:59.919 INFO:teuthology.orchestra.run.smithi070.stdout:151 write 0x1c1aa11 thru 0x1c1de73 (0x3463 bytes) 2024-09-11T05:32:59.921 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:32:59.922 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:32:59.922 INFO:teuthology.orchestra.run.smithi070.stdout:152 write 0xa481361 thru 0xa4864db (0x517b bytes) 2024-09-11T05:32:59.923 INFO:teuthology.orchestra.run.smithi070.stdout:154 read 0xd319a16 thru 0xd31d06a (0x3655 bytes) 2024-09-11T05:32:59.923 INFO:teuthology.orchestra.run.smithi070.stdout:155 read 0x3f9a3a9 thru 0x3fa838f (0xdfe7 bytes) 2024-09-11T05:32:59.924 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:32:59.924 INFO:teuthology.orchestra.run.smithi070.stdout:157 writesame 0x331ce2c thru 0x332857c data_size 0x1(0xb751 bytes) 2024-09-11T05:32:59.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:32:59.957 INFO:teuthology.orchestra.run.smithi070.stdout:160 writesame 0xc6c14d7 thru 0xc6c7157 data_size 0x11(0x5c81 bytes) 2024-09-11T05:32:59.963 INFO:teuthology.orchestra.run.smithi070.stdout:161 write 0xb499d31 thru 0xb4a6b31 (0xce01 bytes) 2024-09-11T05:32:59.967 INFO:teuthology.orchestra.run.smithi070.stdout:162 read 0x3b30943 thru 0x3b3d867 (0xcf25 bytes) 2024-09-11T05:32:59.967 INFO:teuthology.orchestra.run.smithi070.stdout:165 punch from 0x6b3344b to 0x6b3656f, (0x3124 bytes) 2024-09-11T05:32:59.967 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:32:59.967 INFO:teuthology.orchestra.run.smithi070.stdout:167 punch from 0x254c893 to 0x2552e12, (0x657f bytes) 2024-09-11T05:32:59.967 INFO:teuthology.orchestra.run.smithi070.stdout:168 read 0x35e29ea thru 0x35ed09f (0xa6b6 bytes) 2024-09-11T05:32:59.967 INFO:teuthology.orchestra.run.smithi070.stdout:169 read 0x7561e79 thru 0x757073b (0xe8c3 bytes) 2024-09-11T05:32:59.968 INFO:teuthology.orchestra.run.smithi070.stdout:170 read 0x919baac thru 0x91a0033 (0x4588 bytes) 2024-09-11T05:32:59.968 INFO:teuthology.orchestra.run.smithi070.stdout:171 read 0x2718d08 thru 0x27260ba (0xd3b3 bytes) 2024-09-11T05:32:59.968 INFO:teuthology.orchestra.run.smithi070.stdout:172 write 0x49bf531 thru 0x49c70df (0x7baf bytes) 2024-09-11T05:32:59.971 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:32:59.971+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:32:59.984 INFO:teuthology.orchestra.run.smithi070.stdout:173 trunc from 0xe6ce8c5 to 0x17a71c7 2024-09-11T05:33:00.004 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:33:00.004 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:00.004 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 25, 2024-09-11T05:33:00.004 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "eb5ff116-0384-4170-94d3-d3ddcb9c254f", 2024-09-11T05:33:00.004 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T05:32:25.817911+0000", 2024-09-11T05:33:00.005 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T05:32:57.603462+0000", 2024-09-11T05:33:00.005 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T05:32:37.539498+0000", 2024-09-11T05:33:00.005 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T05:32:54.623194+0000", 2024-09-11T05:33:00.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T05:33:00.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5806080, 2024-09-11T05:33:00.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T05:33:00.005 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2024-09-11T05:33:00.005 INFO:teuthology.orchestra.run.smithi070.stdout: "noscrub", 2024-09-11T05:33:00.005 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T05:33:00.005 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T05:33:00.005 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T05:33:00.005 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T05:33:00.006 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:00.006 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 5, 2024-09-11T05:33:00.006 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T05:33:00.006 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T05:33:00.006 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T05:33:00.006 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T05:33:00.006 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T05:33:00.006 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T05:33:00.006 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T05:33:00.006 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "jewel", 2024-09-11T05:33:00.006 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T05:33:00.006 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T05:33:00.006 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T05:33:00.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.007 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T05:33:00.007 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T05:33:00.007 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:37.977484+0000", 2024-09-11T05:33:00.007 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T05:33:00.007 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T05:33:00.007 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:33:00.007 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:33:00.007 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:33:00.007 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:33:00.007 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:33:00.007 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:33:00.007 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:33:00.008 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:33:00.008 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:33:00.008 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:33:00.008 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:33:00.008 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T05:33:00.008 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T05:33:00.008 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T05:33:00.008 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T05:33:00.008 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T05:33:00.008 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:33:00.008 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:33:00.008 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:33:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:33:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:33:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:33:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:33:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "17", 2024-09-11T05:33:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:33:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:33:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:33:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:33:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:33:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T05:33:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:33:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:33:00.011 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:33:00.011 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:33:00.011 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:33:00.011 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:33:00.011 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:33:00.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.011 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:33:00.011 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:33:00.011 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:33:00.011 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:33:00.011 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:33:00.011 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:33:00.011 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:33:00.012 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:33:00.012 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:33:00.012 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:33:00.012 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:33:00.012 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T05:33:00.012 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T05:33:00.012 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T05:33:00.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.012 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:33:00.012 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T05:33:00.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.012 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:33:00.012 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T05:33:00.013 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:43.780723+0000", 2024-09-11T05:33:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T05:33:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:33:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:33:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:33:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:33:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:33:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:33:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:33:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:33:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:33:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:33:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:33:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:33:00.015 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T05:33:00.015 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T05:33:00.015 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T05:33:00.015 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T05:33:00.015 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T05:33:00.015 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:33:00.015 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:33:00.015 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:33:00.015 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:33:00.015 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:33:00.015 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:33:00.015 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:33:00.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.016 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "21", 2024-09-11T05:33:00.016 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:33:00.016 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:33:00.016 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:33:00.016 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:33:00.016 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:33:00.016 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T05:33:00.016 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 21, 2024-09-11T05:33:00.016 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:33:00.016 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:33:00.016 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:33:00.016 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:33:00.016 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:33:00.017 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:33:00.017 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:33:00.017 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:33:00.017 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:33:00.017 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:33:00.017 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:33:00.017 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:33:00.017 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:33:00.017 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:33:00.017 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:33:00.017 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:33:00.017 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:33:00.017 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:33:00.018 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T05:33:00.019 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:33:00.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T05:33:00.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.019 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:33:00.019 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:33:00.019 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 5, 2024-09-11T05:33:00.019 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 5, 2024-09-11T05:33:00.019 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.75, 2024-09-11T05:33:00.019 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 3.75, 2024-09-11T05:33:00.019 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 3.75, 2024-09-11T05:33:00.019 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-11T05:33:00.019 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-11T05:33:00.019 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-11T05:33:00.020 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.020 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T05:33:00.020 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T05:33:00.020 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:53.728195+0000", 2024-09-11T05:33:00.020 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T05:33:00.020 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:33:00.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:33:00.020 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:33:00.020 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:33:00.020 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:33:00.020 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T05:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T05:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T05:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T05:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T05:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "25", 2024-09-11T05:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T05:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 25, 2024-09-11T05:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:33:00.024 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:33:00.024 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:33:00.024 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:33:00.024 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:33:00.024 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:33:00.024 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:33:00.024 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:33:00.024 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:33:00.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:33:00.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.024 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:33:00.024 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:33:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:33:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.7400000095367432, 2024-09-11T05:33:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.7400000095367432, 2024-09-11T05:33:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T05:33:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-11T05:33:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-11T05:33:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-11T05:33:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-11T05:33:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-11T05:33:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T05:33:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T05:33:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "6ef7487b-9326-4062-8fe4-ef39030252bd", 2024-09-11T05:33:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T05:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T05:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T05:33:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T05:33:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T05:33:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T05:33:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6819/4108497907", 2024-09-11T05:33:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6821/4108497907", 2024-09-11T05:33:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6825/4108497907", 2024-09-11T05:33:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6823/4108497907", 2024-09-11T05:33:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T05:33:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "3e0d8348-6e1b-4d63-b0f1-c20d90d73760", 2024-09-11T05:33:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T05:33:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T05:33:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T05:33:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T05:33:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T05:33:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T05:33:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.038 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T05:33:00.038 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:00.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.038 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.038 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/3979396531", 2024-09-11T05:33:00.038 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/3979396531", 2024-09-11T05:33:00.038 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/3979396531", 2024-09-11T05:33:00.038 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/3979396531", 2024-09-11T05:33:00.038 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:00.038 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:00.038 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:00.038 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.039 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T05:33:00.039 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "38bbb42f-85e2-4064-8f55-e0385aff07d4", 2024-09-11T05:33:00.039 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:00.039 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:00.039 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:00.039 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:00.039 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:00.039 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:00.039 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:00.039 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:00.039 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T05:33:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T05:33:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T05:33:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T05:33:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T05:33:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T05:33:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T05:33:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T05:33:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6811/4053894977", 2024-09-11T05:33:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6813/4053894977", 2024-09-11T05:33:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6817/4053894977", 2024-09-11T05:33:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6815/4053894977", 2024-09-11T05:33:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T05:33:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "e96ca529-f3b3-4f7e-bd59-1e9872a5efab", 2024-09-11T05:33:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T05:33:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T05:33:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6832", 2024-09-11T05:33:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6833", 2024-09-11T05:33:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T05:33:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T05:33:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6827/2067624829", 2024-09-11T05:33:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6829/2067624829", 2024-09-11T05:33:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6833/2067624829", 2024-09-11T05:33:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6831/2067624829", 2024-09-11T05:33:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T05:33:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dbbde660-d90e-4e02-9a01-16b0f76aa2b8", 2024-09-11T05:33:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 0, 2024-09-11T05:33:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0, 2024-09-11T05:33:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 18, 2024-09-11T05:33:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6816", 2024-09-11T05:33:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6817", 2024-09-11T05:33:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6818", 2024-09-11T05:33:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6819", 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6822", 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6823", 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6820", 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6821", 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6817/1743986256", 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6819/1743986256", 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6823/1743986256", 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6821/1743986256", 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "2dc1a002-3ec0-4b4d-b84d-e684fa8a9131", 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6824", 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6825", 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6826", 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6827", 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6830", 2024-09-11T05:33:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6831", 2024-09-11T05:33:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6828", 2024-09-11T05:33:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6829", 2024-09-11T05:33:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6825/2732588656", 2024-09-11T05:33:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6827/2732588656", 2024-09-11T05:33:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6831/2732588656", 2024-09-11T05:33:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6829/2732588656", 2024-09-11T05:33:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T05:33:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a", 2024-09-11T05:33:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6800", 2024-09-11T05:33:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6801", 2024-09-11T05:33:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6802", 2024-09-11T05:33:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6803", 2024-09-11T05:33:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6806", 2024-09-11T05:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6807", 2024-09-11T05:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6804", 2024-09-11T05:33:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6805", 2024-09-11T05:33:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6801/372011645", 2024-09-11T05:33:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6803/372011645", 2024-09-11T05:33:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6807/372011645", 2024-09-11T05:33:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6805/372011645", 2024-09-11T05:33:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "5fef4450-317c-4e1f-b05b-80740b9538f1", 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6808", 2024-09-11T05:33:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6809", 2024-09-11T05:33:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6810", 2024-09-11T05:33:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6811", 2024-09-11T05:33:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6814", 2024-09-11T05:33:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6815", 2024-09-11T05:33:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6812", 2024-09-11T05:33:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6813", 2024-09-11T05:33:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6809/583221652", 2024-09-11T05:33:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6811/583221652", 2024-09-11T05:33:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6815/583221652", 2024-09-11T05:33:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6813/583221652", 2024-09-11T05:33:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T05:33:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T05:33:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.130019+0000", 2024-09-11T05:33:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T05:33:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.339373+0000", 2024-09-11T05:33:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T05:33:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.204705+0000", 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.075490+0000", 2024-09-11T05:33:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T05:33:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 65536, 2024-09-11T05:33:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.279790+0000", 2024-09-11T05:33:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.287168+0000", 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:34.320448+0000", 2024-09-11T05:33:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T05:33:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:34.838001+0000", 2024-09-11T05:33:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [], 2024-09-11T05:33:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [], 2024-09-11T05:33:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T05:33:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T05:33:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T05:33:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T05:33:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T05:33:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T05:33:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [ 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 2, 2024-09-11T05:33:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [ 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 2, 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-11T05:33:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T05:33:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T05:33:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T05:33:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T05:33:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T05:33:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T05:33:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T05:33:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T05:33:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.084 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:00.085 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:00.085 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:00.087 INFO:tasks.thrashosds.thrasher:j is {'epoch': 25, 'fsid': 'eb5ff116-0384-4170-94d3-d3ddcb9c254f', 'created': '2024-09-11T05:32:25.817911+0000', 'modified': '2024-09-11T05:32:57.603462+0000', 'last_up_change': '2024-09-11T05:32:37.539498+0000', 'last_in_change': '2024-09-11T05:32:54.623194+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T05:32:37.977484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T05:32:43.780723+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 5, 'score_stable': 5, 'optimal_score': 0.75, 'raw_score_acting': 3.75, 'raw_score_stable': 3.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T05:32:53.728195+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 25, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '6ef7487b-9326-4062-8fe4-ef39030252bd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 4108497907}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 4108497907}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 4108497907}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 4108497907}]}, 'public_addr': '172.21.15.70:6819/4108497907', 'cluster_addr': '172.21.15.70:6821/4108497907', 'heartbeat_back_addr': '172.21.15.70:6825/4108497907', 'heartbeat_front_addr': '172.21.15.70:6823/4108497907', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3e0d8348-6e1b-4d63-b0f1-c20d90d73760', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 3979396531}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 3979396531}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 3979396531}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 3979396531}]}, 'public_addr': '172.21.15.70:6801/3979396531', 'cluster_addr': '172.21.15.70:6803/3979396531', 'heartbeat_back_addr': '172.21.15.70:6807/3979396531', 'heartbeat_front_addr': '172.21.15.70:6805/3979396531', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '38bbb42f-85e2-4064-8f55-e0385aff07d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 4053894977}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 4053894977}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 4053894977}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 4053894977}]}, 'public_addr': '172.21.15.70:6811/4053894977', 'cluster_addr': '172.21.15.70:6813/4053894977', 'heartbeat_back_addr': '172.21.15.70:6817/4053894977', 'heartbeat_front_addr': '172.21.15.70:6815/4053894977', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e96ca529-f3b3-4f7e-bd59-1e9872a5efab', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2067624829}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2067624829}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6832', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6833', 'nonce': 2067624829}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2067624829}]}, 'public_addr': '172.21.15.70:6827/2067624829', 'cluster_addr': '172.21.15.70:6829/2067624829', 'heartbeat_back_addr': '172.21.15.70:6833/2067624829', 'heartbeat_front_addr': '172.21.15.70:6831/2067624829', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'dbbde660-d90e-4e02-9a01-16b0f76aa2b8', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6816', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6817', 'nonce': 1743986256}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6818', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6819', 'nonce': 1743986256}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6822', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6823', 'nonce': 1743986256}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6820', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6821', 'nonce': 1743986256}]}, 'public_addr': '172.21.15.84:6817/1743986256', 'cluster_addr': '172.21.15.84:6819/1743986256', 'heartbeat_back_addr': '172.21.15.84:6823/1743986256', 'heartbeat_front_addr': '172.21.15.84:6821/1743986256', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2dc1a002-3ec0-4b4d-b84d-e684fa8a9131', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6824', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6825', 'nonce': 2732588656}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6826', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6827', 'nonce': 2732588656}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6830', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6831', 'nonce': 2732588656}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6828', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6829', 'nonce': 2732588656}]}, 'public_addr': '172.21.15.84:6825/2732588656', 'cluster_addr': '172.21.15.84:6827/2732588656', 'heartbeat_back_addr': '172.21.15.84:6831/2732588656', 'heartbeat_front_addr': '172.21.15.84:6829/2732588656', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6800', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6801', 'nonce': 372011645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6802', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6803', 'nonce': 372011645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6806', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6807', 'nonce': 372011645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6804', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6805', 'nonce': 372011645}]}, 'public_addr': '172.21.15.84:6801/372011645', 'cluster_addr': '172.21.15.84:6803/372011645', 'heartbeat_back_addr': '172.21.15.84:6807/372011645', 'heartbeat_front_addr': '172.21.15.84:6805/372011645', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '5fef4450-317c-4e1f-b05b-80740b9538f1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6808', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6809', 'nonce': 583221652}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6810', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6811', 'nonce': 583221652}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6814', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6815', 'nonce': 583221652}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6812', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6813', 'nonce': 583221652}]}, 'public_addr': '172.21.15.84:6809/583221652', 'cluster_addr': '172.21.15.84:6811/583221652', 'heartbeat_back_addr': '172.21.15.84:6815/583221652', 'heartbeat_front_addr': '172.21.15.84:6813/583221652', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.130019+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.339373+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.204705+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.075490+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.279790+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.287168+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:34.320448+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:34.838001+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 2, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 2, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T05:33:00.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:33:00.088 INFO:teuthology.orchestra.run.smithi070.stdout:174 write 0x8d7811a thru 0x8d789dc (0x8c3 bytes) 2024-09-11T05:33:00.088 INFO:teuthology.orchestra.run.smithi070.stdout:175 punch from 0x720c4cf to 0x72185e6, (0xc117 bytes) 2024-09-11T05:33:00.088 INFO:teuthology.orchestra.run.smithi070.stdout:177 read 0x6bad9d0 thru 0x6bafe99 (0x24ca bytes) 2024-09-11T05:33:00.088 INFO:teuthology.orchestra.run.smithi070.stdout:178 trunc from 0x8d789dd to 0x613f4fd 2024-09-11T05:33:00.088 INFO:teuthology.orchestra.run.smithi070.stdout:181 write 0x78ca04a thru 0x78cc622 (0x25d9 bytes) 2024-09-11T05:33:00.088 INFO:teuthology.orchestra.run.smithi070.stdout:184 trunc from 0x78cc623 to 0xb9d643 2024-09-11T05:33:00.088 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:00.088 INFO:teuthology.orchestra.run.smithi070.stdout:187 clone 1 order 23 su 524288 sc 15 2024-09-11T05:33:00.088 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:00.085+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:00.091 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:00.186 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:00.186+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:00.192 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:00.192 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:00.201 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:00.287 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:00.287+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:00.305 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:00.305 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:00.313 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:00.388 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:00.388+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:33:00.408 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:33:00.418 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:00.419 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:00.420 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-11T05:32:59.949132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590452,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":126,"num_write":167,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":208780,"kb_used_data":2920,"kb_used_omap":10,"kb_used_meta":205685,"kb_avail":660394100,"statfs":{"total":676457349120,"available":676243558400,"internally_reserved":0,"allocated":2990080,"data_stored":1830754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11157,"internal_metadata":210621547},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":26,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.321100"},"pg_stats":[{"pgid":"3.1f","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.623948+0000","last_change":"2024-09-11T05:32:57.613041+0000","last_active":"2024-09-11T05:32:57.623948+0000","last_peered":"2024-09-11T05:32:57.623948+0000","last_clean":"2024-09-11T05:32:57.623948+0000","last_became_active":"2024-09-11T05:32:55.616706+0000","last_became_peered":"2024-09-11T05:32:55.616706+0000","last_unstale":"2024-09-11T05:32:57.623948+0000","last_undegraded":"2024-09-11T05:32:57.623948+0000","last_fullsized":"2024-09-11T05:32:57.623948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:03:52.411513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069887699999999998,"stat_sum":{"num_bytes":46,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.612693+0000","last_change":"2024-09-11T05:32:57.612693+0000","last_active":"2024-09-11T05:32:57.612693+0000","last_peered":"2024-09-11T05:32:57.612693+0000","last_clean":"2024-09-11T05:32:57.612693+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:32:57.612693+0000","last_undegraded":"2024-09-11T05:32:57.612693+0000","last_fullsized":"2024-09-11T05:32:57.612693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:03.675984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039696399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.891873+0000","last_change":"2024-09-11T05:32:57.891873+0000","last_active":"2024-09-11T05:32:57.891873+0000","last_peered":"2024-09-11T05:32:57.891873+0000","last_clean":"2024-09-11T05:32:57.891873+0000","last_became_active":"2024-09-11T05:32:55.615674+0000","last_became_peered":"2024-09-11T05:32:55.615674+0000","last_unstale":"2024-09-11T05:32:57.891873+0000","last_undegraded":"2024-09-11T05:32:57.891873+0000","last_fullsized":"2024-09-11T05:32:57.891873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:00.766416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057469400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1c","version":"25'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.612989+0000","last_change":"2024-09-11T05:32:57.610640+0000","last_active":"2024-09-11T05:32:57.612989+0000","last_peered":"2024-09-11T05:32:57.612989+0000","last_clean":"2024-09-11T05:32:57.612989+0000","last_became_active":"2024-09-11T05:32:55.611900+0000","last_became_peered":"2024-09-11T05:32:55.611900+0000","last_unstale":"2024-09-11T05:32:57.612989+0000","last_undegraded":"2024-09-11T05:32:57.612989+0000","last_fullsized":"2024-09-11T05:32:57.612989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:56.664612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060489099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.607436+0000","last_change":"2024-09-11T05:32:57.607436+0000","last_active":"2024-09-11T05:32:57.607436+0000","last_peered":"2024-09-11T05:32:57.607436+0000","last_clean":"2024-09-11T05:32:57.607436+0000","last_became_active":"2024-09-11T05:32:55.616210+0000","last_became_peered":"2024-09-11T05:32:55.616210+0000","last_unstale":"2024-09-11T05:32:57.607436+0000","last_undegraded":"2024-09-11T05:32:57.607436+0000","last_fullsized":"2024-09-11T05:32:57.607436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:34:58.113881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061541299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1a","version":"25'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.628008+0000","last_change":"2024-09-11T05:32:57.611081+0000","last_active":"2024-09-11T05:32:57.628008+0000","last_peered":"2024-09-11T05:32:57.628008+0000","last_clean":"2024-09-11T05:32:57.628008+0000","last_became_active":"2024-09-11T05:32:55.612495+0000","last_became_peered":"2024-09-11T05:32:55.612495+0000","last_unstale":"2024-09-11T05:32:57.628008+0000","last_undegraded":"2024-09-11T05:32:57.628008+0000","last_fullsized":"2024-09-11T05:32:57.628008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:45.649221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049061,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.610393+0000","last_change":"2024-09-11T05:32:57.610393+0000","last_active":"2024-09-11T05:32:57.610393+0000","last_peered":"2024-09-11T05:32:57.610393+0000","last_clean":"2024-09-11T05:32:57.610393+0000","last_became_active":"2024-09-11T05:32:55.616919+0000","last_became_peered":"2024-09-11T05:32:55.616919+0000","last_unstale":"2024-09-11T05:32:57.610393+0000","last_undegraded":"2024-09-11T05:32:57.610393+0000","last_fullsized":"2024-09-11T05:32:57.610393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:30:14.389771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050971999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.613299+0000","last_change":"2024-09-11T05:32:57.613299+0000","last_active":"2024-09-11T05:32:57.613299+0000","last_peered":"2024-09-11T05:32:57.613299+0000","last_clean":"2024-09-11T05:32:57.613299+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:32:57.613299+0000","last_undegraded":"2024-09-11T05:32:57.613299+0000","last_fullsized":"2024-09-11T05:32:57.613299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:43.502866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084187599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.613037+0000","last_change":"2024-09-11T05:32:57.613037+0000","last_active":"2024-09-11T05:32:57.613037+0000","last_peered":"2024-09-11T05:32:57.613037+0000","last_clean":"2024-09-11T05:32:57.613037+0000","last_became_active":"2024-09-11T05:32:55.620957+0000","last_became_peered":"2024-09-11T05:32:55.620957+0000","last_unstale":"2024-09-11T05:32:57.613037+0000","last_undegraded":"2024-09-11T05:32:57.613037+0000","last_fullsized":"2024-09-11T05:32:57.613037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:55.041413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065268399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.891156+0000","last_change":"2024-09-11T05:32:57.891156+0000","last_active":"2024-09-11T05:32:57.891156+0000","last_peered":"2024-09-11T05:32:57.891156+0000","last_clean":"2024-09-11T05:32:57.891156+0000","last_became_active":"2024-09-11T05:32:55.618120+0000","last_became_peered":"2024-09-11T05:32:55.618120+0000","last_unstale":"2024-09-11T05:32:57.891156+0000","last_undegraded":"2024-09-11T05:32:57.891156+0000","last_fullsized":"2024-09-11T05:32:57.891156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:11.932021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057970299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.607444+0000","last_change":"2024-09-11T05:32:57.607444+0000","last_active":"2024-09-11T05:32:57.607444+0000","last_peered":"2024-09-11T05:32:57.607444+0000","last_clean":"2024-09-11T05:32:57.607444+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:32:57.607444+0000","last_undegraded":"2024-09-11T05:32:57.607444+0000","last_fullsized":"2024-09-11T05:32:57.607444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:57:45.182186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066300199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.890899+0000","last_change":"2024-09-11T05:32:57.890899+0000","last_active":"2024-09-11T05:32:57.890899+0000","last_peered":"2024-09-11T05:32:57.890899+0000","last_clean":"2024-09-11T05:32:57.890899+0000","last_became_active":"2024-09-11T05:32:55.617623+0000","last_became_peered":"2024-09-11T05:32:55.617623+0000","last_unstale":"2024-09-11T05:32:57.890899+0000","last_undegraded":"2024-09-11T05:32:57.890899+0000","last_fullsized":"2024-09-11T05:32:57.890899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:04.053462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073758600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.891165+0000","last_change":"2024-09-11T05:32:47.598023+0000","last_active":"2024-09-11T05:32:57.891165+0000","last_peered":"2024-09-11T05:32:57.891165+0000","last_clean":"2024-09-11T05:32:57.891165+0000","last_became_active":"2024-09-11T05:32:45.702003+0000","last_became_peered":"2024-09-11T05:32:45.702003+0000","last_unstale":"2024-09-11T05:32:57.891165+0000","last_undegraded":"2024-09-11T05:32:57.891165+0000","last_fullsized":"2024-09-11T05:32:57.891165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:08.654916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.659941+0000","last_change":"2024-09-11T05:32:57.659941+0000","last_active":"2024-09-11T05:32:57.659941+0000","last_peered":"2024-09-11T05:32:57.659941+0000","last_clean":"2024-09-11T05:32:57.659941+0000","last_became_active":"2024-09-11T05:32:55.613342+0000","last_became_peered":"2024-09-11T05:32:55.613342+0000","last_unstale":"2024-09-11T05:32:57.659941+0000","last_undegraded":"2024-09-11T05:32:57.659941+0000","last_fullsized":"2024-09-11T05:32:57.659941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:44:17.515365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033519099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.606807+0000","last_change":"2024-09-11T05:32:55.614406+0000","last_active":"2024-09-11T05:32:57.606807+0000","last_peered":"2024-09-11T05:32:57.606807+0000","last_clean":"2024-09-11T05:32:57.606807+0000","last_became_active":"2024-09-11T05:32:55.614125+0000","last_became_peered":"2024-09-11T05:32:55.614125+0000","last_unstale":"2024-09-11T05:32:57.606807+0000","last_undegraded":"2024-09-11T05:32:57.606807+0000","last_fullsized":"2024-09-11T05:32:57.606807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:06:59.971006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.618706+0000","last_change":"2024-09-11T05:32:57.618706+0000","last_active":"2024-09-11T05:32:57.618706+0000","last_peered":"2024-09-11T05:32:57.618706+0000","last_clean":"2024-09-11T05:32:57.618706+0000","last_became_active":"2024-09-11T05:32:55.615465+0000","last_became_peered":"2024-09-11T05:32:55.615465+0000","last_unstale":"2024-09-11T05:32:57.618706+0000","last_undegraded":"2024-09-11T05:32:57.618706+0000","last_fullsized":"2024-09-11T05:32:57.618706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:45:33.097987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099597899999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.891561+0000","last_change":"2024-09-11T05:32:55.611737+0000","last_active":"2024-09-11T05:32:57.891561+0000","last_peered":"2024-09-11T05:32:57.891561+0000","last_clean":"2024-09-11T05:32:57.891561+0000","last_became_active":"2024-09-11T05:32:55.611432+0000","last_became_peered":"2024-09-11T05:32:55.611432+0000","last_unstale":"2024-09-11T05:32:57.891561+0000","last_undegraded":"2024-09-11T05:32:57.891561+0000","last_fullsized":"2024-09-11T05:32:57.891561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:16.067863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'2","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.630030+0000","last_change":"2024-09-11T05:32:57.618700+0000","last_active":"2024-09-11T05:32:57.630030+0000","last_peered":"2024-09-11T05:32:57.630030+0000","last_clean":"2024-09-11T05:32:57.630030+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:32:57.630030+0000","last_undegraded":"2024-09-11T05:32:57.630030+0000","last_fullsized":"2024-09-11T05:32:57.630030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:35.373775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010906679999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.612169+0000","last_change":"2024-09-11T05:32:47.727035+0000","last_active":"2024-09-11T05:32:57.612169+0000","last_peered":"2024-09-11T05:32:57.612169+0000","last_clean":"2024-09-11T05:32:57.612169+0000","last_became_active":"2024-09-11T05:32:45.702510+0000","last_became_peered":"2024-09-11T05:32:45.702510+0000","last_unstale":"2024-09-11T05:32:57.612169+0000","last_undegraded":"2024-09-11T05:32:57.612169+0000","last_fullsized":"2024-09-11T05:32:57.612169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:35:31.635413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.890326+0000","last_change":"2024-09-11T05:32:57.890326+0000","last_active":"2024-09-11T05:32:57.890326+0000","last_peered":"2024-09-11T05:32:57.890326+0000","last_clean":"2024-09-11T05:32:57.890326+0000","last_became_active":"2024-09-11T05:32:55.611732+0000","last_became_peered":"2024-09-11T05:32:55.611732+0000","last_unstale":"2024-09-11T05:32:57.890326+0000","last_undegraded":"2024-09-11T05:32:57.890326+0000","last_fullsized":"2024-09-11T05:32:57.890326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:56:36.249776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045416500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.607689+0000","last_change":"2024-09-11T05:32:57.607689+0000","last_active":"2024-09-11T05:32:57.607689+0000","last_peered":"2024-09-11T05:32:57.607689+0000","last_clean":"2024-09-11T05:32:57.607689+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:32:57.607689+0000","last_undegraded":"2024-09-11T05:32:57.607689+0000","last_fullsized":"2024-09-11T05:32:57.607689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:03.556295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074095900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.890880+0000","last_change":"2024-09-11T05:32:47.597956+0000","last_active":"2024-09-11T05:32:57.890880+0000","last_peered":"2024-09-11T05:32:57.890880+0000","last_clean":"2024-09-11T05:32:57.890880+0000","last_became_active":"2024-09-11T05:32:45.702439+0000","last_became_peered":"2024-09-11T05:32:45.702439+0000","last_unstale":"2024-09-11T05:32:57.890880+0000","last_undegraded":"2024-09-11T05:32:57.890880+0000","last_fullsized":"2024-09-11T05:32:57.890880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:27:05.110151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195137,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.612724+0000","last_change":"2024-09-11T05:32:57.612724+0000","last_active":"2024-09-11T05:32:57.612724+0000","last_peered":"2024-09-11T05:32:57.612724+0000","last_clean":"2024-09-11T05:32:57.612724+0000","last_became_active":"2024-09-11T05:32:55.613283+0000","last_became_peered":"2024-09-11T05:32:55.613283+0000","last_unstale":"2024-09-11T05:32:57.612724+0000","last_undegraded":"2024-09-11T05:32:57.612724+0000","last_fullsized":"2024-09-11T05:32:57.612724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:51.123373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041242399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.659521+0000","last_change":"2024-09-11T05:32:47.726973+0000","last_active":"2024-09-11T05:32:57.659521+0000","last_peered":"2024-09-11T05:32:57.659521+0000","last_clean":"2024-09-11T05:32:57.659521+0000","last_became_active":"2024-09-11T05:32:45.585103+0000","last_became_peered":"2024-09-11T05:32:45.585103+0000","last_unstale":"2024-09-11T05:32:57.659521+0000","last_undegraded":"2024-09-11T05:32:57.659521+0000","last_fullsized":"2024-09-11T05:32:57.659521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:07:32.584388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039722200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.617928+0000","last_change":"2024-09-11T05:32:57.617928+0000","last_active":"2024-09-11T05:32:57.617928+0000","last_peered":"2024-09-11T05:32:57.617928+0000","last_clean":"2024-09-11T05:32:57.617928+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:32:57.617928+0000","last_undegraded":"2024-09-11T05:32:57.617928+0000","last_fullsized":"2024-09-11T05:32:57.617928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:54.706146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045617500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.889459+0000","last_change":"2024-09-11T05:32:47.597556+0000","last_active":"2024-09-11T05:32:57.889459+0000","last_peered":"2024-09-11T05:32:57.889459+0000","last_clean":"2024-09-11T05:32:57.889459+0000","last_became_active":"2024-09-11T05:32:45.585150+0000","last_became_peered":"2024-09-11T05:32:45.585150+0000","last_unstale":"2024-09-11T05:32:57.889459+0000","last_undegraded":"2024-09-11T05:32:57.889459+0000","last_fullsized":"2024-09-11T05:32:57.889459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:57:16.674978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077988099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.890067+0000","last_change":"2024-09-11T05:32:57.890067+0000","last_active":"2024-09-11T05:32:57.890067+0000","last_peered":"2024-09-11T05:32:57.890067+0000","last_clean":"2024-09-11T05:32:57.890067+0000","last_became_active":"2024-09-11T05:32:55.616909+0000","last_became_peered":"2024-09-11T05:32:55.616909+0000","last_unstale":"2024-09-11T05:32:57.890067+0000","last_undegraded":"2024-09-11T05:32:57.890067+0000","last_fullsized":"2024-09-11T05:32:57.890067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:35:35.292639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054678799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.890580+0000","last_change":"2024-09-11T05:32:47.597195+0000","last_active":"2024-09-11T05:32:57.890580+0000","last_peered":"2024-09-11T05:32:57.890580+0000","last_clean":"2024-09-11T05:32:57.890580+0000","last_became_active":"2024-09-11T05:32:45.582294+0000","last_became_peered":"2024-09-11T05:32:45.582294+0000","last_unstale":"2024-09-11T05:32:57.890580+0000","last_undegraded":"2024-09-11T05:32:57.890580+0000","last_fullsized":"2024-09-11T05:32:57.890580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:49:22.206673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045578900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.610024+0000","last_change":"2024-09-11T05:32:39.551254+0000","last_active":"2024-09-11T05:32:57.610024+0000","last_peered":"2024-09-11T05:32:57.610024+0000","last_clean":"2024-09-11T05:32:57.610024+0000","last_became_active":"2024-09-11T05:32:39.550968+0000","last_became_peered":"2024-09-11T05:32:39.550968+0000","last_unstale":"2024-09-11T05:32:57.610024+0000","last_undegraded":"2024-09-11T05:32:57.610024+0000","last_fullsized":"2024-09-11T05:32:57.610024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:09.466849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.660171+0000","last_change":"2024-09-11T05:32:57.660171+0000","last_active":"2024-09-11T05:32:57.660171+0000","last_peered":"2024-09-11T05:32:57.660171+0000","last_clean":"2024-09-11T05:32:57.660171+0000","last_became_active":"2024-09-11T05:32:55.611842+0000","last_became_peered":"2024-09-11T05:32:55.611842+0000","last_unstale":"2024-09-11T05:32:57.660171+0000","last_undegraded":"2024-09-11T05:32:57.660171+0000","last_fullsized":"2024-09-11T05:32:57.660171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:47:56.420848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042237200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.890158+0000","last_change":"2024-09-11T05:32:57.890158+0000","last_active":"2024-09-11T05:32:57.890158+0000","last_peered":"2024-09-11T05:32:57.890158+0000","last_clean":"2024-09-11T05:32:57.890158+0000","last_became_active":"2024-09-11T05:32:55.617893+0000","last_became_peered":"2024-09-11T05:32:55.617893+0000","last_unstale":"2024-09-11T05:32:57.890158+0000","last_undegraded":"2024-09-11T05:32:57.890158+0000","last_fullsized":"2024-09-11T05:32:57.890158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:07.339213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038649399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.891151+0000","last_change":"2024-09-11T05:32:57.891151+0000","last_active":"2024-09-11T05:32:57.891151+0000","last_peered":"2024-09-11T05:32:57.891151+0000","last_clean":"2024-09-11T05:32:57.891151+0000","last_became_active":"2024-09-11T05:32:55.617635+0000","last_became_peered":"2024-09-11T05:32:55.617635+0000","last_unstale":"2024-09-11T05:32:57.891151+0000","last_undegraded":"2024-09-11T05:32:57.891151+0000","last_fullsized":"2024-09-11T05:32:57.891151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:47:37.477360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039096600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.659963+0000","last_change":"2024-09-11T05:32:57.659963+0000","last_active":"2024-09-11T05:32:57.659963+0000","last_peered":"2024-09-11T05:32:57.659963+0000","last_clean":"2024-09-11T05:32:57.659963+0000","last_became_active":"2024-09-11T05:32:55.612809+0000","last_became_peered":"2024-09-11T05:32:55.612809+0000","last_unstale":"2024-09-11T05:32:57.659963+0000","last_undegraded":"2024-09-11T05:32:57.659963+0000","last_fullsized":"2024-09-11T05:32:57.659963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:26.942317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035048700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.607220+0000","last_change":"2024-09-11T05:32:57.607220+0000","last_active":"2024-09-11T05:32:57.607220+0000","last_peered":"2024-09-11T05:32:57.607220+0000","last_clean":"2024-09-11T05:32:57.607220+0000","last_became_active":"2024-09-11T05:32:55.611273+0000","last_became_peered":"2024-09-11T05:32:55.611273+0000","last_unstale":"2024-09-11T05:32:57.607220+0000","last_undegraded":"2024-09-11T05:32:57.607220+0000","last_fullsized":"2024-09-11T05:32:57.607220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:18.058521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055575600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.891891+0000","last_change":"2024-09-11T05:32:57.891891+0000","last_active":"2024-09-11T05:32:57.891891+0000","last_peered":"2024-09-11T05:32:57.891891+0000","last_clean":"2024-09-11T05:32:57.891891+0000","last_became_active":"2024-09-11T05:32:55.614392+0000","last_became_peered":"2024-09-11T05:32:55.614392+0000","last_unstale":"2024-09-11T05:32:57.891891+0000","last_undegraded":"2024-09-11T05:32:57.891891+0000","last_fullsized":"2024-09-11T05:32:57.891891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:06:05.347533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000425738,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.891358+0000","last_change":"2024-09-11T05:32:57.891358+0000","last_active":"2024-09-11T05:32:57.891358+0000","last_peered":"2024-09-11T05:32:57.891358+0000","last_clean":"2024-09-11T05:32:57.891358+0000","last_became_active":"2024-09-11T05:32:55.610903+0000","last_became_peered":"2024-09-11T05:32:55.610903+0000","last_unstale":"2024-09-11T05:32:57.891358+0000","last_undegraded":"2024-09-11T05:32:57.891358+0000","last_fullsized":"2024-09-11T05:32:57.891358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:27:39.344191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060018099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.607163+0000","last_change":"2024-09-11T05:32:57.607163+0000","last_active":"2024-09-11T05:32:57.607163+0000","last_peered":"2024-09-11T05:32:57.607163+0000","last_clean":"2024-09-11T05:32:57.607163+0000","last_became_active":"2024-09-11T05:32:55.614915+0000","last_became_peered":"2024-09-11T05:32:55.614915+0000","last_unstale":"2024-09-11T05:32:57.607163+0000","last_undegraded":"2024-09-11T05:32:57.607163+0000","last_fullsized":"2024-09-11T05:32:57.607163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:44.086118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050988100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.610399+0000","last_change":"2024-09-11T05:32:57.610399+0000","last_active":"2024-09-11T05:32:57.610399+0000","last_peered":"2024-09-11T05:32:57.610399+0000","last_clean":"2024-09-11T05:32:57.610399+0000","last_became_active":"2024-09-11T05:32:55.614295+0000","last_became_peered":"2024-09-11T05:32:55.614295+0000","last_unstale":"2024-09-11T05:32:57.610399+0000","last_undegraded":"2024-09-11T05:32:57.610399+0000","last_fullsized":"2024-09-11T05:32:57.610399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:16.771049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054624999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.890065+0000","last_change":"2024-09-11T05:32:57.890065+0000","last_active":"2024-09-11T05:32:57.890065+0000","last_peered":"2024-09-11T05:32:57.890065+0000","last_clean":"2024-09-11T05:32:57.890065+0000","last_became_active":"2024-09-11T05:32:55.617684+0000","last_became_peered":"2024-09-11T05:32:55.617684+0000","last_unstale":"2024-09-11T05:32:57.890065+0000","last_undegraded":"2024-09-11T05:32:57.890065+0000","last_fullsized":"2024-09-11T05:32:57.890065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:30.702653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065996499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.617941+0000","last_change":"2024-09-11T05:32:57.617941+0000","last_active":"2024-09-11T05:32:57.617941+0000","last_peered":"2024-09-11T05:32:57.617941+0000","last_clean":"2024-09-11T05:32:57.617941+0000","last_became_active":"2024-09-11T05:32:55.617445+0000","last_became_peered":"2024-09-11T05:32:55.617445+0000","last_unstale":"2024-09-11T05:32:57.617941+0000","last_undegraded":"2024-09-11T05:32:57.617941+0000","last_fullsized":"2024-09-11T05:32:57.617941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:56:29.812314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046356899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-11T05:32:57.890965+0000","last_change":"2024-09-11T05:32:57.890965+0000","last_active":"2024-09-11T05:32:57.890965+0000","last_peered":"2024-09-11T05:32:57.890965+0000","last_clean":"2024-09-11T05:32:57.890965+0000","last_became_active":"2024-09-11T05:32:55.618294+0000","last_became_peered":"2024-09-11T05:32:55.618294+0000","last_unstale":"2024-09-11T05:32:57.890965+0000","last_undegraded":"2024-09-11T05:32:57.890965+0000","last_fullsized":"2024-09-11T05:32:57.890965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:49.387811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049377000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":26,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":249856,"data_stored":90197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":90216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":847872,"data_stored":680573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":0,"seq":60129542150,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":96411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":96392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":680573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":262144,"data_stored":96392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":65,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":65,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:33:00.421 INFO:tasks.thrashosds.thrasher:Setting 2.4 to [6, 1, 7, 0] 2024-09-11T05:33:00.422 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.4', '6', '1', '7', '0'] 2024-09-11T05:33:00.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.4 6 1 7 0 2024-09-11T05:33:00.428 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:00.454 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:33:00.489 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:00.489+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:00.575 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:00.575 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:00.586 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:00.603 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:00.603 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:00.603+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:00.634 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:00.634 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:00.645 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T05:33:00.658 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:00.658 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:00.679 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:00.679 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:00.690 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:00.690+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:00.698 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:00.698 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:00.703 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4397.0:10 3.1c e25/22 3:3831950c:::rbd_directory:head v 25'1, mlcod=0'0)", 2024-09-11T05:33:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:57.612286+0000", 2024-09-11T05:33:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0907286809999999, 2024-09-11T05:33:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000526166, 2024-09-11T05:33:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:57.612286+0000", 2024-09-11T05:33:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:57.612286+0000", 2024-09-11T05:33:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:57.612286+0000", 2024-09-11T05:33:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2100000000000001e-07 2024-09-11T05:33:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:57.612291+0000", 2024-09-11T05:33:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5009999999999998e-06 2024-09-11T05:33:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:57.612300+0000", 2024-09-11T05:33:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.628e-06 2024-09-11T05:33:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:57.612308+0000", 2024-09-11T05:33:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6199999999999999e-06 2024-09-11T05:33:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:57.612360+0000", 2024-09-11T05:33:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379000000000001e-05 2024-09-11T05:33:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:57.612378+0000", 2024-09-11T05:33:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7615999999999999e-05 2024-09-11T05:33:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:57.612766+0000", 2024-09-11T05:33:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038808899999999999 2024-09-11T05:33:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:57.612812+0000", 2024-09-11T05:33:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6112000000000002e-05 2024-09-11T05:33:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4397.0:456 3.1d e26/22 3:bee1fd50:::rbd_object_map.112d307a6c14.0000000000000003:head v 26'1, mlcod=0'0)", 2024-09-11T05:33:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.654520+0000", 2024-09-11T05:33:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.048494461000000003, 2024-09-11T05:33:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001405948, 2024-09-11T05:33:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.654520+0000", 2024-09-11T05:33:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.654520+0000", 2024-09-11T05:33:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.654521+0000", 2024-09-11T05:33:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:33:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.654527+0000", 2024-09-11T05:33:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7020000000000004e-06 2024-09-11T05:33:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.654543+0000", 2024-09-11T05:33:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6032000000000002e-05 2024-09-11T05:33:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.654555+0000", 2024-09-11T05:33:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1766999999999999e-05 2024-09-11T05:33:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.654627+0000", 2024-09-11T05:33:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1495000000000006e-05 2024-09-11T05:33:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.654651+0000", 2024-09-11T05:33:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.421e-05 2024-09-11T05:33:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.655880+0000", 2024-09-11T05:33:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012289930000000001 2024-09-11T05:33:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.655926+0000", 2024-09-11T05:33:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-05 2024-09-11T05:33:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4397.0:488 3.1c e26/22 3:3831950c:::rbd_directory:head v 26'6, mlcod=25'4)", 2024-09-11T05:33:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.675572+0000", 2024-09-11T05:33:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.027442712000000001, 2024-09-11T05:33:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071113000000000003, 2024-09-11T05:33:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.675572+0000", 2024-09-11T05:33:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.675572+0000", 2024-09-11T05:33:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.675573+0000", 2024-09-11T05:33:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:33:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.675579+0000", 2024-09-11T05:33:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T05:33:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.675601+0000", 2024-09-11T05:33:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1467999999999998e-05 2024-09-11T05:33:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.675610+0000", 2024-09-11T05:33:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.448e-06 2024-09-11T05:33:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.675670+0000", 2024-09-11T05:33:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9558000000000001e-05 2024-09-11T05:33:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.675693+0000", 2024-09-11T05:33:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3703e-05 2024-09-11T05:33:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676235+0000", 2024-09-11T05:33:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054117300000000004 2024-09-11T05:33:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676283+0000", 2024-09-11T05:33:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8640999999999997e-05 2024-09-11T05:33:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4397.0:489 3.2 e26/22 3:4550e1e5:::rbd_id.image_client.0-clone1:head v 26'10, mlcod=25'8)", 2024-09-11T05:33:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.678634+0000", 2024-09-11T05:33:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.024380532, 2024-09-11T05:33:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00073795299999999996, 2024-09-11T05:33:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678634+0000", 2024-09-11T05:33:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678634+0000", 2024-09-11T05:33:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678635+0000", 2024-09-11T05:33:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3999999999999998e-07 2024-09-11T05:33:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678640+0000", 2024-09-11T05:33:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4110000000000004e-06 2024-09-11T05:33:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678651+0000", 2024-09-11T05:33:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1158999999999999e-05 2024-09-11T05:33:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678659+0000", 2024-09-11T05:33:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5530000000000004e-06 2024-09-11T05:33:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678726+0000", 2024-09-11T05:33:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7545999999999993e-05 2024-09-11T05:33:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678748+0000", 2024-09-11T05:33:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1979000000000001e-05 2024-09-11T05:33:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.679338+0000", 2024-09-11T05:33:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058993299999999995 2024-09-11T05:33:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.679372+0000", 2024-09-11T05:33:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4131999999999998e-05 2024-09-11T05:33:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4397.0:492 3.13 e26/22 3:cc02e7d6:::rbd_object_map.112da50123d8:head v 26'1, mlcod=0'0)", 2024-09-11T05:33:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.683998+0000", 2024-09-11T05:33:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.019016674000000001, 2024-09-11T05:33:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075455499999999996, 2024-09-11T05:33:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.683998+0000", 2024-09-11T05:33:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.683998+0000", 2024-09-11T05:33:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.683999+0000", 2024-09-11T05:33:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9800000000000002e-07 2024-09-11T05:33:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.684007+0000", 2024-09-11T05:33:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:33:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.684022+0000", 2024-09-11T05:33:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4751e-05 2024-09-11T05:33:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.684030+0000", 2024-09-11T05:33:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1820000000000006e-06 2024-09-11T05:33:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.684096+0000", 2024-09-11T05:33:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5616000000000003e-05 2024-09-11T05:33:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.684114+0000", 2024-09-11T05:33:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8445999999999999e-05 2024-09-11T05:33:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.684704+0000", 2024-09-11T05:33:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000589888 2024-09-11T05:33:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.684753+0000", 2024-09-11T05:33:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8803e-05 2024-09-11T05:33:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:00.733 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:00.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:00.734 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:00.735 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:00.735 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:00.736 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:00.749 INFO:teuthology.orchestra.run.smithi070.stdout:188 write 0x5ecc8c8 thru 0x5ece28f (0x19c8 bytes) 2024-09-11T05:33:00.752 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:00.752 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:00.753 INFO:teuthology.orchestra.run.smithi070.stdout:truncating to largest ever: 0xd4f67be 2024-09-11T05:33:00.763 INFO:teuthology.orchestra.run.smithi070.stdout:190 trunc from 0x5ece290 to 0xd4f67be 2024-09-11T05:33:00.769 INFO:teuthology.orchestra.run.smithi070.stdout:194 read 0x5c12982 thru 0x5c1bbc9 (0x9248 bytes) 2024-09-11T05:33:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:196 trunc from 0xd4f67be to 0x10cb92b 2024-09-11T05:33:00.791 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:00.790+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:00.807 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:00.824 INFO:teuthology.orchestra.run.smithi070.stdout:198 write 0x974d9f8 thru 0x97580ac (0xa6b5 bytes) 2024-09-11T05:33:00.835 INFO:teuthology.orchestra.run.smithi070.stdout:199 write 0xbb15dbc thru 0xbb1e6df (0x8924 bytes) 2024-09-11T05:33:00.838 INFO:teuthology.orchestra.run.smithi070.stdout:200 read 0x931e25e thru 0x9327fc2 (0x9d65 bytes) 2024-09-11T05:33:00.838 INFO:teuthology.orchestra.run.smithi070.stdout:201 writesame 0x74f9488 thru 0x7508178 data_size 0x1(0xecf1 bytes) 2024-09-11T05:33:00.871 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:00.872 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:00.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:00.884 INFO:teuthology.orchestra.run.smithi070.stdout:202 write 0x26d0ba5 thru 0x26d7ee1 (0x733d bytes) 2024-09-11T05:33:00.886 INFO:teuthology.orchestra.run.smithi070.stdout:203 read 0xb2bab81 thru 0xb2c8041 (0xd4c1 bytes) 2024-09-11T05:33:00.886 INFO:teuthology.orchestra.run.smithi070.stdout:205 write 0x37d46e1 thru 0x37e2acb (0xe3eb bytes) 2024-09-11T05:33:00.896 INFO:teuthology.orchestra.run.smithi070.stdout:206 write 0xdfc0b17 thru 0xdfc4512 (0x39fc bytes) 2024-09-11T05:33:00.896 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:00.896+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:00.899 INFO:teuthology.orchestra.run.smithi070.stdout:207 punch from 0x3abbf57 to 0x3ac49c2, (0x8a6b bytes) 2024-09-11T05:33:00.899 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:00.899 INFO:teuthology.orchestra.run.smithi070.stdout:213 punch from 0x920dc32 to 0x92165a8, (0x8976 bytes) 2024-09-11T05:33:00.899 INFO:teuthology.orchestra.run.smithi070.stdout:215 read 0xa41bd8 thru 0xa42751 (0xb7a bytes) 2024-09-11T05:33:00.899 INFO:teuthology.orchestra.run.smithi070.stdout:217 write 0xba5b4b5 thru 0xba5fc3c (0x4788 bytes) 2024-09-11T05:33:00.900 INFO:teuthology.orchestra.run.smithi070.stdout:218 read 0x59a53b thru 0x5a91c2 (0xec88 bytes) 2024-09-11T05:33:00.901 INFO:teuthology.orchestra.run.smithi070.stdout:219 write 0xaa81e94 thru 0xaa8b317 (0x9484 bytes) 2024-09-11T05:33:00.912 INFO:teuthology.orchestra.run.smithi070.stdout:221 trunc from 0xdfc4513 to 0x729d536 2024-09-11T05:33:00.930 INFO:teuthology.orchestra.run.smithi070.stdout:223 read 0x4dcb3f1 thru 0x4dd2b8c (0x779c bytes) 2024-09-11T05:33:00.931 INFO:teuthology.orchestra.run.smithi070.stdout:224 write 0x6983e31 thru 0x698ecb8 (0xae88 bytes) 2024-09-11T05:33:00.938 INFO:teuthology.orchestra.run.smithi070.stdout:225 trunc from 0x729d536 to 0xbe9edff 2024-09-11T05:33:00.944 INFO:teuthology.orchestra.run.smithi070.stdout:230 read 0x9d2e534 thru 0x9d3dd74 (0xf841 bytes) 2024-09-11T05:33:00.944 INFO:teuthology.orchestra.run.smithi070.stdout:231 punch from 0x77138 to 0x7e7e3, (0x76ab bytes) 2024-09-11T05:33:00.952 INFO:teuthology.orchestra.run.smithi070.stdout:232 writesame 0xea0e654 thru 0xea1b9e8 data_size 0x17(0xd395 bytes) 2024-09-11T05:33:00.967 INFO:teuthology.orchestra.run.smithi070.stdout:234 trunc from 0xea1b9e9 to 0x22760b7 2024-09-11T05:33:00.975 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:00.976 INFO:teuthology.orchestra.run.smithi070.stdout:236 read 0x4955bb thru 0x49ec4b (0x9691 bytes) 2024-09-11T05:33:00.976 INFO:teuthology.orchestra.run.smithi070.stdout:238 write 0x1ebed3c thru 0x1ec4f23 (0x61e8 bytes) 2024-09-11T05:33:00.992 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:00.992+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:00.993 INFO:teuthology.orchestra.run.smithi070.stdout:239 writesame 0xb2c2f4f thru 0xb2c9c4a data_size 0x5a(0x6cfc bytes) 2024-09-11T05:33:00.993 INFO:teuthology.orchestra.run.smithi070.stdout:240 read 0x512a4da thru 0x51326c7 (0x81ee bytes) 2024-09-11T05:33:00.993 INFO:teuthology.orchestra.run.smithi070.stdout:246 writesame 0x583d7bd thru 0x584a602 data_size 0x27(0xce46 bytes) 2024-09-11T05:33:00.996 INFO:teuthology.orchestra.run.smithi070.stdout:247 read 0xa8db1b5 thru 0xa8db9ed (0x839 bytes) 2024-09-11T05:33:00.996 INFO:teuthology.orchestra.run.smithi070.stdout:248 punch from 0xd36f77 to 0xd391e4, (0x226d bytes) 2024-09-11T05:33:00.996 INFO:teuthology.orchestra.run.smithi070.stdout:250 read 0x8dad153 thru 0x8db41d1 (0x707f bytes) 2024-09-11T05:33:00.997 INFO:teuthology.orchestra.run.smithi070.stdout:251 trunc from 0xb2c9c4b to 0xa5d09bb 2024-09-11T05:33:01.002 INFO:teuthology.orchestra.run.smithi070.stdout:252 read 0x5f70cf5 thru 0x5f7f120 (0xe42c bytes) 2024-09-11T05:33:01.003 INFO:teuthology.orchestra.run.smithi070.stdout:253 read 0x9ed5e57 thru 0x9ed6536 (0x6e0 bytes) 2024-09-11T05:33:01.003 INFO:teuthology.orchestra.run.smithi070.stdout:255 read 0x5dad982 thru 0x5db02f3 (0x2972 bytes) 2024-09-11T05:33:01.003 INFO:teuthology.orchestra.run.smithi070.stdout:256 writesame 0x6940f55 thru 0x694e7a5 data_size 0x3f(0xd851 bytes) 2024-09-11T05:33:01.005 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.006 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:01.006 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:01.006 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:01.007 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:01.007 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:01.008 INFO:teuthology.orchestra.run.smithi070.stdout:258 trunc from 0xa5d09bb to 0x84d0da0 2024-09-11T05:33:01.014 INFO:teuthology.orchestra.run.smithi070.stdout:259 trunc from 0x84d0da0 to 0x91890e6 2024-09-11T05:33:01.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:01.019 INFO:teuthology.orchestra.run.smithi070.stdout:260 punch from 0x2bd4a76 to 0x2bd9078, (0x4602 bytes) 2024-09-11T05:33:01.019 INFO:teuthology.orchestra.run.smithi070.stdout:262 read 0x560f267 thru 0x5614118 (0x4eb2 bytes) 2024-09-11T05:33:01.020 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.020 INFO:teuthology.orchestra.run.smithi070.stdout:264 read 0x2b052e5 thru 0x2b13b67 (0xe883 bytes) 2024-09-11T05:33:01.020 INFO:teuthology.orchestra.run.smithi070.stdout:266 writesame 0x4755cd thru 0x4843ff data_size 0x11(0xee33 bytes) 2024-09-11T05:33:01.023 INFO:teuthology.orchestra.run.smithi070.stdout:267 read 0x7852e7d thru 0x785f036 (0xc1ba bytes) 2024-09-11T05:33:01.023 INFO:teuthology.orchestra.run.smithi070.stdout:268 read 0xb37196 thru 0xb3f776 (0x85e1 bytes) 2024-09-11T05:33:01.024 INFO:teuthology.orchestra.run.smithi070.stdout:269 write 0x740eafc thru 0x74153e3 (0x68e8 bytes) 2024-09-11T05:33:01.025 INFO:teuthology.orchestra.run.smithi070.stdout:270 punch from 0x8059e1e to 0x805c1e8, (0x23ca bytes) 2024-09-11T05:33:01.025 INFO:teuthology.orchestra.run.smithi070.stdout:273 write 0x13f9063 thru 0x1400b89 (0x7b27 bytes) 2024-09-11T05:33:01.027 INFO:teuthology.orchestra.run.smithi070.stdout:274 write 0x8f937ac thru 0x8f9d27e (0x9ad3 bytes) 2024-09-11T05:33:01.030 INFO:teuthology.orchestra.run.smithi070.stdout:275 punch from 0x1c1af2d to 0x1c1dc7e, (0x2d51 bytes) 2024-09-11T05:33:01.030 INFO:teuthology.orchestra.run.smithi070.stdout:276 write 0xa55889 thru 0xa5cde5 (0x755d bytes) 2024-09-11T05:33:01.031 INFO:teuthology.orchestra.run.smithi070.stdout:277 punch from 0x83ef748 to 0x83f1745, (0x1ffd bytes) 2024-09-11T05:33:01.031 INFO:teuthology.orchestra.run.smithi070.stdout:278 read 0x1087b69 thru 0x10894ba (0x1952 bytes) 2024-09-11T05:33:01.032 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.038 INFO:teuthology.orchestra.run.smithi070.stdout:281 write 0xa4db9f2 thru 0xa4e39fb (0x800a bytes) 2024-09-11T05:33:01.046 INFO:teuthology.orchestra.run.smithi070.stdout:282 trunc from 0xa4e39fc to 0x6053e75 2024-09-11T05:33:01.063 INFO:teuthology.orchestra.run.smithi070.stdout:283 trunc from 0x6053e75 to 0x28da73b 2024-09-11T05:33:01.072 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.079 INFO:teuthology.orchestra.run.smithi070.stdout:286 write 0x407e8fd thru 0x40834be (0x4bc2 bytes) 2024-09-11T05:33:01.090 INFO:teuthology.orchestra.run.smithi070.stdout:288 write 0x60b9f83 thru 0x60bb17e (0x11fc bytes) 2024-09-11T05:33:01.092 INFO:teuthology.orchestra.run.smithi070.stdout:289 read 0x5d78e46 thru 0x5d82b50 (0x9d0b bytes) 2024-09-11T05:33:01.093 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:01.092+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:01.098 INFO:teuthology.orchestra.run.smithi070.stdout:290 trunc from 0x60bb17f to 0x12b6fda 2024-09-11T05:33:01.112 INFO:teuthology.orchestra.run.smithi070.stdout:291 read 0x1dc7c4 thru 0x1e87ef (0xc02c bytes) 2024-09-11T05:33:01.112 INFO:teuthology.orchestra.run.smithi070.stdout:292 punch from 0xc0133 to 0xc201f, (0x1eec bytes) 2024-09-11T05:33:01.112 INFO:teuthology.orchestra.run.smithi070.stdout:294 write 0x190df9 thru 0x1985cc (0x77d4 bytes) 2024-09-11T05:33:01.114 INFO:teuthology.orchestra.run.smithi070.stdout:296 punch from 0x112aaf1 to 0x1130b71, (0x6080 bytes) 2024-09-11T05:33:01.114 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.117 INFO:teuthology.orchestra.run.smithi070.stdout:299 trunc from 0x12b6fda to 0x40160ca 2024-09-11T05:33:01.137 INFO:teuthology.orchestra.run.smithi070.stdout:300 write 0xcb77450 thru 0xcb834bd (0xc06e bytes) 2024-09-11T05:33:01.140 INFO:teuthology.orchestra.run.smithi070.stdout:301 writesame 0x8e2de7f thru 0x8e3251b data_size 0x1(0x469d bytes) 2024-09-11T05:33:01.143 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 512~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.609921+0000", 2024-09-11T05:33:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.530786125999999, 2024-09-11T05:33:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072317420000000002, 2024-09-11T05:33:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 68 2024-09-11T05:33:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609921+0000", 2024-09-11T05:33:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609921+0000", 2024-09-11T05:33:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609922+0000", 2024-09-11T05:33:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:33:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609924+0000", 2024-09-11T05:33:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:33:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609929+0000", 2024-09-11T05:33:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6179999999999997e-06 2024-09-11T05:33:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609932+0000", 2024-09-11T05:33:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.101e-06 2024-09-11T05:33:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.610475+0000", 2024-09-11T05:33:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000542974 2024-09-11T05:33:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.610558+0000", 2024-09-11T05:33:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2736000000000002e-05 2024-09-11T05:33:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.610689+0000", 2024-09-11T05:33:01.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013081099999999999 2024-09-11T05:33:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.612277+0000", 2024-09-11T05:33:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015886100000000001 2024-09-11T05:33:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.617058+0000", 2024-09-11T05:33:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047804880000000003 2024-09-11T05:33:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.617111+0000", 2024-09-11T05:33:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3513000000000001e-05 2024-09-11T05:33:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.617153+0000", 2024-09-11T05:33:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1828e-05 2024-09-11T05:33:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.149 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.609938+0000", 2024-09-11T05:33:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.530769193000001, 2024-09-11T05:33:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010332035, 2024-09-11T05:33:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 69 2024-09-11T05:33:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.150 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609938+0000", 2024-09-11T05:33:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609938+0000", 2024-09-11T05:33:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609939+0000", 2024-09-11T05:33:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.22e-07 2024-09-11T05:33:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609976+0000", 2024-09-11T05:33:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7932999999999997e-05 2024-09-11T05:33:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609985+0000", 2024-09-11T05:33:01.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1210000000000007e-06 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609988+0000", 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8909999999999997e-06 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.611041+0000", 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010522299999999999 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.611118+0000", 2024-09-11T05:33:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6890000000000004e-05 2024-09-11T05:33:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.611250+0000", 2024-09-11T05:33:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132652 2024-09-11T05:33:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.612282+0000", 2024-09-11T05:33:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010313060000000001 2024-09-11T05:33:01.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620157+0000", 2024-09-11T05:33:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078758409999999997 2024-09-11T05:33:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620232+0000", 2024-09-11T05:33:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4506999999999997e-05 2024-09-11T05:33:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620270+0000", 2024-09-11T05:33:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8442000000000002e-05 2024-09-11T05:33:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.609995+0000", 2024-09-11T05:33:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.530712273999999, 2024-09-11T05:33:01.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010369461999999999, 2024-09-11T05:33:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 70 2024-09-11T05:33:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609995+0000", 2024-09-11T05:33:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609995+0000", 2024-09-11T05:33:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609996+0000", 2024-09-11T05:33:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:33:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.609999+0000", 2024-09-11T05:33:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5219999999999999e-06 2024-09-11T05:33:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.610003+0000", 2024-09-11T05:33:01.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5190000000000001e-06 2024-09-11T05:33:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.610006+0000", 2024-09-11T05:33:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4410000000000002e-06 2024-09-11T05:33:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.611743+0000", 2024-09-11T05:33:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017366949999999999 2024-09-11T05:33:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.611830+0000", 2024-09-11T05:33:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6822000000000003e-05 2024-09-11T05:33:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.611967+0000", 2024-09-11T05:33:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000137727 2024-09-11T05:33:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.612574+0000", 2024-09-11T05:33:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060694799999999995 2024-09-11T05:33:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620301+0000", 2024-09-11T05:33:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007727233 2024-09-11T05:33:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620340+0000", 2024-09-11T05:33:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8546e-05 2024-09-11T05:33:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620365+0000", 2024-09-11T05:33:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4640000000000001e-05 2024-09-11T05:33:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.163 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:73 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.620617+0000", 2024-09-11T05:33:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.52009047, 2024-09-11T05:33:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075323109999999999, 2024-09-11T05:33:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 73 2024-09-11T05:33:01.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620617+0000", 2024-09-11T05:33:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620617+0000", 2024-09-11T05:33:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620617+0000", 2024-09-11T05:33:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6199999999999998e-07 2024-09-11T05:33:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620666+0000", 2024-09-11T05:33:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8328999999999998e-05 2024-09-11T05:33:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620671+0000", 2024-09-11T05:33:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8099999999999997e-06 2024-09-11T05:33:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620674+0000", 2024-09-11T05:33:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-06 2024-09-11T05:33:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.621664+0000", 2024-09-11T05:33:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099063199999999997 2024-09-11T05:33:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.621738+0000", 2024-09-11T05:33:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3903e-05 2024-09-11T05:33:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.621866+0000", 2024-09-11T05:33:01.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012760399999999999 2024-09-11T05:33:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.622608+0000", 2024-09-11T05:33:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074244299999999997 2024-09-11T05:33:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.628070+0000", 2024-09-11T05:33:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054610730000000003 2024-09-11T05:33:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.628116+0000", 2024-09-11T05:33:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6247e-05 2024-09-11T05:33:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.628149+0000", 2024-09-11T05:33:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3568000000000001e-05 2024-09-11T05:33:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.170 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:74 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.620681+0000", 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.520026986000001, 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075794, 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 74 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620681+0000", 2024-09-11T05:33:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620681+0000", 2024-09-11T05:33:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620681+0000", 2024-09-11T05:33:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:33:01.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620684+0000", 2024-09-11T05:33:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.988e-06 2024-09-11T05:33:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620687+0000", 2024-09-11T05:33:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.484e-06 2024-09-11T05:33:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.620690+0000", 2024-09-11T05:33:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7889999999999999e-06 2024-09-11T05:33:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.622168+0000", 2024-09-11T05:33:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014780450000000001 2024-09-11T05:33:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.622262+0000", 2024-09-11T05:33:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3522000000000003e-05 2024-09-11T05:33:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.622381+0000", 2024-09-11T05:33:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011957500000000001 2024-09-11T05:33:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.622871+0000", 2024-09-11T05:33:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048961800000000004 2024-09-11T05:33:01.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.628195+0000", 2024-09-11T05:33:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053237950000000001 2024-09-11T05:33:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.628235+0000", 2024-09-11T05:33:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0568999999999997e-05 2024-09-11T05:33:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.628260+0000", 2024-09-11T05:33:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4672e-05 2024-09-11T05:33:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.844425+0000", 2024-09-11T05:33:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.296282526999999, 2024-09-11T05:33:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058303729999999998, 2024-09-11T05:33:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 113 2024-09-11T05:33:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844425+0000", 2024-09-11T05:33:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844425+0000", 2024-09-11T05:33:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844426+0000", 2024-09-11T05:33:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6199999999999998e-07 2024-09-11T05:33:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844431+0000", 2024-09-11T05:33:01.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T05:33:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844436+0000", 2024-09-11T05:33:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-06 2024-09-11T05:33:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844439+0000", 2024-09-11T05:33:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.14e-06 2024-09-11T05:33:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.848519+0000", 2024-09-11T05:33:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040796929999999997 2024-09-11T05:33:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.848560+0000", 2024-09-11T05:33:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1108e-05 2024-09-11T05:33:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.848637+0000", 2024-09-11T05:33:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7577999999999995e-05 2024-09-11T05:33:01.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849351+0000", 2024-09-11T05:33:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071328600000000004 2024-09-11T05:33:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850202+0000", 2024-09-11T05:33:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085104099999999997 2024-09-11T05:33:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850233+0000", 2024-09-11T05:33:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1498999999999998e-05 2024-09-11T05:33:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850255+0000", 2024-09-11T05:33:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089000000000001e-05 2024-09-11T05:33:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.183 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.844444+0000", 2024-09-11T05:33:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.296263037999999, 2024-09-11T05:33:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059512999999999996, 2024-09-11T05:33:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 114 2024-09-11T05:33:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844444+0000", 2024-09-11T05:33:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844444+0000", 2024-09-11T05:33:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844445+0000", 2024-09-11T05:33:01.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5499999999999999e-07 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844447+0000", 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844450+0000", 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2310000000000001e-06 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844453+0000", 2024-09-11T05:33:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.757e-06 2024-09-11T05:33:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.848861+0000", 2024-09-11T05:33:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044080250000000003 2024-09-11T05:33:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.848902+0000", 2024-09-11T05:33:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1245999999999998e-05 2024-09-11T05:33:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.848974+0000", 2024-09-11T05:33:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1670999999999999e-05 2024-09-11T05:33:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850300+0000", 2024-09-11T05:33:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013267540000000001 2024-09-11T05:33:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850312+0000", 2024-09-11T05:33:01.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1987999999999999e-05 2024-09-11T05:33:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850360+0000", 2024-09-11T05:33:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7991000000000002e-05 2024-09-11T05:33:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850396+0000", 2024-09-11T05:33:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5298e-05 2024-09-11T05:33:01.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.844461+0000", 2024-09-11T05:33:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.296246236999998, 2024-09-11T05:33:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010378596, 2024-09-11T05:33:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 115 2024-09-11T05:33:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844461+0000", 2024-09-11T05:33:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844461+0000", 2024-09-11T05:33:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844462+0000", 2024-09-11T05:33:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.48e-07 2024-09-11T05:33:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844506+0000", 2024-09-11T05:33:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4079000000000003e-05 2024-09-11T05:33:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844510+0000", 2024-09-11T05:33:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1779999999999996e-06 2024-09-11T05:33:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844513+0000", 2024-09-11T05:33:01.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0280000000000001e-06 2024-09-11T05:33:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849366+0000", 2024-09-11T05:33:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048535100000000001 2024-09-11T05:33:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849408+0000", 2024-09-11T05:33:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1315e-05 2024-09-11T05:33:01.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849477+0000", 2024-09-11T05:33:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9334999999999999e-05 2024-09-11T05:33:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850402+0000", 2024-09-11T05:33:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092514099999999998 2024-09-11T05:33:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.854783+0000", 2024-09-11T05:33:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043809679999999998 2024-09-11T05:33:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.854818+0000", 2024-09-11T05:33:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5131e-05 2024-09-11T05:33:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.854840+0000", 2024-09-11T05:33:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1662999999999999e-05 2024-09-11T05:33:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.844518+0000", 2024-09-11T05:33:01.197 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.296189599000002, 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013241591, 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844518+0000", 2024-09-11T05:33:01.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844518+0000", 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844518+0000", 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844520+0000", 2024-09-11T05:33:01.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.204e-06 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844525+0000", 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3930000000000001e-06 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844530+0000", 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2769999999999996e-06 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849772+0000", 2024-09-11T05:33:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052415789999999997 2024-09-11T05:33:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849821+0000", 2024-09-11T05:33:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9144999999999998e-05 2024-09-11T05:33:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.849885+0000", 2024-09-11T05:33:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4601e-05 2024-09-11T05:33:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850706+0000", 2024-09-11T05:33:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082021299999999998 2024-09-11T05:33:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.857705+0000", 2024-09-11T05:33:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069997990000000001 2024-09-11T05:33:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.857736+0000", 2024-09-11T05:33:01.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0518000000000002e-05 2024-09-11T05:33:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.857759+0000", 2024-09-11T05:33:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3561e-05 2024-09-11T05:33:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.203 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:39.844534+0000", 2024-09-11T05:33:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.296173288999999, 2024-09-11T05:33:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013318656, 2024-09-11T05:33:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117 2024-09-11T05:33:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844534+0000", 2024-09-11T05:33:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844534+0000", 2024-09-11T05:33:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844534+0000", 2024-09-11T05:33:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-07 2024-09-11T05:33:01.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844537+0000", 2024-09-11T05:33:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-11T05:33:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844540+0000", 2024-09-11T05:33:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-06 2024-09-11T05:33:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.844542+0000", 2024-09-11T05:33:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.61e-06 2024-09-11T05:33:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850420+0000", 2024-09-11T05:33:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058780819999999998 2024-09-11T05:33:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850466+0000", 2024-09-11T05:33:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5961000000000003e-05 2024-09-11T05:33:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850539+0000", 2024-09-11T05:33:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2465000000000005e-05 2024-09-11T05:33:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.850901+0000", 2024-09-11T05:33:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036213400000000001 2024-09-11T05:33:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.857791+0000", 2024-09-11T05:33:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068895989999999997 2024-09-11T05:33:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.857831+0000", 2024-09-11T05:33:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0763000000000003e-05 2024-09-11T05:33:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:39.857853+0000", 2024-09-11T05:33:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1557e-05 2024-09-11T05:33:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.209 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186716+0000", 2024-09-11T05:33:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.953991598000002, 2024-09-11T05:33:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071667160000000001, 2024-09-11T05:33:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 134 2024-09-11T05:33:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186716+0000", 2024-09-11T05:33:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186716+0000", 2024-09-11T05:33:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186716+0000", 2024-09-11T05:33:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7999999999999995e-07 2024-09-11T05:33:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186796+0000", 2024-09-11T05:33:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9555999999999995e-05 2024-09-11T05:33:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186816+0000", 2024-09-11T05:33:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9712e-05 2024-09-11T05:33:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186822+0000", 2024-09-11T05:33:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9529999999999996e-06 2024-09-11T05:33:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.189573+0000", 2024-09-11T05:33:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002751664 2024-09-11T05:33:01.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.189642+0000", 2024-09-11T05:33:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8780000000000002e-05 2024-09-11T05:33:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.189759+0000", 2024-09-11T05:33:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116834 2024-09-11T05:33:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.191163+0000", 2024-09-11T05:33:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014038500000000001 2024-09-11T05:33:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193829+0000", 2024-09-11T05:33:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026666390000000002 2024-09-11T05:33:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193860+0000", 2024-09-11T05:33:01.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0543999999999998e-05 2024-09-11T05:33:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193883+0000", 2024-09-11T05:33:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2603999999999999e-05 2024-09-11T05:33:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186841+0000", 2024-09-11T05:33:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.953866261999998, 2024-09-11T05:33:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007183053, 2024-09-11T05:33:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 135 2024-09-11T05:33:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186841+0000", 2024-09-11T05:33:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186841+0000", 2024-09-11T05:33:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186842+0000", 2024-09-11T05:33:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9100000000000004e-07 2024-09-11T05:33:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186845+0000", 2024-09-11T05:33:01.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.366e-06 2024-09-11T05:33:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186852+0000", 2024-09-11T05:33:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-09-11T05:33:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186855+0000", 2024-09-11T05:33:01.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9490000000000001e-06 2024-09-11T05:33:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.190263+0000", 2024-09-11T05:33:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034079290000000001 2024-09-11T05:33:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.190327+0000", 2024-09-11T05:33:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4387000000000005e-05 2024-09-11T05:33:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.190400+0000", 2024-09-11T05:33:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3356999999999996e-05 2024-09-11T05:33:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192283+0000", 2024-09-11T05:33:01.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001882641 2024-09-11T05:33:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193937+0000", 2024-09-11T05:33:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001654336 2024-09-11T05:33:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193987+0000", 2024-09-11T05:33:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9497999999999999e-05 2024-09-11T05:33:01.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194024+0000", 2024-09-11T05:33:01.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7530000000000002e-05 2024-09-11T05:33:01.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.224 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.224 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.224 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186859+0000", 2024-09-11T05:33:01.224 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.953848206, 2024-09-11T05:33:01.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072504070000000004, 2024-09-11T05:33:01.225 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.225 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 136 2024-09-11T05:33:01.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.225 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186859+0000", 2024-09-11T05:33:01.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186859+0000", 2024-09-11T05:33:01.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186860+0000", 2024-09-11T05:33:01.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7799999999999997e-07 2024-09-11T05:33:01.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186861+0000", 2024-09-11T05:33:01.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.753e-06 2024-09-11T05:33:01.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186865+0000", 2024-09-11T05:33:01.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000001e-06 2024-09-11T05:33:01.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186868+0000", 2024-09-11T05:33:01.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8909999999999999e-06 2024-09-11T05:33:01.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.190752+0000", 2024-09-11T05:33:01.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003884116 2024-09-11T05:33:01.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.190806+0000", 2024-09-11T05:33:01.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4011999999999997e-05 2024-09-11T05:33:01.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.190879+0000", 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2366999999999993e-05 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193310+0000", 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024310769999999998 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194061+0000", 2024-09-11T05:33:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075133899999999996 2024-09-11T05:33:01.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194089+0000", 2024-09-11T05:33:01.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8212e-05 2024-09-11T05:33:01.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194110+0000", 2024-09-11T05:33:01.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0392000000000001e-05 2024-09-11T05:33:01.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.230 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.231 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.231 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186872+0000", 2024-09-11T05:33:01.231 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.953835611999999, 2024-09-11T05:33:01.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073548989999999998, 2024-09-11T05:33:01.231 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.232 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 137 2024-09-11T05:33:01.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.232 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186872+0000", 2024-09-11T05:33:01.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186872+0000", 2024-09-11T05:33:01.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186872+0000", 2024-09-11T05:33:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.35e-07 2024-09-11T05:33:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186915+0000", 2024-09-11T05:33:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2830999999999997e-05 2024-09-11T05:33:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186920+0000", 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3789999999999997e-06 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186923+0000", 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.078e-06 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.191196+0000", 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042726170000000003 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.191279+0000", 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3244000000000005e-05 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.191394+0000", 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115146 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193313+0000", 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019188040000000001 2024-09-11T05:33:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194145+0000", 2024-09-11T05:33:01.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083171299999999998 2024-09-11T05:33:01.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194191+0000", 2024-09-11T05:33:01.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6521999999999999e-05 2024-09-11T05:33:01.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194227+0000", 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5330000000000002e-05 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186929+0000", 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.953778974999999, 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073793499999999998, 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138 2024-09-11T05:33:01.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.238 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186929+0000", 2024-09-11T05:33:01.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186929+0000", 2024-09-11T05:33:01.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186929+0000", 2024-09-11T05:33:01.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:33:01.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186931+0000", 2024-09-11T05:33:01.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.108e-06 2024-09-11T05:33:01.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186935+0000", 2024-09-11T05:33:01.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3830000000000002e-06 2024-09-11T05:33:01.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186938+0000", 2024-09-11T05:33:01.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7690000000000001e-06 2024-09-11T05:33:01.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.191919+0000", 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049811009999999999 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.191964+0000", 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5206000000000001e-05 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192042+0000", 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7404999999999995e-05 2024-09-11T05:33:01.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193890+0000", 2024-09-11T05:33:01.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018477330000000001 2024-09-11T05:33:01.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194261+0000", 2024-09-11T05:33:01.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000371839 2024-09-11T05:33:01.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194287+0000", 2024-09-11T05:33:01.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5554e-05 2024-09-11T05:33:01.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194308+0000", 2024-09-11T05:33:01.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0944000000000001e-05 2024-09-11T05:33:01.243 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.243 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.243 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.244 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.244 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186942+0000", 2024-09-11T05:33:01.244 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.953765258000001, 2024-09-11T05:33:01.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074930750000000001, 2024-09-11T05:33:01.244 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.244 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.244 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139 2024-09-11T05:33:01.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.245 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186942+0000", 2024-09-11T05:33:01.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186942+0000", 2024-09-11T05:33:01.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186942+0000", 2024-09-11T05:33:01.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.28e-07 2024-09-11T05:33:01.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186946+0000", 2024-09-11T05:33:01.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6270000000000002e-06 2024-09-11T05:33:01.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186949+0000", 2024-09-11T05:33:01.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1690000000000001e-06 2024-09-11T05:33:01.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186952+0000", 2024-09-11T05:33:01.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5339999999999998e-06 2024-09-11T05:33:01.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192317+0000", 2024-09-11T05:33:01.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053653900000000003 2024-09-11T05:33:01.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192390+0000", 2024-09-11T05:33:01.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2336999999999995e-05 2024-09-11T05:33:01.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192505+0000", 2024-09-11T05:33:01.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115784 2024-09-11T05:33:01.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193893+0000", 2024-09-11T05:33:01.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001387421 2024-09-11T05:33:01.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194355+0000", 2024-09-11T05:33:01.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046241000000000001 2024-09-11T05:33:01.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194402+0000", 2024-09-11T05:33:01.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6780000000000003e-05 2024-09-11T05:33:01.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194435+0000", 2024-09-11T05:33:01.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3395000000000001e-05 2024-09-11T05:33:01.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.251 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.251 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.251 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.186955+0000", 2024-09-11T05:33:01.251 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.953752235, 2024-09-11T05:33:01.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075532510000000004, 2024-09-11T05:33:01.251 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 140 2024-09-11T05:33:01.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.252 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186955+0000", 2024-09-11T05:33:01.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186955+0000", 2024-09-11T05:33:01.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186955+0000", 2024-09-11T05:33:01.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:33:01.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.186999+0000", 2024-09-11T05:33:01.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3760000000000001e-05 2024-09-11T05:33:01.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187003+0000", 2024-09-11T05:33:01.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:33:01.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187006+0000", 2024-09-11T05:33:01.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-11T05:33:01.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192816+0000", 2024-09-11T05:33:01.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058095350000000002 2024-09-11T05:33:01.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192864+0000", 2024-09-11T05:33:01.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7709e-05 2024-09-11T05:33:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.192935+0000", 2024-09-11T05:33:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1657999999999997e-05 2024-09-11T05:33:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194116+0000", 2024-09-11T05:33:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011812470000000001 2024-09-11T05:33:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194462+0000", 2024-09-11T05:33:01.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034602999999999999 2024-09-11T05:33:01.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194489+0000", 2024-09-11T05:33:01.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6363000000000002e-05 2024-09-11T05:33:01.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194509+0000", 2024-09-11T05:33:01.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9712e-05 2024-09-11T05:33:01.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.258 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.258 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.258 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.187011+0000", 2024-09-11T05:33:01.258 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.95369612, 2024-09-11T05:33:01.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076080940000000001, 2024-09-11T05:33:01.258 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 141 2024-09-11T05:33:01.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.259 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187011+0000", 2024-09-11T05:33:01.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187011+0000", 2024-09-11T05:33:01.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187012+0000", 2024-09-11T05:33:01.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:33:01.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187015+0000", 2024-09-11T05:33:01.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0630000000000002e-06 2024-09-11T05:33:01.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187020+0000", 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6999999999999999e-06 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.187022+0000", 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8779999999999998e-06 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193357+0000", 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063344559999999996 2024-09-11T05:33:01.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193428+0000", 2024-09-11T05:33:01.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0726e-05 2024-09-11T05:33:01.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.193545+0000", 2024-09-11T05:33:01.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117151 2024-09-11T05:33:01.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194314+0000", 2024-09-11T05:33:01.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076884900000000005 2024-09-11T05:33:01.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194543+0000", 2024-09-11T05:33:01.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022956699999999999 2024-09-11T05:33:01.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194588+0000", 2024-09-11T05:33:01.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4715000000000001e-05 2024-09-11T05:33:01.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.194619+0000", 2024-09-11T05:33:01.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1606999999999997e-05 2024-09-11T05:33:01.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.264 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.264 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4194.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T05:33:01.264 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:40.639164+0000", 2024-09-11T05:33:01.264 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.501543615999999, 2024-09-11T05:33:01.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055682639999999999, 2024-09-11T05:33:01.264 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4194", 2024-09-11T05:33:01.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1729383482", 2024-09-11T05:33:01.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 159 2024-09-11T05:33:01.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.265 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.639164+0000", 2024-09-11T05:33:01.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.639164+0000", 2024-09-11T05:33:01.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.639164+0000", 2024-09-11T05:33:01.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7000000000000001e-07 2024-09-11T05:33:01.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.639166+0000", 2024-09-11T05:33:01.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0999999999999998e-06 2024-09-11T05:33:01.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.639170+0000", 2024-09-11T05:33:01.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T05:33:01.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.639172+0000", 2024-09-11T05:33:01.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.509e-06 2024-09-11T05:33:01.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.642617+0000", 2024-09-11T05:33:01.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034451070000000002 2024-09-11T05:33:01.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.642666+0000", 2024-09-11T05:33:01.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8668999999999998e-05 2024-09-11T05:33:01.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.642735+0000", 2024-09-11T05:33:01.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8707000000000005e-05 2024-09-11T05:33:01.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.643250+0000", 2024-09-11T05:33:01.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051594499999999997 2024-09-11T05:33:01.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.644683+0000", 2024-09-11T05:33:01.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001432427 2024-09-11T05:33:01.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.644711+0000", 2024-09-11T05:33:01.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8481000000000001e-05 2024-09-11T05:33:01.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:40.644732+0000", 2024-09-11T05:33:01.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0750999999999998e-05 2024-09-11T05:33:01.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.270 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.270 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:672 3.10 3:090f802f:::rbd_data.112da50123d8.000000000000000c:head [stat,truncate 7864320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.920063+0000", 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.22064445999999999, 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066794130000000004, 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 672 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.920063+0000", 2024-09-11T05:33:01.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.920063+0000", 2024-09-11T05:33:01.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.920065+0000", 2024-09-11T05:33:01.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5859999999999999e-06 2024-09-11T05:33:01.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.920071+0000", 2024-09-11T05:33:01.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.947e-06 2024-09-11T05:33:01.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.920086+0000", 2024-09-11T05:33:01.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5851000000000001e-05 2024-09-11T05:33:01.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.920103+0000", 2024-09-11T05:33:01.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6960999999999999e-05 2024-09-11T05:33:01.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.920162+0000", 2024-09-11T05:33:01.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8634999999999997e-05 2024-09-11T05:33:01.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.920240+0000", 2024-09-11T05:33:01.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7739999999999998e-05 2024-09-11T05:33:01.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:01.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.920364+0000", 2024-09-11T05:33:01.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012385299999999999 2024-09-11T05:33:01.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.921034+0000", 2024-09-11T05:33:01.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066994099999999996 2024-09-11T05:33:01.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.926642+0000", 2024-09-11T05:33:01.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056084630000000002 2024-09-11T05:33:01.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.926701+0000", 2024-09-11T05:33:01.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8888999999999998e-05 2024-09-11T05:33:01.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.926742+0000", 2024-09-11T05:33:01.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1547e-05 2024-09-11T05:33:01.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.277 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.278 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.278 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.278 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.278 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:01.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:01.282 INFO:teuthology.orchestra.run.smithi070.stdout:303 punch from 0x5f049b7 to 0x5f061cd, (0x1816 bytes) 2024-09-11T05:33:01.282 INFO:teuthology.orchestra.run.smithi070.stdout:304 write 0x574d801 thru 0x57534a0 (0x5ca0 bytes) 2024-09-11T05:33:01.282 INFO:teuthology.orchestra.run.smithi070.stdout:305 read 0x44cbaca thru 0x44d4228 (0x875f bytes) 2024-09-11T05:33:01.283 INFO:teuthology.orchestra.run.smithi070.stdout:306 read 0x8d883dc thru 0x8d96325 (0xdf4a bytes) 2024-09-11T05:33:01.283 INFO:teuthology.orchestra.run.smithi070.stdout:308 write 0x60ad1ab thru 0x60af721 (0x2577 bytes) 2024-09-11T05:33:01.283 INFO:teuthology.orchestra.run.smithi070.stdout:309 read 0x8480637 thru 0x84836c9 (0x3093 bytes) 2024-09-11T05:33:01.283 INFO:teuthology.orchestra.run.smithi070.stdout:310 trunc from 0xcb834be to 0x28356b7 2024-09-11T05:33:01.283 INFO:teuthology.orchestra.run.smithi070.stdout:311 writesame 0xa86d3ae thru 0xa876494 data_size 0x5(0x90e7 bytes) 2024-09-11T05:33:01.283 INFO:teuthology.orchestra.run.smithi070.stdout:313 write 0xe3270f2 thru 0xe3305b7 (0x94c6 bytes) 2024-09-11T05:33:01.283 INFO:teuthology.orchestra.run.smithi070.stdout:314 trunc from 0xe3305b8 to 0x19fd7ca 2024-09-11T05:33:01.283 INFO:teuthology.orchestra.run.smithi070.stdout:315 read 0xf394d6 thru 0xf3fa7e (0x65a9 bytes) 2024-09-11T05:33:01.283 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.283 INFO:teuthology.orchestra.run.smithi070.stdout:317 trunc from 0x19fd7ca to 0x2476647 2024-09-11T05:33:01.283 INFO:teuthology.orchestra.run.smithi070.stdout:318 read 0x993707 thru 0x9a3395 (0xfc8f bytes) 2024-09-11T05:33:01.283 INFO:teuthology.orchestra.run.smithi070.stdout:319 punch from 0x1e810b7 to 0x1e8a234, (0x917d bytes) 2024-09-11T05:33:01.284 INFO:teuthology.orchestra.run.smithi070.stdout:320 write 0xd83708d thru 0xd83d42b (0x639f bytes) 2024-09-11T05:33:01.284 INFO:teuthology.orchestra.run.smithi070.stdout:321 read 0x7d86492 thru 0x7d95825 (0xf394 bytes) 2024-09-11T05:33:01.284 INFO:teuthology.orchestra.run.smithi070.stdout:322 write 0x5922a16 thru 0x5931e03 (0xf3ee bytes) 2024-09-11T05:33:01.284 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.284 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.284 INFO:teuthology.orchestra.run.smithi070.stdout:326 writesame 0x8f3920e thru 0x8f44f3f data_size 0x3d(0xbd32 bytes) 2024-09-11T05:33:01.284 INFO:teuthology.orchestra.run.smithi070.stdout:327 punch from 0x3929fbb to 0x392e789, (0x47ce bytes) 2024-09-11T05:33:01.284 INFO:teuthology.orchestra.run.smithi070.stdout:328 writesame 0x2494460 thru 0x2498720 data_size 0x1(0x42c1 bytes) 2024-09-11T05:33:01.284 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:01.279+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:01.287 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.287 INFO:teuthology.orchestra.run.smithi070.stdout:331 write 0x16de508 thru 0x16e8f66 (0xaa5f bytes) 2024-09-11T05:33:01.289 INFO:teuthology.orchestra.run.smithi070.stdout:332 writesame 0xc6b5cfa thru 0xc6bb63f data_size 0x27(0x5946 bytes) 2024-09-11T05:33:01.292 INFO:teuthology.orchestra.run.smithi070.stdout:334 read 0xe6fcfc thru 0xe722b9 (0x25be bytes) 2024-09-11T05:33:01.293 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.293 INFO:teuthology.orchestra.run.smithi070.stdout:336 writesame 0x130725f thru 0x1308fe0 data_size 0x3(0x1d82 bytes) 2024-09-11T05:33:01.295 INFO:teuthology.orchestra.run.smithi070.stdout:337 writesame 0xcb1e673 thru 0xcb21da5 data_size 0x1(0x3733 bytes) 2024-09-11T05:33:01.319 INFO:teuthology.orchestra.run.smithi070.stdout:338 trunc from 0xd83d42c to 0xf5956b 2024-09-11T05:33:01.336 INFO:teuthology.orchestra.run.smithi070.stdout:339 read 0x1011c5 thru 0x104b7b (0x39b7 bytes) 2024-09-11T05:33:01.336 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.337 INFO:teuthology.orchestra.run.smithi070.stdout:343 trunc from 0xf5956b to 0x374bdb 2024-09-11T05:33:01.373 INFO:teuthology.orchestra.run.smithi070.stdout:344 writesame 0x85ce45f thru 0x85cf1bf data_size 0x5(0xd61 bytes) 2024-09-11T05:33:01.380 INFO:teuthology.orchestra.run.smithi070.stdout:347 writesame 0x99cb68c thru 0x99d2216 data_size 0x17(0x6b8b bytes) 2024-09-11T05:33:01.380 INFO:teuthology.orchestra.run.smithi070.stdout:348 read 0x4074e8a thru 0x4083e29 (0xefa0 bytes) 2024-09-11T05:33:01.380 INFO:teuthology.orchestra.run.smithi070.stdout:349 read 0x1f585c9 thru 0x1f5abe4 (0x261c bytes) 2024-09-11T05:33:01.381 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:01.380+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:01.381 INFO:teuthology.orchestra.run.smithi070.stdout:350 read 0x7e78721 thru 0x7e84dda (0xc6ba bytes) 2024-09-11T05:33:01.381 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.382 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.382 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.382 INFO:teuthology.orchestra.run.smithi070.stdout:359 read 0x6032259 thru 0x603f0af (0xce57 bytes) 2024-09-11T05:33:01.382 INFO:teuthology.orchestra.run.smithi070.stdout:360 read 0x92c9e59 thru 0x92d50de (0xb286 bytes) 2024-09-11T05:33:01.382 INFO:teuthology.orchestra.run.smithi070.stdout:361 read 0x5d85473 thru 0x5d8a64f (0x51dd bytes) 2024-09-11T05:33:01.382 INFO:teuthology.orchestra.run.smithi070.stdout:362 read 0x5cb6906 thru 0x5cbd30d (0x6a08 bytes) 2024-09-11T05:33:01.382 INFO:teuthology.orchestra.run.smithi070.stdout:363 write 0x234368a thru 0x234f8b4 (0xc22b bytes) 2024-09-11T05:33:01.384 INFO:teuthology.orchestra.run.smithi070.stdout:364 read 0x8c31c89 thru 0x8c3c69a (0xaa12 bytes) 2024-09-11T05:33:01.384 INFO:teuthology.orchestra.run.smithi070.stdout:365 read 0x950df1d thru 0x950fd0f (0x1df3 bytes) 2024-09-11T05:33:01.384 INFO:teuthology.orchestra.run.smithi070.stdout:369 read 0x2052b96 thru 0x205662c (0x3a97 bytes) 2024-09-11T05:33:01.385 INFO:teuthology.orchestra.run.smithi070.stdout:370 writesame 0x854c0be thru 0x854e560 data_size 0x1(0x24a3 bytes) 2024-09-11T05:33:01.397 INFO:teuthology.orchestra.run.smithi070.stdout:371 trunc from 0x99d2217 to 0x564f232 2024-09-11T05:33:01.409 INFO:teuthology.orchestra.run.smithi070.stdout:373 write 0x3743108 thru 0x3747402 (0x42fb bytes) 2024-09-11T05:33:01.411 INFO:teuthology.orchestra.run.smithi070.stdout:374 writesame 0x1d387dc thru 0x1d430b5 data_size 0x1(0xa8da bytes) 2024-09-11T05:33:01.411 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:01.412 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:01.421 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:01.435 INFO:teuthology.orchestra.run.smithi070.stdout:375 read 0x1a94fe thru 0x1ace97 (0x399a bytes) 2024-09-11T05:33:01.437 INFO:teuthology.orchestra.run.smithi070.stdout:377 writesame 0x395469f thru 0x395b696 data_size 0x4(0x6ff8 bytes) 2024-09-11T05:33:01.444 INFO:teuthology.orchestra.run.smithi070.stdout:378 trunc from 0x564f232 to 0x3fab820 2024-09-11T05:33:01.454 INFO:teuthology.orchestra.run.smithi070.stdout:379 read 0x3b293dd thru 0x3b31d93 (0x89b7 bytes) 2024-09-11T05:33:01.470 INFO:teuthology.orchestra.run.smithi070.stdout:380 write 0xc89cd56 thru 0xc8a77f0 (0xaa9b bytes) 2024-09-11T05:33:01.481 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:01.480+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:01.488 INFO:teuthology.orchestra.run.smithi070.stdout:381 trunc from 0xc8a77f1 to 0x3e19b8 2024-09-11T05:33:01.504 INFO:teuthology.orchestra.run.smithi070.stdout:382 read 0x10979b thru 0x113b17 (0xa37d bytes) 2024-09-11T05:33:01.505 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.505 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.505 INFO:teuthology.orchestra.run.smithi070.stdout:truncating to largest ever: 0xed5569e 2024-09-11T05:33:01.522 INFO:teuthology.orchestra.run.smithi070.stdout:387 trunc from 0x3e19b8 to 0xed5569e 2024-09-11T05:33:01.528 INFO:teuthology.orchestra.run.smithi070.stdout:388 write 0xbf88c09 thru 0xbf96787 (0xdb7f bytes) 2024-09-11T05:33:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:390 trunc from 0xed5569e to 0xdb03557 2024-09-11T05:33:01.538 INFO:teuthology.orchestra.run.smithi070.stdout:391 write 0x577c12b thru 0x577e870 (0x2746 bytes) 2024-09-11T05:33:01.541 INFO:teuthology.orchestra.run.smithi070.stdout:392 read 0x9622757 thru 0x9625b9b (0x3445 bytes) 2024-09-11T05:33:01.541 INFO:teuthology.orchestra.run.smithi070.stdout:394 read 0x72a959b thru 0x72b65e0 (0xd046 bytes) 2024-09-11T05:33:01.541 INFO:teuthology.orchestra.run.smithi070.stdout:398 punch from 0x31cfcc8 to 0x31d8b4c, (0x8e84 bytes) 2024-09-11T05:33:01.541 INFO:teuthology.orchestra.run.smithi070.stdout:399 writesame 0x552e5d6 thru 0x55328ff data_size 0x1(0x432a bytes) 2024-09-11T05:33:01.553 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.553 INFO:teuthology.orchestra.run.smithi070.stdout:402 read 0xcdaa349 thru 0xcdb4c82 (0xa93a bytes) 2024-09-11T05:33:01.553 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.553 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.553 INFO:teuthology.orchestra.run.smithi070.stdout:407 read 0x311d7f6 thru 0x311dc4a (0x455 bytes) 2024-09-11T05:33:01.553 INFO:teuthology.orchestra.run.smithi070.stdout:408 read 0x4825cbf thru 0x483370d (0xda4f bytes) 2024-09-11T05:33:01.554 INFO:teuthology.orchestra.run.smithi070.stdout:409 writesame 0xda65cc4 thru 0xda6ce71 data_size 0x1(0x71ae bytes) 2024-09-11T05:33:01.557 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:01.557 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:01.566 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:01.570 INFO:teuthology.orchestra.run.smithi070.stdout:411 read 0xa78c15d thru 0xa79aa4d (0xe8f1 bytes) 2024-09-11T05:33:01.570 INFO:teuthology.orchestra.run.smithi070.stdout:413 write 0x2f90fe0 thru 0x2fa058f (0xf5b0 bytes) 2024-09-11T05:33:01.572 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.572 INFO:teuthology.orchestra.run.smithi070.stdout:415 writesame 0xbbf5d88 thru 0xbbfd39f data_size 0x4(0x7618 bytes) 2024-09-11T05:33:01.578 INFO:teuthology.orchestra.run.smithi070.stdout:416 write 0xd11cc7d thru 0xd125796 (0x8b1a bytes) 2024-09-11T05:33:01.581 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:01.581+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:01.582 INFO:teuthology.orchestra.run.smithi070.stdout:417 write 0x2cc7314 thru 0x2cd4f08 (0xdbf5 bytes) 2024-09-11T05:33:01.585 INFO:teuthology.orchestra.run.smithi070.stdout:419 read 0x32132a6 thru 0x321da8d (0xa7e8 bytes) 2024-09-11T05:33:01.585 INFO:teuthology.orchestra.run.smithi070.stdout:420 read 0x8b3bec6 thru 0x8b3d7b8 (0x18f3 bytes) 2024-09-11T05:33:01.585 INFO:teuthology.orchestra.run.smithi070.stdout:421 read 0x5256a00 thru 0x5256d0b (0x30c bytes) 2024-09-11T05:33:01.599 INFO:teuthology.orchestra.run.smithi070.stdout:423 trunc from 0xdb03557 to 0x38ef087 2024-09-11T05:33:01.613 INFO:teuthology.orchestra.run.smithi070.stdout:427 punch from 0x1ec5905 to 0x1ec70df, (0x17da bytes) 2024-09-11T05:33:01.621 INFO:teuthology.orchestra.run.smithi070.stdout:428 write 0x55f05be thru 0x55fa45f (0x9ea2 bytes) 2024-09-11T05:33:01.622 INFO:teuthology.orchestra.run.smithi070.stdout:430 clone 2 order 21 su 1048576 sc 2 2024-09-11T05:33:01.649 INFO:teuthology.orchestra.run.smithi070.stderr:set 2.4 pg_upmap_items mapping to [6->1,7->0] 2024-09-11T05:33:01.682 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:01.682+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:01.693 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:01.693 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:01.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:01.693 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:01.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.693 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:489 3.2 3:4550e1e5:::rbd_id.image_client.0-clone1:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.693 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.676545+0000", 2024-09-11T05:33:01.694 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.014875, 2024-09-11T05:33:01.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030269920000000001, 2024-09-11T05:33:01.694 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 489 2024-09-11T05:33:01.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.694 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676545+0000", 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676545+0000", 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676547+0000", 2024-09-11T05:33:01.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2730000000000001e-06 2024-09-11T05:33:01.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676556+0000", 2024-09-11T05:33:01.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9309999999999997e-06 2024-09-11T05:33:01.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676576+0000", 2024-09-11T05:33:01.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9545e-05 2024-09-11T05:33:01.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676586+0000", 2024-09-11T05:33:01.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9539999999999999e-06 2024-09-11T05:33:01.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676648+0000", 2024-09-11T05:33:01.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.245e-05 2024-09-11T05:33:01.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T05:33:01.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676657+0000", 2024-09-11T05:33:01.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3590000000000008e-06 2024-09-11T05:33:01.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678192+0000", 2024-09-11T05:33:01.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015357890000000001 2024-09-11T05:33:01.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678318+0000", 2024-09-11T05:33:01.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012543600000000001 2024-09-11T05:33:01.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:01.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678508+0000", 2024-09-11T05:33:01.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018981099999999999 2024-09-11T05:33:01.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.679136+0000", 2024-09-11T05:33:01.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000628456 2024-09-11T05:33:01.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.679497+0000", 2024-09-11T05:33:01.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036036800000000002 2024-09-11T05:33:01.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.679539+0000", 2024-09-11T05:33:01.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2947000000000001e-05 2024-09-11T05:33:01.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.679572+0000", 2024-09-11T05:33:01.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2672999999999997e-05 2024-09-11T05:33:01.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.700 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.701 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:665 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 7864320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.701 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.919524+0000", 2024-09-11T05:33:01.701 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.771896531, 2024-09-11T05:33:01.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020638890000000002, 2024-09-11T05:33:01.701 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 665 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919524+0000", 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919524+0000", 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919525+0000", 2024-09-11T05:33:01.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.66e-06 2024-09-11T05:33:01.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919532+0000", 2024-09-11T05:33:01.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2280000000000003e-06 2024-09-11T05:33:01.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919545+0000", 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3725e-05 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919553+0000", 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919627+0000", 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3919999999999997e-05 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919715+0000", 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8505999999999996e-05 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919863+0000", 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014757299999999999 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.920542+0000", 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067902100000000003 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.921513+0000", 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097081299999999995 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.921553+0000", 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0538999999999999e-05 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.921588+0000", 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4280999999999999e-05 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:706 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 2621440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.968456+0000", 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.72296387600000001, 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002353997, 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 706 2024-09-11T05:33:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968456+0000", 2024-09-11T05:33:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968456+0000", 2024-09-11T05:33:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968459+0000", 2024-09-11T05:33:01.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3829999999999999e-06 2024-09-11T05:33:01.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968485+0000", 2024-09-11T05:33:01.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6798999999999999e-05 2024-09-11T05:33:01.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968505+0000", 2024-09-11T05:33:01.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9726000000000001e-05 2024-09-11T05:33:01.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968519+0000", 2024-09-11T05:33:01.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3413e-05 2024-09-11T05:33:01.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968591+0000", 2024-09-11T05:33:01.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1929999999999997e-05 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968683+0000", 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2291000000000001e-05 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968830+0000", 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147305 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.970110+0000", 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127954 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.970695+0000", 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058518700000000003 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.970747+0000", 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2014e-05 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.970810+0000", 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3409000000000002e-05 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:709 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 2621440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.969151+0000", 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.72226869800000004, 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002099208, 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 709 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969151+0000", 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969151+0000", 2024-09-11T05:33:01.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969152+0000", 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6499999999999998e-07 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969157+0000", 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4519999999999999e-06 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969165+0000", 2024-09-11T05:33:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6340000000000007e-06 2024-09-11T05:33:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969172+0000", 2024-09-11T05:33:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6560000000000003e-06 2024-09-11T05:33:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969229+0000", 2024-09-11T05:33:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7153e-05 2024-09-11T05:33:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969306+0000", 2024-09-11T05:33:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6452000000000006e-05 2024-09-11T05:33:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969428+0000", 2024-09-11T05:33:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122036 2024-09-11T05:33:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.970669+0000", 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001241778 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.971157+0000", 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048744400000000002 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.971209+0000", 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1848000000000002e-05 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.971251+0000", 2024-09-11T05:33:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1990000000000003e-05 2024-09-11T05:33:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:800 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 6815744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.052010+0000", 2024-09-11T05:33:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.63940998100000002, 2024-09-11T05:33:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023934960000000002, 2024-09-11T05:33:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 800 2024-09-11T05:33:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052010+0000", 2024-09-11T05:33:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052010+0000", 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052012+0000", 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052019+0000", 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3950000000000003e-06 2024-09-11T05:33:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052035+0000", 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052043+0000", 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1920000000000005e-06 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052100+0000", 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6774999999999998e-05 2024-09-11T05:33:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052182+0000", 2024-09-11T05:33:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1536e-05 2024-09-11T05:33:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052312+0000", 2024-09-11T05:33:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013061299999999999 2024-09-11T05:33:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054141+0000", 2024-09-11T05:33:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001829106 2024-09-11T05:33:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054320+0000", 2024-09-11T05:33:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017879199999999999 2024-09-11T05:33:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054362+0000", 2024-09-11T05:33:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2089000000000003e-05 2024-09-11T05:33:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054404+0000", 2024-09-11T05:33:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1576000000000003e-05 2024-09-11T05:33:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:803 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 6815744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.052073+0000", 2024-09-11T05:33:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.63934757600000003, 2024-09-11T05:33:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002111515, 2024-09-11T05:33:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 803 2024-09-11T05:33:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052073+0000", 2024-09-11T05:33:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052073+0000", 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052073+0000", 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5899999999999996e-07 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052076+0000", 2024-09-11T05:33:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1250000000000001e-06 2024-09-11T05:33:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052084+0000", 2024-09-11T05:33:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5549999999999997e-06 2024-09-11T05:33:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052090+0000", 2024-09-11T05:33:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:33:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052159+0000", 2024-09-11T05:33:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9009000000000003e-05 2024-09-11T05:33:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052247+0000", 2024-09-11T05:33:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7935000000000004e-05 2024-09-11T05:33:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052375+0000", 2024-09-11T05:33:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127983 2024-09-11T05:33:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054048+0000", 2024-09-11T05:33:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016727440000000001 2024-09-11T05:33:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054089+0000", 2024-09-11T05:33:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1631999999999997e-05 2024-09-11T05:33:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054141+0000", 2024-09-11T05:33:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2058000000000002e-05 2024-09-11T05:33:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054184+0000", 2024-09-11T05:33:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2861000000000002e-05 2024-09-11T05:33:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:824 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 3145728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.063882+0000", 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62753806400000001, 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020148179999999998, 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 824 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063882+0000", 2024-09-11T05:33:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063882+0000", 2024-09-11T05:33:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063884+0000", 2024-09-11T05:33:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3350000000000001e-06 2024-09-11T05:33:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063893+0000", 2024-09-11T05:33:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6459999999999999e-06 2024-09-11T05:33:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063920+0000", 2024-09-11T05:33:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7257999999999999e-05 2024-09-11T05:33:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063930+0000", 2024-09-11T05:33:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7319999999999993e-06 2024-09-11T05:33:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.064019+0000", 2024-09-11T05:33:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9284999999999996e-05 2024-09-11T05:33:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.064117+0000", 2024-09-11T05:33:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7317000000000004e-05 2024-09-11T05:33:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.064268+0000", 2024-09-11T05:33:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151345 2024-09-11T05:33:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.065699+0000", 2024-09-11T05:33:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014312509999999999 2024-09-11T05:33:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.065810+0000", 2024-09-11T05:33:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110246 2024-09-11T05:33:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.065857+0000", 2024-09-11T05:33:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7481999999999997e-05 2024-09-11T05:33:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.065897+0000", 2024-09-11T05:33:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9920999999999999e-05 2024-09-11T05:33:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:827 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 3145728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.063974+0000", 2024-09-11T05:33:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62744602100000002, 2024-09-11T05:33:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025619459999999998, 2024-09-11T05:33:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 827 2024-09-11T05:33:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063974+0000", 2024-09-11T05:33:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063974+0000", 2024-09-11T05:33:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063975+0000", 2024-09-11T05:33:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2500000000000004e-07 2024-09-11T05:33:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063980+0000", 2024-09-11T05:33:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3879999999999999e-06 2024-09-11T05:33:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063988+0000", 2024-09-11T05:33:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8040000000000002e-06 2024-09-11T05:33:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063996+0000", 2024-09-11T05:33:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3390000000000004e-06 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.064218+0000", 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000222372 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.064293+0000", 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5111000000000006e-05 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.064418+0000", 2024-09-11T05:33:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000125282 2024-09-11T05:33:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.066159+0000", 2024-09-11T05:33:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001741175 2024-09-11T05:33:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.066438+0000", 2024-09-11T05:33:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027891999999999999 2024-09-11T05:33:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.066493+0000", 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4951000000000003e-05 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.066536+0000", 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2778999999999998e-05 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:871 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 1572864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.099034+0000", 2024-09-11T05:33:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.59238608299999995, 2024-09-11T05:33:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044718789999999998, 2024-09-11T05:33:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 871 2024-09-11T05:33:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099034+0000", 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099034+0000", 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099037+0000", 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8080000000000001e-06 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099049+0000", 2024-09-11T05:33:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2424e-05 2024-09-11T05:33:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099073+0000", 2024-09-11T05:33:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4074e-05 2024-09-11T05:33:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099084+0000", 2024-09-11T05:33:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0801e-05 2024-09-11T05:33:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099164+0000", 2024-09-11T05:33:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0278000000000006e-05 2024-09-11T05:33:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099256+0000", 2024-09-11T05:33:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1998999999999998e-05 2024-09-11T05:33:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099390+0000", 2024-09-11T05:33:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013373599999999999 2024-09-11T05:33:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.101301+0000", 2024-09-11T05:33:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001910866 2024-09-11T05:33:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.103448+0000", 2024-09-11T05:33:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002146996 2024-09-11T05:33:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.103479+0000", 2024-09-11T05:33:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0812000000000002e-05 2024-09-11T05:33:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.103506+0000", 2024-09-11T05:33:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7084999999999999e-05 2024-09-11T05:33:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:874 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 1572864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.099640+0000", 2024-09-11T05:33:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.59177972999999995, 2024-09-11T05:33:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018944739999999999, 2024-09-11T05:33:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 874 2024-09-11T05:33:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099640+0000", 2024-09-11T05:33:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099640+0000", 2024-09-11T05:33:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099641+0000", 2024-09-11T05:33:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4099999999999998e-07 2024-09-11T05:33:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099645+0000", 2024-09-11T05:33:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9580000000000001e-06 2024-09-11T05:33:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099654+0000", 2024-09-11T05:33:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7560000000000005e-06 2024-09-11T05:33:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099661+0000", 2024-09-11T05:33:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309999999999996e-06 2024-09-11T05:33:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099713+0000", 2024-09-11T05:33:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1984000000000002e-05 2024-09-11T05:33:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099787+0000", 2024-09-11T05:33:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4134000000000005e-05 2024-09-11T05:33:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099917+0000", 2024-09-11T05:33:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130708 2024-09-11T05:33:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.101315+0000", 2024-09-11T05:33:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013973620000000001 2024-09-11T05:33:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.101422+0000", 2024-09-11T05:33:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107487 2024-09-11T05:33:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.101492+0000", 2024-09-11T05:33:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9696999999999994e-05 2024-09-11T05:33:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.101535+0000", 2024-09-11T05:33:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3016000000000003e-05 2024-09-11T05:33:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:929 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 3145728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.174198+0000", 2024-09-11T05:33:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.51722230999999996, 2024-09-11T05:33:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038749209999999999, 2024-09-11T05:33:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 929 2024-09-11T05:33:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174198+0000", 2024-09-11T05:33:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174198+0000", 2024-09-11T05:33:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174199+0000", 2024-09-11T05:33:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.159e-06 2024-09-11T05:33:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174205+0000", 2024-09-11T05:33:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4219999999999997e-06 2024-09-11T05:33:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174219+0000", 2024-09-11T05:33:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3451999999999999e-05 2024-09-11T05:33:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174226+0000", 2024-09-11T05:33:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5379999999999997e-06 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174285+0000", 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8128000000000003e-05 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174363+0000", 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8286000000000002e-05 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174488+0000", 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124688 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.175250+0000", 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076250000000000005 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.178014+0000", 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027635239999999998 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.178046+0000", 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2829e-05 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.178073+0000", 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6395000000000001e-05 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:932 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 2840247] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.174258+0000", 2024-09-11T05:33:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.51716258800000003, 2024-09-11T05:33:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001952493, 2024-09-11T05:33:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 932 2024-09-11T05:33:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174258+0000", 2024-09-11T05:33:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174258+0000", 2024-09-11T05:33:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174258+0000", 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4600000000000004e-07 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174263+0000", 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4109999999999998e-06 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174270+0000", 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2309999999999999e-06 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174276+0000", 2024-09-11T05:33:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6720000000000001e-06 2024-09-11T05:33:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174339+0000", 2024-09-11T05:33:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3133999999999996e-05 2024-09-11T05:33:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174420+0000", 2024-09-11T05:33:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1361999999999998e-05 2024-09-11T05:33:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174551+0000", 2024-09-11T05:33:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130693 2024-09-11T05:33:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.175638+0000", 2024-09-11T05:33:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010872970000000001 2024-09-11T05:33:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.176129+0000", 2024-09-11T05:33:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049100200000000004 2024-09-11T05:33:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.176175+0000", 2024-09-11T05:33:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5689000000000003e-05 2024-09-11T05:33:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.176210+0000", 2024-09-11T05:33:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5355999999999998e-05 2024-09-11T05:33:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:976 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.233058+0000", 2024-09-11T05:33:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.458362569, 2024-09-11T05:33:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001915618, 2024-09-11T05:33:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 976 2024-09-11T05:33:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233058+0000", 2024-09-11T05:33:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233058+0000", 2024-09-11T05:33:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233060+0000", 2024-09-11T05:33:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4040000000000002e-06 2024-09-11T05:33:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233068+0000", 2024-09-11T05:33:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1049999999999995e-06 2024-09-11T05:33:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233088+0000", 2024-09-11T05:33:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0174999999999999e-05 2024-09-11T05:33:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233099+0000", 2024-09-11T05:33:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0234000000000001e-05 2024-09-11T05:33:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233182+0000", 2024-09-11T05:33:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3051000000000002e-05 2024-09-11T05:33:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233279+0000", 2024-09-11T05:33:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7019000000000001e-05 2024-09-11T05:33:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233404+0000", 2024-09-11T05:33:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012492300000000001 2024-09-11T05:33:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.234393+0000", 2024-09-11T05:33:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098997199999999999 2024-09-11T05:33:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.234859+0000", 2024-09-11T05:33:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046591100000000001 2024-09-11T05:33:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.234929+0000", 2024-09-11T05:33:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9326999999999995e-05 2024-09-11T05:33:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.234973+0000", 2024-09-11T05:33:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4496999999999998e-05 2024-09-11T05:33:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:979 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.233167+0000", 2024-09-11T05:33:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.45825301699999998, 2024-09-11T05:33:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002261753, 2024-09-11T05:33:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 979 2024-09-11T05:33:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233167+0000", 2024-09-11T05:33:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233167+0000", 2024-09-11T05:33:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233168+0000", 2024-09-11T05:33:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8500000000000001e-07 2024-09-11T05:33:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233172+0000", 2024-09-11T05:33:01.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:33:01.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233181+0000", 2024-09-11T05:33:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6279999999999994e-06 2024-09-11T05:33:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233187+0000", 2024-09-11T05:33:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1120000000000001e-06 2024-09-11T05:33:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233237+0000", 2024-09-11T05:33:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9876000000000002e-05 2024-09-11T05:33:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233313+0000", 2024-09-11T05:33:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6049000000000003e-05 2024-09-11T05:33:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233424+0000", 2024-09-11T05:33:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011113299999999999 2024-09-11T05:33:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.234350+0000", 2024-09-11T05:33:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092573199999999997 2024-09-11T05:33:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.235332+0000", 2024-09-11T05:33:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098234899999999998 2024-09-11T05:33:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.235389+0000", 2024-09-11T05:33:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6632999999999998e-05 2024-09-11T05:33:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.235429+0000", 2024-09-11T05:33:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0281000000000003e-05 2024-09-11T05:33:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1037 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.326084+0000", 2024-09-11T05:33:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.36533637299999999, 2024-09-11T05:33:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039491140000000001, 2024-09-11T05:33:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1037 2024-09-11T05:33:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326084+0000", 2024-09-11T05:33:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326084+0000", 2024-09-11T05:33:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326085+0000", 2024-09-11T05:33:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1960000000000001e-06 2024-09-11T05:33:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326091+0000", 2024-09-11T05:33:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7729999999999996e-06 2024-09-11T05:33:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326106+0000", 2024-09-11T05:33:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4995e-05 2024-09-11T05:33:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326114+0000", 2024-09-11T05:33:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8960000000000003e-06 2024-09-11T05:33:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326171+0000", 2024-09-11T05:33:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7166999999999997e-05 2024-09-11T05:33:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326248+0000", 2024-09-11T05:33:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7008000000000005e-05 2024-09-11T05:33:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326376+0000", 2024-09-11T05:33:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012861900000000001 2024-09-11T05:33:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.327103+0000", 2024-09-11T05:33:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000726807 2024-09-11T05:33:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.329935+0000", 2024-09-11T05:33:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028322249999999998 2024-09-11T05:33:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.329992+0000", 2024-09-11T05:33:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7012999999999998e-05 2024-09-11T05:33:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.330033+0000", 2024-09-11T05:33:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0414999999999998e-05 2024-09-11T05:33:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1040 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.326148+0000", 2024-09-11T05:33:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.36527243399999998, 2024-09-11T05:33:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002557087, 2024-09-11T05:33:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1040 2024-09-11T05:33:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326148+0000", 2024-09-11T05:33:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326148+0000", 2024-09-11T05:33:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326148+0000", 2024-09-11T05:33:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7199999999999998e-07 2024-09-11T05:33:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326152+0000", 2024-09-11T05:33:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5710000000000002e-06 2024-09-11T05:33:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326161+0000", 2024-09-11T05:33:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6999999999999997e-06 2024-09-11T05:33:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326167+0000", 2024-09-11T05:33:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9179999999999999e-06 2024-09-11T05:33:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326219+0000", 2024-09-11T05:33:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2630999999999998e-05 2024-09-11T05:33:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326296+0000", 2024-09-11T05:33:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6777e-05 2024-09-11T05:33:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326423+0000", 2024-09-11T05:33:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127467 2024-09-11T05:33:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.327747+0000", 2024-09-11T05:33:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001323577 2024-09-11T05:33:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.328639+0000", 2024-09-11T05:33:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089223099999999995 2024-09-11T05:33:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.328674+0000", 2024-09-11T05:33:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4397000000000003e-05 2024-09-11T05:33:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.328705+0000", 2024-09-11T05:33:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1146000000000003e-05 2024-09-11T05:33:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1065 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.337981+0000", 2024-09-11T05:33:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.353438743, 2024-09-11T05:33:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020208660000000001, 2024-09-11T05:33:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1065 2024-09-11T05:33:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.337981+0000", 2024-09-11T05:33:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.337981+0000", 2024-09-11T05:33:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.337982+0000", 2024-09-11T05:33:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7400000000000003e-07 2024-09-11T05:33:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.337986+0000", 2024-09-11T05:33:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T05:33:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.337993+0000", 2024-09-11T05:33:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2069999999999998e-06 2024-09-11T05:33:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338002+0000", 2024-09-11T05:33:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.619e-06 2024-09-11T05:33:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338066+0000", 2024-09-11T05:33:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740999999999996e-05 2024-09-11T05:33:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338213+0000", 2024-09-11T05:33:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014627600000000001 2024-09-11T05:33:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338641+0000", 2024-09-11T05:33:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000428348 2024-09-11T05:33:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339618+0000", 2024-09-11T05:33:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000976848 2024-09-11T05:33:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339922+0000", 2024-09-11T05:33:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000304436 2024-09-11T05:33:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339961+0000", 2024-09-11T05:33:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8729999999999997e-05 2024-09-11T05:33:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.340002+0000", 2024-09-11T05:33:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1365000000000001e-05 2024-09-11T05:33:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1153 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 4718592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.446979+0000", 2024-09-11T05:33:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.24444126499999999, 2024-09-11T05:33:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020556569999999998, 2024-09-11T05:33:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1153 2024-09-11T05:33:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.446979+0000", 2024-09-11T05:33:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.446979+0000", 2024-09-11T05:33:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.446981+0000", 2024-09-11T05:33:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7230000000000001e-06 2024-09-11T05:33:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.446990+0000", 2024-09-11T05:33:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:33:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447011+0000", 2024-09-11T05:33:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1475999999999999e-05 2024-09-11T05:33:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447025+0000", 2024-09-11T05:33:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3789e-05 2024-09-11T05:33:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447103+0000", 2024-09-11T05:33:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8256000000000004e-05 2024-09-11T05:33:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447202+0000", 2024-09-11T05:33:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8529999999999993e-05 2024-09-11T05:33:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447355+0000", 2024-09-11T05:33:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015272500000000001 2024-09-11T05:33:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.448019+0000", 2024-09-11T05:33:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066467900000000005 2024-09-11T05:33:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.448913+0000", 2024-09-11T05:33:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089421399999999995 2024-09-11T05:33:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.448979+0000", 2024-09-11T05:33:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5792999999999998e-05 2024-09-11T05:33:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.449035+0000", 2024-09-11T05:33:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5355000000000001e-05 2024-09-11T05:33:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1156 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 4718592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.447059+0000", 2024-09-11T05:33:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.24436087400000001, 2024-09-11T05:33:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024012819999999998, 2024-09-11T05:33:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1156 2024-09-11T05:33:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.830 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447059+0000", 2024-09-11T05:33:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447059+0000", 2024-09-11T05:33:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447060+0000", 2024-09-11T05:33:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9299999999999999e-07 2024-09-11T05:33:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447063+0000", 2024-09-11T05:33:01.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.303e-06 2024-09-11T05:33:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447070+0000", 2024-09-11T05:33:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8569999999999997e-06 2024-09-11T05:33:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447077+0000", 2024-09-11T05:33:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.34e-06 2024-09-11T05:33:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447153+0000", 2024-09-11T05:33:01.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5816999999999996e-05 2024-09-11T05:33:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447235+0000", 2024-09-11T05:33:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1750999999999997e-05 2024-09-11T05:33:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447359+0000", 2024-09-11T05:33:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012429300000000001 2024-09-11T05:33:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.448534+0000", 2024-09-11T05:33:01.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011745970000000001 2024-09-11T05:33:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.449401+0000", 2024-09-11T05:33:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00086696799999999997 2024-09-11T05:33:01.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.449434+0000", 2024-09-11T05:33:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3439999999999998e-05 2024-09-11T05:33:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.449461+0000", 2024-09-11T05:33:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6523e-05 2024-09-11T05:33:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1190 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.493765+0000", 2024-09-11T05:33:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.19765556200000001, 2024-09-11T05:33:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022484219999999999, 2024-09-11T05:33:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:01.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1190 2024-09-11T05:33:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493765+0000", 2024-09-11T05:33:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493765+0000", 2024-09-11T05:33:01.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493765+0000", 2024-09-11T05:33:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6000000000000004e-07 2024-09-11T05:33:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493768+0000", 2024-09-11T05:33:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.942e-06 2024-09-11T05:33:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493776+0000", 2024-09-11T05:33:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5580000000000003e-06 2024-09-11T05:33:01.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493782+0000", 2024-09-11T05:33:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1410000000000002e-06 2024-09-11T05:33:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:01.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493834+0000", 2024-09-11T05:33:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2512999999999997e-05 2024-09-11T05:33:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493898+0000", 2024-09-11T05:33:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3987999999999998e-05 2024-09-11T05:33:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.494011+0000", 2024-09-11T05:33:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011294399999999999 2024-09-11T05:33:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.494782+0000", 2024-09-11T05:33:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00077052399999999997 2024-09-11T05:33:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.495916+0000", 2024-09-11T05:33:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011341389999999999 2024-09-11T05:33:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.495969+0000", 2024-09-11T05:33:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3190999999999999e-05 2024-09-11T05:33:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.496013+0000", 2024-09-11T05:33:01.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3921999999999997e-05 2024-09-11T05:33:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:01.851 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:01.851 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:01.853 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:01.855 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone1 from 0x55fa460 (overlap 0x374bdb) to 0x1096c1 2024-09-11T05:33:01.855 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-11T05:33:01.855 INFO:teuthology.orchestra.run.smithi070.stdout:431 punch from 0x1a74ec3 to 0x1a782d6, (0x3413 bytes) 2024-09-11T05:33:01.856 INFO:teuthology.orchestra.run.smithi070.stdout:432 writesame 0x19d6160 thru 0x19db5a8 data_size 0x1(0x5449 bytes) 2024-09-11T05:33:01.856 INFO:teuthology.orchestra.run.smithi070.stdout:435 write 0xd7bb26f thru 0xd7c6c23 (0xb9b5 bytes) 2024-09-11T05:33:01.856 INFO:teuthology.orchestra.run.smithi070.stdout:436 read 0xd396010 thru 0xd39963c (0x362d bytes) 2024-09-11T05:33:01.856 INFO:teuthology.orchestra.run.smithi070.stdout:437 punch from 0xc3b539e to 0xc3c4161, (0xedc3 bytes) 2024-09-11T05:33:01.856 INFO:teuthology.orchestra.run.smithi070.stdout:439 write 0x8d8669a thru 0x8d92aee (0xc455 bytes) 2024-09-11T05:33:01.856 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.856 INFO:teuthology.orchestra.run.smithi070.stdout:442 trunc from 0xd7c6c24 to 0x95a4dde 2024-09-11T05:33:01.856 INFO:teuthology.orchestra.run.smithi070.stdout:443 trunc from 0x95a4dde to 0xc7a1464 2024-09-11T05:33:01.856 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.856 INFO:teuthology.orchestra.run.smithi070.stdout:447 write 0xb7acff8 thru 0xb7b6bcf (0x9bd8 bytes) 2024-09-11T05:33:01.856 INFO:teuthology.orchestra.run.smithi070.stdout:449 punch from 0x9ef6fa6 to 0x9ef7384, (0x3de bytes) 2024-09-11T05:33:01.856 INFO:teuthology.orchestra.run.smithi070.stdout:450 read 0x82a548 thru 0x82b5eb (0x10a4 bytes) 2024-09-11T05:33:01.857 INFO:teuthology.orchestra.run.smithi070.stdout:451 read 0x686b75e thru 0x686e10e (0x29b1 bytes) 2024-09-11T05:33:01.857 INFO:teuthology.orchestra.run.smithi070.stdout:452 write 0x2e153f4 thru 0x2e179a6 (0x25b3 bytes) 2024-09-11T05:33:01.857 INFO:teuthology.orchestra.run.smithi070.stdout:453 write 0x203498b thru 0x20418fb (0xcf71 bytes) 2024-09-11T05:33:01.857 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:01.852+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:01.857 INFO:teuthology.orchestra.run.smithi070.stdout:455 trunc from 0xc7a1464 to 0x2f84c42 2024-09-11T05:33:01.869 INFO:teuthology.orchestra.run.smithi070.stdout:457 writesame 0x1f09bfc thru 0x1f0a363 data_size 0xc(0x768 bytes) 2024-09-11T05:33:01.873 INFO:teuthology.orchestra.run.smithi070.stdout:459 read 0x18e31a2 thru 0x18e7f1e (0x4d7d bytes) 2024-09-11T05:33:01.891 INFO:teuthology.orchestra.run.smithi070.stdout:460 write 0xb9f0fe4 thru 0xb9f9d85 (0x8da2 bytes) 2024-09-11T05:33:01.896 INFO:teuthology.orchestra.run.smithi070.stdout:461 trunc from 0xb9f9d86 to 0xd72b89c 2024-09-11T05:33:01.906 INFO:teuthology.orchestra.run.smithi070.stdout:462 trunc from 0xd72b89c to 0x8de5a88 2024-09-11T05:33:01.915 INFO:teuthology.orchestra.run.smithi070.stdout:463 writesame 0x49325ba thru 0x493ca91 data_size 0x32(0xa4d8 bytes) 2024-09-11T05:33:01.918 INFO:teuthology.orchestra.run.smithi070.stdout:464 writesame 0x7d8769b thru 0x7d8d649 data_size 0x17(0x5faf bytes) 2024-09-11T05:33:01.928 INFO:teuthology.orchestra.run.smithi070.stdout:465 trunc from 0x8de5a88 to 0xd92edfa 2024-09-11T05:33:01.937 INFO:teuthology.orchestra.run.smithi070.stdout:466 trunc from 0xd92edfa to 0xa428cb9 2024-09-11T05:33:01.942 INFO:teuthology.orchestra.run.smithi070.stdout:467 write 0x1f7a3d5 thru 0x1f84170 (0x9d9c bytes) 2024-09-11T05:33:01.944 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:01.944 INFO:teuthology.orchestra.run.smithi070.stdout:469 write 0x6e97847 thru 0x6ea467e (0xce38 bytes) 2024-09-11T05:33:01.947 INFO:teuthology.orchestra.run.smithi070.stdout:471 clone 3 order 20 su 32768 sc 4 2024-09-11T05:33:01.953 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:01.953+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:01.977 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:01.978 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:01.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:02.070 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:02.070+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:02.129 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:02.130 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:02.130 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:02.130 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:02.138 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:02.180 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:02.179+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:02.256 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:02.256+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:02.284 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:33:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.692020850999999, 2024-09-11T05:33:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:33:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:33:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:33:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:33:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:33:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:33:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:33:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:33:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:33:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:33:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:33:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:33:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:33:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:33:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:33:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:33:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:581 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786716+0000", 2024-09-11T05:33:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.4955581790000001, 2024-09-11T05:33:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076071070000000001, 2024-09-11T05:33:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 581 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786716+0000", 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786716+0000", 2024-09-11T05:33:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786716+0000", 2024-09-11T05:33:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.65e-07 2024-09-11T05:33:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786718+0000", 2024-09-11T05:33:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.334e-06 2024-09-11T05:33:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786722+0000", 2024-09-11T05:33:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8879999999999999e-06 2024-09-11T05:33:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786725+0000", 2024-09-11T05:33:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6860000000000002e-06 2024-09-11T05:33:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.789379+0000", 2024-09-11T05:33:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002654235 2024-09-11T05:33:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.789465+0000", 2024-09-11T05:33:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5864000000000003e-05 2024-09-11T05:33:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.789808+0000", 2024-09-11T05:33:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034295799999999998 2024-09-11T05:33:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.793255+0000", 2024-09-11T05:33:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034466029999999999 2024-09-11T05:33:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794219+0000", 2024-09-11T05:33:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00096429899999999995 2024-09-11T05:33:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794277+0000", 2024-09-11T05:33:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7769000000000002e-05 2024-09-11T05:33:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794323+0000", 2024-09-11T05:33:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6106000000000002e-05 2024-09-11T05:33:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:582 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786728+0000", 2024-09-11T05:33:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.4955454129999999, 2024-09-11T05:33:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076926620000000003, 2024-09-11T05:33:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 582 2024-09-11T05:33:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786728+0000", 2024-09-11T05:33:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786728+0000", 2024-09-11T05:33:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786729+0000", 2024-09-11T05:33:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:33:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786733+0000", 2024-09-11T05:33:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3640000000000001e-06 2024-09-11T05:33:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786736+0000", 2024-09-11T05:33:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1489999999999998e-06 2024-09-11T05:33:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786739+0000", 2024-09-11T05:33:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5100000000000001e-06 2024-09-11T05:33:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.790700+0000", 2024-09-11T05:33:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039613540000000003 2024-09-11T05:33:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.790788+0000", 2024-09-11T05:33:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8461000000000006e-05 2024-09-11T05:33:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.791161+0000", 2024-09-11T05:33:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00037263599999999997 2024-09-11T05:33:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.793300+0000", 2024-09-11T05:33:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021385589999999999 2024-09-11T05:33:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794334+0000", 2024-09-11T05:33:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010340550000000001 2024-09-11T05:33:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794382+0000", 2024-09-11T05:33:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7938000000000001e-05 2024-09-11T05:33:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794421+0000", 2024-09-11T05:33:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9428999999999998e-05 2024-09-11T05:33:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:583 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786742+0000", 2024-09-11T05:33:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.495531795, 2024-09-11T05:33:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087390200000000001, 2024-09-11T05:33:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 583 2024-09-11T05:33:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786742+0000", 2024-09-11T05:33:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786742+0000", 2024-09-11T05:33:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786742+0000", 2024-09-11T05:33:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:33:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786748+0000", 2024-09-11T05:33:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4940000000000003e-06 2024-09-11T05:33:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786752+0000", 2024-09-11T05:33:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5709999999999999e-06 2024-09-11T05:33:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786756+0000", 2024-09-11T05:33:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8290000000000001e-06 2024-09-11T05:33:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.791511+0000", 2024-09-11T05:33:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047550769999999999 2024-09-11T05:33:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.791606+0000", 2024-09-11T05:33:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5105000000000005e-05 2024-09-11T05:33:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.791984+0000", 2024-09-11T05:33:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00037732299999999999 2024-09-11T05:33:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794431+0000", 2024-09-11T05:33:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024478009999999999 2024-09-11T05:33:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795394+0000", 2024-09-11T05:33:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00096278800000000001 2024-09-11T05:33:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795443+0000", 2024-09-11T05:33:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9001000000000001e-05 2024-09-11T05:33:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795481+0000", 2024-09-11T05:33:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7826e-05 2024-09-11T05:33:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:584 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786759+0000", 2024-09-11T05:33:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.4955142960000001, 2024-09-11T05:33:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089385369999999999, 2024-09-11T05:33:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 584 2024-09-11T05:33:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786759+0000", 2024-09-11T05:33:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786759+0000", 2024-09-11T05:33:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786760+0000", 2024-09-11T05:33:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1500000000000001e-07 2024-09-11T05:33:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786761+0000", 2024-09-11T05:33:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.748e-06 2024-09-11T05:33:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786765+0000", 2024-09-11T05:33:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1480000000000002e-06 2024-09-11T05:33:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786767+0000", 2024-09-11T05:33:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3080000000000002e-06 2024-09-11T05:33:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.792409+0000", 2024-09-11T05:33:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056422540000000002 2024-09-11T05:33:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.792504+0000", 2024-09-11T05:33:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5036000000000003e-05 2024-09-11T05:33:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.792869+0000", 2024-09-11T05:33:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036446599999999998 2024-09-11T05:33:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795495+0000", 2024-09-11T05:33:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026260060000000002 2024-09-11T05:33:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795548+0000", 2024-09-11T05:33:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2862999999999999e-05 2024-09-11T05:33:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795604+0000", 2024-09-11T05:33:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6475999999999999e-05 2024-09-11T05:33:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795698+0000", 2024-09-11T05:33:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4017000000000005e-05 2024-09-11T05:33:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:585 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786770+0000", 2024-09-11T05:33:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.4955040230000001, 2024-09-11T05:33:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011329848999999999, 2024-09-11T05:33:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 585 2024-09-11T05:33:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786770+0000", 2024-09-11T05:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786770+0000", 2024-09-11T05:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786770+0000", 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786772+0000", 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.877e-06 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786775+0000", 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1480000000000002e-06 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786777+0000", 2024-09-11T05:33:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3429999999999998e-06 2024-09-11T05:33:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.793346+0000", 2024-09-11T05:33:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065690030000000003 2024-09-11T05:33:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.793437+0000", 2024-09-11T05:33:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0617000000000003e-05 2024-09-11T05:33:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.793836+0000", 2024-09-11T05:33:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039883900000000001 2024-09-11T05:33:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795749+0000", 2024-09-11T05:33:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019128420000000001 2024-09-11T05:33:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.797994+0000", 2024-09-11T05:33:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022455690000000002 2024-09-11T05:33:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.798058+0000", 2024-09-11T05:33:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3445e-05 2024-09-11T05:33:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.798100+0000", 2024-09-11T05:33:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1962999999999998e-05 2024-09-11T05:33:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:587 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786780+0000", 2024-09-11T05:33:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.495493637, 2024-09-11T05:33:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012403552, 2024-09-11T05:33:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 587 2024-09-11T05:33:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786780+0000", 2024-09-11T05:33:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786780+0000", 2024-09-11T05:33:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786780+0000", 2024-09-11T05:33:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:33:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786782+0000", 2024-09-11T05:33:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2899999999999999e-06 2024-09-11T05:33:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786785+0000", 2024-09-11T05:33:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-06 2024-09-11T05:33:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786787+0000", 2024-09-11T05:33:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.351e-06 2024-09-11T05:33:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794475+0000", 2024-09-11T05:33:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076885080000000001 2024-09-11T05:33:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794563+0000", 2024-09-11T05:33:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7647999999999998e-05 2024-09-11T05:33:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794919+0000", 2024-09-11T05:33:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035574499999999998 2024-09-11T05:33:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799009+0000", 2024-09-11T05:33:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004090593 2024-09-11T05:33:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799070+0000", 2024-09-11T05:33:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0974000000000003e-05 2024-09-11T05:33:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799129+0000", 2024-09-11T05:33:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8492999999999997e-05 2024-09-11T05:33:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799184+0000", 2024-09-11T05:33:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4787999999999998e-05 2024-09-11T05:33:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:588 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786810+0000", 2024-09-11T05:33:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.4954637420000001, 2024-09-11T05:33:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012527862000000001, 2024-09-11T05:33:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 588 2024-09-11T05:33:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786810+0000", 2024-09-11T05:33:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786810+0000", 2024-09-11T05:33:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786810+0000", 2024-09-11T05:33:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.46e-07 2024-09-11T05:33:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786815+0000", 2024-09-11T05:33:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7210000000000002e-06 2024-09-11T05:33:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786821+0000", 2024-09-11T05:33:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0789999999999997e-06 2024-09-11T05:33:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786824+0000", 2024-09-11T05:33:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2009999999999999e-06 2024-09-11T05:33:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795782+0000", 2024-09-11T05:33:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089577919999999991 2024-09-11T05:33:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795870+0000", 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7729e-05 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.796359+0000", 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048856400000000003 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799016+0000", 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026571989999999998 2024-09-11T05:33:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799242+0000", 2024-09-11T05:33:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022623899999999999 2024-09-11T05:33:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799296+0000", 2024-09-11T05:33:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4008000000000002e-05 2024-09-11T05:33:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799338+0000", 2024-09-11T05:33:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1884000000000001e-05 2024-09-11T05:33:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:589 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786829+0000", 2024-09-11T05:33:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.4954445439999999, 2024-09-11T05:33:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012623997, 2024-09-11T05:33:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 589 2024-09-11T05:33:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786829+0000", 2024-09-11T05:33:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786829+0000", 2024-09-11T05:33:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786829+0000", 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.17e-07 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786832+0000", 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786836+0000", 2024-09-11T05:33:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7840000000000001e-06 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786838+0000", 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5129999999999999e-06 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.796701+0000", 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098623259999999994 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.797227+0000", 2024-09-11T05:33:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00052681199999999998 2024-09-11T05:33:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.797616+0000", 2024-09-11T05:33:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038823200000000002 2024-09-11T05:33:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799353+0000", 2024-09-11T05:33:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001737492 2024-09-11T05:33:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799403+0000", 2024-09-11T05:33:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0257999999999999e-05 2024-09-11T05:33:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799432+0000", 2024-09-11T05:33:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8170999999999998e-05 2024-09-11T05:33:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799453+0000", 2024-09-11T05:33:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1634e-05 2024-09-11T05:33:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:590 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786841+0000", 2024-09-11T05:33:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.4954324539999999, 2024-09-11T05:33:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013576911000000001, 2024-09-11T05:33:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 590 2024-09-11T05:33:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786841+0000", 2024-09-11T05:33:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786841+0000", 2024-09-11T05:33:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786842+0000", 2024-09-11T05:33:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786844+0000", 2024-09-11T05:33:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3549999999999999e-06 2024-09-11T05:33:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786847+0000", 2024-09-11T05:33:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:33:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786853+0000", 2024-09-11T05:33:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:33:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.798138+0000", 2024-09-11T05:33:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011284776999999999 2024-09-11T05:33:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.798222+0000", 2024-09-11T05:33:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3881000000000005e-05 2024-09-11T05:33:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.798612+0000", 2024-09-11T05:33:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038983399999999998 2024-09-11T05:33:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800325+0000", 2024-09-11T05:33:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017129350000000001 2024-09-11T05:33:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800366+0000", 2024-09-11T05:33:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0745999999999999e-05 2024-09-11T05:33:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800395+0000", 2024-09-11T05:33:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9203000000000001e-05 2024-09-11T05:33:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800418+0000", 2024-09-11T05:33:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3458000000000001e-05 2024-09-11T05:33:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:591 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786857+0000", 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.4954165239999999, 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015066078, 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 591 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786857+0000", 2024-09-11T05:33:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786857+0000", 2024-09-11T05:33:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786857+0000", 2024-09-11T05:33:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:33:02.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786860+0000", 2024-09-11T05:33:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.295e-06 2024-09-11T05:33:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786864+0000", 2024-09-11T05:33:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9210000000000002e-06 2024-09-11T05:33:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786866+0000", 2024-09-11T05:33:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3609999999999999e-06 2024-09-11T05:33:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799492+0000", 2024-09-11T05:33:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012626111000000001 2024-09-11T05:33:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799542+0000", 2024-09-11T05:33:02.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9478999999999998e-05 2024-09-11T05:33:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799826+0000", 2024-09-11T05:33:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028487100000000002 2024-09-11T05:33:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.801184+0000", 2024-09-11T05:33:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001357285 2024-09-11T05:33:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.801851+0000", 2024-09-11T05:33:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066685699999999997 2024-09-11T05:33:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.801885+0000", 2024-09-11T05:33:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4e-05 2024-09-11T05:33:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.801923+0000", 2024-09-11T05:33:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8679e-05 2024-09-11T05:33:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:592 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.364 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786869+0000", 2024-09-11T05:33:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.4954047699999999, 2024-09-11T05:33:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015330196000000001, 2024-09-11T05:33:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.365 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 592 2024-09-11T05:33:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.366 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786869+0000", 2024-09-11T05:33:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786869+0000", 2024-09-11T05:33:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786869+0000", 2024-09-11T05:33:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9999999999999999e-07 2024-09-11T05:33:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786872+0000", 2024-09-11T05:33:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8399999999999999e-06 2024-09-11T05:33:02.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786878+0000", 2024-09-11T05:33:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9529999999999996e-06 2024-09-11T05:33:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786880+0000", 2024-09-11T05:33:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3980000000000002e-06 2024-09-11T05:33:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800440+0000", 2024-09-11T05:33:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013559953 2024-09-11T05:33:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800508+0000", 2024-09-11T05:33:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7391000000000006e-05 2024-09-11T05:33:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800844+0000", 2024-09-11T05:33:02.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00033596899999999998 2024-09-11T05:33:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.801615+0000", 2024-09-11T05:33:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00077176199999999995 2024-09-11T05:33:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.802101+0000", 2024-09-11T05:33:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048517599999999998 2024-09-11T05:33:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.802157+0000", 2024-09-11T05:33:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6107000000000003e-05 2024-09-11T05:33:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.802199+0000", 2024-09-11T05:33:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2447000000000002e-05 2024-09-11T05:33:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.372 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1071 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.338959+0000", 2024-09-11T05:33:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.94331429200000005, 2024-09-11T05:33:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063611040000000002, 2024-09-11T05:33:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1071 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338959+0000", 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338959+0000", 2024-09-11T05:33:02.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338960+0000", 2024-09-11T05:33:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.96e-07 2024-09-11T05:33:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338964+0000", 2024-09-11T05:33:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8039999999999999e-06 2024-09-11T05:33:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338971+0000", 2024-09-11T05:33:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6090000000000003e-06 2024-09-11T05:33:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338977+0000", 2024-09-11T05:33:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8069999999999996e-06 2024-09-11T05:33:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.342076+0000", 2024-09-11T05:33:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030992070000000001 2024-09-11T05:33:02.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.342143+0000", 2024-09-11T05:33:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6392999999999999e-05 2024-09-11T05:33:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.342351+0000", 2024-09-11T05:33:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020795300000000001 2024-09-11T05:33:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.343700+0000", 2024-09-11T05:33:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001349343 2024-09-11T05:33:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345233+0000", 2024-09-11T05:33:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00153302 2024-09-11T05:33:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345279+0000", 2024-09-11T05:33:02.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5886000000000001e-05 2024-09-11T05:33:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345321+0000", 2024-09-11T05:33:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1686e-05 2024-09-11T05:33:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.379 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1072 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.338984+0000", 2024-09-11T05:33:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.943290195, 2024-09-11T05:33:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081204880000000004, 2024-09-11T05:33:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1072 2024-09-11T05:33:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338984+0000", 2024-09-11T05:33:02.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338984+0000", 2024-09-11T05:33:02.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338984+0000", 2024-09-11T05:33:02.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:33:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338987+0000", 2024-09-11T05:33:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6280000000000001e-06 2024-09-11T05:33:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338993+0000", 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.976e-06 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338998+0000", 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.84e-06 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.342727+0000", 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037284649999999998 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.342809+0000", 2024-09-11T05:33:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1792999999999994e-05 2024-09-11T05:33:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.343171+0000", 2024-09-11T05:33:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036250900000000001 2024-09-11T05:33:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345377+0000", 2024-09-11T05:33:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002205828 2024-09-11T05:33:02.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347040+0000", 2024-09-11T05:33:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001663369 2024-09-11T05:33:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347068+0000", 2024-09-11T05:33:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7399e-05 2024-09-11T05:33:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347104+0000", 2024-09-11T05:33:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6278000000000001e-05 2024-09-11T05:33:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1073 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.339004+0000", 2024-09-11T05:33:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.94326948799999999, 2024-09-11T05:33:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081858910000000007, 2024-09-11T05:33:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1073 2024-09-11T05:33:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339004+0000", 2024-09-11T05:33:02.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339004+0000", 2024-09-11T05:33:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339005+0000", 2024-09-11T05:33:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7e-07 2024-09-11T05:33:02.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339007+0000", 2024-09-11T05:33:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6010000000000002e-06 2024-09-11T05:33:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339035+0000", 2024-09-11T05:33:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7251999999999999e-05 2024-09-11T05:33:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339072+0000", 2024-09-11T05:33:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7072e-05 2024-09-11T05:33:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.343740+0000", 2024-09-11T05:33:02.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046682019999999998 2024-09-11T05:33:02.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.343819+0000", 2024-09-11T05:33:02.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8872e-05 2024-09-11T05:33:02.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.344095+0000", 2024-09-11T05:33:02.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000275853 2024-09-11T05:33:02.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345437+0000", 2024-09-11T05:33:02.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013424279999999999 2024-09-11T05:33:02.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347114+0000", 2024-09-11T05:33:02.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016768359999999999 2024-09-11T05:33:02.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347155+0000", 2024-09-11T05:33:02.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0914999999999997e-05 2024-09-11T05:33:02.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347190+0000", 2024-09-11T05:33:02.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5389999999999998e-05 2024-09-11T05:33:02.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.399 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.399 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1074 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.400 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.339087+0000", 2024-09-11T05:33:02.400 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.94318634700000004, 2024-09-11T05:33:02.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099393229999999999, 2024-09-11T05:33:02.400 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-11T05:33:02.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.402 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339087+0000", 2024-09-11T05:33:02.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339087+0000", 2024-09-11T05:33:02.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339088+0000", 2024-09-11T05:33:02.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8800000000000002e-07 2024-09-11T05:33:02.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339093+0000", 2024-09-11T05:33:02.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4050000000000002e-06 2024-09-11T05:33:02.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339101+0000", 2024-09-11T05:33:02.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1440000000000003e-06 2024-09-11T05:33:02.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339106+0000", 2024-09-11T05:33:02.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949999999999997e-06 2024-09-11T05:33:02.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.344476+0000", 2024-09-11T05:33:02.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053700060000000001 2024-09-11T05:33:02.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.344562+0000", 2024-09-11T05:33:02.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5947999999999998e-05 2024-09-11T05:33:02.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.344947+0000", 2024-09-11T05:33:02.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038467900000000002 2024-09-11T05:33:02.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347239+0000", 2024-09-11T05:33:02.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022924220000000001 2024-09-11T05:33:02.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.348928+0000", 2024-09-11T05:33:02.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016882139999999999 2024-09-11T05:33:02.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.348983+0000", 2024-09-11T05:33:02.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5214999999999999e-05 2024-09-11T05:33:02.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.349027+0000", 2024-09-11T05:33:02.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3906999999999998e-05 2024-09-11T05:33:02.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.413 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.414 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1082 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:02.414 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.345226+0000", 2024-09-11T05:33:02.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.93704791499999995, 2024-09-11T05:33:02.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057925600000000004, 2024-09-11T05:33:02.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1082 2024-09-11T05:33:02.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.415 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345226+0000", 2024-09-11T05:33:02.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345226+0000", 2024-09-11T05:33:02.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345227+0000", 2024-09-11T05:33:02.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-11T05:33:02.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345238+0000", 2024-09-11T05:33:02.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1014e-05 2024-09-11T05:33:02.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345247+0000", 2024-09-11T05:33:02.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9709999999999993e-06 2024-09-11T05:33:02.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345252+0000", 2024-09-11T05:33:02.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8160000000000001e-06 2024-09-11T05:33:02.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.348110+0000", 2024-09-11T05:33:02.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028583609999999998 2024-09-11T05:33:02.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.348184+0000", 2024-09-11T05:33:02.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3736e-05 2024-09-11T05:33:02.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.348549+0000", 2024-09-11T05:33:02.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036567099999999998 2024-09-11T05:33:02.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.349384+0000", 2024-09-11T05:33:02.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083454500000000001 2024-09-11T05:33:02.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.350918+0000", 2024-09-11T05:33:02.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001533864 2024-09-11T05:33:02.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.350975+0000", 2024-09-11T05:33:02.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7698000000000002e-05 2024-09-11T05:33:02.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.351018+0000", 2024-09-11T05:33:02.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3013999999999998e-05 2024-09-11T05:33:02.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.423 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.423 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.423 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1373 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:33:02.423 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.706617+0000", 2024-09-11T05:33:02.423 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.57565646000000004, 2024-09-11T05:33:02.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079570370000000001, 2024-09-11T05:33:02.424 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1373 2024-09-11T05:33:02.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.425 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706617+0000", 2024-09-11T05:33:02.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706617+0000", 2024-09-11T05:33:02.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706618+0000", 2024-09-11T05:33:02.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:33:02.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706620+0000", 2024-09-11T05:33:02.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.553e-06 2024-09-11T05:33:02.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706626+0000", 2024-09-11T05:33:02.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9529999999999996e-06 2024-09-11T05:33:02.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706631+0000", 2024-09-11T05:33:02.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6380000000000003e-06 2024-09-11T05:33:02.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.711085+0000", 2024-09-11T05:33:02.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044538099999999999 2024-09-11T05:33:02.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.711159+0000", 2024-09-11T05:33:02.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4666000000000006e-05 2024-09-11T05:33:02.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.711396+0000", 2024-09-11T05:33:02.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023713799999999999 2024-09-11T05:33:02.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.713735+0000", 2024-09-11T05:33:02.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002338311 2024-09-11T05:33:02.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.714475+0000", 2024-09-11T05:33:02.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074071100000000002 2024-09-11T05:33:02.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.714531+0000", 2024-09-11T05:33:02.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5256000000000001e-05 2024-09-11T05:33:02.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.714574+0000", 2024-09-11T05:33:02.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3643999999999998e-05 2024-09-11T05:33:02.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.437 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.437 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.437 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1374 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:33:02.437 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.706637+0000", 2024-09-11T05:33:02.438 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.57563717400000003, 2024-09-11T05:33:02.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086365460000000002, 2024-09-11T05:33:02.438 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1374 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706637+0000", 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706637+0000", 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706637+0000", 2024-09-11T05:33:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.15e-07 2024-09-11T05:33:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706639+0000", 2024-09-11T05:33:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5299999999999999e-06 2024-09-11T05:33:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706646+0000", 2024-09-11T05:33:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4180000000000002e-06 2024-09-11T05:33:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706652+0000", 2024-09-11T05:33:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0499999999999997e-06 2024-09-11T05:33:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.712057+0000", 2024-09-11T05:33:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054051079999999996 2024-09-11T05:33:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.712134+0000", 2024-09-11T05:33:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6555000000000001e-05 2024-09-11T05:33:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.712453+0000", 2024-09-11T05:33:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031981799999999998 2024-09-11T05:33:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.714585+0000", 2024-09-11T05:33:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021312810000000001 2024-09-11T05:33:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715204+0000", 2024-09-11T05:33:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00061970700000000005 2024-09-11T05:33:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715236+0000", 2024-09-11T05:33:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.163e-05 2024-09-11T05:33:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715273+0000", 2024-09-11T05:33:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7134000000000001e-05 2024-09-11T05:33:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1375 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:33:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.706660+0000", 2024-09-11T05:33:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.57561398799999997, 2024-09-11T05:33:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087440590000000002, 2024-09-11T05:33:02.444 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1375 2024-09-11T05:33:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706660+0000", 2024-09-11T05:33:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706660+0000", 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706660+0000", 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706663+0000", 2024-09-11T05:33:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6769999999999999e-06 2024-09-11T05:33:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706669+0000", 2024-09-11T05:33:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1820000000000003e-06 2024-09-11T05:33:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706674+0000", 2024-09-11T05:33:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1209999999999998e-06 2024-09-11T05:33:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.712940+0000", 2024-09-11T05:33:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006265372 2024-09-11T05:33:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.713020+0000", 2024-09-11T05:33:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0606999999999996e-05 2024-09-11T05:33:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.713326+0000", 2024-09-11T05:33:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000306044 2024-09-11T05:33:02.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715284+0000", 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001957631 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715324+0000", 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0108999999999998e-05 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715371+0000", 2024-09-11T05:33:02.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7491000000000003e-05 2024-09-11T05:33:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715404+0000", 2024-09-11T05:33:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-11T05:33:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:02.450 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:02.450 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:02.452 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:02.452 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:02.451+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:02.553 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:02.553+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:02.556 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:02.557 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:02.565 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:02.656 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:02.653+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:02.665 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:33:02.718 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone2 from 0xa428cb9 (overlap 0x2f84c42) to 0x1301e80 2024-09-11T05:33:02.719 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:02.719 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:02.730 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:02.771 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:02.771+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:02.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:33:02.802 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-11T05:33:02.806 INFO:teuthology.orchestra.run.smithi070.stdout:472 writesame 0x44c520a thru 0x44c9342 data_size 0x1(0x4139 bytes) 2024-09-11T05:33:02.821 INFO:teuthology.orchestra.run.smithi070.stdout:473 write 0x310a06 thru 0x31f183 (0xe77e bytes) 2024-09-11T05:33:02.833 INFO:teuthology.orchestra.run.smithi070.stdout:475 punch from 0x389a7c5 to 0x38a72fa, (0xcb35 bytes) 2024-09-11T05:33:02.833 INFO:teuthology.orchestra.run.smithi070.stdout:476 punch from 0x6db0c9b to 0x6db9f35, (0x929a bytes) 2024-09-11T05:33:02.833 INFO:teuthology.orchestra.run.smithi070.stdout:477 read 0x9084ed0 thru 0x9092d43 (0xde74 bytes) 2024-09-11T05:33:02.834 INFO:teuthology.orchestra.run.smithi070.stdout:478 read 0x2063136 thru 0x206a21f (0x70ea bytes) 2024-09-11T05:33:02.834 INFO:teuthology.orchestra.run.smithi070.stdout:479 punch from 0x8918ca4 to 0x89197be, (0xb1a bytes) 2024-09-11T05:33:02.834 INFO:teuthology.orchestra.run.smithi070.stdout:480 write 0x47ed599 thru 0x47faf9d (0xda05 bytes) 2024-09-11T05:33:02.839 INFO:teuthology.orchestra.run.smithi070.stdout:481 punch from 0x4ad8c7b to 0x4adf1ad, (0x6532 bytes) 2024-09-11T05:33:02.839 INFO:teuthology.orchestra.run.smithi070.stdout:482 punch from 0x81ce75c to 0x81d8c5d, (0xa501 bytes) 2024-09-11T05:33:02.839 INFO:teuthology.orchestra.run.smithi070.stdout:483 read 0x41135d6 thru 0x4121228 (0xdc53 bytes) 2024-09-11T05:33:02.839 INFO:teuthology.orchestra.run.smithi070.stdout:484 read 0x4357f59 thru 0x435b5bd (0x3665 bytes) 2024-09-11T05:33:02.839 INFO:teuthology.orchestra.run.smithi070.stdout:485 write 0x8a1b2b8 thru 0x8a1d79d (0x24e6 bytes) 2024-09-11T05:33:02.847 INFO:teuthology.orchestra.run.smithi070.stdout:486 write 0xa634c4b thru 0xa642b88 (0xdf3e bytes) 2024-09-11T05:33:02.853 INFO:teuthology.orchestra.run.smithi070.stdout:488 punch from 0x8acadad to 0x8ad03e2, (0x5635 bytes) 2024-09-11T05:33:02.853 INFO:teuthology.orchestra.run.smithi070.stdout:489 read 0x7c1f5d thru 0x7c6366 (0x440a bytes) 2024-09-11T05:33:02.853 INFO:teuthology.orchestra.run.smithi070.stdout:491 writesame 0x5164a71 thru 0x516d96c data_size 0x2(0x8efc bytes) 2024-09-11T05:33:02.855 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:02.855+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:02.874 INFO:teuthology.orchestra.run.smithi070.stdout:492 write 0xbb8a587 thru 0xbb8d323 (0x2d9d bytes) 2024-09-11T05:33:02.876 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:33:02.877 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:02.877 INFO:teuthology.orchestra.run.smithi070.stdout:493 read 0x88343b4 thru 0x883e0c2 (0x9d0f bytes) 2024-09-11T05:33:02.886 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:02.887 INFO:teuthology.orchestra.run.smithi070.stdout:494 writesame 0xe433149 thru 0xe43f755 data_size 0x1(0xc60d bytes) 2024-09-11T05:33:02.899 INFO:teuthology.orchestra.run.smithi070.stdout:495 trunc from 0xe43f756 to 0x52ad466 2024-09-11T05:33:02.914 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:02.918 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:02.918 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:02.923 INFO:teuthology.orchestra.run.smithi070.stdout:497 write 0x7b1ba2a thru 0x7b27bc2 (0xc199 bytes) 2024-09-11T05:33:02.933 INFO:teuthology.orchestra.run.smithi070.stdout:498 trunc from 0x7b27bc3 to 0xbc0acfd 2024-09-11T05:33:02.938 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:02.938 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:02.939 INFO:teuthology.orchestra.run.smithi070.stdout:499 read 0xbafbf37 thru 0xbb09ec6 (0xdf90 bytes) 2024-09-11T05:33:02.939 INFO:teuthology.orchestra.run.smithi070.stdout:502 read 0x28f5861 thru 0x28fe588 (0x8d28 bytes) 2024-09-11T05:33:02.939 INFO:teuthology.orchestra.run.smithi070.stdout:503 read 0xbc3089 thru 0xbc3e0e (0xd86 bytes) 2024-09-11T05:33:02.940 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:02.940 INFO:teuthology.orchestra.run.smithi070.stdout:505 read 0x8a8fe3a thru 0x8a9b340 (0xb507 bytes) 2024-09-11T05:33:02.940 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:02.940 INFO:teuthology.orchestra.run.smithi070.stdout:508 write 0xb822ec7 thru 0xb82398d (0xac7 bytes) 2024-09-11T05:33:02.942 INFO:teuthology.orchestra.run.smithi070.stdout:511 write 0x9c17b56 thru 0x9c21f86 (0xa431 bytes) 2024-09-11T05:33:02.956 INFO:teuthology.orchestra.run.smithi070.stdout:512 write 0xed25a6d thru 0xed2ee7c (0x9410 bytes) 2024-09-11T05:33:02.956 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:02.956+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:02.958 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:02.959 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:02.960 INFO:teuthology.orchestra.run.smithi070.stdout:514 read 0xc7809b3 thru 0xc78e94e (0xdf9c bytes) 2024-09-11T05:33:02.960 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:02.960 INFO:teuthology.orchestra.run.smithi070.stdout:517 trunc from 0xed2ee7d to 0xeb229ef 2024-09-11T05:33:02.969 INFO:teuthology.orchestra.run.smithi070.stdout:518 writesame 0x6ef4627 thru 0x6f0279a data_size 0x4(0xe174 bytes) 2024-09-11T05:33:02.980 INFO:teuthology.orchestra.run.smithi070.stdout:520 writesame 0xad932df thru 0xad947b0 data_size 0xd(0x14d2 bytes) 2024-09-11T05:33:02.984 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:02.984 INFO:teuthology.orchestra.run.smithi070.stdout:522 punch from 0x9e9679d to 0x9e9af4f, (0x47b2 bytes) 2024-09-11T05:33:02.984 INFO:teuthology.orchestra.run.smithi070.stdout:523 read 0xddaaead thru 0xddb4f27 (0xa07b bytes) 2024-09-11T05:33:02.984 INFO:teuthology.orchestra.run.smithi070.stdout:524 punch from 0x90e12a0 to 0x90e9a2b, (0x878b bytes) 2024-09-11T05:33:02.984 INFO:teuthology.orchestra.run.smithi070.stdout:526 read 0xa832e0d thru 0xa840224 (0xd418 bytes) 2024-09-11T05:33:02.993 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:02.993 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:02.994 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:02.995 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:02.997 INFO:teuthology.orchestra.run.smithi070.stdout:528 trunc from 0xeb229ef to 0x33b0406 2024-09-11T05:33:03.004 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:03.022 INFO:teuthology.orchestra.run.smithi070.stdout:529 trunc from 0x33b0406 to 0x7d36eff 2024-09-11T05:33:03.027 INFO:teuthology.orchestra.run.smithi070.stdout:531 writesame 0x2814030 thru 0x281e73b data_size 0x2(0xa70c bytes) 2024-09-11T05:33:03.029 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:03.029 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:03.054 INFO:teuthology.orchestra.run.smithi070.stdout:532 write 0xdad913b thru 0xdae61bb (0xd081 bytes) 2024-09-11T05:33:03.057 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:03.057+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:03.058 INFO:teuthology.orchestra.run.smithi070.stdout:533 read 0x58551b7 thru 0x5859690 (0x44da bytes) 2024-09-11T05:33:03.058 INFO:teuthology.orchestra.run.smithi070.stdout:534 writesame 0x883c9ba thru 0x8848c2c data_size 0x3(0xc273 bytes) 2024-09-11T05:33:03.064 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:03.064 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:03.067 INFO:teuthology.orchestra.run.smithi070.stdout:537 punch from 0x593d51 to 0x5a036f, (0xc61e bytes) 2024-09-11T05:33:03.068 INFO:teuthology.orchestra.run.smithi070.stdout:538 write 0xd4ceb49 thru 0xd4d2de9 (0x42a1 bytes) 2024-09-11T05:33:03.072 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:03.072 INFO:teuthology.orchestra.run.smithi070.stdout:540 read 0xc04aa8d thru 0xc058736 (0xdcaa bytes) 2024-09-11T05:33:03.072 INFO:teuthology.orchestra.run.smithi070.stdout:541 punch from 0x821e1b4 to 0x8222882, (0x46ce bytes) 2024-09-11T05:33:03.072 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:03.072 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:03.072 INFO:teuthology.orchestra.run.smithi070.stdout:545 write 0x9dbfe6f thru 0x9dcaa1c (0xabae bytes) 2024-09-11T05:33:03.077 INFO:teuthology.orchestra.run.smithi070.stdout:546 write 0xabb0f73 thru 0xabb6e2d (0x5ebb bytes) 2024-09-11T05:33:03.079 INFO:teuthology.orchestra.run.smithi070.stdout:549 writesame 0x69960ad thru 0x699f0c0 data_size 0x2(0x9014 bytes) 2024-09-11T05:33:03.085 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:03.085 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:03.090 INFO:teuthology.orchestra.run.smithi070.stdout:550 read 0x5074be3 thru 0x5083727 (0xeb45 bytes) 2024-09-11T05:33:03.091 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:03.091 INFO:teuthology.orchestra.run.smithi070.stdout:554 read 0x152a19c thru 0x1534c70 (0xaad5 bytes) 2024-09-11T05:33:03.091 INFO:teuthology.orchestra.run.smithi070.stdout:555 punch from 0x5565a4 to 0x5571e7, (0xc43 bytes) 2024-09-11T05:33:03.091 INFO:teuthology.orchestra.run.smithi070.stdout:557 read 0x8592f9f thru 0x859dace (0xab30 bytes) 2024-09-11T05:33:03.109 INFO:teuthology.orchestra.run.smithi070.stdout:558 trunc from 0xdae61bc to 0x8a9f25 2024-09-11T05:33:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:03.114 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:03.114 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:03.121 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:03.142 INFO:teuthology.orchestra.run.smithi070.stdout:559 trunc from 0x8a9f25 to 0x7933338 2024-09-11T05:33:03.147 INFO:teuthology.orchestra.run.smithi070.stdout:560 writesame 0x17e1e50 thru 0x17e30d2 data_size 0x1(0x1283 bytes) 2024-09-11T05:33:03.152 INFO:teuthology.orchestra.run.smithi070.stdout:562 write 0x129be9e thru 0x12a3e39 (0x7f9c bytes) 2024-09-11T05:33:03.162 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:03.162+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:03.167 INFO:teuthology.orchestra.run.smithi070.stdout:563 writesame 0xc3daaf3 thru 0xc3e7dcf data_size 0x1(0xd2dd bytes) 2024-09-11T05:33:03.170 INFO:teuthology.orchestra.run.smithi070.stdout:565 trunc from 0xc3e7dd0 to 0x969c8d4 2024-09-11T05:33:03.176 INFO:teuthology.orchestra.run.smithi070.stdout:567 write 0x7730aa3 thru 0x773f083 (0xe5e1 bytes) 2024-09-11T05:33:03.179 INFO:teuthology.orchestra.run.smithi070.stdout:568 punch from 0x8f32433 to 0x8f40b15, (0xe6e2 bytes) 2024-09-11T05:33:03.180 INFO:teuthology.orchestra.run.smithi070.stdout:569 punch from 0x75c9306 to 0x75cd588, (0x4282 bytes) 2024-09-11T05:33:03.180 INFO:teuthology.orchestra.run.smithi070.stdout:571 read 0x2ea8b18 thru 0x2eaddca (0x52b3 bytes) 2024-09-11T05:33:03.189 INFO:teuthology.orchestra.run.smithi070.stdout:572 write 0xd55abf0 thru 0xd55cacd (0x1ede bytes) 2024-09-11T05:33:03.192 INFO:teuthology.orchestra.run.smithi070.stdout:573 punch from 0x42458f9 to 0x424f265, (0x996c bytes) 2024-09-11T05:33:03.199 INFO:teuthology.orchestra.run.smithi070.stdout:574 write 0xe786a68 thru 0xe78eab8 (0x8051 bytes) 2024-09-11T05:33:03.202 INFO:teuthology.orchestra.run.smithi070.stdout:575 write 0x4524ead thru 0x452b2e7 (0x643b bytes) 2024-09-11T05:33:03.205 INFO:teuthology.orchestra.run.smithi070.stdout:577 write 0x1d52d22 thru 0x1d5302f (0x30e bytes) 2024-09-11T05:33:03.208 INFO:teuthology.orchestra.run.smithi070.stdout:578 read 0xaef8b thru 0xb1e06 (0x2e7c bytes) 2024-09-11T05:33:03.208 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:03.209 INFO:teuthology.orchestra.run.smithi070.stdout:582 write 0x9dd6438 thru 0x9ddf4b9 (0x9082 bytes) 2024-09-11T05:33:03.212 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:03.212 INFO:teuthology.orchestra.run.smithi070.stdout:584 write 0x68d0b79 thru 0x68dc7c7 (0xbc4f bytes) 2024-09-11T05:33:03.215 INFO:teuthology.orchestra.run.smithi070.stdout:585 writesame 0x3077c3f thru 0x307ac27 data_size 0x5(0x2fe9 bytes) 2024-09-11T05:33:03.219 INFO:teuthology.orchestra.run.smithi070.stdout:586 write 0xa88ce57 thru 0xa88d219 (0x3c3 bytes) 2024-09-11T05:33:03.222 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:03.227 INFO:teuthology.orchestra.run.smithi070.stdout:588 write 0xed00576 thru 0xed0ca01 (0xc48c bytes) 2024-09-11T05:33:03.231 INFO:teuthology.orchestra.run.smithi070.stdout:589 read 0x139962f thru 0x13a1d4c (0x871e bytes) 2024-09-11T05:33:03.232 INFO:teuthology.orchestra.run.smithi070.stdout:590 punch from 0x8fe19a to 0x9051d1, (0x7037 bytes) 2024-09-11T05:33:03.232 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:03.232 INFO:teuthology.orchestra.run.smithi070.stdout:592 read 0xc422e5b thru 0xc430670 (0xd816 bytes) 2024-09-11T05:33:03.232 INFO:teuthology.orchestra.run.smithi070.stdout:593 write 0x15ae7e7 thru 0x15ba19a (0xb9b4 bytes) 2024-09-11T05:33:03.236 INFO:teuthology.orchestra.run.smithi070.stdout:594 write 0xb4f2bb8 thru 0xb4f303e (0x487 bytes) 2024-09-11T05:33:03.239 INFO:teuthology.orchestra.run.smithi070.stdout:595 write 0x21ec0ab thru 0x21f3f88 (0x7ede bytes) 2024-09-11T05:33:03.242 INFO:teuthology.orchestra.run.smithi070.stdout:596 read 0x3c2be25 thru 0x3c326dc (0x68b8 bytes) 2024-09-11T05:33:03.243 INFO:teuthology.orchestra.run.smithi070.stdout:597 read 0x15a6d9d thru 0x15aab48 (0x3dac bytes) 2024-09-11T05:33:03.243 INFO:teuthology.orchestra.run.smithi070.stdout:598 write 0xb1c37c6 thru 0xb1c68c3 (0x30fe bytes) 2024-09-11T05:33:03.250 INFO:teuthology.orchestra.run.smithi070.stdout:599 trunc from 0xed0ca02 to 0xafc665f 2024-09-11T05:33:03.259 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:03.259+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:03.260 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:03.260 INFO:teuthology.orchestra.run.smithi070.stdout:602 write 0x1cd8eef thru 0x1cdf15c (0x626e bytes) 2024-09-11T05:33:03.263 INFO:teuthology.orchestra.run.smithi070.stdout:606 write 0x5112bf8 thru 0x511d7b8 (0xabc1 bytes) 2024-09-11T05:33:03.267 INFO:teuthology.orchestra.run.smithi070.stdout:607 punch from 0x5bce339 to 0x5bd32bd, (0x4f84 bytes) 2024-09-11T05:33:03.267 INFO:teuthology.orchestra.run.smithi070.stdout:608 read 0x1d16e2d thru 0x1d171eb (0x3bf bytes) 2024-09-11T05:33:03.268 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:03.268 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:03.277 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:03.280 INFO:teuthology.orchestra.run.smithi070.stdout:609 trunc from 0xafc665f to 0x1b2c86 2024-09-11T05:33:03.304 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:03.321 INFO:teuthology.orchestra.run.smithi070.stdout:612 write 0x9dfc8ee thru 0x9e01cb7 (0x53ca bytes) 2024-09-11T05:33:03.325 INFO:teuthology.orchestra.run.smithi070.stdout:613 writesame 0x3b85b6d thru 0x3b89ac0 data_size 0x2a(0x3f54 bytes) 2024-09-11T05:33:03.331 INFO:teuthology.orchestra.run.smithi070.stdout:614 trunc from 0x9e01cb8 to 0xc4a45d2 2024-09-11T05:33:03.337 INFO:teuthology.orchestra.run.smithi070.stdout:615 punch from 0x426b2c8 to 0x42718ab, (0x65e3 bytes) 2024-09-11T05:33:03.345 INFO:teuthology.orchestra.run.smithi070.stdout:616 writesame 0xe9fd78f thru 0xe9fefa9 data_size 0x21(0x181b bytes) 2024-09-11T05:33:03.345 INFO:teuthology.orchestra.run.smithi070.stdout:617 writesame 0xb51b1d2 thru 0xb52038f data_size 0x1(0x51be bytes) 2024-09-11T05:33:03.357 INFO:teuthology.orchestra.run.smithi070.stdout:618 write 0xa53fefb thru 0xa54c265 (0xc36b bytes) 2024-09-11T05:33:03.361 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:03.361+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:03.362 INFO:teuthology.orchestra.run.smithi070.stdout:619 read 0x556d29 thru 0x55fd8c (0x9064 bytes) 2024-09-11T05:33:03.362 INFO:teuthology.orchestra.run.smithi070.stdout:620 punch from 0xa0ad091 to 0xa0b7fb4, (0xaf23 bytes) 2024-09-11T05:33:03.367 INFO:teuthology.orchestra.run.smithi070.stdout:621 trunc from 0xe9fefaa to 0xa6546ac 2024-09-11T05:33:03.388 INFO:teuthology.orchestra.run.smithi070.stdout:622 write 0xe09eda7 thru 0xe0a1c81 (0x2edb bytes) 2024-09-11T05:33:03.392 INFO:teuthology.orchestra.run.smithi070.stdout:623 read 0x80fd728 thru 0x8108e0f (0xb6e8 bytes) 2024-09-11T05:33:03.392 INFO:teuthology.orchestra.run.smithi070.stdout:624 read 0x5077aaf thru 0x50854b6 (0xda08 bytes) 2024-09-11T05:33:03.392 INFO:teuthology.orchestra.run.smithi070.stdout:625 read 0xc3e153b thru 0xc3e61f4 (0x4cba bytes) 2024-09-11T05:33:03.392 INFO:teuthology.orchestra.run.smithi070.stdout:626 clone 4 order 20 su 262144 sc 8 2024-09-11T05:33:03.424 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:03.424 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:03.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:03.474 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:03.474+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:03.563 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:03.563+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:03.576 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:03.576 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:03.585 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:03.652 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T05:33:03.664 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:03.663+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:03.726 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone3 from 0xe0a1c82 (overlap 0x1b2c86) to 0x104dea 2024-09-11T05:33:03.738 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:03.738 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:03.747 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:03.765 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:03.764+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:03.809 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-11T05:33:03.838 INFO:teuthology.orchestra.run.smithi070.stdout:627 write 0x4e232b0 thru 0x4e28194 (0x4ee5 bytes) 2024-09-11T05:33:03.844 INFO:teuthology.orchestra.run.smithi070.stdout:628 write 0xb7447b6 thru 0xb749701 (0x4f4c bytes) 2024-09-11T05:33:03.855 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:03.855 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:03.862 INFO:teuthology.orchestra.run.smithi070.stdout:629 trunc from 0xe0a1c82 to 0x1735c37 2024-09-11T05:33:03.864 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:03.865 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:03.865+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:03.880 INFO:teuthology.orchestra.run.smithi070.stdout:630 read 0x110366f thru 0x110cf0a (0x989c bytes) 2024-09-11T05:33:03.880 INFO:teuthology.orchestra.run.smithi070.stdout:631 trunc from 0x1735c37 to 0x353efce 2024-09-11T05:33:03.901 INFO:teuthology.orchestra.run.smithi070.stdout:633 write 0xd2b496b thru 0xd2be896 (0x9f2c bytes) 2024-09-11T05:33:03.905 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:03.917 INFO:teuthology.orchestra.run.smithi070.stdout:635 trunc from 0xd2be897 to 0x2e3178b 2024-09-11T05:33:03.936 INFO:teuthology.orchestra.run.smithi070.stdout:637 write 0x72a3833 thru 0x72ab186 (0x7954 bytes) 2024-09-11T05:33:03.938 INFO:teuthology.orchestra.run.smithi070.stdout:641 punch from 0x665efea to 0x66641bd, (0x51d3 bytes) 2024-09-11T05:33:03.938 INFO:teuthology.orchestra.run.smithi070.stdout:642 read 0x286ea17 thru 0x287a0f9 (0xb6e3 bytes) 2024-09-11T05:33:03.943 INFO:teuthology.orchestra.run.smithi070.stdout:645 writesame 0x7579790 thru 0x7581825 data_size 0x2(0x8096 bytes) 2024-09-11T05:33:03.951 INFO:teuthology.orchestra.run.smithi070.stdout:646 write 0x9e3abb0 thru 0x9e40330 (0x5781 bytes) 2024-09-11T05:33:03.955 INFO:teuthology.orchestra.run.smithi070.stdout:647 punch from 0x77436d3 to 0x7751032, (0xd95f bytes) 2024-09-11T05:33:03.955 INFO:teuthology.orchestra.run.smithi070.stdout:648 read 0x5a2c313 thru 0x5a39be7 (0xd8d5 bytes) 2024-09-11T05:33:03.966 INFO:teuthology.orchestra.run.smithi070.stdout:649 trunc from 0x9e40331 to 0xccc77e 2024-09-11T05:33:03.966 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:03.966+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:03.967 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:03.967 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:03.976 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:03.995 INFO:teuthology.orchestra.run.smithi070.stdout:650 trunc from 0xccc77e to 0x91bd9c4 2024-09-11T05:33:03.999 INFO:teuthology.orchestra.run.smithi070.stdout:651 write 0x73d0e6d thru 0x73d7ad6 (0x6c6a bytes) 2024-09-11T05:33:04.002 INFO:teuthology.orchestra.run.smithi070.stdout:652 read 0x245a426 thru 0x245e761 (0x433c bytes) 2024-09-11T05:33:04.003 INFO:teuthology.orchestra.run.smithi070.stdout:654 punch from 0x73a0afe to 0x73a567e, (0x4b80 bytes) 2024-09-11T05:33:04.009 INFO:teuthology.orchestra.run.smithi070.stdout:655 trunc from 0x91bd9c4 to 0xeb1936d 2024-09-11T05:33:04.014 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.014 INFO:teuthology.orchestra.run.smithi070.stdout:660 write 0x6dd25cc thru 0x6dd40a9 (0x1ade bytes) 2024-09-11T05:33:04.017 INFO:teuthology.orchestra.run.smithi070.stdout:663 punch from 0x37bce96 to 0x37c210e, (0x5278 bytes) 2024-09-11T05:33:04.017 INFO:teuthology.orchestra.run.smithi070.stdout:665 read 0xc660da thru 0xc696d7 (0x35fe bytes) 2024-09-11T05:33:04.025 INFO:teuthology.orchestra.run.smithi070.stdout:666 trunc from 0xeb1936d to 0x79d9ba6 2024-09-11T05:33:04.030 INFO:teuthology.orchestra.run.smithi070.stdout:667 read 0xa75b3 thru 0xaaf6f (0x39bd bytes) 2024-09-11T05:33:04.031 INFO:teuthology.orchestra.run.smithi070.stdout:668 read 0x5d6a306 thru 0x5d77a72 (0xd76d bytes) 2024-09-11T05:33:04.031 INFO:teuthology.orchestra.run.smithi070.stdout:670 writesame 0x47a2ef thru 0x488f95 data_size 0x1(0xeca7 bytes) 2024-09-11T05:33:04.066 INFO:teuthology.orchestra.run.smithi070.stdout:671 write 0x7ab962 thru 0x7b1350 (0x59ef bytes) 2024-09-11T05:33:04.067 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:04.066+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:04.071 INFO:teuthology.orchestra.run.smithi070.stdout:673 read 0x660e3d2 thru 0x660ecd5 (0x904 bytes) 2024-09-11T05:33:04.071 INFO:teuthology.orchestra.run.smithi070.stdout:675 read 0x518640f thru 0x51932da (0xcecc bytes) 2024-09-11T05:33:04.078 INFO:teuthology.orchestra.run.smithi070.stdout:676 write 0x8973d37 thru 0x8982af2 (0xedbc bytes) 2024-09-11T05:33:04.079 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:04.079 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:04.082 INFO:teuthology.orchestra.run.smithi070.stdout:677 punch from 0x64780e9 to 0x6478a34, (0x94b bytes) 2024-09-11T05:33:04.084 INFO:teuthology.orchestra.run.smithi070.stdout:678 punch from 0x6a2c8af to 0x6a392bf, (0xca10 bytes) 2024-09-11T05:33:04.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:04.094 INFO:teuthology.orchestra.run.smithi070.stdout:679 write 0xec363a0 thru 0xec3f946 (0x95a7 bytes) 2024-09-11T05:33:04.097 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.098 INFO:teuthology.orchestra.run.smithi070.stdout:685 punch from 0xc04437b to 0xc04cc83, (0x8908 bytes) 2024-09-11T05:33:04.098 INFO:teuthology.orchestra.run.smithi070.stdout:686 writesame 0x4448014 thru 0x4456214 data_size 0x1(0xe201 bytes) 2024-09-11T05:33:04.131 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.147 INFO:teuthology.orchestra.run.smithi070.stdout:688 trunc from 0xec3f947 to 0x363aee3 2024-09-11T05:33:04.167 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:04.167+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:04.178 INFO:teuthology.orchestra.run.smithi070.stdout:689 write 0xc8572a7 thru 0xc8625c3 (0xb31d bytes) 2024-09-11T05:33:04.181 INFO:teuthology.orchestra.run.smithi070.stdout:690 punch from 0x3e85c77 to 0x3e8c50b, (0x6894 bytes) 2024-09-11T05:33:04.181 INFO:teuthology.orchestra.run.smithi070.stdout:691 punch from 0xb6594a6 to 0xb6687b6, (0xf310 bytes) 2024-09-11T05:33:04.181 INFO:teuthology.orchestra.run.smithi070.stdout:693 punch from 0x24c99f8 to 0x24d19d6, (0x7fde bytes) 2024-09-11T05:33:04.181 INFO:teuthology.orchestra.run.smithi070.stdout:695 write 0x230dbe6 thru 0x231578f (0x7baa bytes) 2024-09-11T05:33:04.184 INFO:teuthology.orchestra.run.smithi070.stdout:696 writesame 0xa56fbeb thru 0xa57795e data_size 0x7c(0x7d74 bytes) 2024-09-11T05:33:04.187 INFO:teuthology.orchestra.run.smithi070.stdout:697 punch from 0x3f2ff02 to 0x3f3c6f8, (0xc7f6 bytes) 2024-09-11T05:33:04.192 INFO:teuthology.orchestra.run.smithi070.stdout:698 write 0xd4f8988 thru 0xd4fe481 (0x5afa bytes) 2024-09-11T05:33:04.195 INFO:teuthology.orchestra.run.smithi070.stdout:699 read 0xcff830 thru 0xd01b7f (0x2350 bytes) 2024-09-11T05:33:04.196 INFO:teuthology.orchestra.run.smithi070.stdout:702 read 0xd2cde26 thru 0xd2d9605 (0xb7e0 bytes) 2024-09-11T05:33:04.214 INFO:teuthology.orchestra.run.smithi070.stdout:703 trunc from 0xd4fe482 to 0xe7248b 2024-09-11T05:33:04.225 INFO:teuthology.orchestra.run.smithi070.stdout:704 read 0xb58148 thru 0xb5ea6d (0x6926 bytes) 2024-09-11T05:33:04.226 INFO:teuthology.orchestra.run.smithi070.stdout:705 read 0xa5a0ef thru 0xa608e8 (0x67fa bytes) 2024-09-11T05:33:04.226 INFO:teuthology.orchestra.run.smithi070.stdout:706 read 0x3e6ba5 thru 0x3f285f (0xbcbb bytes) 2024-09-11T05:33:04.226 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:04.226 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:04.227 INFO:teuthology.orchestra.run.smithi070.stdout:707 punch from 0xae3ea2 to 0xaef193, (0xb2f1 bytes) 2024-09-11T05:33:04.227 INFO:teuthology.orchestra.run.smithi070.stdout:712 punch from 0x45b82f to 0x461128, (0x58f9 bytes) 2024-09-11T05:33:04.235 INFO:teuthology.orchestra.run.smithi070.stdout:713 writesame 0x36cea03 thru 0x36d08bd data_size 0x1(0x1ebb bytes) 2024-09-11T05:33:04.238 INFO:teuthology.orchestra.run.smithi070.stdout:714 trunc from 0x36d08be to 0x18866ea 2024-09-11T05:33:04.240 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:04.244 INFO:teuthology.orchestra.run.smithi070.stdout:715 punch from 0x89fdd4 to 0x8a20e6, (0x2312 bytes) 2024-09-11T05:33:04.244 INFO:teuthology.orchestra.run.smithi070.stdout:716 punch from 0x9cd9c8 to 0x9d89f4, (0xb02c bytes) 2024-09-11T05:33:04.244 INFO:teuthology.orchestra.run.smithi070.stdout:717 read 0x4056cf thru 0x41525c (0xfb8e bytes) 2024-09-11T05:33:04.244 INFO:teuthology.orchestra.run.smithi070.stdout:719 read 0x11be537 thru 0x11c70dd (0x8ba7 bytes) 2024-09-11T05:33:04.244 INFO:teuthology.orchestra.run.smithi070.stdout:720 read 0xcf900b thru 0xd00b8a (0x7b80 bytes) 2024-09-11T05:33:04.244 INFO:teuthology.orchestra.run.smithi070.stdout:721 read 0x96c725 thru 0x974d86 (0x8662 bytes) 2024-09-11T05:33:04.244 INFO:teuthology.orchestra.run.smithi070.stdout:722 write 0x12241cc thru 0x1227d3d (0x3b72 bytes) 2024-09-11T05:33:04.252 INFO:teuthology.orchestra.run.smithi070.stdout:723 write 0x1cb4b49 thru 0x1cc01f5 (0xb6ad bytes) 2024-09-11T05:33:04.256 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.264 INFO:teuthology.orchestra.run.smithi070.stdout:725 writesame 0x4ac3fb3 thru 0x4acedd8 data_size 0x1(0xae26 bytes) 2024-09-11T05:33:04.268 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:04.268+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:04.277 INFO:teuthology.orchestra.run.smithi070.stdout:727 writesame 0xa97236d thru 0xa974a19 data_size 0x1(0x26ad bytes) 2024-09-11T05:33:04.277 INFO:teuthology.orchestra.run.smithi070.stdout:728 punch from 0x1fd31cc to 0x1fd952e, (0x6362 bytes) 2024-09-11T05:33:04.277 INFO:teuthology.orchestra.run.smithi070.stdout:729 write 0x125daa6 thru 0x1267efc (0xa457 bytes) 2024-09-11T05:33:04.280 INFO:teuthology.orchestra.run.smithi070.stdout:731 read 0x7ec2e36 thru 0x7ec8687 (0x5852 bytes) 2024-09-11T05:33:04.280 INFO:teuthology.orchestra.run.smithi070.stdout:732 punch from 0x9a0de3b to 0x9a1cd30, (0xeef5 bytes) 2024-09-11T05:33:04.280 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.280 INFO:teuthology.orchestra.run.smithi070.stdout:735 read 0x2a6b457 thru 0x2a7a534 (0xf0de bytes) 2024-09-11T05:33:04.280 INFO:teuthology.orchestra.run.smithi070.stdout:737 read 0x4ea4dae thru 0x4eaa487 (0x56da bytes) 2024-09-11T05:33:04.280 INFO:teuthology.orchestra.run.smithi070.stdout:739 writesame 0x93975 thru 0xa3938 data_size 0x2(0xffc4 bytes) 2024-09-11T05:33:04.309 INFO:teuthology.orchestra.run.smithi070.stdout:741 trunc from 0xa974a1a to 0x874d4a6 2024-09-11T05:33:04.316 INFO:teuthology.orchestra.run.smithi070.stdout:743 read 0x76b913 thru 0x77ad82 (0xf470 bytes) 2024-09-11T05:33:04.316 INFO:teuthology.orchestra.run.smithi070.stdout:745 read 0x6a2b1 thru 0x78fff (0xed4f bytes) 2024-09-11T05:33:04.327 INFO:teuthology.orchestra.run.smithi070.stdout:746 write 0xcb2006d thru 0xcb2db9e (0xdb32 bytes) 2024-09-11T05:33:04.330 INFO:teuthology.orchestra.run.smithi070.stdout:747 read 0x6bdbebe thru 0x6beaff7 (0xf13a bytes) 2024-09-11T05:33:04.338 INFO:teuthology.orchestra.run.smithi070.stdout:749 writesame 0xeb476ec thru 0xeb53625 data_size 0x7b(0xbf3a bytes) 2024-09-11T05:33:04.338 INFO:teuthology.orchestra.run.smithi070.stdout:751 read 0xdf2f31b thru 0xdf3f03f (0xfd25 bytes) 2024-09-11T05:33:04.338 INFO:teuthology.orchestra.run.smithi070.stdout:752 writesame 0xc6e2ad2 thru 0xc6ef67b data_size 0x2(0xcbaa bytes) 2024-09-11T05:33:04.355 INFO:teuthology.orchestra.run.smithi070.stdout:753 punch from 0x2f92e2b to 0x2f984ca, (0x569f bytes) 2024-09-11T05:33:04.356 INFO:teuthology.orchestra.run.smithi070.stdout:754 punch from 0x9353bab to 0x9360baa, (0xcfff bytes) 2024-09-11T05:33:04.356 INFO:teuthology.orchestra.run.smithi070.stdout:755 writesame 0xbf1a360 thru 0xbf221e3 data_size 0x6(0x7e84 bytes) 2024-09-11T05:33:04.362 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.362 INFO:teuthology.orchestra.run.smithi070.stdout:758 write 0x2cf8807 thru 0x2cfa478 (0x1c72 bytes) 2024-09-11T05:33:04.365 INFO:teuthology.orchestra.run.smithi070.stdout:759 read 0x8b6b817 thru 0x8b6c2d8 (0xac2 bytes) 2024-09-11T05:33:04.365 INFO:teuthology.orchestra.run.smithi070.stdout:761 punch from 0x433ba96 to 0x4340772, (0x4cdc bytes) 2024-09-11T05:33:04.366 INFO:teuthology.orchestra.run.smithi070.stdout:763 read 0xe74b889 thru 0xe74dc91 (0x2409 bytes) 2024-09-11T05:33:04.369 INFO:teuthology.orchestra.run.smithi070.stdout:766 trunc from 0xeb53626 to 0xbece279 2024-09-11T05:33:04.369 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:04.369+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:04.369 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:04.370 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:04.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:04.383 INFO:teuthology.orchestra.run.smithi070.stdout:767 write 0x680d8cc thru 0x680fd4d (0x2482 bytes) 2024-09-11T05:33:04.386 INFO:teuthology.orchestra.run.smithi070.stdout:768 writesame 0x1dbe40d thru 0x1dc9dee data_size 0x2a(0xb9e2 bytes) 2024-09-11T05:33:04.390 INFO:teuthology.orchestra.run.smithi070.stdout:769 read 0x2179135 thru 0x217ddbd (0x4c89 bytes) 2024-09-11T05:33:04.390 INFO:teuthology.orchestra.run.smithi070.stdout:770 read 0x437a959 thru 0x43842af (0x9957 bytes) 2024-09-11T05:33:04.391 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.391 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.391 INFO:teuthology.orchestra.run.smithi070.stdout:774 read 0xa101c2b thru 0xa10e1fd (0xc5d3 bytes) 2024-09-11T05:33:04.391 INFO:teuthology.orchestra.run.smithi070.stdout:776 read 0x11d18bb thru 0x11d2b81 (0x12c7 bytes) 2024-09-11T05:33:04.396 INFO:teuthology.orchestra.run.smithi070.stdout:777 writesame 0xc3c4a98 thru 0xc3d0022 data_size 0x41(0xb58b bytes) 2024-09-11T05:33:04.396 INFO:teuthology.orchestra.run.smithi070.stdout:778 punch from 0x1876edc to 0x18774fe, (0x622 bytes) 2024-09-11T05:33:04.410 INFO:teuthology.orchestra.run.smithi070.stdout:779 trunc from 0xc3d0023 to 0x7a7b82 2024-09-11T05:33:04.433 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.433 INFO:teuthology.orchestra.run.smithi070.stdout:781 write 0x73e2a6 thru 0x7409d1 (0x272c bytes) 2024-09-11T05:33:04.437 INFO:teuthology.orchestra.run.smithi070.stdout:782 punch from 0x741595 to 0x74f65a, (0xe0c5 bytes) 2024-09-11T05:33:04.450 INFO:teuthology.orchestra.run.smithi070.stdout:783 trunc from 0x7a7b82 to 0xb513b7c 2024-09-11T05:33:04.455 INFO:teuthology.orchestra.run.smithi070.stdout:784 writesame 0x8221da4 thru 0x822d6ff data_size 0x2(0xb95c bytes) 2024-09-11T05:33:04.469 INFO:teuthology.orchestra.run.smithi070.stdout:786 write 0x823c88e thru 0x82451cb (0x893e bytes) 2024-09-11T05:33:04.470 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:04.469+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:04.472 INFO:teuthology.orchestra.run.smithi070.stdout:787 writesame 0x64346cb thru 0x6444032 data_size 0x8(0xf968 bytes) 2024-09-11T05:33:04.487 INFO:teuthology.orchestra.run.smithi070.stdout:788 trunc from 0xb513b7c to 0x5341691 2024-09-11T05:33:04.504 INFO:teuthology.orchestra.run.smithi070.stdout:789 writesame 0x5935e19 thru 0x593c6e7 data_size 0x1(0x68cf bytes) 2024-09-11T05:33:04.504 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.507 INFO:teuthology.orchestra.run.smithi070.stdout:793 trunc from 0x593c6e8 to 0x35fa8ef 2024-09-11T05:33:04.509 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:04.509 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:04.521 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:04.528 INFO:teuthology.orchestra.run.smithi070.stdout:794 write 0xcbed839 thru 0xcbf6efc (0x96c4 bytes) 2024-09-11T05:33:04.530 INFO:teuthology.orchestra.run.smithi070.stdout:795 write 0xd28fb0 thru 0xd2b568 (0x25b9 bytes) 2024-09-11T05:33:04.540 INFO:teuthology.orchestra.run.smithi070.stdout:796 write 0xe57d93e thru 0xe58220c (0x48cf bytes) 2024-09-11T05:33:04.551 INFO:teuthology.orchestra.run.smithi070.stdout:800 trunc from 0xe58220d to 0xa6e566c 2024-09-11T05:33:04.562 INFO:teuthology.orchestra.run.smithi070.stdout:801 trunc from 0xa6e566c to 0xc472de1 2024-09-11T05:33:04.567 INFO:teuthology.orchestra.run.smithi070.stdout:802 write 0x37bd79b thru 0x37bff5d (0x27c3 bytes) 2024-09-11T05:33:04.570 INFO:teuthology.orchestra.run.smithi070.stdout:803 write 0x73f73c8 thru 0x7402edf (0xbb18 bytes) 2024-09-11T05:33:04.570 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:04.570+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:04.580 INFO:teuthology.orchestra.run.smithi070.stdout:804 trunc from 0xc472de1 to 0x74a723a 2024-09-11T05:33:04.593 INFO:teuthology.orchestra.run.smithi070.stdout:805 writesame 0x88d397c thru 0x88dd5bd data_size 0x3b(0x9c42 bytes) 2024-09-11T05:33:04.593 INFO:teuthology.orchestra.run.smithi070.stdout:806 write 0xdd91f7 thru 0xde11a7 (0x7fb1 bytes) 2024-09-11T05:33:04.595 INFO:teuthology.orchestra.run.smithi070.stdout:807 read 0x140a693 thru 0x1418e02 (0xe770 bytes) 2024-09-11T05:33:04.595 INFO:teuthology.orchestra.run.smithi070.stdout:810 punch from 0x5935c57 to 0x594272f, (0xcad8 bytes) 2024-09-11T05:33:04.604 INFO:teuthology.orchestra.run.smithi070.stdout:811 write 0xb8398b3 thru 0xb83f941 (0x608f bytes) 2024-09-11T05:33:04.616 INFO:teuthology.orchestra.run.smithi070.stdout:814 writesame 0xec972de thru 0xec9e9ef data_size 0x1(0x7712 bytes) 2024-09-11T05:33:04.616 INFO:teuthology.orchestra.run.smithi070.stdout:817 write 0xd3ba035 thru 0xd3c0c32 (0x6bfe bytes) 2024-09-11T05:33:04.620 INFO:teuthology.orchestra.run.smithi070.stdout:819 writesame 0x8f03654 thru 0x8f0c68a data_size 0x1(0x9037 bytes) 2024-09-11T05:33:04.644 INFO:teuthology.orchestra.run.smithi070.stdout:820 write 0xbf22550 thru 0xbf24f13 (0x29c4 bytes) 2024-09-11T05:33:04.648 INFO:teuthology.orchestra.run.smithi070.stdout:821 write 0xd5bf05c thru 0xd5cb3d5 (0xc37a bytes) 2024-09-11T05:33:04.650 INFO:teuthology.orchestra.run.smithi070.stdout:823 write 0x611dc19 thru 0x612217f (0x4567 bytes) 2024-09-11T05:33:04.651 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:04.652 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:04.654 INFO:teuthology.orchestra.run.smithi070.stdout:824 write 0x80284c7 thru 0x8034f32 (0xca6c bytes) 2024-09-11T05:33:04.657 INFO:teuthology.orchestra.run.smithi070.stdout:825 read 0x58fecb5 thru 0x590b03d (0xc389 bytes) 2024-09-11T05:33:04.664 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:04.664 INFO:teuthology.orchestra.run.smithi070.stdout:826 trunc from 0xec9e9f0 to 0x9ff9960 2024-09-11T05:33:04.673 INFO:teuthology.orchestra.run.smithi070.stdout:827 write 0x84f2e10 thru 0x84fe337 (0xb528 bytes) 2024-09-11T05:33:04.674 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:04.673+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:04.676 INFO:teuthology.orchestra.run.smithi070.stdout:828 writesame 0x8d38c00 thru 0x8d3a769 data_size 0x16(0x1b6a bytes) 2024-09-11T05:33:04.678 INFO:teuthology.orchestra.run.smithi070.stdout:830 read 0x6c50d86 thru 0x6c5c81b (0xba96 bytes) 2024-09-11T05:33:04.686 INFO:teuthology.orchestra.run.smithi070.stdout:831 write 0xd1080fe thru 0xd108ba5 (0xaa8 bytes) 2024-09-11T05:33:04.701 INFO:teuthology.orchestra.run.smithi070.stdout:832 trunc from 0xd108ba6 to 0x3d5b2e0 2024-09-11T05:33:04.713 INFO:teuthology.orchestra.run.smithi070.stdout:833 read 0x3b5ba4d thru 0x3b5c47a (0xa2e bytes) 2024-09-11T05:33:04.713 INFO:teuthology.orchestra.run.smithi070.stdout:834 read 0x1e28edd thru 0x1e34d05 (0xbe29 bytes) 2024-09-11T05:33:04.713 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.723 INFO:teuthology.orchestra.run.smithi070.stdout:838 writesame 0x816099e thru 0x8169eb5 data_size 0x34(0x9518 bytes) 2024-09-11T05:33:04.723 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.723 INFO:teuthology.orchestra.run.smithi070.stdout:841 punch from 0x1619304 to 0x16205eb, (0x72e7 bytes) 2024-09-11T05:33:04.723 INFO:teuthology.orchestra.run.smithi070.stdout:843 read 0x619abf2 thru 0x61a5fa9 (0xb3b8 bytes) 2024-09-11T05:33:04.725 INFO:teuthology.orchestra.run.smithi070.stdout:844 trunc from 0x8169eb6 to 0x989db99 2024-09-11T05:33:04.730 INFO:teuthology.orchestra.run.smithi070.stdout:845 writesame 0x547d524 thru 0x548cbe7 data_size 0x22(0xf6c4 bytes) 2024-09-11T05:33:04.736 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.736 INFO:teuthology.orchestra.run.smithi070.stdout:848 read 0x2e0a8e4 thru 0x2e180e4 (0xd801 bytes) 2024-09-11T05:33:04.747 INFO:teuthology.orchestra.run.smithi070.stdout:849 write 0xe1f36c8 thru 0xe1f8fa9 (0x58e2 bytes) 2024-09-11T05:33:04.750 INFO:teuthology.orchestra.run.smithi070.stdout:851 write 0x8c76786 thru 0x8c85dc9 (0xf644 bytes) 2024-09-11T05:33:04.764 INFO:teuthology.orchestra.run.smithi070.stdout:852 trunc from 0xe1f8faa to 0x688edcf 2024-09-11T05:33:04.772 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:04.771+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:04.773 INFO:teuthology.orchestra.run.smithi070.stdout:854 read 0x334a70e thru 0x334f055 (0x4948 bytes) 2024-09-11T05:33:04.785 INFO:teuthology.orchestra.run.smithi070.stdout:855 writesame 0xc87200c thru 0xc87bb5c data_size 0x1(0x9b51 bytes) 2024-09-11T05:33:04.785 INFO:teuthology.orchestra.run.smithi070.stdout:856 writesame 0x6cf810c thru 0x6cfa041 data_size 0xa(0x1f36 bytes) 2024-09-11T05:33:04.789 INFO:teuthology.orchestra.run.smithi070.stdout:857 read 0xb4f5aa7 thru 0xb501e95 (0xc3ef bytes) 2024-09-11T05:33:04.789 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.789 INFO:teuthology.orchestra.run.smithi070.stdout:859 punch from 0x6bf3a1d to 0x6bfb777, (0x7d5a bytes) 2024-09-11T05:33:04.790 INFO:teuthology.orchestra.run.smithi070.stdout:861 writesame 0x6e92e7b thru 0x6e997ba data_size 0x20(0x6940 bytes) 2024-09-11T05:33:04.792 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.796 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:04.796 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:04.802 INFO:teuthology.orchestra.run.smithi070.stdout:864 trunc from 0xc87bb5d to 0x3cd80bd 2024-09-11T05:33:04.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:04.828 INFO:teuthology.orchestra.run.smithi070.stdout:865 writesame 0xde83439 thru 0xde84b54 data_size 0xc(0x171c bytes) 2024-09-11T05:33:04.835 INFO:teuthology.orchestra.run.smithi070.stdout:866 trunc from 0xde84b55 to 0x81e8b53 2024-09-11T05:33:04.841 INFO:teuthology.orchestra.run.smithi070.stdout:868 read 0x4dfca24 thru 0x4e01c6a (0x5247 bytes) 2024-09-11T05:33:04.844 INFO:teuthology.orchestra.run.smithi070.stdout:870 trunc from 0x81e8b53 to 0x5366c82 2024-09-11T05:33:04.850 INFO:teuthology.orchestra.run.smithi070.stdout:871 read 0x3a438e4 thru 0x3a46e7f (0x359c bytes) 2024-09-11T05:33:04.850 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.850 INFO:teuthology.orchestra.run.smithi070.stdout:873 read 0x865c1f thru 0x8691cb (0x35ad bytes) 2024-09-11T05:33:04.850 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.850 INFO:teuthology.orchestra.run.smithi070.stdout:875 read 0x1d5d7a7 thru 0x1d69206 (0xba60 bytes) 2024-09-11T05:33:04.853 INFO:teuthology.orchestra.run.smithi070.stdout:876 trunc from 0x5366c82 to 0x24a306e 2024-09-11T05:33:04.863 INFO:teuthology.orchestra.run.smithi070.stdout:878 punch from 0x27cdc2 to 0x28adb7, (0xdff5 bytes) 2024-09-11T05:33:04.863 INFO:teuthology.orchestra.run.smithi070.stdout:879 read 0x1c3bd48 thru 0x1c48347 (0xc600 bytes) 2024-09-11T05:33:04.863 INFO:teuthology.orchestra.run.smithi070.stdout:880 punch from 0x23f4f31 to 0x2403ac2, (0xeb91 bytes) 2024-09-11T05:33:04.872 INFO:teuthology.orchestra.run.smithi070.stdout:881 trunc from 0x24a306e to 0x9e18c08 2024-09-11T05:33:04.873 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:04.873+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:04.878 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.878 INFO:teuthology.orchestra.run.smithi070.stdout:883 read 0x83ca771 thru 0x83ca928 (0x1b8 bytes) 2024-09-11T05:33:04.878 INFO:teuthology.orchestra.run.smithi070.stdout:885 punch from 0x6568bcf to 0x6575617, (0xca48 bytes) 2024-09-11T05:33:04.886 INFO:teuthology.orchestra.run.smithi070.stdout:887 writesame 0xcd446e6 thru 0xcd48675 data_size 0x48(0x3f90 bytes) 2024-09-11T05:33:04.893 INFO:teuthology.orchestra.run.smithi070.stdout:888 write 0xe026c11 thru 0xe02752b (0x91b bytes) 2024-09-11T05:33:04.896 INFO:teuthology.orchestra.run.smithi070.stdout:889 write 0xa0ae1b1 thru 0xa0baa6d (0xc8bd bytes) 2024-09-11T05:33:04.899 INFO:teuthology.orchestra.run.smithi070.stdout:890 read 0x263de0b thru 0x2649a02 (0xbbf8 bytes) 2024-09-11T05:33:04.899 INFO:teuthology.orchestra.run.smithi070.stdout:891 read 0x72badd0 thru 0x72bcaaf (0x1ce0 bytes) 2024-09-11T05:33:04.900 INFO:teuthology.orchestra.run.smithi070.stdout:892 write 0x6a49f73 thru 0x6a56a12 (0xcaa0 bytes) 2024-09-11T05:33:04.904 INFO:teuthology.orchestra.run.smithi070.stdout:894 read 0x29bd5f7 thru 0x29c0627 (0x3031 bytes) 2024-09-11T05:33:04.909 INFO:teuthology.orchestra.run.smithi070.stdout:895 trunc from 0xe02752c to 0x88d1a6a 2024-09-11T05:33:04.919 INFO:teuthology.orchestra.run.smithi070.stdout:897 read 0x1e25620 thru 0x1e2bd8f (0x6770 bytes) 2024-09-11T05:33:04.919 INFO:teuthology.orchestra.run.smithi070.stdout:898 write 0x452e353 thru 0x4535ebb (0x7b69 bytes) 2024-09-11T05:33:04.921 INFO:teuthology.orchestra.run.smithi070.stdout:899 read 0x5b2f03b thru 0x5b3bbd8 (0xcb9e bytes) 2024-09-11T05:33:04.922 INFO:teuthology.orchestra.run.smithi070.stdout:900 read 0x6fd6e3e thru 0x6fde91e (0x7ae1 bytes) 2024-09-11T05:33:04.922 INFO:teuthology.orchestra.run.smithi070.stdout:901 read 0x71bfd3b thru 0x71c193c (0x1c02 bytes) 2024-09-11T05:33:04.933 INFO:teuthology.orchestra.run.smithi070.stdout:902 write 0xdae7243 thru 0xdaf2b93 (0xb951 bytes) 2024-09-11T05:33:04.936 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.936 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.936 INFO:teuthology.orchestra.run.smithi070.stdout:906 read 0xab4aaad thru 0xab4c6f7 (0x1c4b bytes) 2024-09-11T05:33:04.936 INFO:teuthology.orchestra.run.smithi070.stdout:907 writesame 0x382e794 thru 0x3834855 data_size 0x5(0x60c2 bytes) 2024-09-11T05:33:04.941 INFO:teuthology.orchestra.run.smithi070.stdout:908 write 0xbca9a3b thru 0xbcb4b24 (0xb0ea bytes) 2024-09-11T05:33:04.944 INFO:teuthology.orchestra.run.smithi070.stdout:909 writesame 0x634a1a3 thru 0x6354d87 data_size 0xd(0xabe5 bytes) 2024-09-11T05:33:04.951 INFO:teuthology.orchestra.run.smithi070.stdout:910 trunc from 0xdaf2b94 to 0xbe19241 2024-09-11T05:33:04.951 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:04.951 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:04.961 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:04.962 INFO:teuthology.orchestra.run.smithi070.stdout:911 write 0x2820803 thru 0x282d529 (0xcd27 bytes) 2024-09-11T05:33:04.965 INFO:teuthology.orchestra.run.smithi070.stdout:912 writesame 0xa2fdeba thru 0xa2ff5b1 data_size 0x31(0x16f8 bytes) 2024-09-11T05:33:04.968 INFO:teuthology.orchestra.run.smithi070.stdout:913 writesame 0xb729294 thru 0xb72c57f data_size 0x2(0x32ec bytes) 2024-09-11T05:33:04.973 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:04.973+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:04.974 INFO:teuthology.orchestra.run.smithi070.stdout:914 read 0x569a459 thru 0x569b480 (0x1028 bytes) 2024-09-11T05:33:04.975 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:04.977 INFO:teuthology.orchestra.run.smithi070.stdout:917 trunc from 0xbe19241 to 0xdf0323c 2024-09-11T05:33:04.995 INFO:teuthology.orchestra.run.smithi070.stdout:918 trunc from 0xdf0323c to 0x31c7277 2024-09-11T05:33:05.007 INFO:teuthology.orchestra.run.smithi070.stdout:919 trunc from 0x31c7277 to 0x557f51b 2024-09-11T05:33:05.012 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.012 INFO:teuthology.orchestra.run.smithi070.stdout:922 read 0x3fe6d76 thru 0x3ff6c66 (0xfef1 bytes) 2024-09-11T05:33:05.012 INFO:teuthology.orchestra.run.smithi070.stdout:923 write 0x1a8c522 thru 0x1a92a34 (0x6513 bytes) 2024-09-11T05:33:05.015 INFO:teuthology.orchestra.run.smithi070.stdout:925 read 0x1acdabc thru 0x1add4db (0xfa20 bytes) 2024-09-11T05:33:05.023 INFO:teuthology.orchestra.run.smithi070.stdout:927 write 0x794c5c9 thru 0x7959684 (0xd0bc bytes) 2024-09-11T05:33:05.026 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.032 INFO:teuthology.orchestra.run.smithi070.stdout:929 write 0x8162246 thru 0x8162a92 (0x84d bytes) 2024-09-11T05:33:05.034 INFO:teuthology.orchestra.run.smithi070.stdout:931 write 0x3868f25 thru 0x386bc21 (0x2cfd bytes) 2024-09-11T05:33:05.046 INFO:teuthology.orchestra.run.smithi070.stdout:932 trunc from 0x8162a93 to 0xaa96cf 2024-09-11T05:33:05.058 INFO:teuthology.orchestra.run.smithi070.stdout:933 punch from 0x2edf5d to 0x2f747f, (0x9522 bytes) 2024-09-11T05:33:05.058 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.068 INFO:teuthology.orchestra.run.smithi070.stdout:937 writesame 0x4792170 thru 0x4799e2a data_size 0x1(0x7cbb bytes) 2024-09-11T05:33:05.068 INFO:teuthology.orchestra.run.smithi070.stdout:939 punch from 0xa3ccc0 to 0xa48203, (0xb543 bytes) 2024-09-11T05:33:05.074 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:05.074+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:05.076 INFO:teuthology.orchestra.run.smithi070.stdout:940 write 0x75382db thru 0x75443a9 (0xc0cf bytes) 2024-09-11T05:33:05.080 INFO:teuthology.orchestra.run.smithi070.stdout:941 read 0x40ce8a8 thru 0x40ddf27 (0xf680 bytes) 2024-09-11T05:33:05.080 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.085 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:05.085 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:05.091 INFO:teuthology.orchestra.run.smithi070.stdout:943 write 0xc71bfc4 thru 0xc7269e9 (0xaa26 bytes) 2024-09-11T05:33:05.095 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:05.096 INFO:teuthology.orchestra.run.smithi070.stdout:945 writesame 0x907616d thru 0x907f36f data_size 0x1(0x9203 bytes) 2024-09-11T05:33:05.116 INFO:teuthology.orchestra.run.smithi070.stdout:946 punch from 0x34284f5 to 0x342e5fc, (0x6107 bytes) 2024-09-11T05:33:05.116 INFO:teuthology.orchestra.run.smithi070.stdout:947 write 0x80c7168 thru 0x80ce279 (0x7112 bytes) 2024-09-11T05:33:05.119 INFO:teuthology.orchestra.run.smithi070.stdout:948 punch from 0x261c24d to 0x2627df1, (0xbba4 bytes) 2024-09-11T05:33:05.119 INFO:teuthology.orchestra.run.smithi070.stdout:949 write 0xa70a4e8 thru 0xa713b23 (0x963c bytes) 2024-09-11T05:33:05.122 INFO:teuthology.orchestra.run.smithi070.stdout:950 writesame 0x527aa3e thru 0x527b7d7 data_size 0x1(0xd9a bytes) 2024-09-11T05:33:05.127 INFO:teuthology.orchestra.run.smithi070.stdout:951 punch from 0x148bfa7 to 0x1490260, (0x42b9 bytes) 2024-09-11T05:33:05.127 INFO:teuthology.orchestra.run.smithi070.stdout:952 read 0xbb5cd13 thru 0xbb6701a (0xa308 bytes) 2024-09-11T05:33:05.127 INFO:teuthology.orchestra.run.smithi070.stdout:954 read 0xa598914 thru 0xa59db11 (0x51fe bytes) 2024-09-11T05:33:05.127 INFO:teuthology.orchestra.run.smithi070.stdout:955 write 0xb0bc12d thru 0xb0caf2e (0xee02 bytes) 2024-09-11T05:33:05.132 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:33:05.133 INFO:teuthology.orchestra.run.smithi070.stdout:957 trunc from 0xc7269ea to 0xb84ca81 2024-09-11T05:33:05.145 INFO:teuthology.orchestra.run.smithi070.stdout:958 write 0x8ee91c6 thru 0x8eeb230 (0x206b bytes) 2024-09-11T05:33:05.157 INFO:teuthology.orchestra.run.smithi070.stdout:959 writesame 0xda00d03 thru 0xda03bd7 data_size 0x1(0x2ed5 bytes) 2024-09-11T05:33:05.157 INFO:teuthology.orchestra.run.smithi070.stdout:960 punch from 0x4a7b7ba to 0x4a83413, (0x7c59 bytes) 2024-09-11T05:33:05.157 INFO:teuthology.orchestra.run.smithi070.stdout:961 write 0x70da814 thru 0x70dd307 (0x2af4 bytes) 2024-09-11T05:33:05.160 INFO:teuthology.orchestra.run.smithi070.stdout:962 write 0x722c409 thru 0x7237059 (0xac51 bytes) 2024-09-11T05:33:05.164 INFO:teuthology.orchestra.run.smithi070.stdout:963 read 0x8639aa2 thru 0x863bf18 (0x2477 bytes) 2024-09-11T05:33:05.164 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.175 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:05.175+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:05.179 INFO:teuthology.orchestra.run.smithi070.stdout:966 trunc from 0xda03bd8 to 0xa58998 2024-09-11T05:33:05.208 INFO:teuthology.orchestra.run.smithi070.stdout:967 write 0x93339a8 thru 0x9335c93 (0x22ec bytes) 2024-09-11T05:33:05.211 INFO:teuthology.orchestra.run.smithi070.stdout:968 read 0x55114f5 thru 0x55176ad (0x61b9 bytes) 2024-09-11T05:33:05.212 INFO:teuthology.orchestra.run.smithi070.stdout:969 punch from 0xc82d8 to 0xd23a5, (0xa0cd bytes) 2024-09-11T05:33:05.221 INFO:teuthology.orchestra.run.smithi070.stdout:971 writesame 0xc4d2af5 thru 0xc4dc97d data_size 0x1(0x9e89 bytes) 2024-09-11T05:33:05.221 INFO:teuthology.orchestra.run.smithi070.stdout:972 read 0x37c4274 thru 0x37c5090 (0xe1d bytes) 2024-09-11T05:33:05.229 INFO:teuthology.orchestra.run.smithi070.stdout:973 trunc from 0xc4dc97e to 0x647c7ae 2024-09-11T05:33:05.239 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:05.239 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:05.240 INFO:teuthology.orchestra.run.smithi070.stdout:974 punch from 0x5beef56 to 0x5bf6e85, (0x7f2f bytes) 2024-09-11T05:33:05.240 INFO:teuthology.orchestra.run.smithi070.stdout:975 read 0x5c382ac thru 0x5c412cb (0x9020 bytes) 2024-09-11T05:33:05.240 INFO:teuthology.orchestra.run.smithi070.stdout:976 read 0x2f989f9 thru 0x2f9a216 (0x181e bytes) 2024-09-11T05:33:05.240 INFO:teuthology.orchestra.run.smithi070.stdout:977 punch from 0x5ebdb3c to 0x5ec99eb, (0xbeaf bytes) 2024-09-11T05:33:05.240 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.252 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:05.255 INFO:teuthology.orchestra.run.smithi070.stdout:980 writesame 0xd8d9f91 thru 0xd8e4d4a data_size 0x25(0xadba bytes) 2024-09-11T05:33:05.255 INFO:teuthology.orchestra.run.smithi070.stdout:981 punch from 0x3f6b835 to 0x3f6c3c8, (0xb93 bytes) 2024-09-11T05:33:05.255 INFO:teuthology.orchestra.run.smithi070.stdout:985 write 0xc82801e thru 0xc82ff24 (0x7f07 bytes) 2024-09-11T05:33:05.258 INFO:teuthology.orchestra.run.smithi070.stdout:987 punch from 0x3a0b0c to 0x3a2770, (0x1c64 bytes) 2024-09-11T05:33:05.258 INFO:teuthology.orchestra.run.smithi070.stdout:988 punch from 0x41c8c2a to 0x41d4e1e, (0xc1f4 bytes) 2024-09-11T05:33:05.258 INFO:teuthology.orchestra.run.smithi070.stdout:989 punch from 0x51667b5 to 0x5173c86, (0xd4d1 bytes) 2024-09-11T05:33:05.264 INFO:teuthology.orchestra.run.smithi070.stdout:990 trunc from 0xd8e4d4b to 0x81fd694 2024-09-11T05:33:05.274 INFO:teuthology.orchestra.run.smithi070.stdout:991 writesame 0x695b51 thru 0x6a31c8 data_size 0x4(0xd678 bytes) 2024-09-11T05:33:05.276 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:05.275+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:05.283 INFO:teuthology.orchestra.run.smithi070.stdout:993 read 0xf7abec thru 0xf859f9 (0xae0e bytes) 2024-09-11T05:33:05.283 INFO:teuthology.orchestra.run.smithi070.stdout:994 read 0x2eeae00 thru 0x2eec41d (0x161e bytes) 2024-09-11T05:33:05.283 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.283 INFO:teuthology.orchestra.run.smithi070.stdout:996 punch from 0x54b2ecc to 0x54be269, (0xb39d bytes) 2024-09-11T05:33:05.283 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.283 INFO:teuthology.orchestra.run.smithi070.stdout:999 writesame 0x1356b10 thru 0x13591e8 data_size 0x1(0x26d9 bytes) 2024-09-11T05:33:05.290 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:05.290 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:05.306 INFO:teuthology.orchestra.run.smithi070.stdout:1000 write 0xee31594 thru 0xee40276 (0xece3 bytes) 2024-09-11T05:33:05.310 INFO:teuthology.orchestra.run.smithi070.stdout:1001 punch from 0x22129b7 to 0x2220f40, (0xe589 bytes) 2024-09-11T05:33:05.310 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.310 INFO:teuthology.orchestra.run.smithi070.stdout:1004 write 0xc02f399 thru 0xc030429 (0x1091 bytes) 2024-09-11T05:33:05.311 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:05.311 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:05.313 INFO:teuthology.orchestra.run.smithi070.stdout:1005 punch from 0x808894e to 0x808a360, (0x1a12 bytes) 2024-09-11T05:33:05.313 INFO:teuthology.orchestra.run.smithi070.stdout:1006 write 0x4f24eac thru 0x4f25a0f (0xb64 bytes) 2024-09-11T05:33:05.316 INFO:teuthology.orchestra.run.smithi070.stdout:1007 write 0x87e5294 thru 0x87e5bbc (0x929 bytes) 2024-09-11T05:33:05.320 INFO:teuthology.orchestra.run.smithi070.stdout:1008 read 0xbe843ef thru 0xbe9330b (0xef1d bytes) 2024-09-11T05:33:05.320 INFO:teuthology.orchestra.run.smithi070.stdout:1009 read 0x6b50551 thru 0x6b59fe9 (0x9a99 bytes) 2024-09-11T05:33:05.329 INFO:teuthology.orchestra.run.smithi070.stdout:1011 trunc from 0xee40277 to 0x66c50cb 2024-09-11T05:33:05.330 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:05.330 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:05.340 INFO:teuthology.orchestra.run.smithi070.stdout:1014 read 0x487c119 thru 0x4888e2d (0xcd15 bytes) 2024-09-11T05:33:05.340 INFO:teuthology.orchestra.run.smithi070.stdout:1015 read 0x1332054 thru 0x13402a8 (0xe255 bytes) 2024-09-11T05:33:05.340 INFO:teuthology.orchestra.run.smithi070.stdout:1016 punch from 0x66b76d6 to 0x66c3352, (0xbc7c bytes) 2024-09-11T05:33:05.341 INFO:teuthology.orchestra.run.smithi070.stdout:1018 trunc from 0x66c50cb to 0x5f5001d 2024-09-11T05:33:05.346 INFO:teuthology.orchestra.run.smithi070.stdout:1019 flatten 2024-09-11T05:33:05.351 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:05.352 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:05.354 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.355 INFO:teuthology.orchestra.run.smithi070.stdout:1021 read 0x19b156e thru 0x19bd6e6 (0xc179 bytes) 2024-09-11T05:33:05.361 INFO:teuthology.orchestra.run.smithi070.stdout:1022 writesame 0x68124ab thru 0x681793c data_size 0x19(0x5492 bytes) 2024-09-11T05:33:05.361 INFO:teuthology.orchestra.run.smithi070.stdout:1024 writesame 0x2fdb386 thru 0x2fe1dc3 data_size 0x9(0x6a3e bytes) 2024-09-11T05:33:05.365 INFO:teuthology.orchestra.run.smithi070.stdout:1025 writesame 0x19c0d3f thru 0x19c1e20 data_size 0x1(0x10e2 bytes) 2024-09-11T05:33:05.370 INFO:teuthology.orchestra.run.smithi070.stdout:1026 read 0x4b8fabf thru 0x4b92b9f (0x30e1 bytes) 2024-09-11T05:33:05.370 INFO:teuthology.orchestra.run.smithi070.stdout:1029 read 0x3c84a55 thru 0x3c8df61 (0x950d bytes) 2024-09-11T05:33:05.371 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:05.371 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:05.376 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:05.376+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:05.377 INFO:teuthology.orchestra.run.smithi070.stdout:1030 writesame 0x70b19b0 thru 0x70bf8aa data_size 0x1(0xdefb bytes) 2024-09-11T05:33:05.380 INFO:teuthology.orchestra.run.smithi070.stdout:1031 trunc from 0x70bf8ab to 0x5210c23 2024-09-11T05:33:05.385 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:489 3.2 3:4550e1e5:::rbd_id.image_client.0-clone1:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.676545+0000", 2024-09-11T05:33:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7065798650000001, 2024-09-11T05:33:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030269920000000001, 2024-09-11T05:33:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 489 2024-09-11T05:33:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676545+0000", 2024-09-11T05:33:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676545+0000", 2024-09-11T05:33:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676547+0000", 2024-09-11T05:33:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2730000000000001e-06 2024-09-11T05:33:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676556+0000", 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9309999999999997e-06 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676576+0000", 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9545e-05 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676586+0000", 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9539999999999999e-06 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676648+0000", 2024-09-11T05:33:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.245e-05 2024-09-11T05:33:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T05:33:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.676657+0000", 2024-09-11T05:33:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3590000000000008e-06 2024-09-11T05:33:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678192+0000", 2024-09-11T05:33:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015357890000000001 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678318+0000", 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012543600000000001 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.678508+0000", 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018981099999999999 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.679136+0000", 2024-09-11T05:33:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000628456 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.679497+0000", 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036036800000000002 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.679539+0000", 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2947000000000001e-05 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.679572+0000", 2024-09-11T05:33:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2672999999999997e-05 2024-09-11T05:33:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:665 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 7864320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.919524+0000", 2024-09-11T05:33:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4636013959999996, 2024-09-11T05:33:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020638890000000002, 2024-09-11T05:33:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 665 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919524+0000", 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919524+0000", 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919525+0000", 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.66e-06 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919532+0000", 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2280000000000003e-06 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919545+0000", 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3725e-05 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919553+0000", 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6229999999999997e-06 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919627+0000", 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3919999999999997e-05 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919715+0000", 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8505999999999996e-05 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.919863+0000", 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014757299999999999 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.920542+0000", 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067902100000000003 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.921513+0000", 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097081299999999995 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.921553+0000", 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0538999999999999e-05 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.921588+0000", 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4280999999999999e-05 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:706 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 2621440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.968456+0000", 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4146687409999998, 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002353997, 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 706 2024-09-11T05:33:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968456+0000", 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968456+0000", 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968459+0000", 2024-09-11T05:33:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3829999999999999e-06 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968485+0000", 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6798999999999999e-05 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968505+0000", 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9726000000000001e-05 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968519+0000", 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3413e-05 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968591+0000", 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1929999999999997e-05 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968683+0000", 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2291000000000001e-05 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.968830+0000", 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147305 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.970110+0000", 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127954 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.970695+0000", 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058518700000000003 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.970747+0000", 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2014e-05 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.970810+0000", 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3409000000000002e-05 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:709 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 2621440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.969151+0000", 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4139735629999999, 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002099208, 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 709 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969151+0000", 2024-09-11T05:33:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969151+0000", 2024-09-11T05:33:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969152+0000", 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6499999999999998e-07 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969157+0000", 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4519999999999999e-06 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969165+0000", 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6340000000000007e-06 2024-09-11T05:33:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969172+0000", 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6560000000000003e-06 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969229+0000", 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7153e-05 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969306+0000", 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6452000000000006e-05 2024-09-11T05:33:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.969428+0000", 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122036 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.970669+0000", 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001241778 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.971157+0000", 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048744400000000002 2024-09-11T05:33:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.971209+0000", 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1848000000000002e-05 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.971251+0000", 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1990000000000003e-05 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:800 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 6815744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.052010+0000", 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3311148460000002, 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023934960000000002, 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 800 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052010+0000", 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052010+0000", 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052012+0000", 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8819999999999999e-06 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052019+0000", 2024-09-11T05:33:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3950000000000003e-06 2024-09-11T05:33:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052035+0000", 2024-09-11T05:33:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-11T05:33:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052043+0000", 2024-09-11T05:33:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1920000000000005e-06 2024-09-11T05:33:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052100+0000", 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6774999999999998e-05 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052182+0000", 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1536e-05 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052312+0000", 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013061299999999999 2024-09-11T05:33:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054141+0000", 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001829106 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054320+0000", 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017879199999999999 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054362+0000", 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2089000000000003e-05 2024-09-11T05:33:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054404+0000", 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1576000000000003e-05 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:803 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 6815744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.052073+0000", 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3310524409999998, 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002111515, 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 803 2024-09-11T05:33:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052073+0000", 2024-09-11T05:33:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052073+0000", 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052073+0000", 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5899999999999996e-07 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052076+0000", 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1250000000000001e-06 2024-09-11T05:33:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052084+0000", 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5549999999999997e-06 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052090+0000", 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052159+0000", 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9009000000000003e-05 2024-09-11T05:33:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052247+0000", 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7935000000000004e-05 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.052375+0000", 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127983 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054048+0000", 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016727440000000001 2024-09-11T05:33:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054089+0000", 2024-09-11T05:33:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1631999999999997e-05 2024-09-11T05:33:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054141+0000", 2024-09-11T05:33:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2058000000000002e-05 2024-09-11T05:33:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.054184+0000", 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2861000000000002e-05 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:827 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 3145728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.063974+0000", 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3191508860000001, 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025619459999999998, 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 827 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063974+0000", 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063974+0000", 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063975+0000", 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2500000000000004e-07 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063980+0000", 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3879999999999999e-06 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063988+0000", 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8040000000000002e-06 2024-09-11T05:33:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.063996+0000", 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3390000000000004e-06 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.064218+0000", 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000222372 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.064293+0000", 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5111000000000006e-05 2024-09-11T05:33:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.064418+0000", 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000125282 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.066159+0000", 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001741175 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.066438+0000", 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027891999999999999 2024-09-11T05:33:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.066493+0000", 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4951000000000003e-05 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.066536+0000", 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2778999999999998e-05 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:871 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 1572864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.099034+0000", 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.2840909480000002, 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044718789999999998, 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 871 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099034+0000", 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099034+0000", 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099037+0000", 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8080000000000001e-06 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099049+0000", 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2424e-05 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099073+0000", 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4074e-05 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099084+0000", 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0801e-05 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099164+0000", 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0278000000000006e-05 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099256+0000", 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1998999999999998e-05 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.099390+0000", 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013373599999999999 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.101301+0000", 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001910866 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.103448+0000", 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002146996 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.103479+0000", 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0812000000000002e-05 2024-09-11T05:33:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.103506+0000", 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7084999999999999e-05 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:929 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 3145728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.174198+0000", 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.2089271750000004, 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038749209999999999, 2024-09-11T05:33:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 929 2024-09-11T05:33:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174198+0000", 2024-09-11T05:33:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174198+0000", 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174199+0000", 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.159e-06 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174205+0000", 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4219999999999997e-06 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174219+0000", 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3451999999999999e-05 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174226+0000", 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5379999999999997e-06 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174285+0000", 2024-09-11T05:33:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8128000000000003e-05 2024-09-11T05:33:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174363+0000", 2024-09-11T05:33:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8286000000000002e-05 2024-09-11T05:33:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.174488+0000", 2024-09-11T05:33:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124688 2024-09-11T05:33:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.175250+0000", 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076250000000000005 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.178014+0000", 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027635239999999998 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.178046+0000", 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2829e-05 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.178073+0000", 2024-09-11T05:33:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6395000000000001e-05 2024-09-11T05:33:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:979 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.233167+0000", 2024-09-11T05:33:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1499578819999998, 2024-09-11T05:33:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002261753, 2024-09-11T05:33:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 979 2024-09-11T05:33:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233167+0000", 2024-09-11T05:33:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233167+0000", 2024-09-11T05:33:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233168+0000", 2024-09-11T05:33:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8500000000000001e-07 2024-09-11T05:33:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233172+0000", 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233181+0000", 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6279999999999994e-06 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233187+0000", 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1120000000000001e-06 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233237+0000", 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9876000000000002e-05 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233313+0000", 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6049000000000003e-05 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.233424+0000", 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011113299999999999 2024-09-11T05:33:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.234350+0000", 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092573199999999997 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.235332+0000", 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098234899999999998 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.235389+0000", 2024-09-11T05:33:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6632999999999998e-05 2024-09-11T05:33:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.235429+0000", 2024-09-11T05:33:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0281000000000003e-05 2024-09-11T05:33:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1037 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.326084+0000", 2024-09-11T05:33:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.057041238, 2024-09-11T05:33:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039491140000000001, 2024-09-11T05:33:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1037 2024-09-11T05:33:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326084+0000", 2024-09-11T05:33:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326084+0000", 2024-09-11T05:33:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326085+0000", 2024-09-11T05:33:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1960000000000001e-06 2024-09-11T05:33:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326091+0000", 2024-09-11T05:33:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7729999999999996e-06 2024-09-11T05:33:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326106+0000", 2024-09-11T05:33:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4995e-05 2024-09-11T05:33:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326114+0000", 2024-09-11T05:33:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8960000000000003e-06 2024-09-11T05:33:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326171+0000", 2024-09-11T05:33:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7166999999999997e-05 2024-09-11T05:33:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326248+0000", 2024-09-11T05:33:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7008000000000005e-05 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326376+0000", 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012861900000000001 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.327103+0000", 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000726807 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.329935+0000", 2024-09-11T05:33:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028322249999999998 2024-09-11T05:33:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.329992+0000", 2024-09-11T05:33:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7012999999999998e-05 2024-09-11T05:33:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.330033+0000", 2024-09-11T05:33:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0414999999999998e-05 2024-09-11T05:33:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1040 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.326148+0000", 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0569772989999997, 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002557087, 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1040 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326148+0000", 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326148+0000", 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326148+0000", 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7199999999999998e-07 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326152+0000", 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5710000000000002e-06 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326161+0000", 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6999999999999997e-06 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326167+0000", 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9179999999999999e-06 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326219+0000", 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2630999999999998e-05 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326296+0000", 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6777e-05 2024-09-11T05:33:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.326423+0000", 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127467 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.327747+0000", 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001323577 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.328639+0000", 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089223099999999995 2024-09-11T05:33:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.328674+0000", 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4397000000000003e-05 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.328705+0000", 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1146000000000003e-05 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1153 3.5 3:a4e7d0a8:::rbd_data.112da50123d8.0000000000000002:head [stat,truncate 4718592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.446979+0000", 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.93614613, 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020556569999999998, 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1153 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.446979+0000", 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.446979+0000", 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.446981+0000", 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7230000000000001e-06 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.446990+0000", 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447011+0000", 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1475999999999999e-05 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447025+0000", 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3789e-05 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447103+0000", 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8256000000000004e-05 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447202+0000", 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8529999999999993e-05 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447355+0000", 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015272500000000001 2024-09-11T05:33:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.448019+0000", 2024-09-11T05:33:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066467900000000005 2024-09-11T05:33:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.448913+0000", 2024-09-11T05:33:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089421399999999995 2024-09-11T05:33:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.448979+0000", 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5792999999999998e-05 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.449035+0000", 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5355000000000001e-05 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1156 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 4718592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.447059+0000", 2024-09-11T05:33:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.936065739, 2024-09-11T05:33:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024012819999999998, 2024-09-11T05:33:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1156 2024-09-11T05:33:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447059+0000", 2024-09-11T05:33:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447059+0000", 2024-09-11T05:33:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447060+0000", 2024-09-11T05:33:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9299999999999999e-07 2024-09-11T05:33:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447063+0000", 2024-09-11T05:33:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.303e-06 2024-09-11T05:33:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447070+0000", 2024-09-11T05:33:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8569999999999997e-06 2024-09-11T05:33:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447077+0000", 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.34e-06 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447153+0000", 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5816999999999996e-05 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447235+0000", 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1750999999999997e-05 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.447359+0000", 2024-09-11T05:33:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012429300000000001 2024-09-11T05:33:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.448534+0000", 2024-09-11T05:33:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011745970000000001 2024-09-11T05:33:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.449401+0000", 2024-09-11T05:33:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00086696799999999997 2024-09-11T05:33:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.449434+0000", 2024-09-11T05:33:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3439999999999998e-05 2024-09-11T05:33:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.449461+0000", 2024-09-11T05:33:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6523e-05 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1190 3.16 3:6d8a3602:::rbd_data.112da50123d8.0000000000000005:head [stat,truncate 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.493765+0000", 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8893604269999997, 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022484219999999999, 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1190 2024-09-11T05:33:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493765+0000", 2024-09-11T05:33:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493765+0000", 2024-09-11T05:33:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493765+0000", 2024-09-11T05:33:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6000000000000004e-07 2024-09-11T05:33:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493768+0000", 2024-09-11T05:33:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.942e-06 2024-09-11T05:33:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493776+0000", 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5580000000000003e-06 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493782+0000", 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1410000000000002e-06 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493834+0000", 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2512999999999997e-05 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.493898+0000", 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3987999999999998e-05 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.494011+0000", 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011294399999999999 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.494782+0000", 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00077052399999999997 2024-09-11T05:33:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.495916+0000", 2024-09-11T05:33:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011341389999999999 2024-09-11T05:33:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.495969+0000", 2024-09-11T05:33:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3190999999999999e-05 2024-09-11T05:33:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.496013+0000", 2024-09-11T05:33:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3921999999999997e-05 2024-09-11T05:33:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1606 3.5 3:a5e0cded:::rbd_object_map.112d83e8b99.0000000000000005:head [writefull 0~55] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:02.658148+0000", 2024-09-11T05:33:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.7249765589999999, 2024-09-11T05:33:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025410250000000001, 2024-09-11T05:33:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1606 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.658148+0000", 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.658148+0000", 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.658150+0000", 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6190000000000001e-06 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.658158+0000", 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7689999999999996e-06 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.658172+0000", 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4415e-05 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.658180+0000", 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2230000000000001e-06 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.658230+0000", 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0219000000000001e-05 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T05:33:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.658235+0000", 2024-09-11T05:33:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4349999999999996e-06 2024-09-11T05:33:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.659693+0000", 2024-09-11T05:33:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014579529999999999 2024-09-11T05:33:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.659790+0000", 2024-09-11T05:33:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7159999999999998e-05 2024-09-11T05:33:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.659877+0000", 2024-09-11T05:33:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6507000000000004e-05 2024-09-11T05:33:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.660389+0000", 2024-09-11T05:33:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051211799999999999 2024-09-11T05:33:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.660614+0000", 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000224964 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.660649+0000", 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5303999999999999e-05 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.660689+0000", 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0339000000000001e-05 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1702 3.5 3:a4d1fec2:::rbd_data.112d83e8b99.000000000000000c:head [stat,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:02.720525+0000", 2024-09-11T05:33:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.662600431, 2024-09-11T05:33:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038332269999999998, 2024-09-11T05:33:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1702 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.720525+0000", 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.720525+0000", 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.720525+0000", 2024-09-11T05:33:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6000000000000003e-07 2024-09-11T05:33:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.720531+0000", 2024-09-11T05:33:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2730000000000002e-06 2024-09-11T05:33:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.720541+0000", 2024-09-11T05:33:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0172e-05 2024-09-11T05:33:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.720548+0000", 2024-09-11T05:33:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1709999999999996e-06 2024-09-11T05:33:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.720638+0000", 2024-09-11T05:33:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9771999999999994e-05 2024-09-11T05:33:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.720765+0000", 2024-09-11T05:33:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127849 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.724358+0000", 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035923299999999999 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1721 3.5 3:a0e94ca9:::rbd_data.112d83e8b99.000000000000000b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:02.722657+0000", 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.6604679390000001, 2024-09-11T05:33:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045013020000000004, 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1721 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.722657+0000", 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.722657+0000", 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.722658+0000", 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6199999999999997e-07 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.722662+0000", 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5569999999999997e-06 2024-09-11T05:33:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.722672+0000", 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8619999999999998e-06 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.722677+0000", 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9729999999999997e-06 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.722723+0000", 2024-09-11T05:33:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6202000000000003e-05 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.722768+0000", 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4588000000000001e-05 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.722913+0000", 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145451 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.723374+0000", 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046018799999999999 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.727085+0000", 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003711691 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.727126+0000", 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0210000000000003e-05 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.727158+0000", 2024-09-11T05:33:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2818000000000003e-05 2024-09-11T05:33:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1727 3.5 3:a4d1fec2:::rbd_data.112d83e8b99.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:02.725060+0000", 2024-09-11T05:33:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.658065095, 2024-09-11T05:33:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022402110000000002, 2024-09-11T05:33:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1727 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.725060+0000", 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.725060+0000", 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.725061+0000", 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5799999999999998e-07 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.725065+0000", 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.109e-06 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.725085+0000", 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9732e-05 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.725092+0000", 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2389999999999996e-06 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.725138+0000", 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6208999999999998e-05 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.725205+0000", 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6756999999999998e-05 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.725328+0000", 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012329800000000001 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.725806+0000", 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047798099999999999 2024-09-11T05:33:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.727238+0000", 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014315129999999999 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.727268+0000", 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0667999999999998e-05 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.727300+0000", 2024-09-11T05:33:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1946999999999998e-05 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4397.0:1916 3.9 e28/22 3:94ac6693:::rbd_data.112dc2b7c1.0000000000000002:head v 28'22, mlcod=26'19)", 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:02.829251+0000", 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5538737550000001, 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043025269999999996, 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.829251+0000", 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.829251+0000", 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.829253+0000", 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.829940+0000", 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00068688899999999999 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.829960+0000", 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0220999999999998e-05 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.829970+0000", 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7010000000000008e-06 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.830031+0000", 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1470000000000006e-05 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.830056+0000", 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4834999999999999e-05 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.833507+0000", 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034512810000000001 2024-09-11T05:33:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:02.833554+0000", 2024-09-11T05:33:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6575e-05 2024-09-11T05:33:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.502 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:05.503 INFO:teuthology.orchestra.run.smithi070.stdout:1032 read 0x4110a3 thru 0x413a82 (0x29e0 bytes) 2024-09-11T05:33:05.503 INFO:teuthology.orchestra.run.smithi070.stdout:1033 writesame 0xe881b thru 0xea917 data_size 0x5(0x20fd bytes) 2024-09-11T05:33:05.503 INFO:teuthology.orchestra.run.smithi070.stdout:1036 read 0x50a022f thru 0x50a9d01 (0x9ad3 bytes) 2024-09-11T05:33:05.503 INFO:teuthology.orchestra.run.smithi070.stdout:1038 read 0x18fc943 thru 0x18fd405 (0xac3 bytes) 2024-09-11T05:33:05.503 INFO:teuthology.orchestra.run.smithi070.stdout:1039 read 0x2a45306 thru 0x2a5287f (0xd57a bytes) 2024-09-11T05:33:05.503 INFO:teuthology.orchestra.run.smithi070.stdout:1040 write 0x391c5e4 thru 0x392412e (0x7b4b bytes) 2024-09-11T05:33:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:05.504 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:1045 read 0x8a9a92 thru 0x8b504e (0xb5bd bytes) 2024-09-11T05:33:05.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:1046 write 0x81a282c thru 0x81a7e39 (0x560e bytes) 2024-09-11T05:33:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:1047 writesame 0x248efaf thru 0x249edb4 data_size 0x23(0xfe06 bytes) 2024-09-11T05:33:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:05.507 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:05.507 INFO:teuthology.orchestra.run.smithi070.stdout:1049 write 0x98bb573 thru 0x98c4294 (0x8d22 bytes) 2024-09-11T05:33:05.507 INFO:teuthology.orchestra.run.smithi070.stdout:1050 trunc from 0x98c4295 to 0x269f5ea 2024-09-11T05:33:05.507 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:05.508 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:05.509 INFO:teuthology.orchestra.run.smithi070.stdout:1052 write 0xbd536c3 thru 0xbd58e26 (0x5764 bytes) 2024-09-11T05:33:05.509 INFO:teuthology.orchestra.run.smithi070.stdout:1053 punch from 0x4acf941 to 0x4ad0261, (0x920 bytes) 2024-09-11T05:33:05.509 INFO:teuthology.orchestra.run.smithi070.stdout:1054 writesame 0x88991d1 thru 0x88a11cb data_size 0x43(0x7ffb bytes) 2024-09-11T05:33:05.510 INFO:teuthology.orchestra.run.smithi070.stdout:1055 write 0x8cc655a thru 0x8cc84a9 (0x1f50 bytes) 2024-09-11T05:33:05.510 INFO:teuthology.orchestra.run.smithi070.stdout:1056 punch from 0x2a1d4e6 to 0x2a1f11b, (0x1c35 bytes) 2024-09-11T05:33:05.510 INFO:teuthology.orchestra.run.smithi070.stdout:1057 writesame 0xcadce6d thru 0xcaeab81 data_size 0x1(0xdd15 bytes) 2024-09-11T05:33:05.510 INFO:teuthology.orchestra.run.smithi070.stdout:1058 read 0x133bc3 thru 0x141bd9 (0xe017 bytes) 2024-09-11T05:33:05.510 INFO:teuthology.orchestra.run.smithi070.stdout:1061 write 0x4c328dd thru 0x4c3caf0 (0xa214 bytes) 2024-09-11T05:33:05.510 INFO:teuthology.orchestra.run.smithi070.stdout:1062 punch from 0x6f0fbf2 to 0x6f13b90, (0x3f9e bytes) 2024-09-11T05:33:05.510 INFO:teuthology.orchestra.run.smithi070.stdout:1063 punch from 0x57d45fe to 0x57e2524, (0xdf26 bytes) 2024-09-11T05:33:05.510 INFO:teuthology.orchestra.run.smithi070.stdout:1065 writesame 0xf30b9e thru 0xf3f8dd data_size 0x92(0xed40 bytes) 2024-09-11T05:33:05.510 INFO:teuthology.orchestra.run.smithi070.stdout:1067 trunc from 0xcaeab82 to 0x1bce38f 2024-09-11T05:33:05.513 INFO:teuthology.orchestra.run.smithi070.stdout:1068 write 0xa0445a1 thru 0xa051de1 (0xd841 bytes) 2024-09-11T05:33:05.514 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:05.513+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:05.516 INFO:teuthology.orchestra.run.smithi070.stdout:1069 read 0x84b0fc8 thru 0x84ba671 (0x96aa bytes) 2024-09-11T05:33:05.524 INFO:teuthology.orchestra.run.smithi070.stdout:1070 write 0xb9e4de3 thru 0xb9f176f (0xc98d bytes) 2024-09-11T05:33:05.532 INFO:teuthology.orchestra.run.smithi070.stdout:1071 trunc from 0xb9f1770 to 0x7924ff6 2024-09-11T05:33:05.542 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.542 INFO:teuthology.orchestra.run.smithi070.stdout:1073 read 0x6ab1e88 thru 0x6abab13 (0x8c8c bytes) 2024-09-11T05:33:05.542 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.542 INFO:teuthology.orchestra.run.smithi070.stdout:1078 write 0xe33fa1 thru 0xe3b2b1 (0x7311 bytes) 2024-09-11T05:33:05.545 INFO:teuthology.orchestra.run.smithi070.stdout:1079 writesame 0x4ef7e83 thru 0x4efdf5e data_size 0x2(0x60dc bytes) 2024-09-11T05:33:05.554 INFO:teuthology.orchestra.run.smithi070.stdout:1082 trunc from 0x7924ff6 to 0x6642fbe 2024-09-11T05:33:05.560 INFO:teuthology.orchestra.run.smithi070.stdout:1085 writesame 0x3f1b0c7 thru 0x3f1c77b data_size 0x1(0x16b5 bytes) 2024-09-11T05:33:05.566 INFO:teuthology.orchestra.run.smithi070.stdout:1086 write 0x3770a0 thru 0x38121d (0xa17e bytes) 2024-09-11T05:33:05.568 INFO:teuthology.orchestra.run.smithi070.stdout:1087 punch from 0x1fee9b to 0x20739e, (0x8503 bytes) 2024-09-11T05:33:05.568 INFO:teuthology.orchestra.run.smithi070.stdout:1088 writesame 0x1cb49ba thru 0x1cb53a9 data_size 0x18(0x9f0 bytes) 2024-09-11T05:33:05.571 INFO:teuthology.orchestra.run.smithi070.stdout:1089 write 0x64d6bac thru 0x64e32c1 (0xc716 bytes) 2024-09-11T05:33:05.574 INFO:teuthology.orchestra.run.smithi070.stdout:1091 writesame 0x26f72d thru 0x27b5d9 data_size 0x35(0xbead bytes) 2024-09-11T05:33:05.575 INFO:teuthology.orchestra.run.smithi070.stdout:1092 read 0x2f9abfd thru 0x2f9f6fa (0x4afe bytes) 2024-09-11T05:33:05.576 INFO:teuthology.orchestra.run.smithi070.stdout:1093 write 0x37b0048 thru 0x37b5fb8 (0x5f71 bytes) 2024-09-11T05:33:05.578 INFO:teuthology.orchestra.run.smithi070.stdout:1097 read 0x5f7785a thru 0x5f83b6e (0xc315 bytes) 2024-09-11T05:33:05.578 INFO:teuthology.orchestra.run.smithi070.stdout:1098 read 0x1b7d02a thru 0x1b7e16d (0x1144 bytes) 2024-09-11T05:33:05.579 INFO:teuthology.orchestra.run.smithi070.stdout:1099 read 0x61a1150 thru 0x61a484f (0x3700 bytes) 2024-09-11T05:33:05.593 INFO:teuthology.orchestra.run.smithi070.stdout:1100 write 0xe33ff73 thru 0xe34b6b1 (0xb73f bytes) 2024-09-11T05:33:05.608 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:05.607+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:05.609 INFO:teuthology.orchestra.run.smithi070.stdout:1102 trunc from 0xe34b6b2 to 0x41ac818 2024-09-11T05:33:05.624 INFO:teuthology.orchestra.run.smithi070.stdout:1104 read 0x17f2cc7 thru 0x17fcc38 (0x9f72 bytes) 2024-09-11T05:33:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:1105 writesame 0x5e56bf3 thru 0x5e610f4 data_size 0x1(0xa502 bytes) 2024-09-11T05:33:05.640 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:05.640 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:05.640 INFO:teuthology.orchestra.run.smithi070.stdout:1107 write 0x8ece435 thru 0x8ed942e (0xaffa bytes) 2024-09-11T05:33:05.643 INFO:teuthology.orchestra.run.smithi070.stdout:1108 write 0x210d4af thru 0x210e085 (0xbd7 bytes) 2024-09-11T05:33:05.650 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:05.653 INFO:teuthology.orchestra.run.smithi070.stdout:1110 trunc from 0x8ed942f to 0x3532dcf 2024-09-11T05:33:05.668 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:33:05.670 INFO:teuthology.orchestra.run.smithi070.stdout:1112 trunc from 0x3532dcf to 0x9198a6d 2024-09-11T05:33:05.675 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.685 INFO:teuthology.orchestra.run.smithi070.stdout:1115 write 0xc0604a4 thru 0xc06f00c (0xeb69 bytes) 2024-09-11T05:33:05.689 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.697 INFO:teuthology.orchestra.run.smithi070.stdout:1117 writesame 0xe1bceb6 thru 0xe1cb743 data_size 0x67(0xe88e bytes) 2024-09-11T05:33:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:1119 trunc from 0xe1cb744 to 0x6e967f9 2024-09-11T05:33:05.709 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:05.709+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:05.716 INFO:teuthology.orchestra.run.smithi070.stdout:1121 write 0x4e469d5 thru 0x4e4f34e (0x897a bytes) 2024-09-11T05:33:05.719 INFO:teuthology.orchestra.run.smithi070.stdout:1122 read 0x3ae0c44 thru 0x3ae15cf (0x98c bytes) 2024-09-11T05:33:05.731 INFO:teuthology.orchestra.run.smithi070.stdout:1123 writesame 0xbeff942 thru 0xbf097f5 data_size 0xe(0x9eb4 bytes) 2024-09-11T05:33:05.731 INFO:teuthology.orchestra.run.smithi070.stdout:1124 write 0x400d9f3 thru 0x401cb3e (0xf14c bytes) 2024-09-11T05:33:05.734 INFO:teuthology.orchestra.run.smithi070.stdout:1125 writesame 0xaef783e thru 0xaf01260 data_size 0x7(0x9a23 bytes) 2024-09-11T05:33:05.740 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.740 INFO:teuthology.orchestra.run.smithi070.stdout:1128 read 0xb01b6a0 thru 0xb02a1eb (0xeb4c bytes) 2024-09-11T05:33:05.741 INFO:teuthology.orchestra.run.smithi070.stdout:1129 read 0x715c73f thru 0x7161efc (0x57be bytes) 2024-09-11T05:33:05.741 INFO:teuthology.orchestra.run.smithi070.stdout:1130 write 0x54bb785 thru 0x54c7d0f (0xc58b bytes) 2024-09-11T05:33:05.745 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:05.745 INFO:teuthology.orchestra.run.smithi070.stdout:1133 writesame 0x6212b00 thru 0x6220693 data_size 0x5e(0xdb94 bytes) 2024-09-11T05:33:05.749 INFO:teuthology.orchestra.run.smithi070.stdout:1134 punch from 0x355c2a0 to 0x356c277, (0xffd7 bytes) 2024-09-11T05:33:05.756 INFO:teuthology.orchestra.run.smithi070.stdout:1135 trunc from 0xbf097f6 to 0x5ce3633 2024-09-11T05:33:05.766 INFO:teuthology.orchestra.run.smithi070.stdout:1136 write 0x1cd6906 thru 0x1cdb638 (0x4d33 bytes) 2024-09-11T05:33:05.780 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:05.780 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:05.780 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:05.780 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:05.780 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:05.783 INFO:teuthology.orchestra.run.smithi070.stdout:1137 writesame 0xca6412d thru 0xca6c9ff data_size 0x1(0x88d3 bytes) 2024-09-11T05:33:05.792 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:05.793 INFO:teuthology.orchestra.run.smithi070.stdout:1138 write 0xe7da4e8 thru 0xe7e34ea (0x9003 bytes) 2024-09-11T05:33:05.795 INFO:teuthology.orchestra.run.smithi070.stdout:1139 write 0xbd97cb2 thru 0xbd9ae49 (0x3198 bytes) 2024-09-11T05:33:05.798 INFO:teuthology.orchestra.run.smithi070.stdout:1143 write 0xa3edfb6 thru 0xa3fa7ec (0xc837 bytes) 2024-09-11T05:33:05.801 INFO:teuthology.orchestra.run.smithi070.stdout:1144 write 0xb3c7a4c thru 0xb3d3094 (0xb649 bytes) 2024-09-11T05:33:05.805 INFO:teuthology.orchestra.run.smithi070.stdout:1145 write 0x8a1888b thru 0x8a25db0 (0xd526 bytes) 2024-09-11T05:33:05.809 INFO:teuthology.orchestra.run.smithi070.stdout:1146 write 0x3cbfc2 thru 0x3d28bd (0x68fc bytes) 2024-09-11T05:33:05.810 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:05.809+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:05.811 INFO:teuthology.orchestra.run.smithi070.stdout:1147 writesame 0xc38a4d8 thru 0xc38c934 data_size 0x1d(0x245d bytes) 2024-09-11T05:33:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:1148 write 0x668cc13 thru 0x66971bc (0xa5aa bytes) 2024-09-11T05:33:05.818 INFO:teuthology.orchestra.run.smithi070.stdout:1149 write 0x7c7c4fb thru 0x7c7f084 (0x2b8a bytes) 2024-09-11T05:33:05.826 INFO:teuthology.orchestra.run.smithi070.stdout:1150 trunc from 0xe7e34eb to 0xa726e88 2024-09-11T05:33:05.838 INFO:teuthology.orchestra.run.smithi070.stdout:1151 write 0x5dc693e thru 0x5dd2cb2 (0xc375 bytes) 2024-09-11T05:33:05.842 INFO:teuthology.orchestra.run.smithi070.stdout:1152 writesame 0x1618483 thru 0x162308b data_size 0x1(0xac09 bytes) 2024-09-11T05:33:05.866 INFO:teuthology.orchestra.run.smithi070.stdout:1154 write 0x9969554 thru 0x9970568 (0x7015 bytes) 2024-09-11T05:33:05.879 INFO:teuthology.orchestra.run.smithi070.stdout:1156 write 0xd10f79f thru 0xd110936 (0x1198 bytes) 2024-09-11T05:33:05.891 INFO:teuthology.orchestra.run.smithi070.stdout:1161 trunc from 0xd110937 to 0x5d7fe8e 2024-09-11T05:33:05.905 INFO:teuthology.orchestra.run.smithi070.stdout:1163 read 0x4e319ba thru 0x4e353d0 (0x3a17 bytes) 2024-09-11T05:33:05.905 INFO:teuthology.orchestra.run.smithi070.stdout:1164 write 0xe1bf16 thru 0xe1c4a3 (0x58e bytes) 2024-09-11T05:33:05.910 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:05.910+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:05.914 INFO:teuthology.orchestra.run.smithi070.stdout:1165 trunc from 0x5d7fe8e to 0xcd2284d 2024-09-11T05:33:05.918 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:33:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.325721828999999, 2024-09-11T05:33:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:33:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:33:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:33:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:33:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:33:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:33:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:33:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:581 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786716+0000", 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1292591569999999, 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076071070000000001, 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 581 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786716+0000", 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786716+0000", 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786716+0000", 2024-09-11T05:33:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.65e-07 2024-09-11T05:33:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786718+0000", 2024-09-11T05:33:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.334e-06 2024-09-11T05:33:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786722+0000", 2024-09-11T05:33:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8879999999999999e-06 2024-09-11T05:33:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786725+0000", 2024-09-11T05:33:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6860000000000002e-06 2024-09-11T05:33:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.789379+0000", 2024-09-11T05:33:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002654235 2024-09-11T05:33:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.789465+0000", 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5864000000000003e-05 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.789808+0000", 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034295799999999998 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.793255+0000", 2024-09-11T05:33:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034466029999999999 2024-09-11T05:33:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794219+0000", 2024-09-11T05:33:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00096429899999999995 2024-09-11T05:33:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794277+0000", 2024-09-11T05:33:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7769000000000002e-05 2024-09-11T05:33:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794323+0000", 2024-09-11T05:33:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6106000000000002e-05 2024-09-11T05:33:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:582 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786728+0000", 2024-09-11T05:33:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1292463909999997, 2024-09-11T05:33:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076926620000000003, 2024-09-11T05:33:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 582 2024-09-11T05:33:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786728+0000", 2024-09-11T05:33:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786728+0000", 2024-09-11T05:33:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786729+0000", 2024-09-11T05:33:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0699999999999999e-07 2024-09-11T05:33:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786733+0000", 2024-09-11T05:33:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3640000000000001e-06 2024-09-11T05:33:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786736+0000", 2024-09-11T05:33:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1489999999999998e-06 2024-09-11T05:33:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786739+0000", 2024-09-11T05:33:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5100000000000001e-06 2024-09-11T05:33:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.790700+0000", 2024-09-11T05:33:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039613540000000003 2024-09-11T05:33:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.790788+0000", 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8461000000000006e-05 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.791161+0000", 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00037263599999999997 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.793300+0000", 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021385589999999999 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794334+0000", 2024-09-11T05:33:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010340550000000001 2024-09-11T05:33:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794382+0000", 2024-09-11T05:33:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7938000000000001e-05 2024-09-11T05:33:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794421+0000", 2024-09-11T05:33:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9428999999999998e-05 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:583 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786742+0000", 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.129232773, 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087390200000000001, 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 583 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786742+0000", 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786742+0000", 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786742+0000", 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786748+0000", 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4940000000000003e-06 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786752+0000", 2024-09-11T05:33:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5709999999999999e-06 2024-09-11T05:33:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786756+0000", 2024-09-11T05:33:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8290000000000001e-06 2024-09-11T05:33:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.791511+0000", 2024-09-11T05:33:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047550769999999999 2024-09-11T05:33:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.791606+0000", 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5105000000000005e-05 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.791984+0000", 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00037732299999999999 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794431+0000", 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024478009999999999 2024-09-11T05:33:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795394+0000", 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00096278800000000001 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795443+0000", 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9001000000000001e-05 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795481+0000", 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7826e-05 2024-09-11T05:33:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:584 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786759+0000", 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1292152739999999, 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089385369999999999, 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 584 2024-09-11T05:33:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786759+0000", 2024-09-11T05:33:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786759+0000", 2024-09-11T05:33:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786760+0000", 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1500000000000001e-07 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786761+0000", 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.748e-06 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786765+0000", 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1480000000000002e-06 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786767+0000", 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3080000000000002e-06 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.792409+0000", 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056422540000000002 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.792504+0000", 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5036000000000003e-05 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.792869+0000", 2024-09-11T05:33:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036446599999999998 2024-09-11T05:33:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795495+0000", 2024-09-11T05:33:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026260060000000002 2024-09-11T05:33:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795548+0000", 2024-09-11T05:33:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2862999999999999e-05 2024-09-11T05:33:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795604+0000", 2024-09-11T05:33:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6475999999999999e-05 2024-09-11T05:33:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795698+0000", 2024-09-11T05:33:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4017000000000005e-05 2024-09-11T05:33:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:585 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786770+0000", 2024-09-11T05:33:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1292050009999999, 2024-09-11T05:33:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011329848999999999, 2024-09-11T05:33:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 585 2024-09-11T05:33:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786770+0000", 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786770+0000", 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786770+0000", 2024-09-11T05:33:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:33:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786772+0000", 2024-09-11T05:33:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.877e-06 2024-09-11T05:33:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786775+0000", 2024-09-11T05:33:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1480000000000002e-06 2024-09-11T05:33:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786777+0000", 2024-09-11T05:33:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3429999999999998e-06 2024-09-11T05:33:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.793346+0000", 2024-09-11T05:33:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065690030000000003 2024-09-11T05:33:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.793437+0000", 2024-09-11T05:33:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0617000000000003e-05 2024-09-11T05:33:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.793836+0000", 2024-09-11T05:33:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039883900000000001 2024-09-11T05:33:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795749+0000", 2024-09-11T05:33:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019128420000000001 2024-09-11T05:33:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.797994+0000", 2024-09-11T05:33:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022455690000000002 2024-09-11T05:33:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.798058+0000", 2024-09-11T05:33:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3445e-05 2024-09-11T05:33:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.798100+0000", 2024-09-11T05:33:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1962999999999998e-05 2024-09-11T05:33:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:587 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786780+0000", 2024-09-11T05:33:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1291946150000003, 2024-09-11T05:33:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012403552, 2024-09-11T05:33:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 587 2024-09-11T05:33:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786780+0000", 2024-09-11T05:33:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786780+0000", 2024-09-11T05:33:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786780+0000", 2024-09-11T05:33:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:33:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786782+0000", 2024-09-11T05:33:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2899999999999999e-06 2024-09-11T05:33:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786785+0000", 2024-09-11T05:33:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-06 2024-09-11T05:33:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786787+0000", 2024-09-11T05:33:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.351e-06 2024-09-11T05:33:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794475+0000", 2024-09-11T05:33:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076885080000000001 2024-09-11T05:33:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794563+0000", 2024-09-11T05:33:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7647999999999998e-05 2024-09-11T05:33:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.794919+0000", 2024-09-11T05:33:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035574499999999998 2024-09-11T05:33:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799009+0000", 2024-09-11T05:33:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004090593 2024-09-11T05:33:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799070+0000", 2024-09-11T05:33:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0974000000000003e-05 2024-09-11T05:33:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799129+0000", 2024-09-11T05:33:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8492999999999997e-05 2024-09-11T05:33:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799184+0000", 2024-09-11T05:33:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4787999999999998e-05 2024-09-11T05:33:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:588 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786810+0000", 2024-09-11T05:33:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1291647200000003, 2024-09-11T05:33:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012527862000000001, 2024-09-11T05:33:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 588 2024-09-11T05:33:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786810+0000", 2024-09-11T05:33:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786810+0000", 2024-09-11T05:33:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786810+0000", 2024-09-11T05:33:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.46e-07 2024-09-11T05:33:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786815+0000", 2024-09-11T05:33:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7210000000000002e-06 2024-09-11T05:33:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786821+0000", 2024-09-11T05:33:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0789999999999997e-06 2024-09-11T05:33:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786824+0000", 2024-09-11T05:33:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2009999999999999e-06 2024-09-11T05:33:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795782+0000", 2024-09-11T05:33:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089577919999999991 2024-09-11T05:33:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.795870+0000", 2024-09-11T05:33:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7729e-05 2024-09-11T05:33:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.796359+0000", 2024-09-11T05:33:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048856400000000003 2024-09-11T05:33:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799016+0000", 2024-09-11T05:33:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026571989999999998 2024-09-11T05:33:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799242+0000", 2024-09-11T05:33:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022623899999999999 2024-09-11T05:33:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799296+0000", 2024-09-11T05:33:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4008000000000002e-05 2024-09-11T05:33:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799338+0000", 2024-09-11T05:33:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1884000000000001e-05 2024-09-11T05:33:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:589 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786829+0000", 2024-09-11T05:33:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.129145522, 2024-09-11T05:33:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012623997, 2024-09-11T05:33:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 589 2024-09-11T05:33:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786829+0000", 2024-09-11T05:33:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786829+0000", 2024-09-11T05:33:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786829+0000", 2024-09-11T05:33:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.17e-07 2024-09-11T05:33:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786832+0000", 2024-09-11T05:33:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:33:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786836+0000", 2024-09-11T05:33:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7840000000000001e-06 2024-09-11T05:33:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786838+0000", 2024-09-11T05:33:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5129999999999999e-06 2024-09-11T05:33:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.796701+0000", 2024-09-11T05:33:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098623259999999994 2024-09-11T05:33:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.797227+0000", 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00052681199999999998 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.797616+0000", 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038823200000000002 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799353+0000", 2024-09-11T05:33:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001737492 2024-09-11T05:33:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799403+0000", 2024-09-11T05:33:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0257999999999999e-05 2024-09-11T05:33:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799432+0000", 2024-09-11T05:33:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8170999999999998e-05 2024-09-11T05:33:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799453+0000", 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1634e-05 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:590 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786841+0000", 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1291334319999997, 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013576911000000001, 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 590 2024-09-11T05:33:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786841+0000", 2024-09-11T05:33:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786841+0000", 2024-09-11T05:33:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786842+0000", 2024-09-11T05:33:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786844+0000", 2024-09-11T05:33:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3549999999999999e-06 2024-09-11T05:33:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786847+0000", 2024-09-11T05:33:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:33:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786853+0000", 2024-09-11T05:33:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:33:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.798138+0000", 2024-09-11T05:33:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011284776999999999 2024-09-11T05:33:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.798222+0000", 2024-09-11T05:33:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3881000000000005e-05 2024-09-11T05:33:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.798612+0000", 2024-09-11T05:33:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038983399999999998 2024-09-11T05:33:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800325+0000", 2024-09-11T05:33:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017129350000000001 2024-09-11T05:33:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800366+0000", 2024-09-11T05:33:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0745999999999999e-05 2024-09-11T05:33:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800395+0000", 2024-09-11T05:33:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9203000000000001e-05 2024-09-11T05:33:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800418+0000", 2024-09-11T05:33:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3458000000000001e-05 2024-09-11T05:33:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:591 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786857+0000", 2024-09-11T05:33:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1291175019999997, 2024-09-11T05:33:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015066078, 2024-09-11T05:33:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 591 2024-09-11T05:33:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786857+0000", 2024-09-11T05:33:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786857+0000", 2024-09-11T05:33:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786857+0000", 2024-09-11T05:33:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:33:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786860+0000", 2024-09-11T05:33:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.295e-06 2024-09-11T05:33:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786864+0000", 2024-09-11T05:33:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9210000000000002e-06 2024-09-11T05:33:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786866+0000", 2024-09-11T05:33:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3609999999999999e-06 2024-09-11T05:33:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799492+0000", 2024-09-11T05:33:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012626111000000001 2024-09-11T05:33:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799542+0000", 2024-09-11T05:33:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9478999999999998e-05 2024-09-11T05:33:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.799826+0000", 2024-09-11T05:33:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028487100000000002 2024-09-11T05:33:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.801184+0000", 2024-09-11T05:33:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001357285 2024-09-11T05:33:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.801851+0000", 2024-09-11T05:33:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066685699999999997 2024-09-11T05:33:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.801885+0000", 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4e-05 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.801923+0000", 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8679e-05 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:592 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:00.786869+0000", 2024-09-11T05:33:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1291057479999997, 2024-09-11T05:33:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015330196000000001, 2024-09-11T05:33:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 592 2024-09-11T05:33:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786869+0000", 2024-09-11T05:33:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786869+0000", 2024-09-11T05:33:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786869+0000", 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9999999999999999e-07 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786872+0000", 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8399999999999999e-06 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786878+0000", 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9529999999999996e-06 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.786880+0000", 2024-09-11T05:33:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3980000000000002e-06 2024-09-11T05:33:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800440+0000", 2024-09-11T05:33:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013559953 2024-09-11T05:33:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800508+0000", 2024-09-11T05:33:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7391000000000006e-05 2024-09-11T05:33:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.800844+0000", 2024-09-11T05:33:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00033596899999999998 2024-09-11T05:33:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.801615+0000", 2024-09-11T05:33:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00077176199999999995 2024-09-11T05:33:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.802101+0000", 2024-09-11T05:33:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048517599999999998 2024-09-11T05:33:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.802157+0000", 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6107000000000003e-05 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:00.802199+0000", 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2447000000000002e-05 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1071 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.338959+0000", 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5770152700000004, 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063611040000000002, 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1071 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338959+0000", 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338959+0000", 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338960+0000", 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.96e-07 2024-09-11T05:33:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338964+0000", 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8039999999999999e-06 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338971+0000", 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6090000000000003e-06 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338977+0000", 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8069999999999996e-06 2024-09-11T05:33:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.342076+0000", 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030992070000000001 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.342143+0000", 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6392999999999999e-05 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.342351+0000", 2024-09-11T05:33:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020795300000000001 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.343700+0000", 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001349343 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345233+0000", 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00153302 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345279+0000", 2024-09-11T05:33:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5886000000000001e-05 2024-09-11T05:33:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345321+0000", 2024-09-11T05:33:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1686e-05 2024-09-11T05:33:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1072 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.338984+0000", 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5769911729999997, 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081204880000000004, 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1072 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338984+0000", 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338984+0000", 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338984+0000", 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338987+0000", 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6280000000000001e-06 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338993+0000", 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.976e-06 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.338998+0000", 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.84e-06 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.342727+0000", 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037284649999999998 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.342809+0000", 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1792999999999994e-05 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.343171+0000", 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036250900000000001 2024-09-11T05:33:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345377+0000", 2024-09-11T05:33:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002205828 2024-09-11T05:33:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347040+0000", 2024-09-11T05:33:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001663369 2024-09-11T05:33:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347068+0000", 2024-09-11T05:33:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7399e-05 2024-09-11T05:33:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347104+0000", 2024-09-11T05:33:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6278000000000001e-05 2024-09-11T05:33:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1073 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.339004+0000", 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5769704659999997, 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081858910000000007, 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1073 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339004+0000", 2024-09-11T05:33:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339004+0000", 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339005+0000", 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7e-07 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339007+0000", 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6010000000000002e-06 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339035+0000", 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7251999999999999e-05 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339072+0000", 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7072e-05 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.343740+0000", 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046682019999999998 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.343819+0000", 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8872e-05 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.344095+0000", 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000275853 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345437+0000", 2024-09-11T05:33:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013424279999999999 2024-09-11T05:33:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347114+0000", 2024-09-11T05:33:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016768359999999999 2024-09-11T05:33:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347155+0000", 2024-09-11T05:33:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0914999999999997e-05 2024-09-11T05:33:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347190+0000", 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5389999999999998e-05 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1074 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.339087+0000", 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5768873249999995, 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099393229999999999, 2024-09-11T05:33:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339087+0000", 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339087+0000", 2024-09-11T05:33:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339088+0000", 2024-09-11T05:33:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8800000000000002e-07 2024-09-11T05:33:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339093+0000", 2024-09-11T05:33:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4050000000000002e-06 2024-09-11T05:33:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339101+0000", 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1440000000000003e-06 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.339106+0000", 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949999999999997e-06 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.344476+0000", 2024-09-11T05:33:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053700060000000001 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.344562+0000", 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5947999999999998e-05 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.344947+0000", 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038467900000000002 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.347239+0000", 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022924220000000001 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.348928+0000", 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016882139999999999 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.348983+0000", 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5214999999999999e-05 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.349027+0000", 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3906999999999998e-05 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1082 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.345226+0000", 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5707488930000002, 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057925600000000004, 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1082 2024-09-11T05:33:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345226+0000", 2024-09-11T05:33:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345226+0000", 2024-09-11T05:33:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345227+0000", 2024-09-11T05:33:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-11T05:33:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345238+0000", 2024-09-11T05:33:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1014e-05 2024-09-11T05:33:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345247+0000", 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9709999999999993e-06 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.345252+0000", 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8160000000000001e-06 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.348110+0000", 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028583609999999998 2024-09-11T05:33:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.348184+0000", 2024-09-11T05:33:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3736e-05 2024-09-11T05:33:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.348549+0000", 2024-09-11T05:33:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036567099999999998 2024-09-11T05:33:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.349384+0000", 2024-09-11T05:33:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083454500000000001 2024-09-11T05:33:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.350918+0000", 2024-09-11T05:33:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001533864 2024-09-11T05:33:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.350975+0000", 2024-09-11T05:33:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7698000000000002e-05 2024-09-11T05:33:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.351018+0000", 2024-09-11T05:33:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3013999999999998e-05 2024-09-11T05:33:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1373 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:33:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.706617+0000", 2024-09-11T05:33:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.2093574379999996, 2024-09-11T05:33:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079570370000000001, 2024-09-11T05:33:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1373 2024-09-11T05:33:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706617+0000", 2024-09-11T05:33:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706617+0000", 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706618+0000", 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706620+0000", 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.553e-06 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706626+0000", 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9529999999999996e-06 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706631+0000", 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6380000000000003e-06 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.711085+0000", 2024-09-11T05:33:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044538099999999999 2024-09-11T05:33:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.711159+0000", 2024-09-11T05:33:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4666000000000006e-05 2024-09-11T05:33:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.711396+0000", 2024-09-11T05:33:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023713799999999999 2024-09-11T05:33:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.713735+0000", 2024-09-11T05:33:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002338311 2024-09-11T05:33:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.714475+0000", 2024-09-11T05:33:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074071100000000002 2024-09-11T05:33:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.714531+0000", 2024-09-11T05:33:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5256000000000001e-05 2024-09-11T05:33:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.714574+0000", 2024-09-11T05:33:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3643999999999998e-05 2024-09-11T05:33:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1374 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:33:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.706637+0000", 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.2093381519999999, 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086365460000000002, 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1374 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706637+0000", 2024-09-11T05:33:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706637+0000", 2024-09-11T05:33:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706637+0000", 2024-09-11T05:33:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.15e-07 2024-09-11T05:33:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706639+0000", 2024-09-11T05:33:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5299999999999999e-06 2024-09-11T05:33:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706646+0000", 2024-09-11T05:33:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4180000000000002e-06 2024-09-11T05:33:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706652+0000", 2024-09-11T05:33:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0499999999999997e-06 2024-09-11T05:33:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.712057+0000", 2024-09-11T05:33:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054051079999999996 2024-09-11T05:33:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.712134+0000", 2024-09-11T05:33:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6555000000000001e-05 2024-09-11T05:33:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.712453+0000", 2024-09-11T05:33:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031981799999999998 2024-09-11T05:33:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.714585+0000", 2024-09-11T05:33:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021312810000000001 2024-09-11T05:33:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715204+0000", 2024-09-11T05:33:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00061970700000000005 2024-09-11T05:33:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715236+0000", 2024-09-11T05:33:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.163e-05 2024-09-11T05:33:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715273+0000", 2024-09-11T05:33:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7134000000000001e-05 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:1375 3.13 3:cc02e7d6:::rbd_object_map.112da50123d8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:01.706660+0000", 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.209314966, 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087440590000000002, 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1375 2024-09-11T05:33:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706660+0000", 2024-09-11T05:33:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706660+0000", 2024-09-11T05:33:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706660+0000", 2024-09-11T05:33:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:33:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706663+0000", 2024-09-11T05:33:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6769999999999999e-06 2024-09-11T05:33:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706669+0000", 2024-09-11T05:33:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1820000000000003e-06 2024-09-11T05:33:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.706674+0000", 2024-09-11T05:33:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1209999999999998e-06 2024-09-11T05:33:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.712940+0000", 2024-09-11T05:33:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006265372 2024-09-11T05:33:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.713020+0000", 2024-09-11T05:33:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0606999999999996e-05 2024-09-11T05:33:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T05:33:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.713326+0000", 2024-09-11T05:33:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000306044 2024-09-11T05:33:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715284+0000", 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001957631 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715324+0000", 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0108999999999998e-05 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715371+0000", 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7491000000000003e-05 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:06.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:01.715404+0000", 2024-09-11T05:33:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-11T05:33:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:06.044 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:06.044 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:06.045 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:06.046 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:06.048 INFO:teuthology.orchestra.run.smithi070.stdout:1167 trunc from 0xcd2284d to 0x47b0127 2024-09-11T05:33:06.048 INFO:teuthology.orchestra.run.smithi070.stdout:1168 punch from 0x20c1398 to 0x20c8d2f, (0x7997 bytes) 2024-09-11T05:33:06.048 INFO:teuthology.orchestra.run.smithi070.stdout:1169 write 0x696abd4 thru 0x6979884 (0xecb1 bytes) 2024-09-11T05:33:06.048 INFO:teuthology.orchestra.run.smithi070.stdout:1171 read 0x5e3a719 thru 0x5e46c04 (0xc4ec bytes) 2024-09-11T05:33:06.048 INFO:teuthology.orchestra.run.smithi070.stdout:1172 trunc from 0x6979885 to 0x7c582c6 2024-09-11T05:33:06.048 INFO:teuthology.orchestra.run.smithi070.stdout:1173 trunc from 0x7c582c6 to 0x4a9c1cb 2024-09-11T05:33:06.049 INFO:teuthology.orchestra.run.smithi070.stdout:1174 writesame 0x8863338 thru 0x886bea3 data_size 0x2(0x8b6c bytes) 2024-09-11T05:33:06.049 INFO:teuthology.orchestra.run.smithi070.stdout:1175 read 0x373fdc3 thru 0x37437e7 (0x3a25 bytes) 2024-09-11T05:33:06.049 INFO:teuthology.orchestra.run.smithi070.stdout:1177 read 0x6addc44 thru 0x6ae7c3f (0x9ffc bytes) 2024-09-11T05:33:06.049 INFO:teuthology.orchestra.run.smithi070.stdout:1178 read 0x21e04b4 thru 0x21e5d59 (0x58a6 bytes) 2024-09-11T05:33:06.049 INFO:teuthology.orchestra.run.smithi070.stdout:1180 write 0x37218fd thru 0x372e112 (0xc816 bytes) 2024-09-11T05:33:06.049 INFO:teuthology.orchestra.run.smithi070.stdout:1181 read 0x3eddd25 thru 0x3eeda23 (0xfcff bytes) 2024-09-11T05:33:06.049 INFO:teuthology.orchestra.run.smithi070.stdout:1182 write 0x37e7be1 thru 0x37f0f98 (0x93b8 bytes) 2024-09-11T05:33:06.049 INFO:teuthology.orchestra.run.smithi070.stdout:1183 write 0xc920d40 thru 0xc92d7ac (0xca6d bytes) 2024-09-11T05:33:06.049 INFO:teuthology.orchestra.run.smithi070.stdout:1184 read 0x9bef688 thru 0x9bf9c43 (0xa5bc bytes) 2024-09-11T05:33:06.049 INFO:teuthology.orchestra.run.smithi070.stdout:1185 trunc from 0xc92d7ad to 0x41bb4af 2024-09-11T05:33:06.049 INFO:teuthology.orchestra.run.smithi070.stdout:1187 clone 5 order 24 su 65536 sc 13 2024-09-11T05:33:06.050 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:06.045+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:06.146 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:06.146+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:06.152 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:06.153 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:06.161 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:06.247 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:06.246+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:06.303 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:06.303 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:06.312 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:06.348 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:06.348+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:06.413 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:33:06.413 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:06.421 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:06.465 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:06.465+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:06.524 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:06.524 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:06.532 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:06.573 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:06.573+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:06.650 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:06.650+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:06.666 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:33:06.666 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:33:06.666 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-11T05:33:06.666 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T05:33:06.666 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T05:33:06.667 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-11T05:33:06.667 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T05:33:06.676 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:06.676 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:06.685 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:06.751 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:06.750+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:06.772 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T05:33:06.773 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:06.802 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-11T05:33:06.812 INFO:teuthology.orchestra.run.smithi070.stdout:1188 trunc from 0x41bb4af to 0x8f8cfde 2024-09-11T05:33:06.821 INFO:teuthology.orchestra.run.smithi070.stdout:1189 read 0x206171f thru 0x206ec85 (0xd567 bytes) 2024-09-11T05:33:06.821 INFO:teuthology.orchestra.run.smithi070.stdout:1190 write 0x72bb16c thru 0x72c212f (0x6fc4 bytes) 2024-09-11T05:33:06.837 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:67 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'41, mlcod=16'39)", 2024-09-11T05:33:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.610267+0000", 2024-09-11T05:33:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.224668204, 2024-09-11T05:33:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0045575110000000002, 2024-09-11T05:33:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610267+0000", 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610267+0000", 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610268+0000", 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5600000000000005e-07 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610272+0000", 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.143e-06 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610281+0000", 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.3950000000000007e-06 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610288+0000", 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2929999999999997e-06 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610329+0000", 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1140999999999998e-05 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610347+0000", 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8518000000000001e-05 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.614798+0000", 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.004450374 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.614825+0000", 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6991e-05 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-11T05:33:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.610837+0000", 2024-09-11T05:33:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.224098986000001, 2024-09-11T05:33:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0059650909999999996, 2024-09-11T05:33:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610837+0000", 2024-09-11T05:33:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610837+0000", 2024-09-11T05:33:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610837+0000", 2024-09-11T05:33:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1099999999999995e-07 2024-09-11T05:33:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610843+0000", 2024-09-11T05:33:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.699e-06 2024-09-11T05:33:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610854+0000", 2024-09-11T05:33:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1188e-05 2024-09-11T05:33:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610859+0000", 2024-09-11T05:33:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9749999999999998e-06 2024-09-11T05:33:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.613785+0000", 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002925881 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.613811+0000", 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5965e-05 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.616750+0000", 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029392680000000001 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.616802+0000", 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1403999999999998e-05 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.611420+0000", 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.223515877000001, 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0084477409999999999, 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.611420+0000", 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.611420+0000", 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.611420+0000", 2024-09-11T05:33:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.92e-07 2024-09-11T05:33:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.611451+0000", 2024-09-11T05:33:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0154999999999998e-05 2024-09-11T05:33:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.611462+0000", 2024-09-11T05:33:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1466e-05 2024-09-11T05:33:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.611467+0000", 2024-09-11T05:33:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.938e-06 2024-09-11T05:33:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.614073+0000", 2024-09-11T05:33:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026055990000000001 2024-09-11T05:33:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.614091+0000", 2024-09-11T05:33:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8813000000000001e-05 2024-09-11T05:33:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.619835+0000", 2024-09-11T05:33:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005743494 2024-09-11T05:33:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.619867+0000", 2024-09-11T05:33:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2484000000000003e-05 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=16'39)", 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.612107+0000", 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.222828298, 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0077767390000000004, 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.612107+0000", 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.612107+0000", 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.612108+0000", 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9200000000000001e-07 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.612112+0000", 2024-09-11T05:33:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:33:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.612120+0000", 2024-09-11T05:33:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4819999999999997e-06 2024-09-11T05:33:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.612124+0000", 2024-09-11T05:33:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8330000000000004e-06 2024-09-11T05:33:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.614593+0000", 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0024693509999999998 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.614607+0000", 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.4462e-05 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.619869+0000", 2024-09-11T05:33:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052615140000000001 2024-09-11T05:33:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.619884+0000", 2024-09-11T05:33:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5098e-05 2024-09-11T05:33:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:73 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'47, mlcod=16'43)", 2024-09-11T05:33:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.621971+0000", 2024-09-11T05:33:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.212964210999999, 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0059640919999999998, 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.621971+0000", 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.621971+0000", 2024-09-11T05:33:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.621972+0000", 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622032+0000", 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0577e-05 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622039+0000", 2024-09-11T05:33:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1849999999999998e-06 2024-09-11T05:33:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622045+0000", 2024-09-11T05:33:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6200000000000004e-06 2024-09-11T05:33:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622101+0000", 2024-09-11T05:33:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6039000000000003e-05 2024-09-11T05:33:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622118+0000", 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.732e-05 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.627906+0000", 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0057875269999999998 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.627935+0000", 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9383e-05 2024-09-11T05:33:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:74 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'48, mlcod=16'43)", 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.622476+0000", 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.212459406000001, 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054752780000000001, 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622476+0000", 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622476+0000", 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622477+0000", 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1999999999999999e-07 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622481+0000", 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3919999999999996e-06 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622496+0000", 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5237e-05 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622502+0000", 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6509999999999998e-06 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622535+0000", 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3243e-05 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622548+0000", 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2662e-05 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.627937+0000", 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0053892230000000003 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.627951+0000", 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.4250000000000001e-05 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:89 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'59, mlcod=16'57)", 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.640021+0000", 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.194914109999999, 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.004429395, 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640021+0000", 2024-09-11T05:33:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640021+0000", 2024-09-11T05:33:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640022+0000", 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7000000000000004e-07 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640076+0000", 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3959999999999998e-05 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640088+0000", 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1715999999999999e-05 2024-09-11T05:33:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640093+0000", 2024-09-11T05:33:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1710000000000001e-06 2024-09-11T05:33:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640168+0000", 2024-09-11T05:33:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5518000000000004e-05 2024-09-11T05:33:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640189+0000", 2024-09-11T05:33:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0941000000000002e-05 2024-09-11T05:33:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.644416+0000", 2024-09-11T05:33:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0042268990000000001 2024-09-11T05:33:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.644451+0000", 2024-09-11T05:33:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4520000000000002e-05 2024-09-11T05:33:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:90 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'60, mlcod=16'57)", 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.640363+0000", 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.194572017999999, 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0042560469999999998, 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640363+0000", 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640363+0000", 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640364+0000", 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.51e-07 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640439+0000", 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5300000000000001e-05 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640449+0000", 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9669999999999996e-06 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640470+0000", 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0968e-05 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640521+0000", 2024-09-11T05:33:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0458999999999999e-05 2024-09-11T05:33:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.640532+0000", 2024-09-11T05:33:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1229999999999999e-05 2024-09-11T05:33:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.644603+0000", 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0040712220000000002 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.644620+0000", 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6350000000000001e-05 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:115 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'77, mlcod=16'73)", 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.849560+0000", 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 26.985375087000001, 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050404550000000001, 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849560+0000", 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849560+0000", 2024-09-11T05:33:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849561+0000", 2024-09-11T05:33:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0800000000000005e-07 2024-09-11T05:33:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849631+0000", 2024-09-11T05:33:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9684000000000006e-05 2024-09-11T05:33:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849640+0000", 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849646+0000", 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7450000000000001e-06 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849678+0000", 2024-09-11T05:33:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1980999999999998e-05 2024-09-11T05:33:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849691+0000", 2024-09-11T05:33:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2547e-05 2024-09-11T05:33:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.854551+0000", 2024-09-11T05:33:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0048601429999999999 2024-09-11T05:33:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.854601+0000", 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0077000000000002e-05 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:116 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'78, mlcod=16'73)", 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.849972+0000", 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 26.984963393000001, 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0075296679999999998, 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849972+0000", 2024-09-11T05:33:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849972+0000", 2024-09-11T05:33:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849975+0000", 2024-09-11T05:33:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:33:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849979+0000", 2024-09-11T05:33:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:33:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849986+0000", 2024-09-11T05:33:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8480000000000003e-06 2024-09-11T05:33:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849993+0000", 2024-09-11T05:33:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1570000000000003e-06 2024-09-11T05:33:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850026+0000", 2024-09-11T05:33:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2719000000000003e-05 2024-09-11T05:33:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850035+0000", 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6819999999999998e-06 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.857463+0000", 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0074274349999999996 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.857502+0000", 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9045999999999999e-05 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:117 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'79, mlcod=16'75)", 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.850622+0000", 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 26.984313834000002, 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0068985990000000001, 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850622+0000", 2024-09-11T05:33:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850622+0000", 2024-09-11T05:33:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850622+0000", 2024-09-11T05:33:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.63e-07 2024-09-11T05:33:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850626+0000", 2024-09-11T05:33:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5829999999999998e-06 2024-09-11T05:33:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850633+0000", 2024-09-11T05:33:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.075e-06 2024-09-11T05:33:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850638+0000", 2024-09-11T05:33:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2009999999999998e-06 2024-09-11T05:33:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850671+0000", 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2758e-05 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850684+0000", 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3611000000000001e-05 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.857504+0000", 2024-09-11T05:33:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0068197379999999997 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.857520+0000", 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6169999999999999e-05 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:666 3.0 3:05ba09ea:::rbd_data.112da50123d8.0000000000000006:head [stat,truncate 7864320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:00.919688+0000", 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.9152474030000004, 2024-09-11T05:33:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0070816619999999999, 2024-09-11T05:33:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 666 2024-09-11T05:33:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919688+0000", 2024-09-11T05:33:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919688+0000", 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919690+0000", 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9970000000000001e-06 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919700+0000", 2024-09-11T05:33:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.8789999999999998e-06 2024-09-11T05:33:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919732+0000", 2024-09-11T05:33:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2064000000000003e-05 2024-09-11T05:33:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919754+0000", 2024-09-11T05:33:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2172e-05 2024-09-11T05:33:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919902+0000", 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014731100000000001 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920029+0000", 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012731299999999999 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 7", 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920155+0000", 2024-09-11T05:33:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012596800000000001 2024-09-11T05:33:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920915+0000", 2024-09-11T05:33:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00075980999999999998 2024-09-11T05:33:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926707+0000", 2024-09-11T05:33:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0057919399999999998 2024-09-11T05:33:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926737+0000", 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0156999999999999e-05 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926770+0000", 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3050999999999999e-05 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:672 3.10 e26/22 3:090f802f:::rbd_data.112da50123d8.000000000000000c:head v 26'2, mlcod=0'0)", 2024-09-11T05:33:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:00.920674+0000", 2024-09-11T05:33:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.9142611570000003, 2024-09-11T05:33:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0058441830000000002, 2024-09-11T05:33:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920674+0000", 2024-09-11T05:33:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920674+0000", 2024-09-11T05:33:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920675+0000", 2024-09-11T05:33:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0999999999999997e-07 2024-09-11T05:33:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920681+0000", 2024-09-11T05:33:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1190000000000002e-06 2024-09-11T05:33:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920695+0000", 2024-09-11T05:33:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3335e-05 2024-09-11T05:33:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920705+0000", 2024-09-11T05:33:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0608000000000001e-05 2024-09-11T05:33:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920753+0000", 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8269999999999997e-05 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920772+0000", 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8725000000000001e-05 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926426+0000", 2024-09-11T05:33:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0056539729999999996 2024-09-11T05:33:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926519+0000", 2024-09-11T05:33:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2342999999999993e-05 2024-09-11T05:33:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:875 3.0 3:05ba09ea:::rbd_data.112da50123d8.0000000000000006:head [stat,truncate 1572864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.099085+0000", 2024-09-11T05:33:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.7358508329999998, 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0043194050000000001, 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 875 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099085+0000", 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099085+0000", 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099085+0000", 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8000000000000005e-07 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099089+0000", 2024-09-11T05:33:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.805e-06 2024-09-11T05:33:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099101+0000", 2024-09-11T05:33:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1409e-05 2024-09-11T05:33:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099107+0000", 2024-09-11T05:33:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6950000000000003e-06 2024-09-11T05:33:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099173+0000", 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5949000000000002e-05 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099248+0000", 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4966e-05 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 7", 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099373+0000", 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000124838 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099918+0000", 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000544992 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.103337+0000", 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00341873 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.103379+0000", 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2094000000000001e-05 2024-09-11T05:33:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.103404+0000", 2024-09-11T05:33:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5147000000000002e-05 2024-09-11T05:33:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:937 3.17 3:eff84ccf:::rbd_data.112da50123d8.000000000000000a:head [stat,truncate 2621440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.175032+0000", 2024-09-11T05:33:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.6599033600000004, 2024-09-11T05:33:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054180670000000004, 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 937 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175032+0000", 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175032+0000", 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175033+0000", 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5799999999999998e-07 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175037+0000", 2024-09-11T05:33:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8739999999999997e-06 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175047+0000", 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0196e-05 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175054+0000", 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3100000000000003e-06 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175108+0000", 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3321e-05 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175184+0000", 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6465999999999996e-05 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175336+0000", 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015205199999999999 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.176676+0000", 2024-09-11T05:33:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0013399449999999999 2024-09-11T05:33:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180391+0000", 2024-09-11T05:33:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0037146979999999998 2024-09-11T05:33:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180425+0000", 2024-09-11T05:33:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3915000000000003e-05 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180450+0000", 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5432e-05 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1041 3.0 3:05ba09ea:::rbd_data.112da50123d8.0000000000000006:head [stat,truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.326195+0000", 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.50874095, 2024-09-11T05:33:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0039864729999999999, 2024-09-11T05:33:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1041 2024-09-11T05:33:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326195+0000", 2024-09-11T05:33:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326195+0000", 2024-09-11T05:33:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326196+0000", 2024-09-11T05:33:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.7120000000000001e-06 2024-09-11T05:33:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326202+0000", 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2700000000000004e-06 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326215+0000", 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3658999999999999e-05 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326223+0000", 2024-09-11T05:33:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5360000000000004e-06 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326299+0000", 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6765000000000001e-05 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326381+0000", 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1205000000000006e-05 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 7", 2024-09-11T05:33:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326519+0000", 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013814 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.327017+0000", 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00049787200000000001 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.330090+0000", 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0030729970000000001 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.330141+0000", 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1437999999999998e-05 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.330181+0000", 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9879000000000002e-05 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1716 3.18 3:1decd148:::rbd_data.112d83e8b99.0000000000000014:head [stat,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.722246+0000", 2024-09-11T05:33:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.1126892929999999, 2024-09-11T05:33:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0048678979999999998, 2024-09-11T05:33:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1716 2024-09-11T05:33:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722246+0000", 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722246+0000", 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722247+0000", 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0780000000000001e-06 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722252+0000", 2024-09-11T05:33:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4739999999999999e-06 2024-09-11T05:33:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722263+0000", 2024-09-11T05:33:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1443e-05 2024-09-11T05:33:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722270+0000", 2024-09-11T05:33:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722325+0000", 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5096999999999998e-05 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722412+0000", 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6785000000000003e-05 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.727114+0000", 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0047024620000000001 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1722 3.1f 3:f9530b1a:::rbd_data.112d83e8b99.0000000000000011:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.722714+0000", 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.1122214489999998, 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0042824200000000003, 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1722 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722714+0000", 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722714+0000", 2024-09-11T05:33:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722715+0000", 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5799999999999998e-07 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722719+0000", 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.233e-06 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722731+0000", 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2242000000000001e-05 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722739+0000", 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6550000000000004e-06 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722792+0000", 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3029999999999999e-05 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722874+0000", 2024-09-11T05:33:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2311999999999994e-05 2024-09-11T05:33:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:33:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723094+0000", 2024-09-11T05:33:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00021956300000000001 2024-09-11T05:33:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723902+0000", 2024-09-11T05:33:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00080805000000000004 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726890+0000", 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002988203 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726948+0000", 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7334999999999999e-05 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726996+0000", 2024-09-11T05:33:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8939e-05 2024-09-11T05:33:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:1719 3.1a e28/22 3:5c2bb9c3:::rbd_data.112d83e8b99.000000000000000a:head v 28'4, mlcod=25'2)", 2024-09-11T05:33:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.722768+0000", 2024-09-11T05:33:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.112167393, 2024-09-11T05:33:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0041120330000000002, 2024-09-11T05:33:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722768+0000", 2024-09-11T05:33:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722768+0000", 2024-09-11T05:33:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722769+0000", 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9299999999999997e-07 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722776+0000", 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7959999999999998e-06 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722786+0000", 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0013999999999999e-05 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722792+0000", 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3770000000000001e-06 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722849+0000", 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7352000000000002e-05 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722876+0000", 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6730999999999999e-05 2024-09-11T05:33:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726830+0000", 2024-09-11T05:33:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0039539099999999997 2024-09-11T05:33:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726880+0000", 2024-09-11T05:33:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0059999999999998e-05 2024-09-11T05:33:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1740 3.18 3:1decd148:::rbd_data.112d83e8b99.0000000000000014:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.728087+0000", 2024-09-11T05:33:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.1068480630000002, 2024-09-11T05:33:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049178420000000004, 2024-09-11T05:33:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1740 2024-09-11T05:33:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728087+0000", 2024-09-11T05:33:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728087+0000", 2024-09-11T05:33:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728088+0000", 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.06e-07 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728093+0000", 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6580000000000001e-06 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728101+0000", 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3620000000000006e-06 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728106+0000", 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.369e-06 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728140+0000", 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4076999999999999e-05 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728186+0000", 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6786999999999998e-05 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728303+0000", 2024-09-11T05:33:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000116902 2024-09-11T05:33:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728784+0000", 2024-09-11T05:33:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00048103700000000002 2024-09-11T05:33:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732947+0000", 2024-09-11T05:33:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.004162692 2024-09-11T05:33:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732981+0000", 2024-09-11T05:33:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3949000000000003e-05 2024-09-11T05:33:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.733005+0000", 2024-09-11T05:33:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4303000000000001e-05 2024-09-11T05:33:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:06.938 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:06.940 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:06.941 INFO:teuthology.orchestra.run.smithi070.stdout:1191 write 0xbe6618d thru 0xbe6f754 (0x95c8 bytes) 2024-09-11T05:33:06.941 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:06.941 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:06.941 INFO:teuthology.orchestra.run.smithi070.stdout:1194 write 0x36657f4 thru 0x3665cbc (0x4c9 bytes) 2024-09-11T05:33:06.941 INFO:teuthology.orchestra.run.smithi070.stdout:1195 write 0x912641 thru 0x92016f (0xdb2f bytes) 2024-09-11T05:33:06.941 INFO:teuthology.orchestra.run.smithi070.stdout:1196 trunc from 0xbe6f755 to 0x1be07e2 2024-09-11T05:33:06.941 INFO:teuthology.orchestra.run.smithi070.stdout:1197 writesame 0x2d42654 thru 0x2d5011e data_size 0x1(0xdacb bytes) 2024-09-11T05:33:06.941 INFO:teuthology.orchestra.run.smithi070.stdout:1199 read 0x17dca6a thru 0x17ea3bb (0xd952 bytes) 2024-09-11T05:33:06.941 INFO:teuthology.orchestra.run.smithi070.stdout:1200 punch from 0x151236d to 0x151440c, (0x209f bytes) 2024-09-11T05:33:06.941 INFO:teuthology.orchestra.run.smithi070.stdout:1201 read 0x183132f thru 0x1834013 (0x2ce5 bytes) 2024-09-11T05:33:06.942 INFO:teuthology.orchestra.run.smithi070.stdout:1202 writesame 0xd2fc7e0 thru 0xd30c557 data_size 0x4(0xfd78 bytes) 2024-09-11T05:33:06.942 INFO:teuthology.orchestra.run.smithi070.stdout:1203 write 0x9e67913 thru 0x9e73923 (0xc011 bytes) 2024-09-11T05:33:06.942 INFO:teuthology.orchestra.run.smithi070.stdout:1204 punch from 0xa6e83dc to 0xa6ea50c, (0x2130 bytes) 2024-09-11T05:33:06.942 INFO:teuthology.orchestra.run.smithi070.stdout:1206 write 0xe02e43a thru 0xe0302fe (0x1ec5 bytes) 2024-09-11T05:33:06.942 INFO:teuthology.orchestra.run.smithi070.stdout:1208 writesame 0x6a13222 thru 0x6a1f042 data_size 0x1(0xbe21 bytes) 2024-09-11T05:33:06.942 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:06.938+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:06.948 INFO:teuthology.orchestra.run.smithi070.stdout:1209 clone 6 order 20 su 8192 sc 4 2024-09-11T05:33:07.039 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:07.039+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:07.043 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:07.044 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:07.044 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:07.044 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:07.052 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:07.140 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:07.139+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:07.194 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:07.194 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:07.194 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:07.194 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:07.194 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:07.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:07.241 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:07.241+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:07.308 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:07.308 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:07.308 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:07.308 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:07.308 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.308 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:667 3.4 3:22b6acf1:::rbd_data.112da50123d8.0000000000000007:head [stat,truncate 7864320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:00.919693+0000", 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 6.3870484510000001, 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0039871539999999997, 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 667 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.309 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919693+0000", 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919693+0000", 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919695+0000", 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.7370000000000001e-06 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.310 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919706+0000", 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0530000000000001e-05 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919733+0000", 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7103000000000001e-05 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919746+0000", 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3223e-05 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919908+0000", 2024-09-11T05:33:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016242399999999999 2024-09-11T05:33:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920015+0000", 2024-09-11T05:33:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000106764 2024-09-11T05:33:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920117+0000", 2024-09-11T05:33:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000102231 2024-09-11T05:33:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920835+0000", 2024-09-11T05:33:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00071793699999999998 2024-09-11T05:33:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.923617+0000", 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0027821719999999999 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.923655+0000", 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7342000000000003e-05 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.923680+0000", 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5690999999999998e-05 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:876 3.4 3:22b6acf1:::rbd_data.112da50123d8.0000000000000007:head [stat,truncate 1273818] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.099122+0000", 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 6.2076196350000004, 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0040213389999999996, 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 876 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099122+0000", 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099122+0000", 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099123+0000", 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4899999999999995e-07 2024-09-11T05:33:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099125+0000", 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099133+0000", 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4610000000000002e-06 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099138+0000", 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4539999999999998e-06 2024-09-11T05:33:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099192+0000", 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3789000000000003e-05 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099267+0000", 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5377999999999996e-05 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099408+0000", 2024-09-11T05:33:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014016000000000001 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100505+0000", 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0010972309999999999 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.103058+0000", 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025533510000000001 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.103104+0000", 2024-09-11T05:33:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6031e-05 2024-09-11T05:33:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.103143+0000", 2024-09-11T05:33:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.926e-05 2024-09-11T05:33:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:934 3.4 3:22b6acf1:::rbd_data.112da50123d8.0000000000000007:head [stat,truncate 2621440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.174370+0000", 2024-09-11T05:33:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 6.1323721869999996, 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0035831130000000002, 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 934 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174370+0000", 2024-09-11T05:33:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174370+0000", 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174370+0000", 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9699999999999996e-07 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174374+0000", 2024-09-11T05:33:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4690000000000002e-06 2024-09-11T05:33:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174381+0000", 2024-09-11T05:33:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6569999999999997e-06 2024-09-11T05:33:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174387+0000", 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6269999999999997e-06 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174451+0000", 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3715999999999998e-05 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174509+0000", 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7896000000000003e-05 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174582+0000", 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3097999999999997e-05 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175326+0000", 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00074403000000000002 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.177860+0000", 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025341640000000002 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.177913+0000", 2024-09-11T05:33:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3081999999999998e-05 2024-09-11T05:33:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.177953+0000", 2024-09-11T05:33:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9777000000000002e-05 2024-09-11T05:33:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:938 3.15 e26/22 3:ab6ce323:::rbd_data.112da50123d8.000000000000000b:head v 26'13, mlcod=26'11)", 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.175480+0000", 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 6.1312613999999996, 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005063812, 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175480+0000", 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175480+0000", 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175481+0000", 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0299999999999998e-07 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175493+0000", 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2079000000000001e-05 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175503+0000", 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9170000000000001e-06 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175508+0000", 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6600000000000003e-06 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175546+0000", 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8043999999999997e-05 2024-09-11T05:33:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175566+0000", 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.067e-05 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180516+0000", 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049498110000000001 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180544+0000", 2024-09-11T05:33:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7928000000000001e-05 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1042 3.4 3:22b6acf1:::rbd_data.112da50123d8.0000000000000007:head [stat,truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.326274+0000", 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.9804673380000004, 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038336149999999999, 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1042 2024-09-11T05:33:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326274+0000", 2024-09-11T05:33:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326274+0000", 2024-09-11T05:33:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326275+0000", 2024-09-11T05:33:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8400000000000004e-07 2024-09-11T05:33:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326278+0000", 2024-09-11T05:33:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9100000000000001e-06 2024-09-11T05:33:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326286+0000", 2024-09-11T05:33:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8299999999999996e-06 2024-09-11T05:33:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326293+0000", 2024-09-11T05:33:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9199999999999998e-06 2024-09-11T05:33:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326344+0000", 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1394000000000003e-05 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326426+0000", 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1984999999999995e-05 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326564+0000", 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013788900000000001 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.329801+0000", 2024-09-11T05:33:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003237275 2024-09-11T05:33:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.330049+0000", 2024-09-11T05:33:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00024757700000000002 2024-09-11T05:33:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.330085+0000", 2024-09-11T05:33:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6220999999999998e-05 2024-09-11T05:33:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.330108+0000", 2024-09-11T05:33:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3030000000000001e-05 2024-09-11T05:33:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:1703 3.15 e28/22 3:aa18e722:::rbd_data.112d83e8b99.000000000000000d:head v 28'19, mlcod=26'16)", 2024-09-11T05:33:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.720457+0000", 2024-09-11T05:33:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5862847589999998, 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003646556, 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720457+0000", 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720457+0000", 2024-09-11T05:33:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720457+0000", 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9700000000000003e-07 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720472+0000", 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.4932999999999999e-05 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720479+0000", 2024-09-11T05:33:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2599999999999999e-06 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720492+0000", 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2269999999999999e-05 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720543+0000", 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0862000000000002e-05 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720564+0000", 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1169999999999999e-05 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.724063+0000", 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0034994399999999999 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.724104+0000", 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0324000000000002e-05 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "pg_update_log_missing(3.15 epoch 28/22 rep_tid 131 entries 28'20 (0'0) error 3:ae0819f0:::rbd_data.112d83e8b99.000000000000000e:head by client.4397.0:1704 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 26'16)", 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.721408+0000", 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5853337820000002, 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054215289999999996, 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721408+0000", 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721408+0000", 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721409+0000", 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3099999999999997e-07 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721415+0000", 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2299999999999996e-06 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721429+0000", 2024-09-11T05:33:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3679999999999999e-05 2024-09-11T05:33:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721436+0000", 2024-09-11T05:33:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7419999999999997e-06 2024-09-11T05:33:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721503+0000", 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6948999999999999e-05 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726829+0000", 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0053262969999999998 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1709 3.12 3:4a093325:::rbd_data.112d83e8b99.0000000000000013:head [stat,delete] snapc 5=[5] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.721527+0000", 2024-09-11T05:33:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5852150570000001, 2024-09-11T05:33:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0055917620000000001, 2024-09-11T05:33:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1709 2024-09-11T05:33:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721527+0000", 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721527+0000", 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721527+0000", 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0900000000000002e-07 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721530+0000", 2024-09-11T05:33:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.367e-06 2024-09-11T05:33:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721536+0000", 2024-09-11T05:33:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4620000000000001e-06 2024-09-11T05:33:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721542+0000", 2024-09-11T05:33:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0820000000000004e-06 2024-09-11T05:33:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721591+0000", 2024-09-11T05:33:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9227000000000001e-05 2024-09-11T05:33:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721706+0000", 2024-09-11T05:33:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000114768 2024-09-11T05:33:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.727118+0000", 2024-09-11T05:33:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054123469999999996 2024-09-11T05:33:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1710 3.4 3:205bf505:::rbd_header.112d83e8b99:head [watch reconnect cookie 140342620614448 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.721554+0000", 2024-09-11T05:33:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5851880730000003, 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054143619999999998, 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1710 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721554+0000", 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721554+0000", 2024-09-11T05:33:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721554+0000", 2024-09-11T05:33:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6199999999999998e-07 2024-09-11T05:33:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721556+0000", 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1840000000000002e-06 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721563+0000", 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.353e-06 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721568+0000", 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9660000000000004e-06 2024-09-11T05:33:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721615+0000", 2024-09-11T05:33:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7685999999999997e-05 2024-09-11T05:33:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721686+0000", 2024-09-11T05:33:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0667999999999995e-05 2024-09-11T05:33:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726968+0000", 2024-09-11T05:33:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052820430000000002 2024-09-11T05:33:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1720 3.7 3:e3c45f22:::rbd_data.112d83e8b99.0000000000000012:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.722467+0000", 2024-09-11T05:33:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5842747690000003, 2024-09-11T05:33:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0045417280000000001, 2024-09-11T05:33:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1720 2024-09-11T05:33:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722467+0000", 2024-09-11T05:33:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722467+0000", 2024-09-11T05:33:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722468+0000", 2024-09-11T05:33:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5499999999999996e-07 2024-09-11T05:33:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722474+0000", 2024-09-11T05:33:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7450000000000001e-06 2024-09-11T05:33:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722490+0000", 2024-09-11T05:33:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6515999999999999e-05 2024-09-11T05:33:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722498+0000", 2024-09-11T05:33:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6769999999999995e-06 2024-09-11T05:33:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722561+0000", 2024-09-11T05:33:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3295999999999998e-05 2024-09-11T05:33:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722643+0000", 2024-09-11T05:33:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1662000000000005e-05 2024-09-11T05:33:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:33:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722809+0000", 2024-09-11T05:33:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016574499999999999 2024-09-11T05:33:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723654+0000", 2024-09-11T05:33:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00084562299999999999 2024-09-11T05:33:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726920+0000", 2024-09-11T05:33:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032656569999999999 2024-09-11T05:33:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726965+0000", 2024-09-11T05:33:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5633999999999997e-05 2024-09-11T05:33:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.727009+0000", 2024-09-11T05:33:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3217999999999999e-05 2024-09-11T05:33:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "pg_update_log_missing(3.18 epoch 28/22 rep_tid 159 entries 28'5 (0'0) error 3:1decd148:::rbd_data.112d83e8b99.0000000000000014:head by client.4397.0:1716 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 25'3)", 2024-09-11T05:33:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.722601+0000", 2024-09-11T05:33:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5841402550000003, 2024-09-11T05:33:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0042928209999999996, 2024-09-11T05:33:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722601+0000", 2024-09-11T05:33:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722601+0000", 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722602+0000", 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5600000000000005e-07 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722611+0000", 2024-09-11T05:33:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4500000000000004e-06 2024-09-11T05:33:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722631+0000", 2024-09-11T05:33:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9857e-05 2024-09-11T05:33:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722646+0000", 2024-09-11T05:33:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5082999999999999e-05 2024-09-11T05:33:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722712+0000", 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6598000000000002e-05 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726894+0000", 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0041820770000000002 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:1721 3.5 e28/22 3:a0e94ca9:::rbd_data.112d83e8b99.000000000000000b:head v 28'21, mlcod=28'18)", 2024-09-11T05:33:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.723009+0000", 2024-09-11T05:33:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5837327779999999, 2024-09-11T05:33:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003942419, 2024-09-11T05:33:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723009+0000", 2024-09-11T05:33:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723009+0000", 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723010+0000", 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9299999999999997e-07 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723015+0000", 2024-09-11T05:33:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000001e-06 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723025+0000", 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.8120000000000002e-06 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723031+0000", 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1449999999999996e-06 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723073+0000", 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2382000000000002e-05 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723093+0000", 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9967e-05 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726915+0000", 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038216959999999999 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726951+0000", 2024-09-11T05:33:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6334000000000001e-05 2024-09-11T05:33:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1741 3.12 3:4a093325:::rbd_data.112d83e8b99.0000000000000013:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.728162+0000", 2024-09-11T05:33:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5785794490000002, 2024-09-11T05:33:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.004709843, 2024-09-11T05:33:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1741 2024-09-11T05:33:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728162+0000", 2024-09-11T05:33:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728162+0000", 2024-09-11T05:33:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728163+0000", 2024-09-11T05:33:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:33:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728167+0000", 2024-09-11T05:33:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:33:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728176+0000", 2024-09-11T05:33:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9870000000000005e-06 2024-09-11T05:33:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728182+0000", 2024-09-11T05:33:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:33:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728221+0000", 2024-09-11T05:33:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9116999999999998e-05 2024-09-11T05:33:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728269+0000", 2024-09-11T05:33:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7508e-05 2024-09-11T05:33:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728437+0000", 2024-09-11T05:33:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016876 2024-09-11T05:33:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.729189+0000", 2024-09-11T05:33:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00075146900000000005 2024-09-11T05:33:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732814+0000", 2024-09-11T05:33:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003624759 2024-09-11T05:33:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732848+0000", 2024-09-11T05:33:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4347000000000002e-05 2024-09-11T05:33:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732872+0000", 2024-09-11T05:33:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4176999999999999e-05 2024-09-11T05:33:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:1740 3.18 e28/22 3:1decd148:::rbd_data.112d83e8b99.0000000000000014:head v 28'6, mlcod=25'4)", 2024-09-11T05:33:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.728377+0000", 2024-09-11T05:33:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5783643249999999, 2024-09-11T05:33:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.004462756, 2024-09-11T05:33:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728377+0000", 2024-09-11T05:33:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728377+0000", 2024-09-11T05:33:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728378+0000", 2024-09-11T05:33:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4199999999999995e-07 2024-09-11T05:33:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728385+0000", 2024-09-11T05:33:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.528e-06 2024-09-11T05:33:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728396+0000", 2024-09-11T05:33:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1122e-05 2024-09-11T05:33:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728403+0000", 2024-09-11T05:33:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.956e-06 2024-09-11T05:33:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728451+0000", 2024-09-11T05:33:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7862999999999999e-05 2024-09-11T05:33:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728473+0000", 2024-09-11T05:33:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2844999999999999e-05 2024-09-11T05:33:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732801+0000", 2024-09-11T05:33:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0043274280000000004 2024-09-11T05:33:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732840+0000", 2024-09-11T05:33:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9271999999999999e-05 2024-09-11T05:33:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:4286 3.4 3:2325b4aa:::rbd_data.112d517a1288.00000000000000e5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-11T05:33:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:05.611970+0000", 2024-09-11T05:33:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.694771713, 2024-09-11T05:33:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0060933869999999996, 2024-09-11T05:33:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 4286 2024-09-11T05:33:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.611970+0000", 2024-09-11T05:33:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.611970+0000", 2024-09-11T05:33:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.611972+0000", 2024-09-11T05:33:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0260000000000002e-06 2024-09-11T05:33:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.611983+0000", 2024-09-11T05:33:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0607e-05 2024-09-11T05:33:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.612011+0000", 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8546000000000001e-05 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.612025+0000", 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.4136e-05 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.612126+0000", 2024-09-11T05:33:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000100585 2024-09-11T05:33:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:33:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.612136+0000", 2024-09-11T05:33:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.026e-05 2024-09-11T05:33:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.614741+0000", 2024-09-11T05:33:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026046089999999999 2024-09-11T05:33:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.614821+0000", 2024-09-11T05:33:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0107999999999999e-05 2024-09-11T05:33:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.614937+0000", 2024-09-11T05:33:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000115677 2024-09-11T05:33:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.617961+0000", 2024-09-11T05:33:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0030245010000000002 2024-09-11T05:33:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.617976+0000", 2024-09-11T05:33:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5148e-05 2024-09-11T05:33:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.618022+0000", 2024-09-11T05:33:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5469999999999997e-05 2024-09-11T05:33:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.618063+0000", 2024-09-11T05:33:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1714000000000001e-05 2024-09-11T05:33:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:4819 3.1 3:83efb0b6:::rbd_object_map.112deff072db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T05:33:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:06.824907+0000", 2024-09-11T05:33:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.48183494399999999, 2024-09-11T05:33:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0040344489999999998, 2024-09-11T05:33:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 4819 2024-09-11T05:33:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824907+0000", 2024-09-11T05:33:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824907+0000", 2024-09-11T05:33:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824908+0000", 2024-09-11T05:33:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9100000000000002e-07 2024-09-11T05:33:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824915+0000", 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.622e-06 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824924+0000", 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4030000000000007e-06 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824933+0000", 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5219999999999996e-06 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.825290+0000", 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035708099999999998 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.825383+0000", 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2570000000000003e-05 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.825792+0000", 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040932799999999998 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.826503+0000", 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00071069600000000003 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.828843+0000", 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0023399430000000001 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.828900+0000", 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7496e-05 2024-09-11T05:33:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.408 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.408 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.408 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.828941+0000", 2024-09-11T05:33:07.408 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0896999999999998e-05 2024-09-11T05:33:07.408 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.408 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.408 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.408 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.408 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.408 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:5107 3.1 3:83efb0b6:::rbd_object_map.112deff072db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T05:33:07.408 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:06.871712+0000", 2024-09-11T05:33:07.408 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.43502939000000002, 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003679959, 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 5107 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871712+0000", 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.410 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.410 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.410 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871712+0000", 2024-09-11T05:33:07.410 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.410 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.411 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.411 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871713+0000", 2024-09-11T05:33:07.411 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:33:07.411 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.411 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.411 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.411 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871715+0000", 2024-09-11T05:33:07.411 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.872e-06 2024-09-11T05:33:07.411 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.411 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.411 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.411 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871719+0000", 2024-09-11T05:33:07.411 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6059999999999996e-06 2024-09-11T05:33:07.412 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.412 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.412 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.412 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871733+0000", 2024-09-11T05:33:07.412 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3906999999999999e-05 2024-09-11T05:33:07.412 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.412 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.412 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.412 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872996+0000", 2024-09-11T05:33:07.412 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0012628310000000001 2024-09-11T05:33:07.412 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.412 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.412 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.413 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.873047+0000", 2024-09-11T05:33:07.413 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1236999999999997e-05 2024-09-11T05:33:07.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.413 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.413 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:07.413 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.873264+0000", 2024-09-11T05:33:07.413 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00021653699999999999 2024-09-11T05:33:07.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.413 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.413 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:07.413 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874801+0000", 2024-09-11T05:33:07.413 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0015369380000000001 2024-09-11T05:33:07.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.414 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.414 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:07.414 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875342+0000", 2024-09-11T05:33:07.414 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00054159200000000003 2024-09-11T05:33:07.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.414 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.414 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.415 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875370+0000", 2024-09-11T05:33:07.415 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7885000000000002e-05 2024-09-11T05:33:07.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.415 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.415 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.415 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875392+0000", 2024-09-11T05:33:07.415 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2229999999999999e-05 2024-09-11T05:33:07.415 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.415 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:5108 3.1 3:83efb0b6:::rbd_object_map.112deff072db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:06.871740+0000", 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.43500149799999999, 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0037320600000000002, 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.416 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 5108 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871740+0000", 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871740+0000", 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871741+0000", 2024-09-11T05:33:07.418 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.32e-07 2024-09-11T05:33:07.418 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.418 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.418 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.418 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871743+0000", 2024-09-11T05:33:07.418 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.967e-06 2024-09-11T05:33:07.418 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.418 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.418 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.418 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871749+0000", 2024-09-11T05:33:07.418 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5239999999999997e-06 2024-09-11T05:33:07.418 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.419 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.419 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.419 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871754+0000", 2024-09-11T05:33:07.419 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.865e-06 2024-09-11T05:33:07.419 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.419 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.419 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.419 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.873752+0000", 2024-09-11T05:33:07.420 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0019984460000000001 2024-09-11T05:33:07.420 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.420 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.420 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.420 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.873813+0000", 2024-09-11T05:33:07.420 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0473000000000002e-05 2024-09-11T05:33:07.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.421 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.421 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:07.421 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874006+0000", 2024-09-11T05:33:07.421 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000192886 2024-09-11T05:33:07.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.421 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.421 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:07.421 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875398+0000", 2024-09-11T05:33:07.421 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0013926380000000001 2024-09-11T05:33:07.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.421 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.421 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875416+0000", 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.7407000000000001e-05 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875446+0000", 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0119000000000001e-05 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875472+0000", 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6302999999999999e-05 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.422 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:5109 3.1 3:83efb0b6:::rbd_object_map.112deff072db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:06.871763+0000", 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.43497839999999999, 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038804349999999998, 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 5109 2024-09-11T05:33:07.423 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.424 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.424 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.424 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.424 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871763+0000", 2024-09-11T05:33:07.424 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.424 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.424 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.424 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.424 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871763+0000", 2024-09-11T05:33:07.424 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.424 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.424 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.425 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.425 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871764+0000", 2024-09-11T05:33:07.425 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:33:07.425 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.425 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.425 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.425 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871767+0000", 2024-09-11T05:33:07.425 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4400000000000001e-06 2024-09-11T05:33:07.425 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.425 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.425 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.426 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871773+0000", 2024-09-11T05:33:07.426 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6550000000000001e-06 2024-09-11T05:33:07.426 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.426 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.426 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.426 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871776+0000", 2024-09-11T05:33:07.427 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1650000000000002e-06 2024-09-11T05:33:07.427 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.427 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.427 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.427 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874251+0000", 2024-09-11T05:33:07.427 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0024749030000000001 2024-09-11T05:33:07.427 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.428 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.428 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.428 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874299+0000", 2024-09-11T05:33:07.428 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8296e-05 2024-09-11T05:33:07.428 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.428 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.428 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:07.429 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874521+0000", 2024-09-11T05:33:07.429 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00022216200000000001 2024-09-11T05:33:07.429 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.429 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.429 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:07.429 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875489+0000", 2024-09-11T05:33:07.429 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00096752100000000005 2024-09-11T05:33:07.429 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.429 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.429 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875594+0000", 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104693 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875623+0000", 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9448e-05 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875644+0000", 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0721e-05 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.430 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:5110 3.1 3:83efb0b6:::rbd_object_map.112deff072db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:06.872118+0000", 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.43462362599999999, 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038501579999999998, 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 5110 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872118+0000", 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872118+0000", 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:07.432 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872119+0000", 2024-09-11T05:33:07.433 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4499999999999997e-07 2024-09-11T05:33:07.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.433 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.433 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:07.433 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872122+0000", 2024-09-11T05:33:07.433 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5080000000000001e-06 2024-09-11T05:33:07.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.433 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.433 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:07.433 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872129+0000", 2024-09-11T05:33:07.433 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9970000000000001e-06 2024-09-11T05:33:07.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.433 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872133+0000", 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8789999999999996e-06 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874822+0000", 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026886670000000001 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874869+0000", 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6881000000000001e-05 2024-09-11T05:33:07.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875105+0000", 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000235997 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875653+0000", 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00054827700000000001 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875926+0000", 2024-09-11T05:33:07.435 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00027281000000000001 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875951+0000", 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5329000000000001e-05 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875968+0000", 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.7167999999999999e-05 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:07.436 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:07.437 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:07.438 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:07.439 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:07.438+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:07.509 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:33:07.554 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:07.554+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:07.581 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:07.582 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:07.582 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:07.582 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:07.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:07.630 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:07.631 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:07.640 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:07.640+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:07.647 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:07.647 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:07.663 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:07.663 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:07.684 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:07.684 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:07.695 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:07.695 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:07.695 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:07.695 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:07.695 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:07.701 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:07.702 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:07.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:07.720 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:07.721 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:07.722 INFO:teuthology.orchestra.run.smithi070.stdout:flattening image image_client.0-clone5 2024-09-11T05:33:07.738 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:07.738 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:07.740 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:07.740+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:07.755 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:07.755 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:07.842 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:07.842+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:07.847 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:07.847 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:07.857 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:07.872 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-11T05:33:07.943 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:07.942+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:07.964 INFO:teuthology.orchestra.run.smithi070.stdout:1210 punch from 0x14e3539 to 0x14e9ac4, (0x658b bytes) 2024-09-11T05:33:07.968 INFO:teuthology.orchestra.run.smithi070.stdout:1211 punch from 0x2d9d85b to 0x2dacc00, (0xf3a5 bytes) 2024-09-11T05:33:07.968 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:07.968 INFO:teuthology.orchestra.run.smithi070.stdout:1215 write 0x64fd496 thru 0x650163d (0x41a8 bytes) 2024-09-11T05:33:07.977 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:07.977 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:07.985 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:07.986 INFO:teuthology.orchestra.run.smithi070.stdout:1217 write 0xc72149d thru 0xc722941 (0x14a5 bytes) 2024-09-11T05:33:07.990 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:07.996 INFO:teuthology.orchestra.run.smithi070.stdout:1218 writesame 0x5cafd05 thru 0x5cbe3df data_size 0x1(0xe6db bytes) 2024-09-11T05:33:08.043 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:08.043+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:08.051 INFO:teuthology.orchestra.run.smithi070.stdout:1220 trunc from 0xe0302ff to 0x5872e46 2024-09-11T05:33:08.094 INFO:teuthology.orchestra.run.smithi070.stdout:1221 writesame 0x639c57c thru 0x63a297b data_size 0x64(0x6400 bytes) 2024-09-11T05:33:08.096 INFO:teuthology.orchestra.run.smithi070.stdout:1222 trunc from 0x63a297c to 0x7efba3c 2024-09-11T05:33:08.101 INFO:teuthology.orchestra.run.smithi070.stdout:1223 write 0x77f221d thru 0x78015f3 (0xf3d7 bytes) 2024-09-11T05:33:08.108 INFO:teuthology.orchestra.run.smithi070.stdout:1224 read 0x5dff80 thru 0x5e42c7 (0x4348 bytes) 2024-09-11T05:33:08.108 INFO:teuthology.orchestra.run.smithi070.stdout:1225 writesame 0x4d7413c thru 0x4d7d38f data_size 0xa(0x9254 bytes) 2024-09-11T05:33:08.130 INFO:teuthology.orchestra.run.smithi070.stdout:1226 punch from 0x3ba848c to 0x3bad210, (0x4d84 bytes) 2024-09-11T05:33:08.139 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:08.139 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:08.142 INFO:teuthology.orchestra.run.smithi070.stdout:1228 write 0xd4fc1c6 thru 0xd505c6e (0x9aa9 bytes) 2024-09-11T05:33:08.144 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:08.144+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:08.147 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:08.147 INFO:teuthology.orchestra.run.smithi070.stdout:1230 read 0x7492082 thru 0x749d1fe (0xb17d bytes) 2024-09-11T05:33:08.148 INFO:teuthology.orchestra.run.smithi070.stdout:1231 write 0xb55bd1c thru 0xb55db9d (0x1e82 bytes) 2024-09-11T05:33:08.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:08.157 INFO:teuthology.orchestra.run.smithi070.stdout:1232 write 0xdf482bd thru 0xdf4cb78 (0x48bc bytes) 2024-09-11T05:33:08.161 INFO:teuthology.orchestra.run.smithi070.stdout:1233 write 0xc37326d thru 0xc3747ee (0x1582 bytes) 2024-09-11T05:33:08.169 INFO:teuthology.orchestra.run.smithi070.stdout:1236 trunc from 0xdf4cb79 to 0xa93aaa6 2024-09-11T05:33:08.180 INFO:teuthology.orchestra.run.smithi070.stdout:1237 punch from 0x88a21d2 to 0x88b097d, (0xe7ab bytes) 2024-09-11T05:33:08.180 INFO:teuthology.orchestra.run.smithi070.stdout:1238 punch from 0x4dcab47 to 0x4dd5690, (0xab49 bytes) 2024-09-11T05:33:08.180 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:08.180 INFO:teuthology.orchestra.run.smithi070.stdout:1240 write 0x36422e3 thru 0x36448e9 (0x2607 bytes) 2024-09-11T05:33:08.191 INFO:teuthology.orchestra.run.smithi070.stdout:1242 read 0x28335b1 thru 0x2838cdd (0x572d bytes) 2024-09-11T05:33:08.199 INFO:teuthology.orchestra.run.smithi070.stdout:1243 trunc from 0xa93aaa6 to 0x446b7e1 2024-09-11T05:33:08.238 INFO:teuthology.orchestra.run.smithi070.stdout:1244 trunc from 0x446b7e1 to 0x86147d2 2024-09-11T05:33:08.243 INFO:teuthology.orchestra.run.smithi070.stdout:1245 write 0x217f841 thru 0x2180f34 (0x16f4 bytes) 2024-09-11T05:33:08.245 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:08.245+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:08.269 INFO:teuthology.orchestra.run.smithi070.stdout:1246 write 0xdcf68d6 thru 0xdd027a0 (0xbecb bytes) 2024-09-11T05:33:08.274 INFO:teuthology.orchestra.run.smithi070.stdout:1247 write 0x316361d thru 0x316ac35 (0x7619 bytes) 2024-09-11T05:33:08.298 INFO:teuthology.orchestra.run.smithi070.stdout:1248 read 0x5085326 thru 0x5091d4b (0xca26 bytes) 2024-09-11T05:33:08.298 INFO:teuthology.orchestra.run.smithi070.stdout:1250 read 0xa806b3f thru 0xa81563b (0xeafd bytes) 2024-09-11T05:33:08.299 INFO:teuthology.orchestra.run.smithi070.stdout:1251 read 0x8ea3b57 thru 0x8ea3bc6 (0x70 bytes) 2024-09-11T05:33:08.305 INFO:teuthology.orchestra.run.smithi070.stdout:1252 trunc from 0xdd027a1 to 0x933e61d 2024-09-11T05:33:08.313 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:08.313 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:08.316 INFO:teuthology.orchestra.run.smithi070.stdout:1254 trunc from 0x933e61d to 0x7964ac3 2024-09-11T05:33:08.324 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:08.333 INFO:teuthology.orchestra.run.smithi070.stdout:1255 writesame 0xcf0d0b1 thru 0xcf1c53b data_size 0x1(0xf48b bytes) 2024-09-11T05:33:08.333 INFO:teuthology.orchestra.run.smithi070.stdout:1256 write 0x8d2133b thru 0x8d30520 (0xf1e6 bytes) 2024-09-11T05:33:08.339 INFO:teuthology.orchestra.run.smithi070.stdout:1257 read 0xb6f26ea thru 0xb6fc7e4 (0xa0fb bytes) 2024-09-11T05:33:08.339 INFO:teuthology.orchestra.run.smithi070.stdout:1258 punch from 0x20cf575 to 0x20dca4d, (0xd4d8 bytes) 2024-09-11T05:33:08.339 INFO:teuthology.orchestra.run.smithi070.stdout:1259 read 0x527df24 thru 0x528a4ff (0xc5dc bytes) 2024-09-11T05:33:08.339 INFO:teuthology.orchestra.run.smithi070.stdout:1260 read 0x1b76283 thru 0x1b805b2 (0xa330 bytes) 2024-09-11T05:33:08.340 INFO:teuthology.orchestra.run.smithi070.stdout:1261 read 0x8e5e758 thru 0x8e69773 (0xb01c bytes) 2024-09-11T05:33:08.341 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:08.341 INFO:teuthology.orchestra.run.smithi070.stdout:1263 write 0x5c7a118 thru 0x5c83b9b (0x9a84 bytes) 2024-09-11T05:33:08.346 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:08.346+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:08.347 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:08.347 INFO:teuthology.orchestra.run.smithi070.stdout:1265 trunc from 0xcf1c53c to 0xc98fc4d 2024-09-11T05:33:08.352 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:08.352 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:08.352 INFO:teuthology.orchestra.run.smithi070.stdout:1270 read 0x7b29ae5 thru 0x7b2eca8 (0x51c4 bytes) 2024-09-11T05:33:08.352 INFO:teuthology.orchestra.run.smithi070.stdout:1271 write 0x72cea68 thru 0x72d422b (0x57c4 bytes) 2024-09-11T05:33:08.364 INFO:teuthology.orchestra.run.smithi070.stdout:1273 write 0xddadd9c thru 0xddb8e83 (0xb0e8 bytes) 2024-09-11T05:33:08.370 INFO:teuthology.orchestra.run.smithi070.stdout:1274 write 0x67c047e thru 0x67c72b4 (0x6e37 bytes) 2024-09-11T05:33:08.375 INFO:teuthology.orchestra.run.smithi070.stdout:1275 writesame 0x2d89882 thru 0x2d90025 data_size 0xc(0x67a4 bytes) 2024-09-11T05:33:08.397 INFO:teuthology.orchestra.run.smithi070.stdout:1276 read 0x3438998 thru 0x343c9a0 (0x4009 bytes) 2024-09-11T05:33:08.397 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:08.397 INFO:teuthology.orchestra.run.smithi070.stdout:1278 punch from 0x5206896 to 0x520f679, (0x8de3 bytes) 2024-09-11T05:33:08.397 INFO:teuthology.orchestra.run.smithi070.stdout:1280 write 0x3ae8697 thru 0x3af2bf3 (0xa55d bytes) 2024-09-11T05:33:08.425 INFO:teuthology.orchestra.run.smithi070.stdout:1281 writesame 0xe0331eb thru 0xe04017d data_size 0x1(0xcf93 bytes) 2024-09-11T05:33:08.444 INFO:teuthology.orchestra.run.smithi070.stdout:1282 trunc from 0xe04017e to 0x520294 2024-09-11T05:33:08.447 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:08.447+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:08.492 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:08.492 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:08.498 INFO:teuthology.orchestra.run.smithi070.stdout:1283 trunc from 0x520294 to 0x55f15dd 2024-09-11T05:33:08.504 INFO:teuthology.orchestra.run.smithi070.stdout:1284 punch from 0x2a0ab91 to 0x2a1499f, (0x9e0e bytes) 2024-09-11T05:33:08.504 INFO:teuthology.orchestra.run.smithi070.stdout:1287 read 0x2c50b1b thru 0x2c5d0e8 (0xc5ce bytes) 2024-09-11T05:33:08.504 INFO:teuthology.orchestra.run.smithi070.stdout:1289 read 0x3ba7651 thru 0x3bb2a2a (0xb3da bytes) 2024-09-11T05:33:08.504 INFO:teuthology.orchestra.run.smithi070.stdout:1290 read 0x4836062 thru 0x4843f80 (0xdf1f bytes) 2024-09-11T05:33:08.504 INFO:teuthology.orchestra.run.smithi070.stdout:1291 punch from 0x4e0d845 to 0x4e11c8b, (0x4446 bytes) 2024-09-11T05:33:08.504 INFO:teuthology.orchestra.run.smithi070.stdout:1293 writesame 0x145b5d4 thru 0x1466218 data_size 0x1(0xac45 bytes) 2024-09-11T05:33:08.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:08.531 INFO:teuthology.orchestra.run.smithi070.stdout:1294 read 0x166175c thru 0x1669b3b (0x83e0 bytes) 2024-09-11T05:33:08.540 INFO:teuthology.orchestra.run.smithi070.stdout:1295 write 0x8be683f thru 0x8be8d03 (0x24c5 bytes) 2024-09-11T05:33:08.544 INFO:teuthology.orchestra.run.smithi070.stdout:1297 read 0x586518c thru 0x5870988 (0xb7fd bytes) 2024-09-11T05:33:08.544 INFO:teuthology.orchestra.run.smithi070.stdout:1298 write 0x210bea4 thru 0x2118af4 (0xcc51 bytes) 2024-09-11T05:33:08.548 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:08.548+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:08.550 INFO:teuthology.orchestra.run.smithi070.stdout:1301 punch from 0x3954b2a to 0x395c3b4, (0x788a bytes) 2024-09-11T05:33:08.552 INFO:teuthology.orchestra.run.smithi070.stdout:1302 trunc from 0x8be8d04 to 0x73f4219 2024-09-11T05:33:08.562 INFO:teuthology.orchestra.run.smithi070.stdout:1303 punch from 0x50f0397 to 0x50ffed9, (0xfb42 bytes) 2024-09-11T05:33:08.562 INFO:teuthology.orchestra.run.smithi070.stdout:1306 clone 7 order 20 su 8192 sc 12 2024-09-11T05:33:08.636 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:08.636 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:08.645 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:08.649 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:08.649+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:08.686 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:33:08.730 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone6 from 0x73f4219 (overlap 0x520294) to 0x83375 2024-09-11T05:33:08.750 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:08.750+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:08.814 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:08.814 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:08.820 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-11T05:33:08.826 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:08.851 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:08.851+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:08.952 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:08.952+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:08.984 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:08.984 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:08.994 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:09.053 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:09.053+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:09.118 INFO:teuthology.orchestra.run.smithi070.stdout:1307 read 0x253e8db thru 0x25468d7 (0x7ffd bytes) 2024-09-11T05:33:09.119 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:09.119 INFO:teuthology.orchestra.run.smithi070.stdout:1312 write 0x374af3c thru 0x375a82f (0xf8f4 bytes) 2024-09-11T05:33:09.141 INFO:teuthology.orchestra.run.smithi070.stdout:1313 write 0x9d02e3e thru 0x9d04492 (0x1655 bytes) 2024-09-11T05:33:09.144 INFO:teuthology.orchestra.run.smithi070.stdout:1317 read 0x7069090 thru 0x706fa9e (0x6a0f bytes) 2024-09-11T05:33:09.151 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:09.151 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:09.152 INFO:teuthology.orchestra.run.smithi070.stdout:1318 write 0xc801fd3 thru 0xc808b7a (0x6ba8 bytes) 2024-09-11T05:33:09.153 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:09.153+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:09.159 INFO:teuthology.orchestra.run.smithi070.stdout:1319 punch from 0xc13ceca to 0xc13f9ba, (0x2af0 bytes) 2024-09-11T05:33:09.163 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:09.164 INFO:teuthology.orchestra.run.smithi070.stdout:1320 write 0xcec2f4a thru 0xcecb4f0 (0x85a7 bytes) 2024-09-11T05:33:09.172 INFO:teuthology.orchestra.run.smithi070.stdout:1321 read 0xb814f6f thru 0xb816455 (0x14e7 bytes) 2024-09-11T05:33:09.172 INFO:teuthology.orchestra.run.smithi070.stdout:1322 punch from 0x3317121 to 0x332108e, (0x9f6d bytes) 2024-09-11T05:33:09.172 INFO:teuthology.orchestra.run.smithi070.stdout:1323 write 0xc9e7480 thru 0xc9eb26f (0x3df0 bytes) 2024-09-11T05:33:09.181 INFO:teuthology.orchestra.run.smithi070.stdout:1324 write 0xdf5787e thru 0xdf609e0 (0x9163 bytes) 2024-09-11T05:33:09.189 INFO:teuthology.orchestra.run.smithi070.stdout:1325 write 0xd4828e8 thru 0xd4866f8 (0x3e11 bytes) 2024-09-11T05:33:09.193 INFO:teuthology.orchestra.run.smithi070.stdout:1326 write 0x1d08b70 thru 0x1d12cf3 (0xa184 bytes) 2024-09-11T05:33:09.212 INFO:teuthology.orchestra.run.smithi070.stdout:1328 read 0xba9cfd7 thru 0xbaa798f (0xa9b9 bytes) 2024-09-11T05:33:09.212 INFO:teuthology.orchestra.run.smithi070.stdout:1330 punch from 0x8a80621 to 0x8a84576, (0x3f55 bytes) 2024-09-11T05:33:09.212 INFO:teuthology.orchestra.run.smithi070.stdout:1331 read 0xca02558 thru 0xca05385 (0x2e2e bytes) 2024-09-11T05:33:09.226 INFO:teuthology.orchestra.run.smithi070.stdout:1332 trunc from 0xdf609e1 to 0x2d7d3f7 2024-09-11T05:33:09.254 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:09.253+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:09.257 INFO:teuthology.orchestra.run.smithi070.stdout:1333 read 0x4d0c0b thru 0x4d2b11 (0x1f07 bytes) 2024-09-11T05:33:09.272 INFO:teuthology.orchestra.run.smithi070.stdout:1334 write 0xb545273 thru 0xb545c97 (0xa25 bytes) 2024-09-11T05:33:09.275 INFO:teuthology.orchestra.run.smithi070.stdout:1336 punch from 0x7e24dbc to 0x7e3132b, (0xc56f bytes) 2024-09-11T05:33:09.275 INFO:teuthology.orchestra.run.smithi070.stdout:1337 read 0x6e2963f thru 0x6e318cb (0x828d bytes) 2024-09-11T05:33:09.276 INFO:teuthology.orchestra.run.smithi070.stdout:1338 punch from 0xb237786 to 0xb23d9ba, (0x6234 bytes) 2024-09-11T05:33:09.276 INFO:teuthology.orchestra.run.smithi070.stdout:1339 clone 8 order 20 su 65536 sc 9 2024-09-11T05:33:09.294 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:09.294 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:09.303 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:09.355 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:09.354+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:09.446 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:09.446 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:09.454 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:09.456 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:09.456+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:09.556 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:09.556+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:09.557 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:09.557 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:09.565 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:09.657 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:09.657+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:09.669 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:09.669 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:09.676 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T05:33:09.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:09.740 INFO:teuthology.orchestra.run.smithi070.stdout:flattening image image_client.0-clone7 2024-09-11T05:33:09.758 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:09.758+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:09.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:33:09.796 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:09.797 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:09.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:09.860 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:09.859+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:09.921 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:09.921 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:09.927 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:09.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:09.946 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:09.946 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:09.964 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:09.974 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:09.974+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:09.981 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:09.981 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:09.982 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-11T05:33:09.995 INFO:teuthology.orchestra.run.smithi070.stdout:1340 trunc from 0xb545c98 to 0x36482b6 2024-09-11T05:33:09.999 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:09.999 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:10.010 INFO:teuthology.orchestra.run.smithi070.stdout:1341 read 0x440ca4 thru 0x4494ed (0x884a bytes) 2024-09-11T05:33:10.019 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:10.019 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:10.029 INFO:teuthology.orchestra.run.smithi070.stdout:1342 write 0xe8fcd10 thru 0xe90ab17 (0xde08 bytes) 2024-09-11T05:33:10.035 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.035 INFO:teuthology.orchestra.run.smithi070.stdout:1344 read 0x13e4dc5 thru 0x13f322b (0xe467 bytes) 2024-09-11T05:33:10.037 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:10.037 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:10.037 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:10.037 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:33:10.037 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:10.037 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:10.038 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:10.046 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:10.048 INFO:teuthology.orchestra.run.smithi070.stdout:1346 trunc from 0xe90ab18 to 0x3f3072c 2024-09-11T05:33:10.055 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:10.055 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:10.058 INFO:teuthology.orchestra.run.smithi070.stdout:1347 read 0xce38c5 thru 0xcf1227 (0xd963 bytes) 2024-09-11T05:33:10.072 INFO:teuthology.orchestra.run.smithi070.stdout:1348 trunc from 0x3f3072c to 0xeb20a8d 2024-09-11T05:33:10.077 INFO:teuthology.orchestra.run.smithi070.stdout:1349 write 0x8c3a544 thru 0x8c4279f (0x825c bytes) 2024-09-11T05:33:10.083 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.083 INFO:teuthology.orchestra.run.smithi070.stdout:1352 write 0x9cb5670 thru 0x9cc3fc4 (0xe955 bytes) 2024-09-11T05:33:10.087 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:10.087+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:10.087 INFO:teuthology.orchestra.run.smithi070.stdout:1353 punch from 0x875addc to 0x875ca96, (0x1cba bytes) 2024-09-11T05:33:10.088 INFO:teuthology.orchestra.run.smithi070.stdout:1354 writesame 0xd8a9539 thru 0xd8abcdd data_size 0x1(0x27a5 bytes) 2024-09-11T05:33:10.094 INFO:teuthology.orchestra.run.smithi070.stdout:1355 write 0x85bb4c5 thru 0x85c3c73 (0x87af bytes) 2024-09-11T05:33:10.097 INFO:teuthology.orchestra.run.smithi070.stdout:1357 read 0xe1e76ef thru 0xe1e8940 (0x1252 bytes) 2024-09-11T05:33:10.097 INFO:teuthology.orchestra.run.smithi070.stdout:1358 write 0x7e0318e thru 0x7e0a038 (0x6eab bytes) 2024-09-11T05:33:10.100 INFO:teuthology.orchestra.run.smithi070.stdout:1359 write 0xea4ad08 thru 0xea51c5b (0x6f54 bytes) 2024-09-11T05:33:10.104 INFO:teuthology.orchestra.run.smithi070.stdout:1360 read 0xda76b6a thru 0xda7b188 (0x461f bytes) 2024-09-11T05:33:10.104 INFO:teuthology.orchestra.run.smithi070.stdout:1361 writesame 0xbcf0516 thru 0xbcfcc00 data_size 0x1(0xc6eb bytes) 2024-09-11T05:33:10.131 INFO:teuthology.orchestra.run.smithi070.stdout:1362 punch from 0x3673237 to 0x3673efa, (0xcc3 bytes) 2024-09-11T05:33:10.131 INFO:teuthology.orchestra.run.smithi070.stdout:1363 writesame 0x7ec3c66 thru 0x7ed0526 data_size 0x25(0xc8c1 bytes) 2024-09-11T05:33:10.136 INFO:teuthology.orchestra.run.smithi070.stdout:1364 write 0x1266406 thru 0x1275fb9 (0xfbb4 bytes) 2024-09-11T05:33:10.146 INFO:teuthology.orchestra.run.smithi070.stdout:1365 punch from 0xc87510a to 0xc882981, (0xd877 bytes) 2024-09-11T05:33:10.146 INFO:teuthology.orchestra.run.smithi070.stdout:1366 write 0xa55a017 thru 0xa5653b3 (0xb39d bytes) 2024-09-11T05:33:10.150 INFO:teuthology.orchestra.run.smithi070.stdout:1367 writesame 0x7a6acf2 thru 0x7a795cd data_size 0x4(0xe8dc bytes) 2024-09-11T05:33:10.160 INFO:teuthology.orchestra.run.smithi070.stdout:1369 read 0x1eced71 thru 0x1ecefec (0x27c bytes) 2024-09-11T05:33:10.161 INFO:teuthology.orchestra.run.smithi070.stdout:1370 read 0x6c73a62 thru 0x6c777ae (0x3d4d bytes) 2024-09-11T05:33:10.161 INFO:teuthology.orchestra.run.smithi070.stdout:1371 punch from 0x5db197f to 0x5db76f5, (0x5d76 bytes) 2024-09-11T05:33:10.162 INFO:teuthology.orchestra.run.smithi070.stdout:1373 trunc from 0xeb20a8d to 0xda7bb19 2024-09-11T05:33:10.162 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:10.161+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:10.187 INFO:teuthology.orchestra.run.smithi070.stdout:1374 trunc from 0xda7bb19 to 0x2808bf0 2024-09-11T05:33:10.200 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:10.200 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:10.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.200 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14793 3.1f 3.dc43f6ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.201 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197530+0000", 2024-09-11T05:33:10.201 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.000433354, 2024-09-11T05:33:10.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00045302199999999997, 2024-09-11T05:33:10.201 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.201 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.201 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.201 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.202 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14793 2024-09-11T05:33:10.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.202 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.202 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197530+0000", 2024-09-11T05:33:10.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197530+0000", 2024-09-11T05:33:10.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197531+0000", 2024-09-11T05:33:10.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0100000000000001e-07 2024-09-11T05:33:10.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197532+0000", 2024-09-11T05:33:10.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9199999999999999e-07 2024-09-11T05:33:10.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197535+0000", 2024-09-11T05:33:10.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9179999999999998e-06 2024-09-11T05:33:10.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197537+0000", 2024-09-11T05:33:10.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8119999999999999e-06 2024-09-11T05:33:10.205 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.205 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.205 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.206 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14794 3.1f 3.dc43f6ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.206 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197541+0000", 2024-09-11T05:33:10.206 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00042291200000000001, 2024-09-11T05:33:10.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00050465999999999998, 2024-09-11T05:33:10.206 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.206 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.206 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.206 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.206 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.206 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.206 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14794 2024-09-11T05:33:10.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.206 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197541+0000", 2024-09-11T05:33:10.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197541+0000", 2024-09-11T05:33:10.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197541+0000", 2024-09-11T05:33:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1500000000000001e-07 2024-09-11T05:33:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197542+0000", 2024-09-11T05:33:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.026e-06 2024-09-11T05:33:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197549+0000", 2024-09-11T05:33:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5570000000000001e-06 2024-09-11T05:33:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197552+0000", 2024-09-11T05:33:10.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.129e-06 2024-09-11T05:33:10.209 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.209 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.209 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.209 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14795 3.1f 3.dc43f6ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.210 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197555+0000", 2024-09-11T05:33:10.210 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00040852999999999999, 2024-09-11T05:33:10.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00054878700000000002, 2024-09-11T05:33:10.210 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.210 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.210 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.210 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.210 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.210 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.210 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14795 2024-09-11T05:33:10.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.210 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197555+0000", 2024-09-11T05:33:10.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197555+0000", 2024-09-11T05:33:10.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197555+0000", 2024-09-11T05:33:10.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.05e-07 2024-09-11T05:33:10.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197557+0000", 2024-09-11T05:33:10.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.198e-06 2024-09-11T05:33:10.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197560+0000", 2024-09-11T05:33:10.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0319999999999999e-06 2024-09-11T05:33:10.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197571+0000", 2024-09-11T05:33:10.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0883999999999999e-05 2024-09-11T05:33:10.213 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.213 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.213 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.213 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14796 3.1f 3.dc43f6ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.213 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197584+0000", 2024-09-11T05:33:10.213 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00037967600000000002, 2024-09-11T05:33:10.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00057569499999999998, 2024-09-11T05:33:10.213 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.213 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.214 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.214 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.214 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.214 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.214 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14796 2024-09-11T05:33:10.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.214 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197584+0000", 2024-09-11T05:33:10.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197584+0000", 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197585+0000", 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.39e-07 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197586+0000", 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.703e-06 2024-09-11T05:33:10.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.216 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.216 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.216 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197590+0000", 2024-09-11T05:33:10.216 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.563e-06 2024-09-11T05:33:10.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.216 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.216 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.216 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197592+0000", 2024-09-11T05:33:10.216 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.683e-06 2024-09-11T05:33:10.216 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.216 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.216 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14797 3.1f 3.dc43f6ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197596+0000", 2024-09-11T05:33:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00036786099999999998, 2024-09-11T05:33:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000616626, 2024-09-11T05:33:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14797 2024-09-11T05:33:10.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.218 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197596+0000", 2024-09-11T05:33:10.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197596+0000", 2024-09-11T05:33:10.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197596+0000", 2024-09-11T05:33:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197597+0000", 2024-09-11T05:33:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1310000000000001e-06 2024-09-11T05:33:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197600+0000", 2024-09-11T05:33:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.847e-06 2024-09-11T05:33:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197603+0000", 2024-09-11T05:33:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4530000000000001e-06 2024-09-11T05:33:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14798 3.1f 3.dc43f6ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197605+0000", 2024-09-11T05:33:10.221 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00035841399999999999, 2024-09-11T05:33:10.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00066284700000000005, 2024-09-11T05:33:10.221 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.221 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.221 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.221 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.221 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.221 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.221 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14798 2024-09-11T05:33:10.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.221 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197605+0000", 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197605+0000", 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197606+0000", 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9700000000000003e-07 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197607+0000", 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.043e-06 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197610+0000", 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8109999999999999e-06 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197612+0000", 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.491e-06 2024-09-11T05:33:10.223 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14799 3.1f 3.dc43f6ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197615+0000", 2024-09-11T05:33:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00034891099999999998, 2024-09-11T05:33:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070542599999999999, 2024-09-11T05:33:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.225 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.225 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14799 2024-09-11T05:33:10.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.225 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197615+0000", 2024-09-11T05:33:10.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197615+0000", 2024-09-11T05:33:10.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.226 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197615+0000", 2024-09-11T05:33:10.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.05e-07 2024-09-11T05:33:10.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.226 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197616+0000", 2024-09-11T05:33:10.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5799999999999998e-07 2024-09-11T05:33:10.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197619+0000", 2024-09-11T05:33:10.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8760000000000001e-06 2024-09-11T05:33:10.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.227 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197621+0000", 2024-09-11T05:33:10.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5299999999999999e-06 2024-09-11T05:33:10.227 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.227 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.227 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.227 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14800 3.1f 3.dc43f6ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197625+0000", 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00033925699999999998, 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00074911699999999999, 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14800 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.228 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197625+0000", 2024-09-11T05:33:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197625+0000", 2024-09-11T05:33:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197625+0000", 2024-09-11T05:33:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.03e-07 2024-09-11T05:33:10.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197629+0000", 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9090000000000002e-06 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197632+0000", 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0900000000000001e-06 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197636+0000", 2024-09-11T05:33:10.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.403e-06 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14801 3.1f 3.dc43f6ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197640+0000", 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00032420300000000001, 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00078646300000000005, 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.231 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.232 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.232 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14801 2024-09-11T05:33:10.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.232 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.232 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.232 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.232 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197640+0000", 2024-09-11T05:33:10.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.232 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.232 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.232 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197640+0000", 2024-09-11T05:33:10.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.233 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.233 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197640+0000", 2024-09-11T05:33:10.233 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:33:10.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.233 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.233 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197642+0000", 2024-09-11T05:33:10.233 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8679999999999999e-06 2024-09-11T05:33:10.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.233 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197645+0000", 2024-09-11T05:33:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.005e-06 2024-09-11T05:33:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197647+0000", 2024-09-11T05:33:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4990000000000001e-06 2024-09-11T05:33:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14802 3.1f 3.dc43f6ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197650+0000", 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00031366400000000001, 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00083138500000000002, 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14802 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.235 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197650+0000", 2024-09-11T05:33:10.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.236 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197650+0000", 2024-09-11T05:33:10.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.236 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197650+0000", 2024-09-11T05:33:10.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:33:10.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197651+0000", 2024-09-11T05:33:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7100000000000011e-07 2024-09-11T05:33:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197654+0000", 2024-09-11T05:33:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.818e-06 2024-09-11T05:33:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197657+0000", 2024-09-11T05:33:10.238 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.072e-06 2024-09-11T05:33:10.238 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.238 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.238 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.238 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.238 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14803 3.1f 3.dc43f6ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.238 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197660+0000", 2024-09-11T05:33:10.238 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.000303324, 2024-09-11T05:33:10.238 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00088166099999999995, 2024-09-11T05:33:10.238 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.238 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.238 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14803 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197660+0000", 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.239 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197660+0000", 2024-09-11T05:33:10.240 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.240 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.240 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.240 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197661+0000", 2024-09-11T05:33:10.240 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.05e-07 2024-09-11T05:33:10.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.240 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.240 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.240 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197662+0000", 2024-09-11T05:33:10.240 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0410000000000001e-06 2024-09-11T05:33:10.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.240 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197665+0000", 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9160000000000001e-06 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197667+0000", 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5739999999999998e-06 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.241 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14804 3.1f 3.dc43f6ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.242 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197670+0000", 2024-09-11T05:33:10.242 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00029376499999999998, 2024-09-11T05:33:10.242 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00092502299999999997, 2024-09-11T05:33:10.242 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.242 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.242 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.242 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.242 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.242 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.242 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14804 2024-09-11T05:33:10.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.242 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.242 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197670+0000", 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197670+0000", 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197670+0000", 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.28e-07 2024-09-11T05:33:10.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.244 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197671+0000", 2024-09-11T05:33:10.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0079999999999999e-06 2024-09-11T05:33:10.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.244 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197674+0000", 2024-09-11T05:33:10.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8210000000000002e-06 2024-09-11T05:33:10.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.244 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197676+0000", 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3999999999999999e-06 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14860 3.1e 3:795a8348:::rbd_data.112d745a9e91.000000000000002c:a [read 344064~8192 out=8192b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197769+0000", 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.000194279, 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00088277500000000003, 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14860 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197769+0000", 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197769+0000", 2024-09-11T05:33:10.246 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197770+0000", 2024-09-11T05:33:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.03e-07 2024-09-11T05:33:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197774+0000", 2024-09-11T05:33:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5290000000000002e-06 2024-09-11T05:33:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.248 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197777+0000", 2024-09-11T05:33:10.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0180000000000002e-06 2024-09-11T05:33:10.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.248 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.248 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197780+0000", 2024-09-11T05:33:10.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1599999999999998e-06 2024-09-11T05:33:10.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.248 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.248 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.198586+0000", 2024-09-11T05:33:10.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00080594499999999997 2024-09-11T05:33:10.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.198620+0000", 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3932e-05 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14861 3.1e 3:795a8348:::rbd_data.112d745a9e91.000000000000002c:a [read 393216~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197784+0000", 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00018017700000000001, 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00093887699999999996, 2024-09-11T05:33:10.249 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.250 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.250 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:10.250 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.250 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.250 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.250 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14861 2024-09-11T05:33:10.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.250 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.250 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.250 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.250 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197784+0000", 2024-09-11T05:33:10.250 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197784+0000", 2024-09-11T05:33:10.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197784+0000", 2024-09-11T05:33:10.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9700000000000003e-07 2024-09-11T05:33:10.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197785+0000", 2024-09-11T05:33:10.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4600000000000003e-07 2024-09-11T05:33:10.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197788+0000", 2024-09-11T05:33:10.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8439999999999998e-06 2024-09-11T05:33:10.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197790+0000", 2024-09-11T05:33:10.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.413e-06 2024-09-11T05:33:10.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.198685+0000", 2024-09-11T05:33:10.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00089492100000000002 2024-09-11T05:33:10.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.198720+0000", 2024-09-11T05:33:10.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5074000000000003e-05 2024-09-11T05:33:10.253 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.253 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.253 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14862 3.1e 3.12c15a9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197793+0000", 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.000170886, 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00099447199999999993, 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14862 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.254 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.255 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.255 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197793+0000", 2024-09-11T05:33:10.255 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.255 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.255 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.255 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197793+0000", 2024-09-11T05:33:10.255 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.255 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.255 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.255 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197793+0000", 2024-09-11T05:33:10.255 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197794+0000", 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0100000000000001e-06 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197798+0000", 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-06 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.256 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197801+0000", 2024-09-11T05:33:10.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.779e-06 2024-09-11T05:33:10.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.257 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.198781+0000", 2024-09-11T05:33:10.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00097992700000000001 2024-09-11T05:33:10.257 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.257 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.257 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.257 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14863 3.1e 3.12c15a9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.257 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197804+0000", 2024-09-11T05:33:10.258 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00016018900000000001, 2024-09-11T05:33:10.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0010474919999999999, 2024-09-11T05:33:10.258 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.258 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.258 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.258 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.258 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.258 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.258 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14863 2024-09-11T05:33:10.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.258 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.258 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197804+0000", 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197804+0000", 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197804+0000", 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.04e-07 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.260 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.260 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197805+0000", 2024-09-11T05:33:10.260 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7399999999999991e-07 2024-09-11T05:33:10.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.260 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.260 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.260 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197808+0000", 2024-09-11T05:33:10.260 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8229999999999999e-06 2024-09-11T05:33:10.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.260 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.260 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.260 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197811+0000", 2024-09-11T05:33:10.260 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.219e-06 2024-09-11T05:33:10.261 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.261 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.261 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.261 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14864 3.1e 3.12c15a9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.261 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197814+0000", 2024-09-11T05:33:10.261 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.000150106, 2024-09-11T05:33:10.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.001090361, 2024-09-11T05:33:10.261 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.261 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.261 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.261 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14864 2024-09-11T05:33:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197814+0000", 2024-09-11T05:33:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197814+0000", 2024-09-11T05:33:10.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197814+0000", 2024-09-11T05:33:10.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0100000000000001e-07 2024-09-11T05:33:10.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.264 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197815+0000", 2024-09-11T05:33:10.264 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.3799999999999996e-07 2024-09-11T05:33:10.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.264 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.264 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.264 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197818+0000", 2024-09-11T05:33:10.264 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2119999999999999e-06 2024-09-11T05:33:10.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.264 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.264 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.264 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197820+0000", 2024-09-11T05:33:10.264 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4229999999999999e-06 2024-09-11T05:33:10.265 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.265 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.265 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.265 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14865 3.1e 3.12c15a9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.265 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197824+0000", 2024-09-11T05:33:10.265 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00014024099999999999, 2024-09-11T05:33:10.265 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0011374410000000001, 2024-09-11T05:33:10.265 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.265 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.265 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.266 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.266 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.266 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.266 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14865 2024-09-11T05:33:10.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.266 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197824+0000", 2024-09-11T05:33:10.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197824+0000", 2024-09-11T05:33:10.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197824+0000", 2024-09-11T05:33:10.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.04e-07 2024-09-11T05:33:10.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197825+0000", 2024-09-11T05:33:10.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7999999999999993e-07 2024-09-11T05:33:10.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.268 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.268 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197828+0000", 2024-09-11T05:33:10.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8399999999999999e-06 2024-09-11T05:33:10.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.268 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.268 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197830+0000", 2024-09-11T05:33:10.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4679999999999999e-06 2024-09-11T05:33:10.268 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.268 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.268 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.269 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.269 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14866 3.1e 3.12c15a9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.269 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197834+0000", 2024-09-11T05:33:10.269 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.000130097, 2024-09-11T05:33:10.269 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0011796179999999999, 2024-09-11T05:33:10.269 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.269 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.269 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.269 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.269 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.269 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.269 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14866 2024-09-11T05:33:10.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.270 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.270 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.270 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197834+0000", 2024-09-11T05:33:10.270 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.270 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.270 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197834+0000", 2024-09-11T05:33:10.270 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197834+0000", 2024-09-11T05:33:10.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:10.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197835+0000", 2024-09-11T05:33:10.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0109999999999999e-06 2024-09-11T05:33:10.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197838+0000", 2024-09-11T05:33:10.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8040000000000002e-06 2024-09-11T05:33:10.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.272 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197840+0000", 2024-09-11T05:33:10.272 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3659999999999999e-06 2024-09-11T05:33:10.272 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.272 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.272 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.272 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14867 3.1e 3.12c15a9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.272 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197844+0000", 2024-09-11T05:33:10.272 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.000119336, 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.001220933, 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14867 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197844+0000", 2024-09-11T05:33:10.273 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.274 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.274 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.274 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197844+0000", 2024-09-11T05:33:10.274 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.274 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.274 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.274 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197845+0000", 2024-09-11T05:33:10.274 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:10.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.274 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.274 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.275 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197846+0000", 2024-09-11T05:33:10.275 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.018e-06 2024-09-11T05:33:10.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.275 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.275 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.275 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197851+0000", 2024-09-11T05:33:10.275 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9660000000000004e-06 2024-09-11T05:33:10.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.275 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.275 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.275 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197854+0000", 2024-09-11T05:33:10.275 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4209999999999999e-06 2024-09-11T05:33:10.275 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.276 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.276 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.276 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.276 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:14868 3.1e 3.12c15a9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.276 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.197868+0000", 2024-09-11T05:33:10.276 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 9.5755999999999996e-05, 2024-09-11T05:33:10.276 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0012502170000000001, 2024-09-11T05:33:10.276 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.276 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.276 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:10.276 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.276 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 14868 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197868+0000", 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197868+0000", 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197868+0000", 2024-09-11T05:33:10.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:33:10.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197870+0000", 2024-09-11T05:33:10.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.494e-06 2024-09-11T05:33:10.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197873+0000", 2024-09-11T05:33:10.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3550000000000001e-06 2024-09-11T05:33:10.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.197876+0000", 2024-09-11T05:33:10.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.571e-06 2024-09-11T05:33:10.279 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.279 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.279 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.279 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.279 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-11T05:33:10.279 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 21 2024-09-11T05:33:10.279 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:10.281 INFO:teuthology.orchestra.run.smithi070.stdout:1375 read 0x264dec thru 0x274699 (0xf8ae bytes) 2024-09-11T05:33:10.281 INFO:teuthology.orchestra.run.smithi070.stdout:1376 read 0x5e31a7 thru 0x5ee599 (0xb3f3 bytes) 2024-09-11T05:33:10.281 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:10.280+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:10.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:10.282 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.282 INFO:teuthology.orchestra.run.smithi070.stdout:1379 trunc from 0x2808bf0 to 0x1cb2658 2024-09-11T05:33:10.334 INFO:teuthology.orchestra.run.smithi070.stdout:1381 read 0x1b20619 thru 0x1b22d88 (0x2770 bytes) 2024-09-11T05:33:10.334 INFO:teuthology.orchestra.run.smithi070.stdout:1382 read 0x995398 thru 0x998e10 (0x3a79 bytes) 2024-09-11T05:33:10.335 INFO:teuthology.orchestra.run.smithi070.stdout:1384 read 0x4dd6c2 thru 0x4de2b7 (0xbf6 bytes) 2024-09-11T05:33:10.335 INFO:teuthology.orchestra.run.smithi070.stdout:1385 read 0x544843 thru 0x548347 (0x3b05 bytes) 2024-09-11T05:33:10.353 INFO:teuthology.orchestra.run.smithi070.stdout:1386 write 0xb422545 thru 0xb429298 (0x6d54 bytes) 2024-09-11T05:33:10.356 INFO:teuthology.orchestra.run.smithi070.stdout:1387 read 0xab35f73 thru 0xab41449 (0xb4d7 bytes) 2024-09-11T05:33:10.356 INFO:teuthology.orchestra.run.smithi070.stdout:1388 read 0x3bba37c thru 0x3bbe445 (0x40ca bytes) 2024-09-11T05:33:10.356 INFO:teuthology.orchestra.run.smithi070.stdout:1389 punch from 0x3603d8e to 0x360a392, (0x6604 bytes) 2024-09-11T05:33:10.356 INFO:teuthology.orchestra.run.smithi070.stdout:1390 read 0xb3e234b thru 0xb3e28db (0x591 bytes) 2024-09-11T05:33:10.356 INFO:teuthology.orchestra.run.smithi070.stdout:1392 read 0x42b8b90 thru 0x42c77c5 (0xec36 bytes) 2024-09-11T05:33:10.356 INFO:teuthology.orchestra.run.smithi070.stdout:1393 read 0xa9f347 thru 0xaa8ff5 (0x9caf bytes) 2024-09-11T05:33:10.356 INFO:teuthology.orchestra.run.smithi070.stdout:1395 punch from 0x7e3fae6 to 0x7e46ba8, (0x70c2 bytes) 2024-09-11T05:33:10.365 INFO:teuthology.orchestra.run.smithi070.stdout:1396 writesame 0xe8d98fd thru 0xe8dd7be data_size 0x1d(0x3ec2 bytes) 2024-09-11T05:33:10.365 INFO:teuthology.orchestra.run.smithi070.stdout:1397 write 0xd3a91dc thru 0xd3ac094 (0x2eb9 bytes) 2024-09-11T05:33:10.367 INFO:teuthology.orchestra.run.smithi070.stdout:1398 write 0x597e08f thru 0x5982261 (0x41d3 bytes) 2024-09-11T05:33:10.381 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:10.381+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:10.385 INFO:teuthology.orchestra.run.smithi070.stdout:1399 trunc from 0xe8dd7bf to 0x1d5b3bd 2024-09-11T05:33:10.392 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:10.392 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:10.392 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:10.392 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:10.392 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:10.401 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:10.405 INFO:teuthology.orchestra.run.smithi070.stdout:1400 writesame 0x431300f thru 0x4321804 data_size 0x9(0xe7f6 bytes) 2024-09-11T05:33:10.405 INFO:teuthology.orchestra.run.smithi070.stdout:1401 read 0x83f495 thru 0x843d97 (0x4903 bytes) 2024-09-11T05:33:10.410 INFO:teuthology.orchestra.run.smithi070.stdout:1402 trunc from 0x4321805 to 0x8964490 2024-09-11T05:33:10.416 INFO:teuthology.orchestra.run.smithi070.stdout:1403 read 0x36f4757 thru 0x36f55f7 (0xea1 bytes) 2024-09-11T05:33:10.416 INFO:teuthology.orchestra.run.smithi070.stdout:1404 punch from 0x571dd3 to 0x577b16, (0x5d43 bytes) 2024-09-11T05:33:10.416 INFO:teuthology.orchestra.run.smithi070.stdout:1405 write 0x3387f59 thru 0x3395f15 (0xdfbd bytes) 2024-09-11T05:33:10.419 INFO:teuthology.orchestra.run.smithi070.stdout:1406 punch from 0x13e10b9 to 0x13ef7f6, (0xe73d bytes) 2024-09-11T05:33:10.420 INFO:teuthology.orchestra.run.smithi070.stdout:1407 read 0x6f24e99 thru 0x6f3251b (0xd683 bytes) 2024-09-11T05:33:10.426 INFO:teuthology.orchestra.run.smithi070.stdout:1408 trunc from 0x8964490 to 0xe4e78c8 2024-09-11T05:33:10.432 INFO:teuthology.orchestra.run.smithi070.stdout:1410 write 0xacb405b thru 0xacbcd3c (0x8ce2 bytes) 2024-09-11T05:33:10.434 INFO:teuthology.orchestra.run.smithi070.stdout:1411 write 0xa1170c4 thru 0xa11c127 (0x5064 bytes) 2024-09-11T05:33:10.440 INFO:teuthology.orchestra.run.smithi070.stdout:1412 trunc from 0xe4e78c8 to 0xb4338c1 2024-09-11T05:33:10.445 INFO:teuthology.orchestra.run.smithi070.stdout:1413 punch from 0x211ab91 to 0x211ed26, (0x4195 bytes) 2024-09-11T05:33:10.446 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.446 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.455 INFO:teuthology.orchestra.run.smithi070.stdout:1417 write 0xec57d64 thru 0xec5bf20 (0x41bd bytes) 2024-09-11T05:33:10.457 INFO:teuthology.orchestra.run.smithi070.stdout:1419 read 0xca39be thru 0xcae527 (0xab6a bytes) 2024-09-11T05:33:10.457 INFO:teuthology.orchestra.run.smithi070.stdout:1420 writesame 0xcc0eabe thru 0xcc186e4 data_size 0x19(0x9c27 bytes) 2024-09-11T05:33:10.464 INFO:teuthology.orchestra.run.smithi070.stdout:1421 read 0x9e3f98c thru 0x9e4859a (0x8c0f bytes) 2024-09-11T05:33:10.464 INFO:teuthology.orchestra.run.smithi070.stdout:1423 read 0x8ea072f thru 0x8eae5d9 (0xdeab bytes) 2024-09-11T05:33:10.464 INFO:teuthology.orchestra.run.smithi070.stdout:1424 writesame 0x4e7f0f5 thru 0x4e8b72b data_size 0xb(0xc637 bytes) 2024-09-11T05:33:10.469 INFO:teuthology.orchestra.run.smithi070.stdout:1425 punch from 0xb4d2d02 to 0xb4d93c4, (0x66c2 bytes) 2024-09-11T05:33:10.469 INFO:teuthology.orchestra.run.smithi070.stdout:1426 read 0xc9fdfca thru 0xca0acc9 (0xcd00 bytes) 2024-09-11T05:33:10.469 INFO:teuthology.orchestra.run.smithi070.stdout:1428 read 0x6d36bba thru 0x6d456fe (0xeb45 bytes) 2024-09-11T05:33:10.469 INFO:teuthology.orchestra.run.smithi070.stdout:1431 writesame 0x62cb91e thru 0x62d81cb data_size 0x11(0xc8ae bytes) 2024-09-11T05:33:10.476 INFO:teuthology.orchestra.run.smithi070.stdout:1432 read 0x56b9ed3 thru 0x56c35f6 (0x9724 bytes) 2024-09-11T05:33:10.476 INFO:teuthology.orchestra.run.smithi070.stdout:1433 read 0x23d0cc8 thru 0x23de9e5 (0xdd1e bytes) 2024-09-11T05:33:10.476 INFO:teuthology.orchestra.run.smithi070.stdout:1434 read 0x4ff87fb thru 0x4ffa73e (0x1f44 bytes) 2024-09-11T05:33:10.476 INFO:teuthology.orchestra.run.smithi070.stdout:1435 write 0x6f6d719 thru 0x6f77738 (0xa020 bytes) 2024-09-11T05:33:10.481 INFO:teuthology.orchestra.run.smithi070.stdout:1436 write 0x723e1a7 thru 0x724c5d3 (0xe42d bytes) 2024-09-11T05:33:10.482 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:10.481+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:10.482 INFO:teuthology.orchestra.run.smithi070.stdout:1437 write 0x18cb8cc thru 0x18d8573 (0xcca8 bytes) 2024-09-11T05:33:10.494 INFO:teuthology.orchestra.run.smithi070.stdout:1438 punch from 0x6a3239f to 0x6a3b768, (0x93c9 bytes) 2024-09-11T05:33:10.494 INFO:teuthology.orchestra.run.smithi070.stdout:1439 read 0x52118b1 thru 0x521a116 (0x8866 bytes) 2024-09-11T05:33:10.494 INFO:teuthology.orchestra.run.smithi070.stdout:1440 read 0x4adc828 thru 0x4ae7710 (0xaee9 bytes) 2024-09-11T05:33:10.502 INFO:teuthology.orchestra.run.smithi070.stdout:1441 trunc from 0xec5bf21 to 0x81a556b 2024-09-11T05:33:10.512 INFO:teuthology.orchestra.run.smithi070.stdout:1442 read 0x467e26b thru 0x467eb93 (0x929 bytes) 2024-09-11T05:33:10.513 INFO:teuthology.orchestra.run.smithi070.stdout:1443 writesame 0x5197ad7 thru 0x519c9c1 data_size 0x1(0x4eeb bytes) 2024-09-11T05:33:10.524 INFO:teuthology.orchestra.run.smithi070.stdout:1444 writesame 0x80b0209 thru 0x80b51a8 data_size 0x1a(0x4fa0 bytes) 2024-09-11T05:33:10.528 INFO:teuthology.orchestra.run.smithi070.stdout:1445 read 0x78eea7c thru 0x78f9e67 (0xb3ec bytes) 2024-09-11T05:33:10.532 INFO:teuthology.orchestra.run.smithi070.stdout:1447 trunc from 0x81a556b to 0xb7c7f43 2024-09-11T05:33:10.543 INFO:teuthology.orchestra.run.smithi070.stdout:1448 writesame 0xbde0396 thru 0xbde613b data_size 0x2(0x5da6 bytes) 2024-09-11T05:33:10.550 INFO:teuthology.orchestra.run.smithi070.stdout:1450 writesame 0xc9efce8 thru 0xc9fef0c data_size 0x1(0xf225 bytes) 2024-09-11T05:33:10.550 INFO:teuthology.orchestra.run.smithi070.stdout:1451 read 0x9f5babc thru 0x9f643f9 (0x893e bytes) 2024-09-11T05:33:10.550 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.553 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:10.554 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:10.554 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:10.554 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:10.554 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.554 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-11T05:33:10.554 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.610837+0000", 2024-09-11T05:33:10.554 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 30.941474330999998, 2024-09-11T05:33:10.554 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0059650909999999996, 2024-09-11T05:33:10.554 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.554 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.554 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.554 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610837+0000", 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610837+0000", 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610837+0000", 2024-09-11T05:33:10.555 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1099999999999995e-07 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610843+0000", 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.699e-06 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610854+0000", 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1188e-05 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.610859+0000", 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9749999999999998e-06 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.613785+0000", 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002925881 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.613811+0000", 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5965e-05 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.616750+0000", 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029392680000000001 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.616802+0000", 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1403999999999998e-05 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.611420+0000", 2024-09-11T05:33:10.558 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 30.940891222000001, 2024-09-11T05:33:10.559 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0084477409999999999, 2024-09-11T05:33:10.559 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.559 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.559 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.559 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.559 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.559 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.611420+0000", 2024-09-11T05:33:10.559 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.559 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.559 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.611420+0000", 2024-09-11T05:33:10.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.611420+0000", 2024-09-11T05:33:10.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.92e-07 2024-09-11T05:33:10.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.611451+0000", 2024-09-11T05:33:10.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0154999999999998e-05 2024-09-11T05:33:10.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.611462+0000", 2024-09-11T05:33:10.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1466e-05 2024-09-11T05:33:10.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.611467+0000", 2024-09-11T05:33:10.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.938e-06 2024-09-11T05:33:10.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.614073+0000", 2024-09-11T05:33:10.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026055990000000001 2024-09-11T05:33:10.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.562 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.562 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.614091+0000", 2024-09-11T05:33:10.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8813000000000001e-05 2024-09-11T05:33:10.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.562 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:10.562 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.619835+0000", 2024-09-11T05:33:10.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005743494 2024-09-11T05:33:10.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.619867+0000", 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2484000000000003e-05 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=16'39)", 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.612107+0000", 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 30.940203643, 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0077767390000000004, 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.563 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.564 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.564 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.612107+0000", 2024-09-11T05:33:10.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.612107+0000", 2024-09-11T05:33:10.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.612108+0000", 2024-09-11T05:33:10.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9200000000000001e-07 2024-09-11T05:33:10.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.566 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.566 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.612112+0000", 2024-09-11T05:33:10.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5070000000000002e-06 2024-09-11T05:33:10.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.566 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.566 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.612120+0000", 2024-09-11T05:33:10.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4819999999999997e-06 2024-09-11T05:33:10.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.612124+0000", 2024-09-11T05:33:10.567 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8330000000000004e-06 2024-09-11T05:33:10.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.614593+0000", 2024-09-11T05:33:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0024693509999999998 2024-09-11T05:33:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.614607+0000", 2024-09-11T05:33:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.4462e-05 2024-09-11T05:33:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.619869+0000", 2024-09-11T05:33:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052615140000000001 2024-09-11T05:33:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.569 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.569 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.619884+0000", 2024-09-11T05:33:10.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5098e-05 2024-09-11T05:33:10.569 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.569 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.569 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.569 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:73 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'47, mlcod=16'43)", 2024-09-11T05:33:10.569 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.621971+0000", 2024-09-11T05:33:10.569 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 30.930339556, 2024-09-11T05:33:10.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0059640919999999998, 2024-09-11T05:33:10.569 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.570 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.570 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.570 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.621971+0000", 2024-09-11T05:33:10.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.621971+0000", 2024-09-11T05:33:10.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.621972+0000", 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622032+0000", 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0577e-05 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622039+0000", 2024-09-11T05:33:10.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1849999999999998e-06 2024-09-11T05:33:10.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622045+0000", 2024-09-11T05:33:10.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6200000000000004e-06 2024-09-11T05:33:10.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622101+0000", 2024-09-11T05:33:10.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6039000000000003e-05 2024-09-11T05:33:10.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622118+0000", 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.732e-05 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.627906+0000", 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0057875269999999998 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.627935+0000", 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9383e-05 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.573 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:74 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'48, mlcod=16'43)", 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.622476+0000", 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 30.929834751000001, 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054752780000000001, 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.574 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622476+0000", 2024-09-11T05:33:10.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.575 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622476+0000", 2024-09-11T05:33:10.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.575 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622477+0000", 2024-09-11T05:33:10.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1999999999999999e-07 2024-09-11T05:33:10.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622481+0000", 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3919999999999996e-06 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622496+0000", 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5237e-05 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622502+0000", 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6509999999999998e-06 2024-09-11T05:33:10.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.577 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.577 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622535+0000", 2024-09-11T05:33:10.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3243e-05 2024-09-11T05:33:10.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.577 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.577 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.622548+0000", 2024-09-11T05:33:10.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2662e-05 2024-09-11T05:33:10.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.577 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:10.577 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.627937+0000", 2024-09-11T05:33:10.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0053892230000000003 2024-09-11T05:33:10.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.627951+0000", 2024-09-11T05:33:10.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.4250000000000001e-05 2024-09-11T05:33:10.578 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.578 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.578 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.578 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:115 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'77, mlcod=16'73)", 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.849560+0000", 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 30.702750431999998, 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050404550000000001, 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849560+0000", 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849560+0000", 2024-09-11T05:33:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849561+0000", 2024-09-11T05:33:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0800000000000005e-07 2024-09-11T05:33:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849631+0000", 2024-09-11T05:33:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9684000000000006e-05 2024-09-11T05:33:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849640+0000", 2024-09-11T05:33:10.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7699999999999996e-06 2024-09-11T05:33:10.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849646+0000", 2024-09-11T05:33:10.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7450000000000001e-06 2024-09-11T05:33:10.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849678+0000", 2024-09-11T05:33:10.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1980999999999998e-05 2024-09-11T05:33:10.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.582 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.582 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.582 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849691+0000", 2024-09-11T05:33:10.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2547e-05 2024-09-11T05:33:10.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.582 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.582 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:10.582 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.854551+0000", 2024-09-11T05:33:10.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0048601429999999999 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.854601+0000", 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0077000000000002e-05 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:116 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'78, mlcod=16'73)", 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.849972+0000", 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 30.702338738000002, 2024-09-11T05:33:10.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0075296679999999998, 2024-09-11T05:33:10.584 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.584 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.584 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.584 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849972+0000", 2024-09-11T05:33:10.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849972+0000", 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849975+0000", 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849979+0000", 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849986+0000", 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8480000000000003e-06 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.849993+0000", 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1570000000000003e-06 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850026+0000", 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2719000000000003e-05 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.587 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.587 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850035+0000", 2024-09-11T05:33:10.587 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6819999999999998e-06 2024-09-11T05:33:10.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.587 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.587 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:10.587 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.857463+0000", 2024-09-11T05:33:10.587 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0074274349999999996 2024-09-11T05:33:10.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.587 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.587 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.587 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.857502+0000", 2024-09-11T05:33:10.587 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9045999999999999e-05 2024-09-11T05:33:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4194.0:117 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'79, mlcod=16'75)", 2024-09-11T05:33:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:32:39.850622+0000", 2024-09-11T05:33:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 30.701689178999999, 2024-09-11T05:33:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0068985990000000001, 2024-09-11T05:33:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850622+0000", 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850622+0000", 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850622+0000", 2024-09-11T05:33:10.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.63e-07 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850626+0000", 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5829999999999998e-06 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850633+0000", 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.075e-06 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850638+0000", 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2009999999999998e-06 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850671+0000", 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2758e-05 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.850684+0000", 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3611000000000001e-05 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:10.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.857504+0000", 2024-09-11T05:33:10.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0068197379999999997 2024-09-11T05:33:10.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:32:39.857520+0000", 2024-09-11T05:33:10.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6169999999999999e-05 2024-09-11T05:33:10.592 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.592 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.592 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.592 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:666 3.0 3:05ba09ea:::rbd_data.112da50123d8.0000000000000006:head [stat,truncate 7864320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:00.919688+0000", 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 9.6326227479999993, 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0070816619999999999, 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 666 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919688+0000", 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919688+0000", 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919690+0000", 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9970000000000001e-06 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.595 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919700+0000", 2024-09-11T05:33:10.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.8789999999999998e-06 2024-09-11T05:33:10.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.595 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919732+0000", 2024-09-11T05:33:10.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2064000000000003e-05 2024-09-11T05:33:10.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919754+0000", 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2172e-05 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919902+0000", 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014731100000000001 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920029+0000", 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012731299999999999 2024-09-11T05:33:10.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 7", 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920155+0000", 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012596800000000001 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920915+0000", 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00075980999999999998 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926707+0000", 2024-09-11T05:33:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0057919399999999998 2024-09-11T05:33:10.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:10.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926737+0000", 2024-09-11T05:33:10.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0156999999999999e-05 2024-09-11T05:33:10.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926770+0000", 2024-09-11T05:33:10.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3050999999999999e-05 2024-09-11T05:33:10.598 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.598 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.598 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.599 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:672 3.10 e26/22 3:090f802f:::rbd_data.112da50123d8.000000000000000c:head v 26'2, mlcod=0'0)", 2024-09-11T05:33:10.599 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:00.920674+0000", 2024-09-11T05:33:10.599 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 9.6316365019999992, 2024-09-11T05:33:10.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0058441830000000002, 2024-09-11T05:33:10.599 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.599 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.599 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.599 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920674+0000", 2024-09-11T05:33:10.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.600 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.600 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920674+0000", 2024-09-11T05:33:10.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.600 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.600 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920675+0000", 2024-09-11T05:33:10.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0999999999999997e-07 2024-09-11T05:33:10.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920681+0000", 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1190000000000002e-06 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920695+0000", 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3335e-05 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920705+0000", 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0608000000000001e-05 2024-09-11T05:33:10.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920753+0000", 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8269999999999997e-05 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920772+0000", 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8725000000000001e-05 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926426+0000", 2024-09-11T05:33:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0056539729999999996 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926519+0000", 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2342999999999993e-05 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:937 3.17 3:eff84ccf:::rbd_data.112da50123d8.000000000000000a:head [stat,truncate 2621440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.175032+0000", 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 9.3772787050000002, 2024-09-11T05:33:10.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054180670000000004, 2024-09-11T05:33:10.604 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.604 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.604 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.604 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.604 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.604 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.604 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 937 2024-09-11T05:33:10.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.604 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.604 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.604 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.604 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175032+0000", 2024-09-11T05:33:10.604 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175032+0000", 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175033+0000", 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5799999999999998e-07 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175037+0000", 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8739999999999997e-06 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175047+0000", 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0196e-05 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175054+0000", 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3100000000000003e-06 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.607 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175108+0000", 2024-09-11T05:33:10.607 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3321e-05 2024-09-11T05:33:10.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.607 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.607 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.607 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175184+0000", 2024-09-11T05:33:10.607 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6465999999999996e-05 2024-09-11T05:33:10.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.607 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.607 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:10.607 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175336+0000", 2024-09-11T05:33:10.607 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015205199999999999 2024-09-11T05:33:10.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.176676+0000", 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0013399449999999999 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180391+0000", 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0037146979999999998 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180425+0000", 2024-09-11T05:33:10.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3915000000000003e-05 2024-09-11T05:33:10.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.609 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.609 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.609 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180450+0000", 2024-09-11T05:33:10.609 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5432e-05 2024-09-11T05:33:10.609 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.609 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.609 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.609 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.609 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1716 3.18 3:1decd148:::rbd_data.112d83e8b99.0000000000000014:head [stat,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:10.609 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.722246+0000", 2024-09-11T05:33:10.609 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8300646379999996, 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0048678979999999998, 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1716 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722246+0000", 2024-09-11T05:33:10.610 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722246+0000", 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722247+0000", 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0780000000000001e-06 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722252+0000", 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4739999999999999e-06 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722263+0000", 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1443e-05 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722270+0000", 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5590000000000002e-06 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.612 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722325+0000", 2024-09-11T05:33:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5096999999999998e-05 2024-09-11T05:33:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722412+0000", 2024-09-11T05:33:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6785000000000003e-05 2024-09-11T05:33:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.727114+0000", 2024-09-11T05:33:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0047024620000000001 2024-09-11T05:33:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1740 3.18 3:1decd148:::rbd_data.112d83e8b99.0000000000000014:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.728087+0000", 2024-09-11T05:33:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8242234079999999, 2024-09-11T05:33:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049178420000000004, 2024-09-11T05:33:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.614 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1740 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728087+0000", 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728087+0000", 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728088+0000", 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.06e-07 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728093+0000", 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6580000000000001e-06 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728101+0000", 2024-09-11T05:33:10.616 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3620000000000006e-06 2024-09-11T05:33:10.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.617 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.617 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728106+0000", 2024-09-11T05:33:10.617 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.369e-06 2024-09-11T05:33:10.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.617 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.617 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728140+0000", 2024-09-11T05:33:10.617 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4076999999999999e-05 2024-09-11T05:33:10.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.617 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.618 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728186+0000", 2024-09-11T05:33:10.618 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6786999999999998e-05 2024-09-11T05:33:10.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.618 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.618 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:10.618 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728303+0000", 2024-09-11T05:33:10.618 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000116902 2024-09-11T05:33:10.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.618 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.618 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:10.618 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728784+0000", 2024-09-11T05:33:10.618 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00048103700000000002 2024-09-11T05:33:10.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732947+0000", 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.004162692 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732981+0000", 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3949000000000003e-05 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.733005+0000", 2024-09-11T05:33:10.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4303000000000001e-05 2024-09-11T05:33:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:15374 3.1e 3:795a8348:::rbd_data.112d745a9e91.000000000000002c:a [read 466944~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.203173+0000", 2024-09-11T05:33:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.34913767499999998, 2024-09-11T05:33:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049343920000000001, 2024-09-11T05:33:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.621 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.621 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.621 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 15374 2024-09-11T05:33:10.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.621 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203173+0000", 2024-09-11T05:33:10.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203173+0000", 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203173+0000", 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.03e-07 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203174+0000", 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.04e-06 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203177+0000", 2024-09-11T05:33:10.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8260000000000001e-06 2024-09-11T05:33:10.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203180+0000", 2024-09-11T05:33:10.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.525e-06 2024-09-11T05:33:10.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208026+0000", 2024-09-11T05:33:10.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0048462490000000004 2024-09-11T05:33:10.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.624 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.624 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208060+0000", 2024-09-11T05:33:10.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3518e-05 2024-09-11T05:33:10.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.624 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.624 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208108+0000", 2024-09-11T05:33:10.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8031000000000001e-05 2024-09-11T05:33:10.624 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.624 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.624 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:15375 3.1e 3:795a8348:::rbd_data.112d745a9e91.000000000000002c:a [read 516096~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.203183+0000", 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.349128151, 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0051166450000000004, 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 15375 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203183+0000", 2024-09-11T05:33:10.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203183+0000", 2024-09-11T05:33:10.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203183+0000", 2024-09-11T05:33:10.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2499999999999999e-07 2024-09-11T05:33:10.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203184+0000", 2024-09-11T05:33:10.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5999999999999991e-07 2024-09-11T05:33:10.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203187+0000", 2024-09-11T05:33:10.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7939999999999998e-06 2024-09-11T05:33:10.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203189+0000", 2024-09-11T05:33:10.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4889999999999998e-06 2024-09-11T05:33:10.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208139+0000", 2024-09-11T05:33:10.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049496829999999999 2024-09-11T05:33:10.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208212+0000", 2024-09-11T05:33:10.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2914e-05 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208299+0000", 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7579999999999998e-05 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:15376 3.1e 3:795a8348:::rbd_data.112d745a9e91.000000000000002c:a [read 565248~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.203192+0000", 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.349118543, 2024-09-11T05:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052025600000000002, 2024-09-11T05:33:10.630 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.630 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.630 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:10.630 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.630 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.630 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.630 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 15376 2024-09-11T05:33:10.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.630 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203192+0000", 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203192+0000", 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203193+0000", 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.631 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203193+0000", 2024-09-11T05:33:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2399999999999996e-07 2024-09-11T05:33:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203197+0000", 2024-09-11T05:33:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5300000000000001e-06 2024-09-11T05:33:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203200+0000", 2024-09-11T05:33:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8789999999999999e-06 2024-09-11T05:33:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208312+0000", 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0051124320000000001 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208347+0000", 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4777000000000003e-05 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208395+0000", 2024-09-11T05:33:10.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7809999999999998e-05 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:15377 3.1e 3:795a8348:::rbd_data.112d745a9e91.000000000000002c:a [read 614400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.203203+0000", 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.34910802200000002, 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0053942349999999998, 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.634 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.635 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.636 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 15377 2024-09-11T05:33:10.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.636 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.636 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203203+0000", 2024-09-11T05:33:10.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203203+0000", 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203203+0000", 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203204+0000", 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0130000000000001e-06 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203208+0000", 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.597e-06 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203210+0000", 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.74e-06 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208427+0000", 2024-09-11T05:33:10.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052162379999999998 2024-09-11T05:33:10.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208502+0000", 2024-09-11T05:33:10.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5618999999999995e-05 2024-09-11T05:33:10.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208597+0000", 2024-09-11T05:33:10.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4819000000000001e-05 2024-09-11T05:33:10.639 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:15378 3.1e 3:795a8348:::rbd_data.112d745a9e91.000000000000002c:a [read 663552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.203214+0000", 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.34909705699999999, 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005484442, 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.640 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 15378 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203214+0000", 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203214+0000", 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203215+0000", 2024-09-11T05:33:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6700000000000003e-07 2024-09-11T05:33:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203216+0000", 2024-09-11T05:33:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.11e-06 2024-09-11T05:33:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203219+0000", 2024-09-11T05:33:10.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6789999999999998e-06 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203223+0000", 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.337e-06 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208613+0000", 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0053905969999999996 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208648+0000", 2024-09-11T05:33:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4978999999999998e-05 2024-09-11T05:33:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208698+0000", 2024-09-11T05:33:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9972999999999997e-05 2024-09-11T05:33:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:15379 3.1e 3:795a8348:::rbd_data.112d745a9e91.000000000000002c:a [read 712704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.203231+0000", 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.34907958500000003, 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0056552069999999998, 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 15379 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203231+0000", 2024-09-11T05:33:10.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203231+0000", 2024-09-11T05:33:10.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203232+0000", 2024-09-11T05:33:10.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0899999999999997e-07 2024-09-11T05:33:10.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203234+0000", 2024-09-11T05:33:10.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9860000000000001e-06 2024-09-11T05:33:10.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203239+0000", 2024-09-11T05:33:10.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9039999999999997e-06 2024-09-11T05:33:10.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203242+0000", 2024-09-11T05:33:10.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7020000000000001e-06 2024-09-11T05:33:10.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208730+0000", 2024-09-11T05:33:10.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054875760000000001 2024-09-11T05:33:10.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208801+0000", 2024-09-11T05:33:10.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1366999999999996e-05 2024-09-11T05:33:10.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208886+0000", 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5363000000000002e-05 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:15380 3.1e 3:795a8348:::rbd_data.112d745a9e91.000000000000002c:a [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.203246+0000", 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.34906531099999999, 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0057417079999999999, 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.649 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:10.650 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.650 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.650 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.650 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 15380 2024-09-11T05:33:10.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.650 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203246+0000", 2024-09-11T05:33:10.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203246+0000", 2024-09-11T05:33:10.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203246+0000", 2024-09-11T05:33:10.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1500000000000001e-07 2024-09-11T05:33:10.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203252+0000", 2024-09-11T05:33:10.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3249999999999996e-06 2024-09-11T05:33:10.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203260+0000", 2024-09-11T05:33:10.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2649999999999996e-06 2024-09-11T05:33:10.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.203265+0000", 2024-09-11T05:33:10.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7439999999999998e-06 2024-09-11T05:33:10.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208900+0000", 2024-09-11T05:33:10.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0056353619999999997 2024-09-11T05:33:10.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208939+0000", 2024-09-11T05:33:10.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8770000000000003e-05 2024-09-11T05:33:10.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.208987+0000", 2024-09-11T05:33:10.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8026999999999999e-05 2024-09-11T05:33:10.653 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.653 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.654 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.654 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.654 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.654 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:10.656 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:10.657 INFO:teuthology.orchestra.run.smithi070.stdout:1453 write 0xeb50271 thru 0xeb5338d (0x311d bytes) 2024-09-11T05:33:10.658 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.658 INFO:teuthology.orchestra.run.smithi070.stdout:1455 punch from 0x816f92b to 0x817265f, (0x2d34 bytes) 2024-09-11T05:33:10.658 INFO:teuthology.orchestra.run.smithi070.stdout:1456 punch from 0x1f22c8e to 0x1f29b66, (0x6ed8 bytes) 2024-09-11T05:33:10.658 INFO:teuthology.orchestra.run.smithi070.stdout:1457 punch from 0x597ed4a to 0x597f89d, (0xb53 bytes) 2024-09-11T05:33:10.658 INFO:teuthology.orchestra.run.smithi070.stdout:1458 writesame 0x33559ac thru 0x3355f81 data_size 0x9(0x5d6 bytes) 2024-09-11T05:33:10.658 INFO:teuthology.orchestra.run.smithi070.stdout:1459 write 0xb415d89 thru 0xb41b3c1 (0x5639 bytes) 2024-09-11T05:33:10.658 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.658 INFO:teuthology.orchestra.run.smithi070.stdout:1461 writesame 0x392d1ca thru 0x39301d9 data_size 0x8(0x3010 bytes) 2024-09-11T05:33:10.658 INFO:teuthology.orchestra.run.smithi070.stdout:1463 read 0x9247c06 thru 0x924b602 (0x39fd bytes) 2024-09-11T05:33:10.658 INFO:teuthology.orchestra.run.smithi070.stdout:1464 write 0xd26e081 thru 0xd27a1b7 (0xc137 bytes) 2024-09-11T05:33:10.658 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.658 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:1469 trunc from 0xeb5338e to 0xed535b3 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:1470 writesame 0x9cbf0ef thru 0x9cccc07 data_size 0x1(0xdb19 bytes) 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:1471 write 0x515208e thru 0x5160bc3 (0xeb36 bytes) 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:1472 writesame 0xc4aaba1 thru 0xc4ac094 data_size 0xc(0x14f4 bytes) 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:1476 writesame 0x1e81475 thru 0x1e8174a data_size 0x3(0x2d6 bytes) 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:1477 read 0xe6fdd64 thru 0xe701d0b (0x3fa8 bytes) 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:1480 write 0x322f650 thru 0x3236a02 (0x73b3 bytes) 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:1481 write 0xe916d47 thru 0xe91d7e0 (0x6a9a bytes) 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:1482 write 0x6ea8f34 thru 0x6eb48c8 (0xb995 bytes) 2024-09-11T05:33:10.659 INFO:teuthology.orchestra.run.smithi070.stdout:1485 punch from 0x48dac5d to 0x48e26fd, (0x7aa0 bytes) 2024-09-11T05:33:10.660 INFO:teuthology.orchestra.run.smithi070.stdout:1488 trunc from 0xed535b3 to 0x40ae9fa 2024-09-11T05:33:10.660 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:10.654+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:10.756 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:10.755+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:10.764 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:10.764 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:10.765 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:10.765 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:10.773 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:10.857 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:10.857+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:10.876 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:10.876 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:10.876 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:10.876 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:10.876 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:10.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:10.958 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:10.958+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:10.988 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:10.988 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:10.988 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:667 3.4 3:22b6acf1:::rbd_data.112da50123d8.0000000000000007:head [stat,truncate 7864320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:00.919693+0000", 2024-09-11T05:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 10.067299755000001, 2024-09-11T05:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0039871539999999997, 2024-09-11T05:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 667 2024-09-11T05:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919693+0000", 2024-09-11T05:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919693+0000", 2024-09-11T05:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919695+0000", 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.7370000000000001e-06 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919706+0000", 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0530000000000001e-05 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919733+0000", 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7103000000000001e-05 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.991 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.992 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.992 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919746+0000", 2024-09-11T05:33:10.992 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3223e-05 2024-09-11T05:33:10.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.992 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.992 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.992 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919908+0000", 2024-09-11T05:33:10.992 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016242399999999999 2024-09-11T05:33:10.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.992 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.992 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.992 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920015+0000", 2024-09-11T05:33:10.992 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000106764 2024-09-11T05:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920117+0000", 2024-09-11T05:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000102231 2024-09-11T05:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920835+0000", 2024-09-11T05:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00071793699999999998 2024-09-11T05:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.923617+0000", 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0027821719999999999 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.923655+0000", 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7342000000000003e-05 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.923680+0000", 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5690999999999998e-05 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:876 3.4 3:22b6acf1:::rbd_data.112da50123d8.0000000000000007:head [stat,truncate 1273818] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.099122+0000", 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 9.8878709390000008, 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0040213389999999996, 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:10.995 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 876 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099122+0000", 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099122+0000", 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.996 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:10.997 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099123+0000", 2024-09-11T05:33:10.997 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4899999999999995e-07 2024-09-11T05:33:10.997 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.997 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.997 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:10.997 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099125+0000", 2024-09-11T05:33:10.997 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:33:10.997 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.997 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.997 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:10.997 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099133+0000", 2024-09-11T05:33:10.997 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4610000000000002e-06 2024-09-11T05:33:10.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.998 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.998 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:10.998 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099138+0000", 2024-09-11T05:33:10.998 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4539999999999998e-06 2024-09-11T05:33:10.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.998 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.998 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:10.998 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099192+0000", 2024-09-11T05:33:10.998 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3789000000000003e-05 2024-09-11T05:33:10.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.998 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.998 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099267+0000", 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5377999999999996e-05 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099408+0000", 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014016000000000001 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100505+0000", 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0010972309999999999 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:10.999 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.000 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.000 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.103058+0000", 2024-09-11T05:33:11.000 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025533510000000001 2024-09-11T05:33:11.000 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.000 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.000 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.000 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.103104+0000", 2024-09-11T05:33:11.000 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6031e-05 2024-09-11T05:33:11.000 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.000 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.000 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.000 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.103143+0000", 2024-09-11T05:33:11.000 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.926e-05 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:934 3.4 3:22b6acf1:::rbd_data.112da50123d8.0000000000000007:head [stat,truncate 2621440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.174370+0000", 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 9.8126234910000001, 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0035831130000000002, 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.001 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 934 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174370+0000", 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174370+0000", 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.003 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.003 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.003 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174370+0000", 2024-09-11T05:33:11.003 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9699999999999996e-07 2024-09-11T05:33:11.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.003 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.003 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.003 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174374+0000", 2024-09-11T05:33:11.003 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4690000000000002e-06 2024-09-11T05:33:11.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.003 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.003 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.003 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174381+0000", 2024-09-11T05:33:11.004 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6569999999999997e-06 2024-09-11T05:33:11.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.004 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.004 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.004 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174387+0000", 2024-09-11T05:33:11.004 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6269999999999997e-06 2024-09-11T05:33:11.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.004 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.004 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.004 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174451+0000", 2024-09-11T05:33:11.004 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3715999999999998e-05 2024-09-11T05:33:11.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.004 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174509+0000", 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7896000000000003e-05 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174582+0000", 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3097999999999997e-05 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175326+0000", 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00074403000000000002 2024-09-11T05:33:11.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.177860+0000", 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025341640000000002 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.177913+0000", 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3081999999999998e-05 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.177953+0000", 2024-09-11T05:33:11.006 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9777000000000002e-05 2024-09-11T05:33:11.007 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.007 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.007 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.007 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.007 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.007 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:938 3.15 e26/22 3:ab6ce323:::rbd_data.112da50123d8.000000000000000b:head v 26'13, mlcod=26'11)", 2024-09-11T05:33:11.007 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.175480+0000", 2024-09-11T05:33:11.007 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 9.8115127040000001, 2024-09-11T05:33:11.007 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005063812, 2024-09-11T05:33:11.007 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.007 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.007 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.007 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175480+0000", 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175480+0000", 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175481+0000", 2024-09-11T05:33:11.008 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0299999999999998e-07 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175493+0000", 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2079000000000001e-05 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175503+0000", 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9170000000000001e-06 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.009 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175508+0000", 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6600000000000003e-06 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175546+0000", 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8043999999999997e-05 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175566+0000", 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.067e-05 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.010 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180516+0000", 2024-09-11T05:33:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049498110000000001 2024-09-11T05:33:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180544+0000", 2024-09-11T05:33:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7928000000000001e-05 2024-09-11T05:33:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.011 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1042 3.4 3:22b6acf1:::rbd_data.112da50123d8.0000000000000007:head [stat,truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:11.012 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.326274+0000", 2024-09-11T05:33:11.012 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 9.6607186419999991, 2024-09-11T05:33:11.012 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038336149999999999, 2024-09-11T05:33:11.012 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.012 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.012 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.012 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.012 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.012 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.012 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1042 2024-09-11T05:33:11.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.012 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.012 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326274+0000", 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326274+0000", 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326275+0000", 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8400000000000004e-07 2024-09-11T05:33:11.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326278+0000", 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9100000000000001e-06 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326286+0000", 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8299999999999996e-06 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326293+0000", 2024-09-11T05:33:11.014 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9199999999999998e-06 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326344+0000", 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1394000000000003e-05 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326426+0000", 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1984999999999995e-05 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:11.015 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.326564+0000", 2024-09-11T05:33:11.016 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013788900000000001 2024-09-11T05:33:11.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.016 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.016 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.016 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.329801+0000", 2024-09-11T05:33:11.016 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003237275 2024-09-11T05:33:11.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.016 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.016 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:11.016 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.330049+0000", 2024-09-11T05:33:11.016 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00024757700000000002 2024-09-11T05:33:11.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.016 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.017 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.017 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.330085+0000", 2024-09-11T05:33:11.017 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6220999999999998e-05 2024-09-11T05:33:11.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.017 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.017 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.017 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.330108+0000", 2024-09-11T05:33:11.017 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3030000000000001e-05 2024-09-11T05:33:11.017 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.017 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.017 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.017 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:1703 3.15 e28/22 3:aa18e722:::rbd_data.112d83e8b99.000000000000000d:head v 28'19, mlcod=26'16)", 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.720457+0000", 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2665360630000002, 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003646556, 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720457+0000", 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.018 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720457+0000", 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720457+0000", 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9700000000000003e-07 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720472+0000", 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.4932999999999999e-05 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.020 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.020 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720479+0000", 2024-09-11T05:33:11.020 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2599999999999999e-06 2024-09-11T05:33:11.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.020 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.020 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.020 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720492+0000", 2024-09-11T05:33:11.020 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2269999999999999e-05 2024-09-11T05:33:11.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.020 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.020 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.021 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720543+0000", 2024-09-11T05:33:11.021 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0862000000000002e-05 2024-09-11T05:33:11.021 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.021 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.021 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.021 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.720564+0000", 2024-09-11T05:33:11.021 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1169999999999999e-05 2024-09-11T05:33:11.021 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.021 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.021 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.021 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.724063+0000", 2024-09-11T05:33:11.021 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0034994399999999999 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.724104+0000", 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0324000000000002e-05 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "pg_update_log_missing(3.15 epoch 28/22 rep_tid 131 entries 28'20 (0'0) error 3:ae0819f0:::rbd_data.112d83e8b99.000000000000000e:head by client.4397.0:1704 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 26'16)", 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.721408+0000", 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2655850859999997, 2024-09-11T05:33:11.022 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054215289999999996, 2024-09-11T05:33:11.023 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.023 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.023 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:11.023 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.023 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.023 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.023 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721408+0000", 2024-09-11T05:33:11.023 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.023 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.023 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.023 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.023 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721408+0000", 2024-09-11T05:33:11.023 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721409+0000", 2024-09-11T05:33:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3099999999999997e-07 2024-09-11T05:33:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721415+0000", 2024-09-11T05:33:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2299999999999996e-06 2024-09-11T05:33:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.024 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721429+0000", 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3679999999999999e-05 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721436+0000", 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7419999999999997e-06 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721503+0000", 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6948999999999999e-05 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.025 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.026 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.026 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726829+0000", 2024-09-11T05:33:11.026 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0053262969999999998 2024-09-11T05:33:11.026 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.026 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.026 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.026 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.026 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1709 3.12 3:4a093325:::rbd_data.112d83e8b99.0000000000000013:head [stat,delete] snapc 5=[5] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:11.026 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.721527+0000", 2024-09-11T05:33:11.026 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2654663609999997, 2024-09-11T05:33:11.026 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0055917620000000001, 2024-09-11T05:33:11.026 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1709 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721527+0000", 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.028 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.028 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721527+0000", 2024-09-11T05:33:11.028 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.028 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.028 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.028 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721527+0000", 2024-09-11T05:33:11.028 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0900000000000002e-07 2024-09-11T05:33:11.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.028 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.028 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.028 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721530+0000", 2024-09-11T05:33:11.028 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.367e-06 2024-09-11T05:33:11.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.029 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.029 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.029 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721536+0000", 2024-09-11T05:33:11.029 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4620000000000001e-06 2024-09-11T05:33:11.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.029 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.029 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.029 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721542+0000", 2024-09-11T05:33:11.029 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0820000000000004e-06 2024-09-11T05:33:11.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.029 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.029 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721591+0000", 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9227000000000001e-05 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721706+0000", 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000114768 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.727118+0000", 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054123469999999996 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.030 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.031 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.031 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.031 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1710 3.4 3:205bf505:::rbd_header.112d83e8b99:head [watch reconnect cookie 140342620614448 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:11.031 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.721554+0000", 2024-09-11T05:33:11.031 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2654393769999999, 2024-09-11T05:33:11.031 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054143619999999998, 2024-09-11T05:33:11.031 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.031 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.031 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.031 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.031 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.031 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.032 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1710 2024-09-11T05:33:11.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.032 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.032 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.032 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721554+0000", 2024-09-11T05:33:11.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.032 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.032 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721554+0000", 2024-09-11T05:33:11.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.033 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.033 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.033 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721554+0000", 2024-09-11T05:33:11.033 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6199999999999998e-07 2024-09-11T05:33:11.033 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.033 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.033 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.033 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721556+0000", 2024-09-11T05:33:11.033 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1840000000000002e-06 2024-09-11T05:33:11.033 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.033 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.033 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721563+0000", 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.353e-06 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721568+0000", 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9660000000000004e-06 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721615+0000", 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7685999999999997e-05 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.034 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721686+0000", 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0667999999999995e-05 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726968+0000", 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052820430000000002 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.035 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1720 3.7 3:e3c45f22:::rbd_data.112d83e8b99.0000000000000012:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:11.036 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.722467+0000", 2024-09-11T05:33:11.036 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2645260730000007, 2024-09-11T05:33:11.036 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0045417280000000001, 2024-09-11T05:33:11.036 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.036 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.036 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.036 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.036 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.036 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.036 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1720 2024-09-11T05:33:11.036 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.036 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.036 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.037 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.037 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722467+0000", 2024-09-11T05:33:11.037 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.037 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.037 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.037 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722467+0000", 2024-09-11T05:33:11.037 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.037 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.037 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.037 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722468+0000", 2024-09-11T05:33:11.037 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5499999999999996e-07 2024-09-11T05:33:11.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.038 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.038 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.038 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722474+0000", 2024-09-11T05:33:11.038 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7450000000000001e-06 2024-09-11T05:33:11.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.038 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.038 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.038 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722490+0000", 2024-09-11T05:33:11.038 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6515999999999999e-05 2024-09-11T05:33:11.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.039 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.039 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.039 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722498+0000", 2024-09-11T05:33:11.039 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6769999999999995e-06 2024-09-11T05:33:11.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.039 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.039 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.039 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722561+0000", 2024-09-11T05:33:11.039 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3295999999999998e-05 2024-09-11T05:33:11.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.039 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.039 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722643+0000", 2024-09-11T05:33:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1662000000000005e-05 2024-09-11T05:33:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:33:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722809+0000", 2024-09-11T05:33:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016574499999999999 2024-09-11T05:33:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723654+0000", 2024-09-11T05:33:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00084562299999999999 2024-09-11T05:33:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.041 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.041 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.041 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726920+0000", 2024-09-11T05:33:11.041 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032656569999999999 2024-09-11T05:33:11.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.041 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.044 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.044 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726965+0000", 2024-09-11T05:33:11.044 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5633999999999997e-05 2024-09-11T05:33:11.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.044 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.044 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.044 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.727009+0000", 2024-09-11T05:33:11.044 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3217999999999999e-05 2024-09-11T05:33:11.044 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.044 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.045 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.045 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.045 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "pg_update_log_missing(3.18 epoch 28/22 rep_tid 159 entries 28'5 (0'0) error 3:1decd148:::rbd_data.112d83e8b99.0000000000000014:head by client.4397.0:1716 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 25'3)", 2024-09-11T05:33:11.045 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.722601+0000", 2024-09-11T05:33:11.045 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2643915589999999, 2024-09-11T05:33:11.045 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0042928209999999996, 2024-09-11T05:33:11.045 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.045 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.045 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722601+0000", 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722601+0000", 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.046 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722602+0000", 2024-09-11T05:33:11.047 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5600000000000005e-07 2024-09-11T05:33:11.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.047 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.047 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.047 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722611+0000", 2024-09-11T05:33:11.047 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4500000000000004e-06 2024-09-11T05:33:11.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.047 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.047 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.047 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722631+0000", 2024-09-11T05:33:11.047 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9857e-05 2024-09-11T05:33:11.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.047 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.048 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.048 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722646+0000", 2024-09-11T05:33:11.048 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5082999999999999e-05 2024-09-11T05:33:11.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.048 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.048 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.048 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722712+0000", 2024-09-11T05:33:11.048 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6598000000000002e-05 2024-09-11T05:33:11.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.048 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.048 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.048 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726894+0000", 2024-09-11T05:33:11.049 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0041820770000000002 2024-09-11T05:33:11.049 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.049 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.049 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.049 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.049 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:1721 3.5 e28/22 3:a0e94ca9:::rbd_data.112d83e8b99.000000000000000b:head v 28'21, mlcod=28'18)", 2024-09-11T05:33:11.049 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.723009+0000", 2024-09-11T05:33:11.049 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2639840820000003, 2024-09-11T05:33:11.049 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003942419, 2024-09-11T05:33:11.049 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.049 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.049 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.050 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.050 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.050 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.050 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723009+0000", 2024-09-11T05:33:11.050 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.050 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.050 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.050 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723009+0000", 2024-09-11T05:33:11.050 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.050 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723010+0000", 2024-09-11T05:33:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9299999999999997e-07 2024-09-11T05:33:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723015+0000", 2024-09-11T05:33:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000001e-06 2024-09-11T05:33:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723025+0000", 2024-09-11T05:33:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.8120000000000002e-06 2024-09-11T05:33:11.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.052 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.052 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.052 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723031+0000", 2024-09-11T05:33:11.052 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1449999999999996e-06 2024-09-11T05:33:11.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.052 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.052 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.052 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723073+0000", 2024-09-11T05:33:11.052 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2382000000000002e-05 2024-09-11T05:33:11.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.053 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.053 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.053 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723093+0000", 2024-09-11T05:33:11.053 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9967e-05 2024-09-11T05:33:11.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.053 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.053 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.053 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726915+0000", 2024-09-11T05:33:11.053 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038216959999999999 2024-09-11T05:33:11.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.053 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.054 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.054 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726951+0000", 2024-09-11T05:33:11.054 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6334000000000001e-05 2024-09-11T05:33:11.054 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.054 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.054 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.054 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.054 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.054 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1741 3.12 3:4a093325:::rbd_data.112d83e8b99.0000000000000013:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:11.054 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.728162+0000", 2024-09-11T05:33:11.054 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2588307529999998, 2024-09-11T05:33:11.054 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.004709843, 2024-09-11T05:33:11.054 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1741 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728162+0000", 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.055 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.056 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.056 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728162+0000", 2024-09-11T05:33:11.056 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.056 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.056 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.056 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728163+0000", 2024-09-11T05:33:11.056 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:33:11.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.056 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.056 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.056 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728167+0000", 2024-09-11T05:33:11.056 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728176+0000", 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9870000000000005e-06 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728182+0000", 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.057 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728221+0000", 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9116999999999998e-05 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728269+0000", 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7508e-05 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728437+0000", 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016876 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:11.058 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.729189+0000", 2024-09-11T05:33:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00075146900000000005 2024-09-11T05:33:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732814+0000", 2024-09-11T05:33:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003624759 2024-09-11T05:33:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732848+0000", 2024-09-11T05:33:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4347000000000002e-05 2024-09-11T05:33:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.060 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.060 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732872+0000", 2024-09-11T05:33:11.060 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4176999999999999e-05 2024-09-11T05:33:11.060 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.060 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.060 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.060 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.060 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.060 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:1740 3.18 e28/22 3:1decd148:::rbd_data.112d83e8b99.0000000000000014:head v 28'6, mlcod=25'4)", 2024-09-11T05:33:11.060 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.728377+0000", 2024-09-11T05:33:11.060 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2586156289999995, 2024-09-11T05:33:11.060 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.004462756, 2024-09-11T05:33:11.061 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.061 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.061 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.061 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.061 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.061 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.061 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728377+0000", 2024-09-11T05:33:11.061 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.061 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.061 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.061 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.061 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728377+0000", 2024-09-11T05:33:11.062 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.062 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.062 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.062 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.062 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728378+0000", 2024-09-11T05:33:11.062 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4199999999999995e-07 2024-09-11T05:33:11.062 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.062 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.062 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.062 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728385+0000", 2024-09-11T05:33:11.062 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.528e-06 2024-09-11T05:33:11.062 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.062 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.063 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.063 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728396+0000", 2024-09-11T05:33:11.063 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1122e-05 2024-09-11T05:33:11.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.063 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.063 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.063 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728403+0000", 2024-09-11T05:33:11.063 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.956e-06 2024-09-11T05:33:11.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.063 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.063 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.063 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728451+0000", 2024-09-11T05:33:11.063 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7862999999999999e-05 2024-09-11T05:33:11.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.064 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.064 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728473+0000", 2024-09-11T05:33:11.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2844999999999999e-05 2024-09-11T05:33:11.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.064 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.064 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732801+0000", 2024-09-11T05:33:11.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0043274280000000004 2024-09-11T05:33:11.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.064 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.065 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.065 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732840+0000", 2024-09-11T05:33:11.065 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9271999999999999e-05 2024-09-11T05:33:11.065 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.065 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.065 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.065 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.065 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:4286 3.4 3:2325b4aa:::rbd_data.112d517a1288.00000000000000e5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-11T05:33:11.065 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:05.611970+0000", 2024-09-11T05:33:11.065 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.3750230170000002, 2024-09-11T05:33:11.065 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0060933869999999996, 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 4286 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.611970+0000", 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.066 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.611970+0000", 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.611972+0000", 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0260000000000002e-06 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.611983+0000", 2024-09-11T05:33:11.067 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0607e-05 2024-09-11T05:33:11.068 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.068 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.068 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.068 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.612011+0000", 2024-09-11T05:33:11.068 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8546000000000001e-05 2024-09-11T05:33:11.068 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.068 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.068 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.068 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.612025+0000", 2024-09-11T05:33:11.068 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.4136e-05 2024-09-11T05:33:11.068 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.068 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.068 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.069 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.612126+0000", 2024-09-11T05:33:11.069 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000100585 2024-09-11T05:33:11.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.069 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.069 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:33:11.069 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.612136+0000", 2024-09-11T05:33:11.069 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.026e-05 2024-09-11T05:33:11.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.069 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.069 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.069 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.614741+0000", 2024-09-11T05:33:11.069 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026046089999999999 2024-09-11T05:33:11.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.614821+0000", 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0107999999999999e-05 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.614937+0000", 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000115677 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.617961+0000", 2024-09-11T05:33:11.070 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0030245010000000002 2024-09-11T05:33:11.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.071 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.071 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.071 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.617976+0000", 2024-09-11T05:33:11.071 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5148e-05 2024-09-11T05:33:11.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.071 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.071 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.071 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.618022+0000", 2024-09-11T05:33:11.071 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5469999999999997e-05 2024-09-11T05:33:11.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.071 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.071 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.072 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.618063+0000", 2024-09-11T05:33:11.072 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1714000000000001e-05 2024-09-11T05:33:11.072 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.072 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.072 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.072 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.072 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:4819 3.1 3:83efb0b6:::rbd_object_map.112deff072db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T05:33:11.072 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:06.824907+0000", 2024-09-11T05:33:11.072 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.1620862479999996, 2024-09-11T05:33:11.072 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0040344489999999998, 2024-09-11T05:33:11.072 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.072 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 4819 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824907+0000", 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.073 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.074 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824907+0000", 2024-09-11T05:33:11.074 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.074 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.074 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.074 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824908+0000", 2024-09-11T05:33:11.074 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9100000000000002e-07 2024-09-11T05:33:11.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.074 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.074 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.074 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824915+0000", 2024-09-11T05:33:11.074 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.622e-06 2024-09-11T05:33:11.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824924+0000", 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4030000000000007e-06 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824933+0000", 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5219999999999996e-06 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.825290+0000", 2024-09-11T05:33:11.075 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035708099999999998 2024-09-11T05:33:11.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.076 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.076 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.076 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.825383+0000", 2024-09-11T05:33:11.076 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2570000000000003e-05 2024-09-11T05:33:11.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.076 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.076 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:11.076 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.825792+0000", 2024-09-11T05:33:11.076 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040932799999999998 2024-09-11T05:33:11.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.076 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.076 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.826503+0000", 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00071069600000000003 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.828843+0000", 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0023399430000000001 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.828900+0000", 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7496e-05 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.077 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.078 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.078 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.828941+0000", 2024-09-11T05:33:11.078 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0896999999999998e-05 2024-09-11T05:33:11.078 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.078 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.078 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.078 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.078 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:5107 3.1 3:83efb0b6:::rbd_object_map.112deff072db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T05:33:11.078 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:06.871712+0000", 2024-09-11T05:33:11.078 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.115280694, 2024-09-11T05:33:11.078 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003679959, 2024-09-11T05:33:11.078 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.079 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.079 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.079 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.079 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.079 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.079 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 5107 2024-09-11T05:33:11.079 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.079 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.079 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.079 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.079 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871712+0000", 2024-09-11T05:33:11.079 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.079 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871712+0000", 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871713+0000", 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871715+0000", 2024-09-11T05:33:11.080 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.872e-06 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871719+0000", 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6059999999999996e-06 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871733+0000", 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3906999999999999e-05 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.081 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872996+0000", 2024-09-11T05:33:11.082 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0012628310000000001 2024-09-11T05:33:11.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.082 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.082 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.082 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.873047+0000", 2024-09-11T05:33:11.082 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1236999999999997e-05 2024-09-11T05:33:11.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.082 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.082 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:11.082 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.873264+0000", 2024-09-11T05:33:11.082 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00021653699999999999 2024-09-11T05:33:11.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.083 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.083 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:11.083 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874801+0000", 2024-09-11T05:33:11.083 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0015369380000000001 2024-09-11T05:33:11.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.083 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.083 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.083 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875342+0000", 2024-09-11T05:33:11.083 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00054159200000000003 2024-09-11T05:33:11.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.084 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.084 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.084 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875370+0000", 2024-09-11T05:33:11.084 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7885000000000002e-05 2024-09-11T05:33:11.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.084 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.084 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.084 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875392+0000", 2024-09-11T05:33:11.084 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2229999999999999e-05 2024-09-11T05:33:11.084 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.084 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.084 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.085 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.085 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.085 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:5108 3.1 3:83efb0b6:::rbd_object_map.112deff072db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T05:33:11.085 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:06.871740+0000", 2024-09-11T05:33:11.085 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.1152528019999997, 2024-09-11T05:33:11.085 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0037320600000000002, 2024-09-11T05:33:11.085 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.085 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.085 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.085 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.085 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.085 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 5108 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871740+0000", 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871740+0000", 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871741+0000", 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.32e-07 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871743+0000", 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.967e-06 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871749+0000", 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5239999999999997e-06 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871754+0000", 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.865e-06 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.873752+0000", 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0019984460000000001 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.873813+0000", 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0473000000000002e-05 2024-09-11T05:33:11.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.089 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.089 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:11.089 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874006+0000", 2024-09-11T05:33:11.089 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000192886 2024-09-11T05:33:11.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.089 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.089 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.089 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875398+0000", 2024-09-11T05:33:11.089 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0013926380000000001 2024-09-11T05:33:11.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.089 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.089 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:11.089 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875416+0000", 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.7407000000000001e-05 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875446+0000", 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0119000000000001e-05 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875472+0000", 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6302999999999999e-05 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.090 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.091 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.091 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:5109 3.1 3:83efb0b6:::rbd_object_map.112deff072db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T05:33:11.091 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:06.871763+0000", 2024-09-11T05:33:11.091 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.1152297039999999, 2024-09-11T05:33:11.091 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038804349999999998, 2024-09-11T05:33:11.091 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.091 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.091 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.091 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.091 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.091 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.091 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 5109 2024-09-11T05:33:11.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.092 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.092 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.092 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.092 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871763+0000", 2024-09-11T05:33:11.092 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.092 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.092 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.092 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871763+0000", 2024-09-11T05:33:11.092 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.092 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.093 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.093 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871764+0000", 2024-09-11T05:33:11.093 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:33:11.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.093 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.093 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.093 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871767+0000", 2024-09-11T05:33:11.093 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4400000000000001e-06 2024-09-11T05:33:11.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.093 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.093 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.093 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871773+0000", 2024-09-11T05:33:11.093 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6550000000000001e-06 2024-09-11T05:33:11.094 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.094 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.094 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.094 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871776+0000", 2024-09-11T05:33:11.094 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1650000000000002e-06 2024-09-11T05:33:11.094 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.094 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.094 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.094 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874251+0000", 2024-09-11T05:33:11.094 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0024749030000000001 2024-09-11T05:33:11.094 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.094 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.094 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.095 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874299+0000", 2024-09-11T05:33:11.095 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8296e-05 2024-09-11T05:33:11.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.095 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.095 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:11.095 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874521+0000", 2024-09-11T05:33:11.095 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00022216200000000001 2024-09-11T05:33:11.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.095 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.095 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.095 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875489+0000", 2024-09-11T05:33:11.095 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00096752100000000005 2024-09-11T05:33:11.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.096 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.096 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:11.096 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875594+0000", 2024-09-11T05:33:11.096 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104693 2024-09-11T05:33:11.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.096 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.096 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.096 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875623+0000", 2024-09-11T05:33:11.096 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9448e-05 2024-09-11T05:33:11.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.096 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.096 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875644+0000", 2024-09-11T05:33:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0721e-05 2024-09-11T05:33:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:5110 3.1 3:83efb0b6:::rbd_object_map.112deff072db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T05:33:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:06.872118+0000", 2024-09-11T05:33:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.11487493, 2024-09-11T05:33:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038501579999999998, 2024-09-11T05:33:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.098 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.098 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.098 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.098 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.098 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 5110 2024-09-11T05:33:11.098 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.098 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.098 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.098 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.098 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872118+0000", 2024-09-11T05:33:11.098 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.098 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.098 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872118+0000", 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872119+0000", 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4499999999999997e-07 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872122+0000", 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5080000000000001e-06 2024-09-11T05:33:11.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.100 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.100 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872129+0000", 2024-09-11T05:33:11.100 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9970000000000001e-06 2024-09-11T05:33:11.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.100 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.100 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872133+0000", 2024-09-11T05:33:11.100 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8789999999999996e-06 2024-09-11T05:33:11.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.100 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.100 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874822+0000", 2024-09-11T05:33:11.101 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026886670000000001 2024-09-11T05:33:11.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.101 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.101 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.101 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874869+0000", 2024-09-11T05:33:11.101 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6881000000000001e-05 2024-09-11T05:33:11.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.101 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.101 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:11.101 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875105+0000", 2024-09-11T05:33:11.101 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000235997 2024-09-11T05:33:11.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.101 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875653+0000", 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00054827700000000001 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875926+0000", 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00027281000000000001 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875951+0000", 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5329000000000001e-05 2024-09-11T05:33:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.103 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.103 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.103 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875968+0000", 2024-09-11T05:33:11.103 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.7167999999999999e-05 2024-09-11T05:33:11.103 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.103 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.103 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.103 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.103 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.103 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:11.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:11.105 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:11.104+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:11.206 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:11.205+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:11.248 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:11.249 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:11.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.249 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.249 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:11.249 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.60044561100000005, 2024-09-11T05:33:11.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.60048209799999996, 2024-09-11T05:33:11.249 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.249 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.249 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:33:11.249 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.249 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.249 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.249 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:33:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:33:11.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:33:11.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:33:11.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:33:11.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:33:11.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:33:11.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:33:11.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:33:11.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:33:11.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:33:11.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.253 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.254 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.254 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.254 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-11T05:33:11.254 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 1 2024-09-11T05:33:11.254 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:11.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:11.341 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:11.341+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:11.399 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:11.400 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:11.400 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:11.400 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:11.408 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:11.408 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:11.407+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:11.509 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:11.508+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:11.553 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:11.553 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:11.554 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:11.554 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:11.554 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.554 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:669 3.8 3:17968d03:::rbd_data.112da50123d8.0000000000000009:head [stat,truncate 7864320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:11.554 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:00.919760+0000", 2024-09-11T05:33:11.554 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 10.632165448, 2024-09-11T05:33:11.554 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0069521119999999999, 2024-09-11T05:33:11.554 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.554 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 669 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919760+0000", 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.555 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919760+0000", 2024-09-11T05:33:11.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919761+0000", 2024-09-11T05:33:11.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1170000000000001e-06 2024-09-11T05:33:11.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919767+0000", 2024-09-11T05:33:11.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9200000000000001e-06 2024-09-11T05:33:11.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.557 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919785+0000", 2024-09-11T05:33:11.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8410000000000002e-05 2024-09-11T05:33:11.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.557 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919968+0000", 2024-09-11T05:33:11.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00018297499999999999 2024-09-11T05:33:11.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.558 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.558 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920660+0000", 2024-09-11T05:33:11.558 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00069168099999999998 2024-09-11T05:33:11.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.558 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.559 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920747+0000", 2024-09-11T05:33:11.559 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7056000000000001e-05 2024-09-11T05:33:11.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.559 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:11.559 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920893+0000", 2024-09-11T05:33:11.559 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014623899999999999 2024-09-11T05:33:11.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:11.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.921678+0000", 2024-09-11T05:33:11.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00078508699999999996 2024-09-11T05:33:11.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926617+0000", 2024-09-11T05:33:11.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049389550000000001 2024-09-11T05:33:11.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926666+0000", 2024-09-11T05:33:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8738e-05 2024-09-11T05:33:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926712+0000", 2024-09-11T05:33:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5933999999999998e-05 2024-09-11T05:33:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:666 3.0 e26/22 3:05ba09ea:::rbd_data.112da50123d8.0000000000000006:head v 26'8, mlcod=26'6)", 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:00.920430+0000", 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 10.631495601999999, 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0061794570000000002, 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920430+0000", 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.562 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920430+0000", 2024-09-11T05:33:11.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920430+0000", 2024-09-11T05:33:11.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7000000000000004e-07 2024-09-11T05:33:11.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920436+0000", 2024-09-11T05:33:11.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2079999999999997e-06 2024-09-11T05:33:11.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920446+0000", 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.3999999999999998e-06 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920452+0000", 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2949999999999999e-06 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920651+0000", 2024-09-11T05:33:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00019905500000000001 2024-09-11T05:33:11.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920669+0000", 2024-09-11T05:33:11.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.7850999999999999e-05 2024-09-11T05:33:11.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926572+0000", 2024-09-11T05:33:11.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0059027890000000003 2024-09-11T05:33:11.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926609+0000", 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7188999999999999e-05 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:878 3.8 3:17968d03:::rbd_data.112da50123d8.0000000000000009:head [stat,truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.099146+0000", 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 10.452779305, 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.006959682, 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.566 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 878 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099146+0000", 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099146+0000", 2024-09-11T05:33:11.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.568 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.568 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099146+0000", 2024-09-11T05:33:11.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9800000000000003e-07 2024-09-11T05:33:11.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.568 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.568 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099150+0000", 2024-09-11T05:33:11.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6509999999999999e-06 2024-09-11T05:33:11.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.569 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.569 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099158+0000", 2024-09-11T05:33:11.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2779999999999993e-06 2024-09-11T05:33:11.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.569 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.569 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099165+0000", 2024-09-11T05:33:11.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1909999999999997e-06 2024-09-11T05:33:11.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.569 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.569 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099981+0000", 2024-09-11T05:33:11.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00081619699999999995 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100057+0000", 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5980000000000001e-05 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100168+0000", 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000111156 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:11.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.102169+0000", 2024-09-11T05:33:11.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0020009659999999999 2024-09-11T05:33:11.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.106034+0000", 2024-09-11T05:33:11.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038647540000000002 2024-09-11T05:33:11.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.106068+0000", 2024-09-11T05:33:11.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4848000000000002e-05 2024-09-11T05:33:11.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.106105+0000", 2024-09-11T05:33:11.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7063000000000001e-05 2024-09-11T05:33:11.572 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.572 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.572 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.572 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:873 3.c e26/22 3:316882c1:::rbd_data.112da50123d8.0000000000000004:head v 26'12, mlcod=26'9)", 2024-09-11T05:33:11.572 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.100046+0000", 2024-09-11T05:33:11.572 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 10.451879227999999, 2024-09-11T05:33:11.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0060209529999999999, 2024-09-11T05:33:11.572 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100046+0000", 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100046+0000", 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100046+0000", 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8999999999999996e-07 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100052+0000", 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3029999999999999e-06 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100061+0000", 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7860000000000002e-06 2024-09-11T05:33:11.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100067+0000", 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7830000000000001e-06 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100125+0000", 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8013999999999997e-05 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100144+0000", 2024-09-11T05:33:11.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8442000000000001e-05 2024-09-11T05:33:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.106027+0000", 2024-09-11T05:33:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005883508 2024-09-11T05:33:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.106067+0000", 2024-09-11T05:33:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9527000000000003e-05 2024-09-11T05:33:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:936 3.8 3:17968d03:::rbd_data.112da50123d8.0000000000000009:head [stat,truncate 2621440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.174372+0000", 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 10.3775534, 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0062560439999999997, 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 936 2024-09-11T05:33:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174372+0000", 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174372+0000", 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174372+0000", 2024-09-11T05:33:11.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174374+0000", 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1050000000000002e-06 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174384+0000", 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9029999999999999e-06 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174390+0000", 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4539999999999998e-06 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174907+0000", 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00051710999999999999 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174978+0000", 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1449e-05 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175137+0000", 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000158553 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.176643+0000", 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0015064150000000001 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180572+0000", 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003928895 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180601+0000", 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8890999999999998e-05 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180628+0000", 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6886999999999999e-05 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.582 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:931 3.c e26/22 3:316882c1:::rbd_data.112da50123d8.0000000000000004:head v 26'14, mlcod=26'11)", 2024-09-11T05:33:11.583 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.175155+0000", 2024-09-11T05:33:11.583 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 10.376770008999999, 2024-09-11T05:33:11.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054482369999999999, 2024-09-11T05:33:11.583 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.583 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.583 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.583 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.583 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.583 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.583 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175155+0000", 2024-09-11T05:33:11.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175155+0000", 2024-09-11T05:33:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175156+0000", 2024-09-11T05:33:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8700000000000005e-07 2024-09-11T05:33:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175167+0000", 2024-09-11T05:33:11.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1365999999999999e-05 2024-09-11T05:33:11.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175182+0000", 2024-09-11T05:33:11.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5213e-05 2024-09-11T05:33:11.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175191+0000", 2024-09-11T05:33:11.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4230000000000005e-06 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175280+0000", 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8807999999999994e-05 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175301+0000", 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1328999999999999e-05 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:11.586 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180573+0000", 2024-09-11T05:33:11.587 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052722790000000004 2024-09-11T05:33:11.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.587 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.587 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.587 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180603+0000", 2024-09-11T05:33:11.587 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0131999999999999e-05 2024-09-11T05:33:11.587 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.587 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.587 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.587 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.587 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16263 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.587 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.292323+0000", 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.2596019140000001, 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0048581759999999996, 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16263 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.588 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292323+0000", 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292323+0000", 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292324+0000", 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9699999999999996e-07 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292326+0000", 2024-09-11T05:33:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.114e-06 2024-09-11T05:33:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292331+0000", 2024-09-11T05:33:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5790000000000003e-06 2024-09-11T05:33:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292341+0000", 2024-09-11T05:33:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1970000000000002e-06 2024-09-11T05:33:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297093+0000", 2024-09-11T05:33:11.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0047521129999999996 2024-09-11T05:33:11.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297138+0000", 2024-09-11T05:33:11.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5439000000000003e-05 2024-09-11T05:33:11.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297181+0000", 2024-09-11T05:33:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3237e-05 2024-09-11T05:33:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16264 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 925696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.292347+0000", 2024-09-11T05:33:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.259578047, 2024-09-11T05:33:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050427420000000002, 2024-09-11T05:33:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.592 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.593 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.593 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.593 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.593 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16264 2024-09-11T05:33:11.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.593 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292347+0000", 2024-09-11T05:33:11.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292347+0000", 2024-09-11T05:33:11.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292347+0000", 2024-09-11T05:33:11.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:33:11.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292349+0000", 2024-09-11T05:33:11.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.03e-06 2024-09-11T05:33:11.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.595 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292355+0000", 2024-09-11T05:33:11.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.604e-06 2024-09-11T05:33:11.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.595 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292360+0000", 2024-09-11T05:33:11.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4739999999999999e-06 2024-09-11T05:33:11.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297220+0000", 2024-09-11T05:33:11.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0048599619999999998 2024-09-11T05:33:11.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297312+0000", 2024-09-11T05:33:11.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2878000000000001e-05 2024-09-11T05:33:11.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297390+0000", 2024-09-11T05:33:11.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7414000000000001e-05 2024-09-11T05:33:11.597 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.597 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.597 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.597 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.597 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16265 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 974848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.597 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.292366+0000", 2024-09-11T05:33:11.597 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.2595586750000001, 2024-09-11T05:33:11.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052095570000000001, 2024-09-11T05:33:11.597 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.597 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.597 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16265 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292366+0000", 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292366+0000", 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292367+0000", 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1100000000000002e-07 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292369+0000", 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.125e-06 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292375+0000", 2024-09-11T05:33:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7409999999999998e-06 2024-09-11T05:33:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292379+0000", 2024-09-11T05:33:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.493e-06 2024-09-11T05:33:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297424+0000", 2024-09-11T05:33:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050453090000000004 2024-09-11T05:33:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297503+0000", 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8603000000000006e-05 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297576+0000", 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2974999999999998e-05 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16266 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 1024000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.292385+0000", 2024-09-11T05:33:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.259540127, 2024-09-11T05:33:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0053872410000000001, 2024-09-11T05:33:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16266 2024-09-11T05:33:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292385+0000", 2024-09-11T05:33:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292385+0000", 2024-09-11T05:33:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292386+0000", 2024-09-11T05:33:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:33:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292388+0000", 2024-09-11T05:33:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.007e-06 2024-09-11T05:33:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292393+0000", 2024-09-11T05:33:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:33:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292398+0000", 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6290000000000001e-06 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297615+0000", 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005217045 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297693+0000", 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8342000000000003e-05 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297772+0000", 2024-09-11T05:33:11.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9017999999999995e-05 2024-09-11T05:33:11.606 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.606 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.606 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.606 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16464 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 540672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.606 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.293929+0000", 2024-09-11T05:33:11.606 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.257995975, 2024-09-11T05:33:11.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049176610000000003, 2024-09-11T05:33:11.606 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.607 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.607 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.607 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.607 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.607 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.607 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16464 2024-09-11T05:33:11.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.607 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.607 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.607 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.607 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293929+0000", 2024-09-11T05:33:11.607 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.608 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.608 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.608 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293929+0000", 2024-09-11T05:33:11.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.608 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.608 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.608 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293929+0000", 2024-09-11T05:33:11.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4200000000000002e-07 2024-09-11T05:33:11.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.608 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.608 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293931+0000", 2024-09-11T05:33:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.057e-06 2024-09-11T05:33:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293934+0000", 2024-09-11T05:33:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0460000000000001e-06 2024-09-11T05:33:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293943+0000", 2024-09-11T05:33:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7080000000000003e-06 2024-09-11T05:33:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298762+0000", 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.004818325 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298806+0000", 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4793999999999998e-05 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298847+0000", 2024-09-11T05:33:11.610 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0488999999999998e-05 2024-09-11T05:33:11.611 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.611 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.611 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.611 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.611 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16465 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 589824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.611 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.293947+0000", 2024-09-11T05:33:11.611 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.2579782500000001, 2024-09-11T05:33:11.611 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050070729999999999, 2024-09-11T05:33:11.611 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.611 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.611 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.611 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16465 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293947+0000", 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293947+0000", 2024-09-11T05:33:11.612 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.613 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.613 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.613 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293947+0000", 2024-09-11T05:33:11.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:33:11.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.613 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.613 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.613 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293951+0000", 2024-09-11T05:33:11.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0770000000000001e-06 2024-09-11T05:33:11.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.613 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.613 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.614 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293956+0000", 2024-09-11T05:33:11.614 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5530000000000003e-06 2024-09-11T05:33:11.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.614 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.614 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.614 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293959+0000", 2024-09-11T05:33:11.614 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0800000000000002e-06 2024-09-11T05:33:11.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.614 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.614 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.614 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298871+0000", 2024-09-11T05:33:11.614 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049121190000000004 2024-09-11T05:33:11.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.615 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298912+0000", 2024-09-11T05:33:11.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0883000000000001e-05 2024-09-11T05:33:11.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.615 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298954+0000", 2024-09-11T05:33:11.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2123999999999999e-05 2024-09-11T05:33:11.615 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.615 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.615 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.616 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16466 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.616 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.293962+0000", 2024-09-11T05:33:11.616 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.257962813, 2024-09-11T05:33:11.616 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050930089999999999, 2024-09-11T05:33:11.616 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.616 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.616 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.616 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.616 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.616 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.616 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16466 2024-09-11T05:33:11.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.617 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.617 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.617 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293962+0000", 2024-09-11T05:33:11.617 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.617 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.617 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293962+0000", 2024-09-11T05:33:11.617 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.617 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293963+0000", 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293964+0000", 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1370000000000001e-06 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293971+0000", 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8399999999999997e-06 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.618 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293973+0000", 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.711e-06 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298980+0000", 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050067230000000002 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299018+0000", 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8118000000000003e-05 2024-09-11T05:33:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299055+0000", 2024-09-11T05:33:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7119000000000002e-05 2024-09-11T05:33:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16468 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 737280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294399+0000", 2024-09-11T05:33:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.257526283, 2024-09-11T05:33:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0048626579999999997, 2024-09-11T05:33:11.621 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.621 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.621 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.621 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.621 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.621 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.621 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16468 2024-09-11T05:33:11.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.621 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294399+0000", 2024-09-11T05:33:11.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.622 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294399+0000", 2024-09-11T05:33:11.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.622 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294399+0000", 2024-09-11T05:33:11.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7100000000000002e-07 2024-09-11T05:33:11.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294401+0000", 2024-09-11T05:33:11.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0509999999999999e-06 2024-09-11T05:33:11.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294407+0000", 2024-09-11T05:33:11.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0109999999999997e-06 2024-09-11T05:33:11.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294411+0000", 2024-09-11T05:33:11.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3560000000000001e-06 2024-09-11T05:33:11.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299187+0000", 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0047765849999999999 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299224+0000", 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7153000000000002e-05 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299261+0000", 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7030999999999998e-05 2024-09-11T05:33:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16469 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 786432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294415+0000", 2024-09-11T05:33:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.257510433, 2024-09-11T05:33:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049499899999999996, 2024-09-11T05:33:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.625 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16469 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294415+0000", 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294415+0000", 2024-09-11T05:33:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294415+0000", 2024-09-11T05:33:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.23e-07 2024-09-11T05:33:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294416+0000", 2024-09-11T05:33:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2109999999999999e-06 2024-09-11T05:33:11.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294420+0000", 2024-09-11T05:33:11.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8480000000000003e-06 2024-09-11T05:33:11.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294430+0000", 2024-09-11T05:33:11.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0125999999999999e-05 2024-09-11T05:33:11.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299285+0000", 2024-09-11T05:33:11.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0048551610000000002 2024-09-11T05:33:11.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299325+0000", 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9891999999999997e-05 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299365+0000", 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9529e-05 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16470 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294437+0000", 2024-09-11T05:33:11.630 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.2574876750000001, 2024-09-11T05:33:11.631 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050253809999999998, 2024-09-11T05:33:11.631 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.631 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.631 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.631 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.631 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.631 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.631 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16470 2024-09-11T05:33:11.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.631 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294437+0000", 2024-09-11T05:33:11.632 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294437+0000", 2024-09-11T05:33:11.632 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294438+0000", 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294440+0000", 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1840000000000002e-06 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294446+0000", 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4200000000000004e-06 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294449+0000", 2024-09-11T05:33:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8210000000000002e-06 2024-09-11T05:33:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299389+0000", 2024-09-11T05:33:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049401530000000001 2024-09-11T05:33:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299427+0000", 2024-09-11T05:33:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7299999999999999e-05 2024-09-11T05:33:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299463+0000", 2024-09-11T05:33:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6091999999999999e-05 2024-09-11T05:33:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16471 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 884736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294472+0000", 2024-09-11T05:33:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.2574528410000001, 2024-09-11T05:33:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005104145, 2024-09-11T05:33:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16471 2024-09-11T05:33:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294472+0000", 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294472+0000", 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294473+0000", 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3599999999999999e-07 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294478+0000", 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5809999999999996e-06 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294482+0000", 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6229999999999999e-06 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294491+0000", 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1349999999999998e-06 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299491+0000", 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050001159999999998 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299535+0000", 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.405e-05 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299576+0000", 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1204000000000001e-05 2024-09-11T05:33:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16472 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 933888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294495+0000", 2024-09-11T05:33:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.2574296700000001, 2024-09-11T05:33:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005183727, 2024-09-11T05:33:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16472 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294495+0000", 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294495+0000", 2024-09-11T05:33:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294496+0000", 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.15e-07 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294500+0000", 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8619999999999996e-06 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294505+0000", 2024-09-11T05:33:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4020000000000001e-06 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294509+0000", 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2080000000000002e-06 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299603+0000", 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050937339999999999 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299643+0000", 2024-09-11T05:33:11.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9768999999999998e-05 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299679+0000", 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6436999999999997e-05 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16473 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294516+0000", 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.25740896, 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052687539999999996, 2024-09-11T05:33:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16473 2024-09-11T05:33:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294516+0000", 2024-09-11T05:33:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294516+0000", 2024-09-11T05:33:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294517+0000", 2024-09-11T05:33:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:33:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9209999999999999e-06 2024-09-11T05:33:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294524+0000", 2024-09-11T05:33:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8139999999999997e-06 2024-09-11T05:33:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294537+0000", 2024-09-11T05:33:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2415999999999999e-05 2024-09-11T05:33:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299704+0000", 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0051678080000000003 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299745+0000", 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0708999999999999e-05 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299785+0000", 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9712999999999997e-05 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16474 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 1032192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294544+0000", 2024-09-11T05:33:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.2573807349999999, 2024-09-11T05:33:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0053395229999999997, 2024-09-11T05:33:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16474 2024-09-11T05:33:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294544+0000", 2024-09-11T05:33:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294544+0000", 2024-09-11T05:33:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294545+0000", 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2100000000000002e-07 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294547+0000", 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0779999999999998e-06 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294559+0000", 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2401999999999999e-05 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294566+0000", 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7089999999999996e-06 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299810+0000", 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052444650000000002 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299847+0000", 2024-09-11T05:33:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6514999999999999e-05 2024-09-11T05:33:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299884+0000", 2024-09-11T05:33:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6933e-05 2024-09-11T05:33:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:11.653 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:11.658 INFO:teuthology.orchestra.run.smithi070.stdout:1489 punch from 0x225572c to 0x2257bbd, (0x2491 bytes) 2024-09-11T05:33:11.658 INFO:teuthology.orchestra.run.smithi070.stdout:1491 read 0x1691366 thru 0x169db9c (0xc837 bytes) 2024-09-11T05:33:11.658 INFO:teuthology.orchestra.run.smithi070.stdout:1492 trunc from 0x40ae9fa to 0x77871ae 2024-09-11T05:33:11.658 INFO:teuthology.orchestra.run.smithi070.stdout:1493 writesame 0x117f7fe thru 0x118bd99 data_size 0x2(0xc59c bytes) 2024-09-11T05:33:11.658 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:11.657+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:11.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:11.668 INFO:teuthology.orchestra.run.smithi070.stdout:1494 write 0x9f9ff73 thru 0x9fa8d5b (0x8de9 bytes) 2024-09-11T05:33:11.672 INFO:teuthology.orchestra.run.smithi070.stdout:1495 read 0x7580009 thru 0x758fa11 (0xfa09 bytes) 2024-09-11T05:33:11.677 INFO:teuthology.orchestra.run.smithi070.stdout:1496 write 0xa4bbe90 thru 0xa4c19a7 (0x5b18 bytes) 2024-09-11T05:33:11.681 INFO:teuthology.orchestra.run.smithi070.stdout:1499 read 0x3252c16 thru 0x325eef9 (0xc2e4 bytes) 2024-09-11T05:33:11.681 INFO:teuthology.orchestra.run.smithi070.stdout:1500 writesame 0x2765a87 thru 0x2767f4b data_size 0x1(0x24c5 bytes) 2024-09-11T05:33:11.689 INFO:teuthology.orchestra.run.smithi070.stdout:1501 read 0x8baf9ae thru 0x8bb3aeb (0x413e bytes) 2024-09-11T05:33:11.689 INFO:teuthology.orchestra.run.smithi070.stdout:1502 read 0x10f660f thru 0x11027ee (0xc1e0 bytes) 2024-09-11T05:33:11.690 INFO:teuthology.orchestra.run.smithi070.stdout:1503 punch from 0x56a124d to 0x56abda4, (0xab57 bytes) 2024-09-11T05:33:11.690 INFO:teuthology.orchestra.run.smithi070.stdout:1504 punch from 0x1a1bdae to 0x1a1c598, (0x7ea bytes) 2024-09-11T05:33:11.690 INFO:teuthology.orchestra.run.smithi070.stdout:1505 punch from 0x9e71bd9 to 0x9e81b6a, (0xff91 bytes) 2024-09-11T05:33:11.690 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:11.691 INFO:teuthology.orchestra.run.smithi070.stdout:1507 writesame 0x1531d1f thru 0x1541246 data_size 0x3c(0xf528 bytes) 2024-09-11T05:33:11.692 INFO:teuthology.orchestra.run.smithi070.stdout:1508 writesame 0x75beb34 thru 0x75c09c2 data_size 0x1(0x1e8f bytes) 2024-09-11T05:33:11.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:33:11.699 INFO:teuthology.orchestra.run.smithi070.stdout:1509 punch from 0x609463 to 0x60a253, (0xdf0 bytes) 2024-09-11T05:33:11.711 INFO:teuthology.orchestra.run.smithi070.stdout:1510 write 0xddea6ec thru 0xddeae5c (0x771 bytes) 2024-09-11T05:33:11.714 INFO:teuthology.orchestra.run.smithi070.stdout:1511 punch from 0x5826724 to 0x582b9e1, (0x52bd bytes) 2024-09-11T05:33:11.714 INFO:teuthology.orchestra.run.smithi070.stdout:1512 write 0x303d08 thru 0x30d4d5 (0x97ce bytes) 2024-09-11T05:33:11.726 INFO:teuthology.orchestra.run.smithi070.stdout:1514 read 0x9c3cb87 thru 0x9c3dd82 (0x11fc bytes) 2024-09-11T05:33:11.736 INFO:teuthology.orchestra.run.smithi070.stdout:1515 trunc from 0xddeae5d to 0x6693fbc 2024-09-11T05:33:11.753 INFO:teuthology.orchestra.run.smithi070.stdout:1516 read 0x236c24f thru 0x236e840 (0x25f2 bytes) 2024-09-11T05:33:11.757 INFO:teuthology.orchestra.run.smithi070.stdout:1517 trunc from 0x6693fbc to 0x3d86983 2024-09-11T05:33:11.758 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:11.757+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:11.763 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:11.764 INFO:teuthology.orchestra.run.smithi070.stdout:1519 punch from 0x12e5a66 to 0x12e7c76, (0x2210 bytes) 2024-09-11T05:33:11.769 INFO:teuthology.orchestra.run.smithi070.stdout:1522 trunc from 0x3d86983 to 0x8884866 2024-09-11T05:33:11.774 INFO:teuthology.orchestra.run.smithi070.stdout:1523 read 0x843d4d7 thru 0x844a27d (0xcda7 bytes) 2024-09-11T05:33:11.782 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:33:11.782 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:33:11.782 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T05:33:11.782 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T05:33:11.783 INFO:teuthology.orchestra.run.smithi070.stdout:1524 trunc from 0x8884866 to 0x1e7b0e4 2024-09-11T05:33:11.792 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:17643 3.3 3:c5cf1e35:::rbd_data.112d40cf1ce.000000000000001d:head [stat out=16b,truncate 393216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:11.790934+0000", 2024-09-11T05:33:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001453679, 2024-09-11T05:33:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014787330000000001, 2024-09-11T05:33:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:33:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 17643 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.790934+0000", 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.790934+0000", 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.790936+0000", 2024-09-11T05:33:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.102e-06 2024-09-11T05:33:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.790941+0000", 2024-09-11T05:33:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T05:33:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.790959+0000", 2024-09-11T05:33:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8085e-05 2024-09-11T05:33:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.790967+0000", 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0430000000000008e-06 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791062+0000", 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5124000000000006e-05 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791139+0000", 2024-09-11T05:33:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6645999999999998e-05 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791267+0000", 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012829700000000001 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:17648 3.3 3:c4d8f71e:::rbd_data.112d40cf1ce.0000000000000022:head [stat out=16b,truncate 393216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:11.791091+0000", 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0012975809999999999, 2024-09-11T05:33:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014116269999999999, 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 17648 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791091+0000", 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791091+0000", 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791091+0000", 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3799999999999996e-07 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791096+0000", 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9309999999999999e-06 2024-09-11T05:33:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791106+0000", 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5429999999999999e-06 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791113+0000", 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2350000000000002e-06 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791687+0000", 2024-09-11T05:33:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057381900000000004 2024-09-11T05:33:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791764+0000", 2024-09-11T05:33:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7542999999999999e-05 2024-09-11T05:33:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791893+0000", 2024-09-11T05:33:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012820600000000001 2024-09-11T05:33:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4397.0:17641 3.1c e34/22 3:3d779258:::rbd_data.112d40cf1ce.000000000000001b:head v 34'73, mlcod=34'71)", 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:11.791872+0000", 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000515885, 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00070305300000000003, 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791872+0000", 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791872+0000", 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791873+0000", 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0860000000000001e-06 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791880+0000", 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0280000000000003e-06 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791892+0000", 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1365999999999999e-05 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791899+0000", 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8310000000000003e-06 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.791989+0000", 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0136999999999994e-05 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.792010+0000", 2024-09-11T05:33:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0988999999999998e-05 2024-09-11T05:33:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:11.792560+0000", 2024-09-11T05:33:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055022600000000001 2024-09-11T05:33:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:11.806 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:11.806 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 3 2024-09-11T05:33:11.806 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:11.807 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:11.815 INFO:teuthology.orchestra.run.smithi070.stdout:1526 write 0xba2e7cd thru 0xba3c0cf (0xd903 bytes) 2024-09-11T05:33:11.819 INFO:teuthology.orchestra.run.smithi070.stdout:1527 writesame 0x290f122 thru 0x291aa21 data_size 0xa0(0xb900 bytes) 2024-09-11T05:33:11.825 INFO:teuthology.orchestra.run.smithi070.stdout:1528 write 0x6fcdba thru 0x700965 (0x3bac bytes) 2024-09-11T05:33:11.837 INFO:teuthology.orchestra.run.smithi070.stdout:1529 read 0xaf93896 thru 0xaf9b854 (0x7fbf bytes) 2024-09-11T05:33:11.845 INFO:teuthology.orchestra.run.smithi070.stdout:1530 write 0xd399b35 thru 0xd399b44 (0x10 bytes) 2024-09-11T05:33:11.854 INFO:teuthology.orchestra.run.smithi070.stdout:1531 write 0xdc097ba thru 0xdc0bc3a (0x2481 bytes) 2024-09-11T05:33:11.860 INFO:teuthology.orchestra.run.smithi070.stdout:1532 read 0x531245a thru 0x53130be (0xc65 bytes) 2024-09-11T05:33:11.861 INFO:teuthology.orchestra.run.smithi070.stdout:1533 writesame 0xb765b70 thru 0xb7742b1 data_size 0xcf(0xe742 bytes) 2024-09-11T05:33:11.861 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:11.858+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:11.861 INFO:teuthology.orchestra.run.smithi070.stdout:1534 write 0x97bf8c4 thru 0x97c945d (0x9b9a bytes) 2024-09-11T05:33:11.864 INFO:teuthology.orchestra.run.smithi070.stdout:1535 write 0xcf2026b thru 0xcf264f6 (0x628c bytes) 2024-09-11T05:33:11.867 INFO:teuthology.orchestra.run.smithi070.stdout:1536 read 0xb86d55 thru 0xb8c3ec (0x5698 bytes) 2024-09-11T05:33:11.867 INFO:teuthology.orchestra.run.smithi070.stdout:1537 writesame 0x5934eb6 thru 0x593e8b5 data_size 0x9a(0x9a00 bytes) 2024-09-11T05:33:11.870 INFO:teuthology.orchestra.run.smithi070.stdout:1538 punch from 0x58ed817 to 0x58f466d, (0x6e56 bytes) 2024-09-11T05:33:11.871 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:11.871 INFO:teuthology.orchestra.run.smithi070.stdout:1542 read 0x22c9a6b thru 0x22d18ba (0x7e50 bytes) 2024-09-11T05:33:11.871 INFO:teuthology.orchestra.run.smithi070.stdout:1543 clone 9 order 18 su 4096 sc 12 2024-09-11T05:33:11.931 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:11.931 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:11.932 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:11.932 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:11.932 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:11.940 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:11.981 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:11.981+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:12.063 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:12.062+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:12.069 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:33:12.087 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:12.087 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:12.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:12.087 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:12.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.088 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15742 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 483328~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.088 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:12.088 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.837473514, 2024-09-11T05:33:12.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022975045999999999, 2024-09-11T05:33:12.088 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.088 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.088 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.088 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15742 2024-09-11T05:33:12.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:12.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:12.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248353+0000", 2024-09-11T05:33:12.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.615e-06 2024-09-11T05:33:12.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248356+0000", 2024-09-11T05:33:12.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.641e-06 2024-09-11T05:33:12.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248360+0000", 2024-09-11T05:33:12.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:33:12.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271209+0000", 2024-09-11T05:33:12.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022848825999999999 2024-09-11T05:33:12.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271264+0000", 2024-09-11T05:33:12.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5170999999999997e-05 2024-09-11T05:33:12.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271326+0000", 2024-09-11T05:33:12.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1389000000000005e-05 2024-09-11T05:33:12.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.092 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.092 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15743 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 532480~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.093 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:12.093 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.8374579660000001, 2024-09-11T05:33:12.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023116772000000001, 2024-09-11T05:33:12.093 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15743 2024-09-11T05:33:12.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.093 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:12.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:12.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248808+0000", 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044169199999999999 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248812+0000", 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6969999999999999e-06 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248819+0000", 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6790000000000005e-06 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248826+0000", 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5509999999999996e-06 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271362+0000", 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022536348000000001 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271413+0000", 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0810000000000003e-05 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271483+0000", 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9994999999999996e-05 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15745 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 630784~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248860+0000", 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.836964206, 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022888384000000001, 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15745 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248860+0000", 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248860+0000", 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248861+0000", 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9699999999999996e-07 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248863+0000", 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2239999999999998e-06 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248869+0000", 2024-09-11T05:33:12.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248873+0000", 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4290000000000003e-06 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271654+0000", 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022780671999999998 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271694+0000", 2024-09-11T05:33:12.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0364000000000002e-05 2024-09-11T05:33:12.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271748+0000", 2024-09-11T05:33:12.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4329000000000001e-05 2024-09-11T05:33:12.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.101 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.101 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15746 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 679936~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.101 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.8369286470000001, 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022995304000000001, 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15746 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:12.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248898+0000", 2024-09-11T05:33:12.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1749999999999999e-06 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248904+0000", 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5759999999999996e-06 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248909+0000", 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9710000000000003e-06 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271775+0000", 2024-09-11T05:33:12.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022866721 2024-09-11T05:33:12.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271833+0000", 2024-09-11T05:33:12.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7132000000000001e-05 2024-09-11T05:33:12.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271891+0000", 2024-09-11T05:33:12.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8303000000000001e-05 2024-09-11T05:33:12.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.106 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15747 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 729088~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.106 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:12.106 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.836910107, 2024-09-11T05:33:12.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023120391000000001, 2024-09-11T05:33:12.106 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15747 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248916+0000", 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4270000000000001e-06 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248919+0000", 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.366e-06 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248922+0000", 2024-09-11T05:33:12.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6790000000000001e-06 2024-09-11T05:33:12.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271914+0000", 2024-09-11T05:33:12.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022992584999999999 2024-09-11T05:33:12.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271965+0000", 2024-09-11T05:33:12.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1008999999999999e-05 2024-09-11T05:33:12.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272034+0000", 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8980999999999996e-05 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15748 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 778240~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.8368991509999999, 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023325197999999998, 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15748 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-07 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248926+0000", 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.077e-06 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248930+0000", 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5920000000000001e-06 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248933+0000", 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7760000000000002e-06 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272074+0000", 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023141656 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272153+0000", 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8566999999999995e-05 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272250+0000", 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7217000000000001e-05 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.114 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16376 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 925696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.115 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:12.115 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7916352309999999, 2024-09-11T05:33:12.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023022233999999999, 2024-09-11T05:33:12.115 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16376 2024-09-11T05:33:12.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.115 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:12.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:12.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:12.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:33:12.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294191+0000", 2024-09-11T05:33:12.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1169999999999998e-06 2024-09-11T05:33:12.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294198+0000", 2024-09-11T05:33:12.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.105e-06 2024-09-11T05:33:12.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294202+0000", 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3490000000000002e-06 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317070+0000", 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022868169000000001 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317141+0000", 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0947999999999999e-05 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317211+0000", 2024-09-11T05:33:12.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0154999999999995e-05 2024-09-11T05:33:12.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.119 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.119 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16377 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 974848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.119 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:12.119 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7916168080000001, 2024-09-11T05:33:12.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023184939000000002, 2024-09-11T05:33:12.119 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16377 2024-09-11T05:33:12.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.120 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:12.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294208+0000", 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5600000000000001e-07 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294210+0000", 2024-09-11T05:33:12.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294215+0000", 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7989999999999999e-06 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294220+0000", 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6580000000000001e-06 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317241+0000", 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023020987999999999 2024-09-11T05:33:12.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317315+0000", 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3496000000000002e-05 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317392+0000", 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7720999999999997e-05 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16378 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 1024000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7915988629999999, 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023298976999999998, 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16378 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294226+0000", 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294228+0000", 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-06 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294234+0000", 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1399999999999997e-06 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294239+0000", 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:33:12.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317420+0000", 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023181499000000001 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317478+0000", 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7608999999999997e-05 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317524+0000", 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6378999999999998e-05 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.127 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16400 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 532480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7914784049999999, 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022889597000000001, 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16400 2024-09-11T05:33:12.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.129 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:12.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:12.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7e-07 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294348+0000", 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294354+0000", 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9880000000000001e-06 2024-09-11T05:33:12.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294359+0000", 2024-09-11T05:33:12.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1580000000000004e-06 2024-09-11T05:33:12.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317080+0000", 2024-09-11T05:33:12.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022720884 2024-09-11T05:33:12.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317162+0000", 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1432000000000002e-05 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317235+0000", 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3705e-05 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16401 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7914587740000001, 2024-09-11T05:33:12.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02302893, 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16401 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294366+0000", 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5499999999999998e-07 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294368+0000", 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:33:12.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294374+0000", 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1720000000000004e-06 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294379+0000", 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9089999999999999e-06 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317261+0000", 2024-09-11T05:33:12.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022882442999999999 2024-09-11T05:33:12.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317322+0000", 2024-09-11T05:33:12.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0145000000000001e-05 2024-09-11T05:33:12.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317394+0000", 2024-09-11T05:33:12.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2756000000000006e-05 2024-09-11T05:33:12.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.136 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16402 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 630784~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.791439378, 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023196998, 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16402 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0900000000000002e-07 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294387+0000", 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9139999999999998e-06 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294393+0000", 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294398+0000", 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317424+0000", 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023026042 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317489+0000", 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5488999999999996e-05 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317582+0000", 2024-09-11T05:33:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2658000000000006e-05 2024-09-11T05:33:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16403 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 679936~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.791420316, 2024-09-11T05:33:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023338022999999999, 2024-09-11T05:33:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16403 2024-09-11T05:33:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T05:33:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294406+0000", 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.902e-06 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294413+0000", 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3450000000000002e-06 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294417+0000", 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9599999999999999e-06 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317608+0000", 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023190137 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317666+0000", 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317742+0000", 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6247000000000004e-05 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16404 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 729088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.791400954, 2024-09-11T05:33:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023640379, 2024-09-11T05:33:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16404 2024-09-11T05:33:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294424+0000", 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294426+0000", 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0420000000000001e-06 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294432+0000", 2024-09-11T05:33:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8810000000000001e-06 2024-09-11T05:33:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294436+0000", 2024-09-11T05:33:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9529999999999998e-06 2024-09-11T05:33:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317770+0000", 2024-09-11T05:33:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023333513 2024-09-11T05:33:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317900+0000", 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013032699999999999 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318064+0000", 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016326900000000001 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16405 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 778240~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7913815099999999, 2024-09-11T05:33:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023946875999999999, 2024-09-11T05:33:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16405 2024-09-11T05:33:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.15e-07 2024-09-11T05:33:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294445+0000", 2024-09-11T05:33:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.838e-06 2024-09-11T05:33:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294451+0000", 2024-09-11T05:33:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8279999999999999e-06 2024-09-11T05:33:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294455+0000", 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-06 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318095+0000", 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023639667999999999 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318161+0000", 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6305999999999998e-05 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318390+0000", 2024-09-11T05:33:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000228481 2024-09-11T05:33:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16406 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 827392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7913631290000001, 2024-09-11T05:33:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024093394000000001, 2024-09-11T05:33:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16406 2024-09-11T05:33:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4999999999999998e-07 2024-09-11T05:33:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294463+0000", 2024-09-11T05:33:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.108e-06 2024-09-11T05:33:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294469+0000", 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8359999999999997e-06 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294474+0000", 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3150000000000002e-06 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318421+0000", 2024-09-11T05:33:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023947231999999999 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318492+0000", 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1367999999999998e-05 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318554+0000", 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2185000000000002e-05 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16407 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.791344287, 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024230683999999999, 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16407 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:33:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294482+0000", 2024-09-11T05:33:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0959999999999999e-06 2024-09-11T05:33:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294488+0000", 2024-09-11T05:33:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8549999999999998e-06 2024-09-11T05:33:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294492+0000", 2024-09-11T05:33:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2180000000000001e-06 2024-09-11T05:33:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318583+0000", 2024-09-11T05:33:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024090232 2024-09-11T05:33:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318648+0000", 2024-09-11T05:33:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5538999999999997e-05 2024-09-11T05:33:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318711+0000", 2024-09-11T05:33:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2366000000000006e-05 2024-09-11T05:33:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16408 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 925696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7913252989999999, 2024-09-11T05:33:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024377862, 2024-09-11T05:33:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16408 2024-09-11T05:33:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294502+0000", 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4420000000000001e-06 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294508+0000", 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1410000000000002e-06 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294512+0000", 2024-09-11T05:33:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.605e-06 2024-09-11T05:33:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318738+0000", 2024-09-11T05:33:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02422535 2024-09-11T05:33:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318816+0000", 2024-09-11T05:33:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7836999999999994e-05 2024-09-11T05:33:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318877+0000", 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1058999999999999e-05 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16409 3.1b 3.bc4667fb (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7913062389999999, 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575657000000001, 2024-09-11T05:33:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16409 2024-09-11T05:33:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294520+0000", 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9410000000000001e-06 2024-09-11T05:33:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294526+0000", 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9649999999999996e-06 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294531+0000", 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5600000000000004e-06 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319081+0000", 2024-09-11T05:33:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024550249 2024-09-11T05:33:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319094+0000", 2024-09-11T05:33:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2621e-05 2024-09-11T05:33:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16410 3.1b 3.bc4667fb (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7912880069999999, 2024-09-11T05:33:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024587633000000001, 2024-09-11T05:33:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16410 2024-09-11T05:33:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.15e-07 2024-09-11T05:33:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294544+0000", 2024-09-11T05:33:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6830000000000008e-06 2024-09-11T05:33:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294550+0000", 2024-09-11T05:33:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:33:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294555+0000", 2024-09-11T05:33:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319117+0000", 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024561862 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319124+0000", 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8539999999999999e-06 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.178 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:12.179 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:33:12.181 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 34, 2024-09-11T05:33:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "eb5ff116-0384-4170-94d3-d3ddcb9c254f", 2024-09-11T05:33:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T05:32:25.817911+0000", 2024-09-11T05:33:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T05:33:09.672258+0000", 2024-09-11T05:33:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T05:32:37.539498+0000", 2024-09-11T05:33:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T05:32:54.623194+0000", 2024-09-11T05:33:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T05:33:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5806080, 2024-09-11T05:33:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T05:33:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2024-09-11T05:33:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "noscrub", 2024-09-11T05:33:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T05:33:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T05:33:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T05:33:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T05:33:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 5, 2024-09-11T05:33:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T05:33:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T05:33:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T05:33:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T05:33:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T05:33:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:37.977484+0000", 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:33:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:33:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:33:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:33:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:33:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:33:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:33:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:33:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:33:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:33:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T05:33:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T05:33:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T05:33:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T05:33:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T05:33:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:33:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:33:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:33:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:33:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:33:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:33:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:33:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "17", 2024-09-11T05:33:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:33:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:33:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:33:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:33:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:33:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T05:33:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T05:33:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:33:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:33:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:33:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:33:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:33:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:33:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:33:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:33:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:33:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:33:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:33:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:33:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:33:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:33:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:33:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:33:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:33:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:33:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:33:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:33:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:33:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T05:33:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:33:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:33:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-11T05:33:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-11T05:33:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-11T05:33:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T05:33:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T05:33:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-11T05:33:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-11T05:33:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-11T05:33:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T05:33:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T05:33:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:43.780723+0000", 2024-09-11T05:33:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T05:33:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:33:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:33:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:33:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:33:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:33:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:33:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:33:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:33:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:33:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:33:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:33:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "21", 2024-09-11T05:33:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:33:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:33:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:33:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:33:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:33:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T05:33:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 21, 2024-09-11T05:33:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:33:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:33:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:33:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:33:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:33:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:33:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:33:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:33:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:33:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:33:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:33:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:33:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:33:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:33:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:33:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:33:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:33:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:33:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T05:33:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:33:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T05:33:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:33:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:33:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 4.9800000190734863, 2024-09-11T05:33:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 4.9800000190734863, 2024-09-11T05:33:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T05:33:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 4.380000114440918, 2024-09-11T05:33:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 4.380000114440918, 2024-09-11T05:33:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-11T05:33:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-11T05:33:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-11T05:33:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T05:33:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T05:33:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:53.728195+0000", 2024-09-11T05:33:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T05:33:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:33:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:33:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:33:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:33:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:33:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:33:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:33:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:33:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:33:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:33:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:33:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "34", 2024-09-11T05:33:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:33:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:33:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:33:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:33:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:33:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 10, 2024-09-11T05:33:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 34, 2024-09-11T05:33:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:33:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:33:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:33:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:33:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:33:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:33:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:33:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:33:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:33:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:33:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:33:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:33:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:33:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:33:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:33:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:33:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:33:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:33:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:33:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:33:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:33:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:33:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:33:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:33:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:33:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:33:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:33:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:33:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:33:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:33:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T05:33:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:33:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T05:33:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:33:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:33:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.7400000095367432, 2024-09-11T05:33:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.7400000095367432, 2024-09-11T05:33:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T05:33:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-11T05:33:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-11T05:33:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-11T05:33:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-11T05:33:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "6ef7487b-9326-4062-8fe4-ef39030252bd", 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T05:33:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T05:33:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T05:33:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T05:33:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T05:33:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T05:33:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6819/4108497907", 2024-09-11T05:33:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6821/4108497907", 2024-09-11T05:33:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6825/4108497907", 2024-09-11T05:33:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6823/4108497907", 2024-09-11T05:33:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T05:33:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "3e0d8348-6e1b-4d63-b0f1-c20d90d73760", 2024-09-11T05:33:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T05:33:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T05:33:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T05:33:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T05:33:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T05:33:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/3979396531", 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/3979396531", 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/3979396531", 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/3979396531", 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T05:33:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "38bbb42f-85e2-4064-8f55-e0385aff07d4", 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T05:33:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T05:33:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T05:33:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T05:33:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6811/4053894977", 2024-09-11T05:33:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6813/4053894977", 2024-09-11T05:33:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6817/4053894977", 2024-09-11T05:33:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6815/4053894977", 2024-09-11T05:33:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T05:33:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "e96ca529-f3b3-4f7e-bd59-1e9872a5efab", 2024-09-11T05:33:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T05:33:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T05:33:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6832", 2024-09-11T05:33:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6833", 2024-09-11T05:33:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T05:33:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T05:33:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6827/2067624829", 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6829/2067624829", 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6833/2067624829", 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6831/2067624829", 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dbbde660-d90e-4e02-9a01-16b0f76aa2b8", 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 0, 2024-09-11T05:33:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0, 2024-09-11T05:33:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 18, 2024-09-11T05:33:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6816", 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6817", 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6818", 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6819", 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6822", 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6823", 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6820", 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6821", 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6817/1743986256", 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6819/1743986256", 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6823/1743986256", 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6821/1743986256", 2024-09-11T05:33:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "2dc1a002-3ec0-4b4d-b84d-e684fa8a9131", 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 27, 2024-09-11T05:33:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6824", 2024-09-11T05:33:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6825", 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6826", 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6827", 2024-09-11T05:33:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6830", 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6831", 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6828", 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6829", 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6825/2732588656", 2024-09-11T05:33:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6827/2732588656", 2024-09-11T05:33:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6831/2732588656", 2024-09-11T05:33:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6829/2732588656", 2024-09-11T05:33:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T05:33:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a", 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6800", 2024-09-11T05:33:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6801", 2024-09-11T05:33:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6802", 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6803", 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6806", 2024-09-11T05:33:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6807", 2024-09-11T05:33:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6804", 2024-09-11T05:33:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6805", 2024-09-11T05:33:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6801/372011645", 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6803/372011645", 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6807/372011645", 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6805/372011645", 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "5fef4450-317c-4e1f-b05b-80740b9538f1", 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6808", 2024-09-11T05:33:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6809", 2024-09-11T05:33:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6810", 2024-09-11T05:33:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6811", 2024-09-11T05:33:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6814", 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6815", 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6812", 2024-09-11T05:33:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6813", 2024-09-11T05:33:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6809/583221652", 2024-09-11T05:33:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6811/583221652", 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6815/583221652", 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6813/583221652", 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.130019+0000", 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.339373+0000", 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T05:33:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.204705+0000", 2024-09-11T05:33:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T05:33:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.075490+0000", 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 65536, 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.279790+0000", 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.287168+0000", 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T05:33:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:34.320448+0000", 2024-09-11T05:33:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T05:33:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:34.838001+0000", 2024-09-11T05:33:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [], 2024-09-11T05:33:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [ 2024-09-11T05:33:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "2.4", 2024-09-11T05:33:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T05:33:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 6, 2024-09-11T05:33:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 1 2024-09-11T05:33:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T05:33:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T05:33:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T05:33:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T05:33:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [], 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T05:33:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T05:33:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T05:33:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T05:33:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T05:33:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T05:33:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T05:33:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T05:33:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:12.258 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:12.259 INFO:tasks.thrashosds.thrasher:j is {'epoch': 34, 'fsid': 'eb5ff116-0384-4170-94d3-d3ddcb9c254f', 'created': '2024-09-11T05:32:25.817911+0000', 'modified': '2024-09-11T05:33:09.672258+0000', 'last_up_change': '2024-09-11T05:32:37.539498+0000', 'last_in_change': '2024-09-11T05:32:54.623194+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T05:32:37.977484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T05:32:43.780723+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T05:32:53.728195+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 10, 'snap_epoch': 34, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '6ef7487b-9326-4062-8fe4-ef39030252bd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 4108497907}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 4108497907}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 4108497907}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 4108497907}]}, 'public_addr': '172.21.15.70:6819/4108497907', 'cluster_addr': '172.21.15.70:6821/4108497907', 'heartbeat_back_addr': '172.21.15.70:6825/4108497907', 'heartbeat_front_addr': '172.21.15.70:6823/4108497907', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3e0d8348-6e1b-4d63-b0f1-c20d90d73760', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 3979396531}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 3979396531}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 3979396531}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 3979396531}]}, 'public_addr': '172.21.15.70:6801/3979396531', 'cluster_addr': '172.21.15.70:6803/3979396531', 'heartbeat_back_addr': '172.21.15.70:6807/3979396531', 'heartbeat_front_addr': '172.21.15.70:6805/3979396531', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '38bbb42f-85e2-4064-8f55-e0385aff07d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 4053894977}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 4053894977}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 4053894977}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 4053894977}]}, 'public_addr': '172.21.15.70:6811/4053894977', 'cluster_addr': '172.21.15.70:6813/4053894977', 'heartbeat_back_addr': '172.21.15.70:6817/4053894977', 'heartbeat_front_addr': '172.21.15.70:6815/4053894977', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e96ca529-f3b3-4f7e-bd59-1e9872a5efab', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2067624829}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2067624829}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6832', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6833', 'nonce': 2067624829}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2067624829}]}, 'public_addr': '172.21.15.70:6827/2067624829', 'cluster_addr': '172.21.15.70:6829/2067624829', 'heartbeat_back_addr': '172.21.15.70:6833/2067624829', 'heartbeat_front_addr': '172.21.15.70:6831/2067624829', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'dbbde660-d90e-4e02-9a01-16b0f76aa2b8', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6816', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6817', 'nonce': 1743986256}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6818', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6819', 'nonce': 1743986256}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6822', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6823', 'nonce': 1743986256}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6820', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6821', 'nonce': 1743986256}]}, 'public_addr': '172.21.15.84:6817/1743986256', 'cluster_addr': '172.21.15.84:6819/1743986256', 'heartbeat_back_addr': '172.21.15.84:6823/1743986256', 'heartbeat_front_addr': '172.21.15.84:6821/1743986256', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2dc1a002-3ec0-4b4d-b84d-e684fa8a9131', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6824', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6825', 'nonce': 2732588656}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6826', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6827', 'nonce': 2732588656}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6830', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6831', 'nonce': 2732588656}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6828', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6829', 'nonce': 2732588656}]}, 'public_addr': '172.21.15.84:6825/2732588656', 'cluster_addr': '172.21.15.84:6827/2732588656', 'heartbeat_back_addr': '172.21.15.84:6831/2732588656', 'heartbeat_front_addr': '172.21.15.84:6829/2732588656', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6800', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6801', 'nonce': 372011645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6802', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6803', 'nonce': 372011645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6806', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6807', 'nonce': 372011645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6804', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6805', 'nonce': 372011645}]}, 'public_addr': '172.21.15.84:6801/372011645', 'cluster_addr': '172.21.15.84:6803/372011645', 'heartbeat_back_addr': '172.21.15.84:6807/372011645', 'heartbeat_front_addr': '172.21.15.84:6805/372011645', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '5fef4450-317c-4e1f-b05b-80740b9538f1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6808', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6809', 'nonce': 583221652}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6810', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6811', 'nonce': 583221652}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6814', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6815', 'nonce': 583221652}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6812', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6813', 'nonce': 583221652}]}, 'public_addr': '172.21.15.84:6809/583221652', 'cluster_addr': '172.21.15.84:6811/583221652', 'heartbeat_back_addr': '172.21.15.84:6815/583221652', 'heartbeat_front_addr': '172.21.15.84:6813/583221652', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.130019+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.339373+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.204705+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.075490+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.279790+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.287168+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:34.320448+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:34.838001+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.4', 'mappings': [{'from': 6, 'to': 1}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T05:33:12.260 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:33:12.260 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:12.178+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:12.260 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:12.261 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:12.261 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:12.261 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:12.262 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:12.262 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:12.262 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:12.263 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:12.263 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:12.263 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:12.273 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:12.273 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:12.290 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:12.291 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:12.290+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:12.307 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:12.367 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:12.367 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:12.376 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:12.380 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:12.380+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:12.480 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:12.480 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:12.481 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:12.481+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:12.489 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:12.547 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:33:12.548 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:33:12.559 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-11T05:33:11.950836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":118729166,"num_objects":139,"num_object_clones":30,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":32,"num_read":11839,"num_read_kb":20940,"num_write":2769,"num_write_kb":16562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2231,"ondisk_log_size":2231,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":232448,"kb_used_data":9760,"kb_used_omap":10,"kb_used_meta":222325,"kb_avail":660370432,"statfs":{"total":676457349120,"available":676219322368,"internally_reserved":0,"allocated":9994240,"data_stored":8935568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11157,"internal_metadata":227660907},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":60181741,"num_objects":57,"num_object_clones":13,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":9,"num_read":7225,"num_read_kb":14654,"num_write":1527,"num_write_kb":7129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.282784"},"pg_stats":[{"pgid":"3.1f","version":"30'114","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.670193+0000","last_change":"2024-09-11T05:32:57.613041+0000","last_active":"2024-09-11T05:33:07.670193+0000","last_peered":"2024-09-11T05:33:07.670193+0000","last_clean":"2024-09-11T05:33:07.670193+0000","last_became_active":"2024-09-11T05:32:55.616706+0000","last_became_peered":"2024-09-11T05:32:55.616706+0000","last_unstale":"2024-09-11T05:33:07.670193+0000","last_undegraded":"2024-09-11T05:33:07.670193+0000","last_fullsized":"2024-09-11T05:33:07.670193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:35:04.807500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069887699999999998,"stat_sum":{"num_bytes":2697157,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":493,"num_read_kb":487,"num_write":174,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"31'18","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.977130+0000","last_change":"2024-09-11T05:32:57.612693+0000","last_active":"2024-09-11T05:33:07.977130+0000","last_peered":"2024-09-11T05:33:07.977130+0000","last_clean":"2024-09-11T05:33:07.977130+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:33:07.977130+0000","last_undegraded":"2024-09-11T05:33:07.977130+0000","last_fullsized":"2024-09-11T05:33:07.977130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:49:55.339722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039696399999999998,"stat_sum":{"num_bytes":12836998,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":222,"num_write":21,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"30'21","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.889554+0000","last_change":"2024-09-11T05:32:57.891873+0000","last_active":"2024-09-11T05:33:07.889554+0000","last_peered":"2024-09-11T05:33:07.889554+0000","last_clean":"2024-09-11T05:33:07.889554+0000","last_became_active":"2024-09-11T05:32:55.615674+0000","last_became_peered":"2024-09-11T05:32:55.615674+0000","last_unstale":"2024-09-11T05:33:07.889554+0000","last_undegraded":"2024-09-11T05:33:07.889554+0000","last_fullsized":"2024-09-11T05:33:07.889554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:28.147355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057469400000000005,"stat_sum":{"num_bytes":582578,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":61,"num_read_kb":22,"num_write":21,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"32'24","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.859099+0000","last_change":"2024-09-11T05:32:57.610640+0000","last_active":"2024-09-11T05:33:07.859099+0000","last_peered":"2024-09-11T05:33:07.859099+0000","last_clean":"2024-09-11T05:33:07.859099+0000","last_became_active":"2024-09-11T05:32:55.611900+0000","last_became_peered":"2024-09-11T05:32:55.611900+0000","last_unstale":"2024-09-11T05:33:07.859099+0000","last_undegraded":"2024-09-11T05:33:07.859099+0000","last_fullsized":"2024-09-11T05:33:07.859099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:37.896881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060489099999999998,"stat_sum":{"num_bytes":2522635,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":74,"num_read_kb":361,"num_write":23,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"30'175","reported_seq":234,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.670308+0000","last_change":"2024-09-11T05:32:57.607436+0000","last_active":"2024-09-11T05:33:07.670308+0000","last_peered":"2024-09-11T05:33:07.670308+0000","last_clean":"2024-09-11T05:33:07.670308+0000","last_became_active":"2024-09-11T05:32:55.616210+0000","last_became_peered":"2024-09-11T05:32:55.616210+0000","last_unstale":"2024-09-11T05:33:07.670308+0000","last_undegraded":"2024-09-11T05:33:07.670308+0000","last_fullsized":"2024-09-11T05:33:07.670308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:55:21.520583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061541299999999998,"stat_sum":{"num_bytes":1636609,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":787,"num_read_kb":745,"num_write":287,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"30'10","reported_seq":356,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.861914+0000","last_change":"2024-09-11T05:32:57.611081+0000","last_active":"2024-09-11T05:33:07.861914+0000","last_peered":"2024-09-11T05:33:07.861914+0000","last_clean":"2024-09-11T05:33:07.861914+0000","last_became_active":"2024-09-11T05:32:55.612495+0000","last_became_peered":"2024-09-11T05:32:55.612495+0000","last_unstale":"2024-09-11T05:33:07.861914+0000","last_undegraded":"2024-09-11T05:33:07.861914+0000","last_fullsized":"2024-09-11T05:33:07.861914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:51.837064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049061,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":308,"num_read_kb":307,"num_write":9,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"31'361","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.682562+0000","last_change":"2024-09-11T05:32:57.610393+0000","last_active":"2024-09-11T05:33:07.682562+0000","last_peered":"2024-09-11T05:33:07.682562+0000","last_clean":"2024-09-11T05:33:07.682562+0000","last_became_active":"2024-09-11T05:32:55.616919+0000","last_became_peered":"2024-09-11T05:32:55.616919+0000","last_unstale":"2024-09-11T05:33:07.682562+0000","last_undegraded":"2024-09-11T05:33:07.682562+0000","last_fullsized":"2024-09-11T05:33:07.682562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:31.605014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050971999999999996,"stat_sum":{"num_bytes":52,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1720,"num_read_kb":1379,"num_write":588,"num_write_kb":803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"30'19","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.670077+0000","last_change":"2024-09-11T05:32:57.613299+0000","last_active":"2024-09-11T05:33:07.670077+0000","last_peered":"2024-09-11T05:33:07.670077+0000","last_clean":"2024-09-11T05:33:07.670077+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:33:07.670077+0000","last_undegraded":"2024-09-11T05:33:07.670077+0000","last_fullsized":"2024-09-11T05:33:07.670077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:15.009446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084187599999999997,"stat_sum":{"num_bytes":950272,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":1,"num_read_kb":0,"num_write":17,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"30'51","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.670249+0000","last_change":"2024-09-11T05:32:57.613037+0000","last_active":"2024-09-11T05:33:07.670249+0000","last_peered":"2024-09-11T05:33:07.670249+0000","last_clean":"2024-09-11T05:33:07.670249+0000","last_became_active":"2024-09-11T05:32:55.620957+0000","last_became_peered":"2024-09-11T05:32:55.620957+0000","last_unstale":"2024-09-11T05:33:07.670249+0000","last_undegraded":"2024-09-11T05:33:07.670249+0000","last_fullsized":"2024-09-11T05:33:07.670249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:33.570292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065268399999999995,"stat_sum":{"num_bytes":174360,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":112,"num_write":51,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"30'36","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.672414+0000","last_change":"2024-09-11T05:32:57.891156+0000","last_active":"2024-09-11T05:33:07.672414+0000","last_peered":"2024-09-11T05:33:07.672414+0000","last_clean":"2024-09-11T05:33:07.672414+0000","last_became_active":"2024-09-11T05:32:55.618120+0000","last_became_peered":"2024-09-11T05:32:55.618120+0000","last_unstale":"2024-09-11T05:33:07.672414+0000","last_undegraded":"2024-09-11T05:33:07.672414+0000","last_fullsized":"2024-09-11T05:33:07.672414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:16.608630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057970299999999999,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":71,"num_read_kb":1380,"num_write":34,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"31'37","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.979848+0000","last_change":"2024-09-11T05:32:57.607444+0000","last_active":"2024-09-11T05:33:07.979848+0000","last_peered":"2024-09-11T05:33:07.979848+0000","last_clean":"2024-09-11T05:33:07.979848+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:33:07.979848+0000","last_undegraded":"2024-09-11T05:33:07.979848+0000","last_fullsized":"2024-09-11T05:33:07.979848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:25.054384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066300199999999999,"stat_sum":{"num_bytes":2118187,"num_objects":8,"num_object_clones":3,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":73,"num_read_kb":184,"num_write":33,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"32'39","reported_seq":158,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.979493+0000","last_change":"2024-09-11T05:32:57.890899+0000","last_active":"2024-09-11T05:33:07.979493+0000","last_peered":"2024-09-11T05:33:07.979493+0000","last_clean":"2024-09-11T05:33:07.979493+0000","last_became_active":"2024-09-11T05:32:55.617623+0000","last_became_peered":"2024-09-11T05:32:55.617623+0000","last_unstale":"2024-09-11T05:33:07.979493+0000","last_undegraded":"2024-09-11T05:33:07.979493+0000","last_fullsized":"2024-09-11T05:33:07.979493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:31:07.487572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073758600000000004,"stat_sum":{"num_bytes":5505081,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":105,"num_read_kb":1162,"num_write":37,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.676461+0000","last_change":"2024-09-11T05:32:47.598023+0000","last_active":"2024-09-11T05:33:07.676461+0000","last_peered":"2024-09-11T05:33:07.676461+0000","last_clean":"2024-09-11T05:33:07.676461+0000","last_became_active":"2024-09-11T05:32:45.702003+0000","last_became_peered":"2024-09-11T05:32:45.702003+0000","last_unstale":"2024-09-11T05:33:07.676461+0000","last_undegraded":"2024-09-11T05:33:07.676461+0000","last_fullsized":"2024-09-11T05:33:07.676461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:08.654916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"31'36","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.837985+0000","last_change":"2024-09-11T05:32:57.659941+0000","last_active":"2024-09-11T05:33:07.837985+0000","last_peered":"2024-09-11T05:33:07.837985+0000","last_clean":"2024-09-11T05:33:07.837985+0000","last_became_active":"2024-09-11T05:32:55.613342+0000","last_became_peered":"2024-09-11T05:32:55.613342+0000","last_unstale":"2024-09-11T05:33:07.837985+0000","last_undegraded":"2024-09-11T05:33:07.837985+0000","last_fullsized":"2024-09-11T05:33:07.837985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:43:31.727093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033519099999999998,"stat_sum":{"num_bytes":596220,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":5,"num_read_kb":0,"num_write":35,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.670226+0000","last_change":"2024-09-11T05:32:55.614406+0000","last_active":"2024-09-11T05:33:07.670226+0000","last_peered":"2024-09-11T05:33:07.670226+0000","last_clean":"2024-09-11T05:33:07.670226+0000","last_became_active":"2024-09-11T05:32:55.614125+0000","last_became_peered":"2024-09-11T05:32:55.614125+0000","last_unstale":"2024-09-11T05:33:07.670226+0000","last_undegraded":"2024-09-11T05:33:07.670226+0000","last_fullsized":"2024-09-11T05:33:07.670226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:06:59.971006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"30'14","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.674476+0000","last_change":"2024-09-11T05:32:57.618706+0000","last_active":"2024-09-11T05:33:07.674476+0000","last_peered":"2024-09-11T05:33:07.674476+0000","last_clean":"2024-09-11T05:33:07.674476+0000","last_became_active":"2024-09-11T05:32:55.615465+0000","last_became_peered":"2024-09-11T05:32:55.615465+0000","last_unstale":"2024-09-11T05:33:07.674476+0000","last_undegraded":"2024-09-11T05:33:07.674476+0000","last_fullsized":"2024-09-11T05:33:07.674476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:53.206753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099597899999999992,"stat_sum":{"num_bytes":1088193,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":3,"num_read":1,"num_read_kb":0,"num_write":11,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.676579+0000","last_change":"2024-09-11T05:32:55.611737+0000","last_active":"2024-09-11T05:33:07.676579+0000","last_peered":"2024-09-11T05:33:07.676579+0000","last_clean":"2024-09-11T05:33:07.676579+0000","last_became_active":"2024-09-11T05:32:55.611432+0000","last_became_peered":"2024-09-11T05:32:55.611432+0000","last_unstale":"2024-09-11T05:33:07.676579+0000","last_undegraded":"2024-09-11T05:33:07.676579+0000","last_fullsized":"2024-09-11T05:33:07.676579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:16.067863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"30'108","reported_seq":646,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.674499+0000","last_change":"2024-09-11T05:32:57.618700+0000","last_active":"2024-09-11T05:33:07.674499+0000","last_peered":"2024-09-11T05:33:07.674499+0000","last_clean":"2024-09-11T05:33:07.674499+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:33:07.674499+0000","last_undegraded":"2024-09-11T05:33:07.674499+0000","last_fullsized":"2024-09-11T05:33:07.674499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:07:40.999985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010906679999999999,"stat_sum":{"num_bytes":987033,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1500,"num_read_kb":1380,"num_write":100,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.669992+0000","last_change":"2024-09-11T05:33:02.663770+0000","last_active":"2024-09-11T05:33:07.669992+0000","last_peered":"2024-09-11T05:33:07.669992+0000","last_clean":"2024-09-11T05:33:07.669992+0000","last_became_active":"2024-09-11T05:33:02.663542+0000","last_became_peered":"2024-09-11T05:33:02.663542+0000","last_unstale":"2024-09-11T05:33:07.669992+0000","last_undegraded":"2024-09-11T05:33:07.669992+0000","last_fullsized":"2024-09-11T05:33:07.669992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:36.032555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"32'60","reported_seq":316,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.976371+0000","last_change":"2024-09-11T05:32:57.890326+0000","last_active":"2024-09-11T05:33:07.976371+0000","last_peered":"2024-09-11T05:33:07.976371+0000","last_clean":"2024-09-11T05:33:07.976371+0000","last_became_active":"2024-09-11T05:32:55.611732+0000","last_became_peered":"2024-09-11T05:32:55.611732+0000","last_unstale":"2024-09-11T05:33:07.976371+0000","last_undegraded":"2024-09-11T05:33:07.976371+0000","last_fullsized":"2024-09-11T05:33:07.976371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:06:29.244502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045416500000000003,"stat_sum":{"num_bytes":5570645,"num_objects":10,"num_object_clones":1,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":2,"num_read":482,"num_read_kb":1619,"num_write":59,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'60","reported_seq":167,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.979072+0000","last_change":"2024-09-11T05:32:57.607689+0000","last_active":"2024-09-11T05:33:07.979072+0000","last_peered":"2024-09-11T05:33:07.979072+0000","last_clean":"2024-09-11T05:33:07.979072+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:33:07.979072+0000","last_undegraded":"2024-09-11T05:33:07.979072+0000","last_fullsized":"2024-09-11T05:33:07.979072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:07:45.895234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074095900000000002,"stat_sum":{"num_bytes":3183081,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":87,"num_read_kb":31,"num_write":61,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.676369+0000","last_change":"2024-09-11T05:32:47.597956+0000","last_active":"2024-09-11T05:33:07.676369+0000","last_peered":"2024-09-11T05:33:07.676369+0000","last_clean":"2024-09-11T05:33:07.676369+0000","last_became_active":"2024-09-11T05:32:45.702439+0000","last_became_peered":"2024-09-11T05:32:45.702439+0000","last_unstale":"2024-09-11T05:33:07.676369+0000","last_undegraded":"2024-09-11T05:33:07.676369+0000","last_fullsized":"2024-09-11T05:33:07.676369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:27:05.110151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195137,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"31'45","reported_seq":190,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.976910+0000","last_change":"2024-09-11T05:32:57.612724+0000","last_active":"2024-09-11T05:33:07.976910+0000","last_peered":"2024-09-11T05:33:07.976910+0000","last_clean":"2024-09-11T05:33:07.976910+0000","last_became_active":"2024-09-11T05:32:55.613283+0000","last_became_peered":"2024-09-11T05:32:55.613283+0000","last_unstale":"2024-09-11T05:33:07.976910+0000","last_undegraded":"2024-09-11T05:33:07.976910+0000","last_fullsized":"2024-09-11T05:33:07.976910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:01:37.153043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041242399999999999,"stat_sum":{"num_bytes":8711313,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":133,"num_read_kb":1481,"num_write":44,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.837911+0000","last_change":"2024-09-11T05:32:47.726973+0000","last_active":"2024-09-11T05:33:07.837911+0000","last_peered":"2024-09-11T05:33:07.837911+0000","last_clean":"2024-09-11T05:33:07.837911+0000","last_became_active":"2024-09-11T05:32:45.585103+0000","last_became_peered":"2024-09-11T05:32:45.585103+0000","last_unstale":"2024-09-11T05:33:07.837911+0000","last_undegraded":"2024-09-11T05:33:07.837911+0000","last_fullsized":"2024-09-11T05:33:07.837911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:07:32.584388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039722200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"32'44","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.888688+0000","last_change":"2024-09-11T05:32:57.617928+0000","last_active":"2024-09-11T05:33:07.888688+0000","last_peered":"2024-09-11T05:33:07.888688+0000","last_clean":"2024-09-11T05:33:07.888688+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:33:07.888688+0000","last_undegraded":"2024-09-11T05:33:07.888688+0000","last_fullsized":"2024-09-11T05:33:07.888688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:22.630851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045617500000000002,"stat_sum":{"num_bytes":1528787,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":237,"num_write":59,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.676199+0000","last_change":"2024-09-11T05:32:47.597556+0000","last_active":"2024-09-11T05:33:07.676199+0000","last_peered":"2024-09-11T05:33:07.676199+0000","last_clean":"2024-09-11T05:33:07.676199+0000","last_became_active":"2024-09-11T05:32:45.585150+0000","last_became_peered":"2024-09-11T05:32:45.585150+0000","last_unstale":"2024-09-11T05:33:07.676199+0000","last_undegraded":"2024-09-11T05:33:07.676199+0000","last_fullsized":"2024-09-11T05:33:07.676199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:57:16.674978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077988099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"31'25","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.973752+0000","last_change":"2024-09-11T05:32:57.890067+0000","last_active":"2024-09-11T05:33:07.973752+0000","last_peered":"2024-09-11T05:33:07.973752+0000","last_clean":"2024-09-11T05:33:07.973752+0000","last_became_active":"2024-09-11T05:32:55.616909+0000","last_became_peered":"2024-09-11T05:32:55.616909+0000","last_unstale":"2024-09-11T05:33:07.973752+0000","last_undegraded":"2024-09-11T05:33:07.973752+0000","last_fullsized":"2024-09-11T05:33:07.973752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:21:30.502849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054678799999999998,"stat_sum":{"num_bytes":2787596,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":58,"num_read_kb":131,"num_write":25,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.676498+0000","last_change":"2024-09-11T05:32:47.597195+0000","last_active":"2024-09-11T05:33:07.676498+0000","last_peered":"2024-09-11T05:33:07.676498+0000","last_clean":"2024-09-11T05:33:07.676498+0000","last_became_active":"2024-09-11T05:32:45.582294+0000","last_became_peered":"2024-09-11T05:32:45.582294+0000","last_unstale":"2024-09-11T05:33:07.676498+0000","last_undegraded":"2024-09-11T05:33:07.676498+0000","last_fullsized":"2024-09-11T05:33:07.676498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:49:22.206673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045578900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.682495+0000","last_change":"2024-09-11T05:32:39.551254+0000","last_active":"2024-09-11T05:33:07.682495+0000","last_peered":"2024-09-11T05:33:07.682495+0000","last_clean":"2024-09-11T05:33:07.682495+0000","last_became_active":"2024-09-11T05:32:39.550968+0000","last_became_peered":"2024-09-11T05:32:39.550968+0000","last_unstale":"2024-09-11T05:33:07.682495+0000","last_undegraded":"2024-09-11T05:33:07.682495+0000","last_fullsized":"2024-09-11T05:33:07.682495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:09.466849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"31'151","reported_seq":830,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.866774+0000","last_change":"2024-09-11T05:32:57.660171+0000","last_active":"2024-09-11T05:33:07.866774+0000","last_peered":"2024-09-11T05:33:07.866774+0000","last_clean":"2024-09-11T05:33:07.866774+0000","last_became_active":"2024-09-11T05:32:55.611842+0000","last_became_peered":"2024-09-11T05:32:55.611842+0000","last_unstale":"2024-09-11T05:33:07.866774+0000","last_undegraded":"2024-09-11T05:33:07.866774+0000","last_fullsized":"2024-09-11T05:33:07.866774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:54.098333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042237200000000001,"stat_sum":{"num_bytes":3670032,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":1862,"num_read_kb":1911,"num_write":147,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'38","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.676303+0000","last_change":"2024-09-11T05:32:57.890158+0000","last_active":"2024-09-11T05:33:07.676303+0000","last_peered":"2024-09-11T05:33:07.676303+0000","last_clean":"2024-09-11T05:33:07.676303+0000","last_became_active":"2024-09-11T05:32:55.617893+0000","last_became_peered":"2024-09-11T05:32:55.617893+0000","last_unstale":"2024-09-11T05:33:07.676303+0000","last_undegraded":"2024-09-11T05:33:07.676303+0000","last_fullsized":"2024-09-11T05:33:07.676303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:31:05.752854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038649399999999998,"stat_sum":{"num_bytes":4566150,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":61,"num_read_kb":798,"num_write":37,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'35","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.980732+0000","last_change":"2024-09-11T05:32:57.891151+0000","last_active":"2024-09-11T05:33:07.980732+0000","last_peered":"2024-09-11T05:33:07.980732+0000","last_clean":"2024-09-11T05:33:07.980732+0000","last_became_active":"2024-09-11T05:32:55.617635+0000","last_became_peered":"2024-09-11T05:32:55.617635+0000","last_unstale":"2024-09-11T05:33:07.980732+0000","last_undegraded":"2024-09-11T05:33:07.980732+0000","last_fullsized":"2024-09-11T05:33:07.980732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:47.779817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039096600000000002,"stat_sum":{"num_bytes":3538944,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":39,"num_read_kb":8,"num_write":35,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'15","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.838038+0000","last_change":"2024-09-11T05:32:57.659963+0000","last_active":"2024-09-11T05:33:07.838038+0000","last_peered":"2024-09-11T05:33:07.838038+0000","last_clean":"2024-09-11T05:33:07.838038+0000","last_became_active":"2024-09-11T05:32:55.612809+0000","last_became_peered":"2024-09-11T05:32:55.612809+0000","last_unstale":"2024-09-11T05:33:07.838038+0000","last_undegraded":"2024-09-11T05:33:07.838038+0000","last_fullsized":"2024-09-11T05:33:07.838038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:32:46.289797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035048700000000002,"stat_sum":{"num_bytes":1028877,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":111,"num_write":15,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"31'54","reported_seq":198,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.980112+0000","last_change":"2024-09-11T05:32:57.607220+0000","last_active":"2024-09-11T05:33:07.980112+0000","last_peered":"2024-09-11T05:33:07.980112+0000","last_clean":"2024-09-11T05:33:07.980112+0000","last_became_active":"2024-09-11T05:32:55.611273+0000","last_became_peered":"2024-09-11T05:32:55.611273+0000","last_unstale":"2024-09-11T05:33:07.980112+0000","last_undegraded":"2024-09-11T05:33:07.980112+0000","last_fullsized":"2024-09-11T05:33:07.980112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:05:50.834680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055575600000000002,"stat_sum":{"num_bytes":12017592,"num_objects":8,"num_object_clones":3,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":154,"num_read_kb":1673,"num_write":53,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"30'18","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.676565+0000","last_change":"2024-09-11T05:32:57.891891+0000","last_active":"2024-09-11T05:33:07.676565+0000","last_peered":"2024-09-11T05:33:07.676565+0000","last_clean":"2024-09-11T05:33:07.676565+0000","last_became_active":"2024-09-11T05:32:55.614392+0000","last_became_peered":"2024-09-11T05:32:55.614392+0000","last_unstale":"2024-09-11T05:33:07.676565+0000","last_undegraded":"2024-09-11T05:33:07.676565+0000","last_fullsized":"2024-09-11T05:33:07.676565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:31.009025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000425738,"stat_sum":{"num_bytes":1056384,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":18,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"31'20","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.974527+0000","last_change":"2024-09-11T05:32:57.891358+0000","last_active":"2024-09-11T05:33:07.974527+0000","last_peered":"2024-09-11T05:33:07.974527+0000","last_clean":"2024-09-11T05:33:07.974527+0000","last_became_active":"2024-09-11T05:32:55.610903+0000","last_became_peered":"2024-09-11T05:32:55.610903+0000","last_unstale":"2024-09-11T05:33:07.974527+0000","last_undegraded":"2024-09-11T05:33:07.974527+0000","last_fullsized":"2024-09-11T05:33:07.974527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:41:09.274617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060018099999999998,"stat_sum":{"num_bytes":8581239,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":164,"num_write":20,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"32'205","reported_seq":1091,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.981333+0000","last_change":"2024-09-11T05:32:57.607163+0000","last_active":"2024-09-11T05:33:07.981333+0000","last_peered":"2024-09-11T05:33:07.981333+0000","last_clean":"2024-09-11T05:33:07.981333+0000","last_became_active":"2024-09-11T05:32:55.614915+0000","last_became_peered":"2024-09-11T05:32:55.614915+0000","last_unstale":"2024-09-11T05:33:07.981333+0000","last_undegraded":"2024-09-11T05:33:07.981333+0000","last_fullsized":"2024-09-11T05:33:07.981333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:49.246045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050988100000000001,"stat_sum":{"num_bytes":14363237,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":2,"num_read":2516,"num_read_kb":2385,"num_write":221,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"30'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.682561+0000","last_change":"2024-09-11T05:32:57.610399+0000","last_active":"2024-09-11T05:33:07.682561+0000","last_peered":"2024-09-11T05:33:07.682561+0000","last_clean":"2024-09-11T05:33:07.682561+0000","last_became_active":"2024-09-11T05:32:55.614295+0000","last_became_peered":"2024-09-11T05:32:55.614295+0000","last_unstale":"2024-09-11T05:33:07.682561+0000","last_undegraded":"2024-09-11T05:33:07.682561+0000","last_fullsized":"2024-09-11T05:33:07.682561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:45.990949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054624999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28,"num_write":30,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"32'35","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.967845+0000","last_change":"2024-09-11T05:32:57.890065+0000","last_active":"2024-09-11T05:33:07.967845+0000","last_peered":"2024-09-11T05:33:07.967845+0000","last_clean":"2024-09-11T05:33:07.967845+0000","last_became_active":"2024-09-11T05:32:55.617684+0000","last_became_peered":"2024-09-11T05:32:55.617684+0000","last_unstale":"2024-09-11T05:33:07.967845+0000","last_undegraded":"2024-09-11T05:33:07.967845+0000","last_fullsized":"2024-09-11T05:33:07.967845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:35.704140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065996499999999999,"stat_sum":{"num_bytes":1669634,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":9,"num_read_kb":1,"num_write":34,"num_write_kb":443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'58","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.674451+0000","last_change":"2024-09-11T05:32:57.617941+0000","last_active":"2024-09-11T05:33:07.674451+0000","last_peered":"2024-09-11T05:33:07.674451+0000","last_clean":"2024-09-11T05:33:07.674451+0000","last_became_active":"2024-09-11T05:32:55.617445+0000","last_became_peered":"2024-09-11T05:32:55.617445+0000","last_unstale":"2024-09-11T05:33:07.674451+0000","last_undegraded":"2024-09-11T05:33:07.674451+0000","last_fullsized":"2024-09-11T05:33:07.674451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:21:03.355215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046356899999999999,"stat_sum":{"num_bytes":7354478,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":83,"num_read_kb":1136,"num_write":59,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"31'155","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T05:33:07.676443+0000","last_change":"2024-09-11T05:32:57.890965+0000","last_active":"2024-09-11T05:33:07.676443+0000","last_peered":"2024-09-11T05:33:07.676443+0000","last_clean":"2024-09-11T05:33:07.676443+0000","last_became_active":"2024-09-11T05:32:55.618294+0000","last_became_peered":"2024-09-11T05:32:55.618294+0000","last_unstale":"2024-09-11T05:33:07.676443+0000","last_undegraded":"2024-09-11T05:33:07.676443+0000","last_fullsized":"2024-09-11T05:33:07.676443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:15:11.403057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049377000000000004,"stat_sum":{"num_bytes":2621092,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":725,"num_read_kb":1385,"num_write":250,"num_write_kb":1482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":118138779,"num_objects":135,"num_object_clones":30,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":32,"num_read":11723,"num_read_kb":20840,"num_write":2608,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6438912,"data_stored":6811188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2111,"ondisk_log_size":2111,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":548958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":473444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":1137781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":0,"seq":60129542152,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33048,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1904640,"data_stored":2120256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36940,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334900,"statfs":{"total":96636764160,"available":96598937600,"internally_reserved":0,"allocated":1634304,"data_stored":1572015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36972,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334868,"statfs":{"total":96636764160,"available":96598904832,"internally_reserved":0,"allocated":1658880,"data_stored":1371805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37304,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334536,"statfs":{"total":96636764160,"available":96598564864,"internally_reserved":0,"allocated":1781760,"data_stored":1711309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1445888,"data_stored":1578239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":716800,"data_stored":642227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1310720,"data_stored":1439093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1552384,"data_stored":1981027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":483328,"data_stored":414343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":340371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":415888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:33:12.561 INFO:tasks.thrashosds.thrasher:Setting 3.b to [6, 4, 0, 5] 2024-09-11T05:33:12.561 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.b', '6', '4', '0', '5'] 2024-09-11T05:33:12.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.b 6 4 0 5 2024-09-11T05:33:12.594 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:12.594 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:12.595 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:12.594+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:12.603 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:12.687 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:12.687+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:12.696 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T05:33:12.758 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone8 from 0xdc0bc3b (overlap 0x1cb2658) to 0x1137d68 2024-09-11T05:33:12.763 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:12.763 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:12.779 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:12.783 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:12.783+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:12.879 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-11T05:33:12.885 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:12.885+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:12.907 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:12.907 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:12.919 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:12.986 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:12.985+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:13.038 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:13.038 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:13.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:13.089 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:13.088+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:13.136 INFO:teuthology.orchestra.run.smithi070.stdout:1545 write 0xab230 thru 0xb2639 (0x740a bytes) 2024-09-11T05:33:13.170 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:13.170 INFO:teuthology.orchestra.run.smithi070.stdout:1547 read 0x95247cd thru 0x952b229 (0x6a5d bytes) 2024-09-11T05:33:13.170 INFO:teuthology.orchestra.run.smithi070.stdout:1548 read 0x8938709 thru 0x89464bf (0xddb7 bytes) 2024-09-11T05:33:13.170 INFO:teuthology.orchestra.run.smithi070.stdout:1550 read 0xa81c2a8 thru 0xa829d67 (0xdac0 bytes) 2024-09-11T05:33:13.171 INFO:teuthology.orchestra.run.smithi070.stdout:1551 read 0x2f08905 thru 0x2f11cfc (0x93f8 bytes) 2024-09-11T05:33:13.171 INFO:teuthology.orchestra.run.smithi070.stdout:1552 read 0xd5e276 thru 0xd692cc (0xb057 bytes) 2024-09-11T05:33:13.171 INFO:teuthology.orchestra.run.smithi070.stdout:1554 read 0x23e64c2 thru 0x23f5047 (0xeb86 bytes) 2024-09-11T05:33:13.172 INFO:teuthology.orchestra.run.smithi070.stdout:1555 read 0xd14cd0d thru 0xd159f2d (0xd221 bytes) 2024-09-11T05:33:13.174 INFO:teuthology.orchestra.run.smithi070.stdout:1557 punch from 0xc6669af to 0xc670b60, (0xa1b1 bytes) 2024-09-11T05:33:13.174 INFO:teuthology.orchestra.run.smithi070.stdout:1558 punch from 0x111a86b to 0x1125301, (0xaa96 bytes) 2024-09-11T05:33:13.185 INFO:teuthology.orchestra.run.smithi070.stdout:1559 trunc from 0xdc0bc3b to 0x50d4ad2 2024-09-11T05:33:13.187 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:13.187+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:13.210 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:13.210 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:13.217 INFO:teuthology.orchestra.run.smithi070.stdout:1560 write 0xd574d60 thru 0xd583cb5 (0xef56 bytes) 2024-09-11T05:33:13.221 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:13.231 INFO:teuthology.orchestra.run.smithi070.stdout:1562 write 0x476c9b8 thru 0x4773474 (0x6abd bytes) 2024-09-11T05:33:13.255 INFO:teuthology.orchestra.run.smithi070.stdout:1564 trunc from 0xd583cb6 to 0x352b2d2 2024-09-11T05:33:13.285 INFO:teuthology.orchestra.run.smithi070.stdout:1566 read 0x1edbd8 thru 0x1fc5e0 (0xea09 bytes) 2024-09-11T05:33:13.288 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:13.287+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:13.305 INFO:teuthology.orchestra.run.smithi070.stdout:1567 write 0xe6fadc6 thru 0xe6ffe06 (0x5041 bytes) 2024-09-11T05:33:13.311 INFO:teuthology.orchestra.run.smithi070.stdout:1570 read 0xc43e87f thru 0xc44aa63 (0xc1e5 bytes) 2024-09-11T05:33:13.312 INFO:teuthology.orchestra.run.smithi070.stdout:1571 write 0xbffb4b thru 0xc06eaa (0x7360 bytes) 2024-09-11T05:33:13.348 INFO:teuthology.orchestra.run.smithi070.stdout:1572 trunc from 0xe6ffe07 to 0x623a676 2024-09-11T05:33:13.362 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:13.362 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:13.371 INFO:teuthology.orchestra.run.smithi070.stdout:1573 write 0xcc274ca thru 0xcc2fb07 (0x863e bytes) 2024-09-11T05:33:13.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:13.388 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:13.388+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:13.389 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:13.389 INFO:teuthology.orchestra.run.smithi070.stdout:1577 writesame 0x6bb951f thru 0x6bc767c data_size 0x1a(0xe15e bytes) 2024-09-11T05:33:13.410 INFO:teuthology.orchestra.run.smithi070.stdout:1578 write 0xd276936 thru 0xd27a413 (0x3ade bytes) 2024-09-11T05:33:13.415 INFO:teuthology.orchestra.run.smithi070.stdout:1579 writesame 0xaabb8aa thru 0xaabbebd data_size 0x2(0x614 bytes) 2024-09-11T05:33:13.418 INFO:teuthology.orchestra.run.smithi070.stdout:1580 read 0x920fafa thru 0x921ad36 (0xb23d bytes) 2024-09-11T05:33:13.419 INFO:teuthology.orchestra.run.smithi070.stdout:1582 write 0x79cc634 thru 0x79d3321 (0x6cee bytes) 2024-09-11T05:33:13.430 INFO:teuthology.orchestra.run.smithi070.stdout:1583 write 0xc2ee601 thru 0xc2fe502 (0xff02 bytes) 2024-09-11T05:33:13.445 INFO:teuthology.orchestra.run.smithi070.stdout:1584 write 0xc6219d3 thru 0xc62e6ec (0xcd1a bytes) 2024-09-11T05:33:13.457 INFO:teuthology.orchestra.run.smithi070.stdout:1585 write 0x9dfd09a thru 0x9dfdf91 (0xef8 bytes) 2024-09-11T05:33:13.459 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:13.459 INFO:teuthology.orchestra.run.smithi070.stdout:1589 punch from 0x82d75bf to 0x82e0da9, (0x97ea bytes) 2024-09-11T05:33:13.459 INFO:teuthology.orchestra.run.smithi070.stdout:1590 write 0x1b1ee81 thru 0x1b2e925 (0xfaa5 bytes) 2024-09-11T05:33:13.489 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:13.488+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:13.509 INFO:teuthology.orchestra.run.smithi070.stdout:1591 write 0x3091de4 thru 0x3093477 (0x1694 bytes) 2024-09-11T05:33:13.517 INFO:teuthology.orchestra.run.smithi070.stdout:1593 read 0x594e9b0 thru 0x5950469 (0x1aba bytes) 2024-09-11T05:33:13.517 INFO:teuthology.orchestra.run.smithi070.stdout:1595 punch from 0x32d89ef to 0x32d9b10, (0x1121 bytes) 2024-09-11T05:33:13.518 INFO:teuthology.orchestra.run.smithi070.stdout:1598 write 0x4e57781 thru 0x4e639d4 (0xc254 bytes) 2024-09-11T05:33:13.520 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:13.520 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:13.530 INFO:teuthology.orchestra.run.smithi070.stdout:1599 punch from 0x1da761 to 0x1e5056, (0xa8f5 bytes) 2024-09-11T05:33:13.531 INFO:teuthology.orchestra.run.smithi070.stdout:1600 clone 10 order 18 su 65536 sc 5 2024-09-11T05:33:13.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:13.589 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:13.589+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:13.636 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:13.636 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:13.645 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:13.690 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:13.689+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:13.692 INFO:teuthology.orchestra.run.smithi070.stderr:set 3.b pg_upmap_items mapping to [6->4,0->5] 2024-09-11T05:33:13.756 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone9 from 0xd27a414 (overlap 0x352b2d2) to 0x5511e1 2024-09-11T05:33:13.791 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:13.790+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:13.812 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:13.812 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:13.824 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:13.892 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:13.891+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:13.970 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:13.971 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:13.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:14.026 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:14.026+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:14.095 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:14.095+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:14.133 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:14.133 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:14.146 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:14.230 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:14.230+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:14.235 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-11T05:33:14.297 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:14.296+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:14.301 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:14.301 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:14.310 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:14.311 INFO:teuthology.orchestra.run.smithi070.stdout:1601 trunc from 0xd27a414 to 0x871590 2024-09-11T05:33:14.319 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:33:14.348 INFO:teuthology.orchestra.run.smithi070.stdout:1602 trunc from 0x871590 to 0xe53e089 2024-09-11T05:33:14.353 INFO:teuthology.orchestra.run.smithi070.stdout:1603 write 0x6d797a8 thru 0x6d7e4b0 (0x4d09 bytes) 2024-09-11T05:33:14.356 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:14.356 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:14.356 INFO:teuthology.orchestra.run.smithi070.stdout:1606 punch from 0x1be1169 to 0x1be72fc, (0x6193 bytes) 2024-09-11T05:33:14.356 INFO:teuthology.orchestra.run.smithi070.stdout:1607 writesame 0x7c3a875 thru 0x7c49658 data_size 0x69(0xede4 bytes) 2024-09-11T05:33:14.359 INFO:teuthology.orchestra.run.smithi070.stdout:1608 write 0x1c08b44 thru 0x1c114fa (0x89b7 bytes) 2024-09-11T05:33:14.363 INFO:teuthology.orchestra.run.smithi070.stdout:1609 punch from 0x874ddbe to 0x87538c6, (0x5b08 bytes) 2024-09-11T05:33:14.363 INFO:teuthology.orchestra.run.smithi070.stdout:1610 punch from 0xc241a6f to 0xc250ef2, (0xf483 bytes) 2024-09-11T05:33:14.364 INFO:teuthology.orchestra.run.smithi070.stdout:1611 read 0x20fe97d thru 0x20ff41e (0xaa2 bytes) 2024-09-11T05:33:14.364 INFO:teuthology.orchestra.run.smithi070.stdout:1612 write 0xac70de6 thru 0xac79d9a (0x8fb5 bytes) 2024-09-11T05:33:14.366 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:14.372 INFO:teuthology.orchestra.run.smithi070.stdout:1615 trunc from 0xe53e089 to 0x942d138 2024-09-11T05:33:14.380 INFO:teuthology.orchestra.run.smithi070.stdout:1617 writesame 0x75a7eba thru 0x75a9b87 data_size 0x3(0x1cce bytes) 2024-09-11T05:33:14.391 INFO:teuthology.orchestra.run.smithi070.stdout:1618 write 0xac15182 thru 0xac211a6 (0xc025 bytes) 2024-09-11T05:33:14.398 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:14.396+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:14.398 INFO:teuthology.orchestra.run.smithi070.stdout:1619 write 0xacadfaa thru 0xacb9589 (0xb5e0 bytes) 2024-09-11T05:33:14.408 INFO:teuthology.orchestra.run.smithi070.stdout:1620 trunc from 0xacb958a to 0x5a01c34 2024-09-11T05:33:14.419 INFO:teuthology.orchestra.run.smithi070.stdout:1621 read 0x953461 thru 0x958e24 (0x59c4 bytes) 2024-09-11T05:33:14.425 INFO:teuthology.orchestra.run.smithi070.stdout:1622 write 0x71ed668 thru 0x71f5e49 (0x87e2 bytes) 2024-09-11T05:33:14.435 INFO:teuthology.orchestra.run.smithi070.stdout:1624 writesame 0x80e439b thru 0x80f3c9f data_size 0x7(0xf905 bytes) 2024-09-11T05:33:14.435 INFO:teuthology.orchestra.run.smithi070.stdout:1626 punch from 0xfe5870 to 0xfe931a, (0x3aaa bytes) 2024-09-11T05:33:14.436 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:14.436 INFO:teuthology.orchestra.run.smithi070.stdout:1628 write 0x4bed057 thru 0x4bee747 (0x16f1 bytes) 2024-09-11T05:33:14.452 INFO:teuthology.orchestra.run.smithi070.stdout:1629 writesame 0xdb14d4d thru 0xdb17f4f data_size 0x7(0x3203 bytes) 2024-09-11T05:33:14.457 INFO:teuthology.orchestra.run.smithi070.stdout:1630 write 0xe60cbeb thru 0xe617422 (0xa838 bytes) 2024-09-11T05:33:14.459 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:14.459 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:14.460 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:14.461 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:14.461 INFO:teuthology.orchestra.run.smithi070.stdout:1635 writesame 0x74199b0 thru 0x7419cb6 data_size 0x5(0x307 bytes) 2024-09-11T05:33:14.464 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:14.464 INFO:teuthology.orchestra.run.smithi070.stdout:1639 writesame 0xa5a72a thru 0xa5c63a data_size 0xb(0x1f11 bytes) 2024-09-11T05:33:14.467 INFO:teuthology.orchestra.run.smithi070.stdout:1640 read 0x593b9c5 thru 0x593dffc (0x2638 bytes) 2024-09-11T05:33:14.467 INFO:teuthology.orchestra.run.smithi070.stdout:1641 write 0x1476676 thru 0x1481a73 (0xb3fe bytes) 2024-09-11T05:33:14.468 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:14.471 INFO:teuthology.orchestra.run.smithi070.stdout:1645 write 0x864d3e3 thru 0x864fc42 (0x2860 bytes) 2024-09-11T05:33:14.474 INFO:teuthology.orchestra.run.smithi070.stdout:1646 write 0x961e690 thru 0x96270cb (0x8a3c bytes) 2024-09-11T05:33:14.479 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:14.479 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:14.479 INFO:teuthology.orchestra.run.smithi070.stdout:1647 write 0x81f43da thru 0x81fed20 (0xa947 bytes) 2024-09-11T05:33:14.482 INFO:teuthology.orchestra.run.smithi070.stdout:1648 punch from 0xd8d9975 to 0xd8e09c6, (0x7051 bytes) 2024-09-11T05:33:14.491 INFO:teuthology.orchestra.run.smithi070.stdout:1649 trunc from 0xe617423 to 0x6fe797a 2024-09-11T05:33:14.498 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:14.498 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:14.502 INFO:teuthology.orchestra.run.smithi070.stdout:1650 read 0x3276b48 thru 0x3285bec (0xf0a5 bytes) 2024-09-11T05:33:14.508 INFO:teuthology.orchestra.run.smithi070.stdout:1651 writesame 0x7bfd9b8 thru 0x7c0515b data_size 0x26(0x77a4 bytes) 2024-09-11T05:33:14.508 INFO:teuthology.orchestra.run.smithi070.stdout:1652 read 0x7857b60 thru 0x7860ed6 (0x9377 bytes) 2024-09-11T05:33:14.513 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:14.513+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:14.516 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:14.516 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:14.520 INFO:teuthology.orchestra.run.smithi070.stdout:1653 writesame 0xc96b70b thru 0xc975e70 data_size 0x7(0xa766 bytes) 2024-09-11T05:33:14.525 INFO:teuthology.orchestra.run.smithi070.stdout:1655 trunc from 0xc975e71 to 0x8380782 2024-09-11T05:33:14.531 INFO:teuthology.orchestra.run.smithi070.stdout:1656 read 0x165be29 thru 0x1667b65 (0xbd3d bytes) 2024-09-11T05:33:14.534 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:14.534 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:14.538 INFO:teuthology.orchestra.run.smithi070.stdout:1657 write 0x9afe7d5 thru 0x9b0d968 (0xf194 bytes) 2024-09-11T05:33:14.546 INFO:teuthology.orchestra.run.smithi070.stdout:1658 trunc from 0x9b0d969 to 0x5ff428e 2024-09-11T05:33:14.552 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:14.553 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:14.555 INFO:teuthology.orchestra.run.smithi070.stdout:1659 write 0x22aac06 thru 0x22b1f9c (0x7397 bytes) 2024-09-11T05:33:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:1660 trunc from 0x5ff428e to 0xe08da83 2024-09-11T05:33:14.570 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:14.573 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:14.573 INFO:teuthology.orchestra.run.smithi070.stdout:1663 write 0x9a5df3b thru 0x9a6c7f8 (0xe8be bytes) 2024-09-11T05:33:14.577 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:14.578 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:14.578 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:14.578 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:14.578 INFO:teuthology.orchestra.run.smithi070.stdout:1664 write 0x651335c thru 0x651edaf (0xba54 bytes) 2024-09-11T05:33:14.580 INFO:teuthology.orchestra.run.smithi070.stdout:1665 read 0x1918ffc thru 0x191dc2d (0x4c32 bytes) 2024-09-11T05:33:14.587 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:14.587 INFO:teuthology.orchestra.run.smithi070.stdout:1666 trunc from 0xe08da83 to 0x90219d2 2024-09-11T05:33:14.588 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:14.588 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:14.599 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:14.598+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:14.603 INFO:teuthology.orchestra.run.smithi070.stdout:1667 write 0x915d6e4 thru 0x915e176 (0xa93 bytes) 2024-09-11T05:33:14.606 INFO:teuthology.orchestra.run.smithi070.stdout:1668 punch from 0x2b1ea18 to 0x2b2a0d9, (0xb6c1 bytes) 2024-09-11T05:33:14.606 INFO:teuthology.orchestra.run.smithi070.stdout:1669 read 0x5748969 thru 0x57535c5 (0xac5d bytes) 2024-09-11T05:33:14.612 INFO:teuthology.orchestra.run.smithi070.stdout:1670 write 0x99fb252 thru 0x9a0960d (0xe3bc bytes) 2024-09-11T05:33:14.630 INFO:teuthology.orchestra.run.smithi070.stdout:1673 write 0xedd0fe0 thru 0xeddcdd7 (0xbdf8 bytes) 2024-09-11T05:33:14.632 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:14.632 INFO:teuthology.orchestra.run.smithi070.stdout:1675 read 0x266878 thru 0x269d17 (0x34a0 bytes) 2024-09-11T05:33:14.633 INFO:teuthology.orchestra.run.smithi070.stdout:1676 write 0x5e2eb1 thru 0x5f220c (0xf35c bytes) 2024-09-11T05:33:14.642 INFO:teuthology.orchestra.run.smithi070.stdout:1677 read 0xb09ea14 thru 0xb0a3dcc (0x53b9 bytes) 2024-09-11T05:33:14.659 INFO:teuthology.orchestra.run.smithi070.stdout:1678 trunc from 0xeddcdd8 to 0xbf6a55 2024-09-11T05:33:14.684 INFO:teuthology.orchestra.run.smithi070.stdout:1679 write 0x73da0f4 thru 0x73da13f (0x4c bytes) 2024-09-11T05:33:14.701 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:14.701+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:14.702 INFO:teuthology.orchestra.run.smithi070.stdout:1680 writesame 0xe7f3289 thru 0xe800c0b data_size 0x45(0xd983 bytes) 2024-09-11T05:33:14.702 INFO:teuthology.orchestra.run.smithi070.stdout:1681 punch from 0x2dfd8b to 0x2ed65b, (0xd8d0 bytes) 2024-09-11T05:33:14.702 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:14.702 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:14.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:33:14.717 INFO:teuthology.orchestra.run.smithi070.stdout:1686 trunc from 0xe800c0c to 0x1be0b4f 2024-09-11T05:33:14.729 INFO:teuthology.orchestra.run.smithi070.stdout:1688 read 0xb0b4f7 thru 0xb16aa0 (0xb5aa bytes) 2024-09-11T05:33:14.735 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:14.735 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:14.736 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:14.736 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:14.736 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:14.744 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:14.746 INFO:teuthology.orchestra.run.smithi070.stdout:1690 write 0xabd2058 thru 0xabdb5b0 (0x9559 bytes) 2024-09-11T05:33:14.749 INFO:teuthology.orchestra.run.smithi070.stdout:1691 writesame 0x50198a9 thru 0x501db79 data_size 0xb(0x42d1 bytes) 2024-09-11T05:33:14.752 INFO:teuthology.orchestra.run.smithi070.stdout:1692 writesame 0x1a299f7 thru 0x1a32e1a data_size 0x26(0x9424 bytes) 2024-09-11T05:33:14.756 INFO:teuthology.orchestra.run.smithi070.stdout:1693 punch from 0x8004687 to 0x80106bd, (0xc036 bytes) 2024-09-11T05:33:14.764 INFO:teuthology.orchestra.run.smithi070.stdout:1694 write 0xde79f80 thru 0xde87b9d (0xdc1e bytes) 2024-09-11T05:33:14.768 INFO:teuthology.orchestra.run.smithi070.stdout:1695 writesame 0xcf379aa thru 0xcf45d17 data_size 0x2b(0xe36e bytes) 2024-09-11T05:33:14.777 INFO:teuthology.orchestra.run.smithi070.stdout:1696 trunc from 0xde87b9e to 0x8a4e4f0 2024-09-11T05:33:14.787 INFO:teuthology.orchestra.run.smithi070.stdout:1699 write 0x47aa6a2 thru 0x47abb0d (0x146c bytes) 2024-09-11T05:33:14.799 INFO:teuthology.orchestra.run.smithi070.stdout:1701 write 0xcc2d1f5 thru 0xcc3cb07 (0xf913 bytes) 2024-09-11T05:33:14.801 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:14.800+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:14.809 INFO:teuthology.orchestra.run.smithi070.stdout:1702 write 0xe40f39c thru 0xe41bfa3 (0xcc08 bytes) 2024-09-11T05:33:14.813 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:14.813 INFO:teuthology.orchestra.run.smithi070.stdout:1705 writesame 0x6c66572 thru 0x6c754a1 data_size 0x59(0xef30 bytes) 2024-09-11T05:33:14.817 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:14.817 INFO:teuthology.orchestra.run.smithi070.stdout:1709 clone 11 order 19 su 262144 sc 11 2024-09-11T05:33:14.891 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:14.891 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:14.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:14.891 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:14.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.891 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:667 3.4 3:22b6acf1:::rbd_data.112da50123d8.0000000000000007:head [stat,truncate 7864320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:14.891 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:00.919693+0000", 2024-09-11T05:33:14.891 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 13.969855104000001, 2024-09-11T05:33:14.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0039871539999999997, 2024-09-11T05:33:14.891 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 667 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919693+0000", 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919693+0000", 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919695+0000", 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.7370000000000001e-06 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919706+0000", 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0530000000000001e-05 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919733+0000", 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7103000000000001e-05 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919746+0000", 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3223e-05 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919908+0000", 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016242399999999999 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920015+0000", 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000106764 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920117+0000", 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000102231 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920835+0000", 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00071793699999999998 2024-09-11T05:33:14.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.923617+0000", 2024-09-11T05:33:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0027821719999999999 2024-09-11T05:33:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.923655+0000", 2024-09-11T05:33:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7342000000000003e-05 2024-09-11T05:33:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.923680+0000", 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5690999999999998e-05 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:876 3.4 3:22b6acf1:::rbd_data.112da50123d8.0000000000000007:head [stat,truncate 1273818] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.099122+0000", 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 13.790426288000001, 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0040213389999999996, 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.897 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 876 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099122+0000", 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099122+0000", 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099123+0000", 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4899999999999995e-07 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099125+0000", 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099133+0000", 2024-09-11T05:33:14.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4610000000000002e-06 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099138+0000", 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4539999999999998e-06 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099192+0000", 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3789000000000003e-05 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099267+0000", 2024-09-11T05:33:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5377999999999996e-05 2024-09-11T05:33:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099408+0000", 2024-09-11T05:33:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014016000000000001 2024-09-11T05:33:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100505+0000", 2024-09-11T05:33:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0010972309999999999 2024-09-11T05:33:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.103058+0000", 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025533510000000001 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.103104+0000", 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6031e-05 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.103143+0000", 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.926e-05 2024-09-11T05:33:14.902 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:938 3.15 e26/22 3:ab6ce323:::rbd_data.112da50123d8.000000000000000b:head v 26'13, mlcod=26'11)", 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.175480+0000", 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 13.714068053, 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005063812, 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175480+0000", 2024-09-11T05:33:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175480+0000", 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175481+0000", 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0299999999999998e-07 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175493+0000", 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2079000000000001e-05 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175503+0000", 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9170000000000001e-06 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175508+0000", 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6600000000000003e-06 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.905 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175546+0000", 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8043999999999997e-05 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175566+0000", 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.067e-05 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180516+0000", 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049498110000000001 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180544+0000", 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7928000000000001e-05 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "pg_update_log_missing(3.15 epoch 28/22 rep_tid 131 entries 28'20 (0'0) error 3:ae0819f0:::rbd_data.112d83e8b99.000000000000000e:head by client.4397.0:1704 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 26'16)", 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.721408+0000", 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.168140435, 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054215289999999996, 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.907 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721408+0000", 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721408+0000", 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721409+0000", 2024-09-11T05:33:14.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3099999999999997e-07 2024-09-11T05:33:14.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721415+0000", 2024-09-11T05:33:14.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2299999999999996e-06 2024-09-11T05:33:14.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721429+0000", 2024-09-11T05:33:14.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3679999999999999e-05 2024-09-11T05:33:14.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721436+0000", 2024-09-11T05:33:14.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7419999999999997e-06 2024-09-11T05:33:14.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721503+0000", 2024-09-11T05:33:14.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6948999999999999e-05 2024-09-11T05:33:14.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726829+0000", 2024-09-11T05:33:14.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0053262969999999998 2024-09-11T05:33:14.911 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.911 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.911 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.911 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1709 3.12 3:4a093325:::rbd_data.112d83e8b99.0000000000000013:head [stat,delete] snapc 5=[5] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:14.911 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.721527+0000", 2024-09-11T05:33:14.911 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.16802171, 2024-09-11T05:33:14.911 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0055917620000000001, 2024-09-11T05:33:14.911 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.911 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.911 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:14.911 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.912 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.912 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.912 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1709 2024-09-11T05:33:14.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.912 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.912 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.912 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.912 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721527+0000", 2024-09-11T05:33:14.912 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.912 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.912 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.912 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721527+0000", 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721527+0000", 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0900000000000002e-07 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721530+0000", 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.367e-06 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721536+0000", 2024-09-11T05:33:14.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4620000000000001e-06 2024-09-11T05:33:14.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721542+0000", 2024-09-11T05:33:14.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0820000000000004e-06 2024-09-11T05:33:14.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721591+0000", 2024-09-11T05:33:14.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9227000000000001e-05 2024-09-11T05:33:14.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721706+0000", 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000114768 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.727118+0000", 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054123469999999996 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1710 3.4 3:205bf505:::rbd_header.112d83e8b99:head [watch reconnect cookie 140342620614448 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:14.915 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.721554+0000", 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.167994726, 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054143619999999998, 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1710 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721554+0000", 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721554+0000", 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721554+0000", 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6199999999999998e-07 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721556+0000", 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1840000000000002e-06 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721563+0000", 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.353e-06 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721568+0000", 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9660000000000004e-06 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.918 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721615+0000", 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7685999999999997e-05 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.721686+0000", 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0667999999999995e-05 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726968+0000", 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052820430000000002 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1720 3.7 3:e3c45f22:::rbd_data.112d83e8b99.0000000000000012:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.722467+0000", 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.167081422000001, 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0045417280000000001, 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1720 2024-09-11T05:33:14.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722467+0000", 2024-09-11T05:33:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722467+0000", 2024-09-11T05:33:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722468+0000", 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5499999999999996e-07 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722474+0000", 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7450000000000001e-06 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722490+0000", 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6515999999999999e-05 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.923 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.923 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722498+0000", 2024-09-11T05:33:14.923 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6769999999999995e-06 2024-09-11T05:33:14.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.923 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.923 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722561+0000", 2024-09-11T05:33:14.923 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3295999999999998e-05 2024-09-11T05:33:14.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.923 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.923 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722643+0000", 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1662000000000005e-05 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722809+0000", 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016574499999999999 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723654+0000", 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00084562299999999999 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:14.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726920+0000", 2024-09-11T05:33:14.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032656569999999999 2024-09-11T05:33:14.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.925 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:14.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726965+0000", 2024-09-11T05:33:14.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5633999999999997e-05 2024-09-11T05:33:14.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.925 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.727009+0000", 2024-09-11T05:33:14.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3217999999999999e-05 2024-09-11T05:33:14.925 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "pg_update_log_missing(3.18 epoch 28/22 rep_tid 159 entries 28'5 (0'0) error 3:1decd148:::rbd_data.112d83e8b99.0000000000000014:head by client.4397.0:1716 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 25'3)", 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.722601+0000", 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.166946908, 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0042928209999999996, 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.926 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722601+0000", 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722601+0000", 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722602+0000", 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5600000000000005e-07 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.927 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722611+0000", 2024-09-11T05:33:14.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4500000000000004e-06 2024-09-11T05:33:14.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722631+0000", 2024-09-11T05:33:14.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9857e-05 2024-09-11T05:33:14.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722646+0000", 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5082999999999999e-05 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.722712+0000", 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6598000000000002e-05 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726894+0000", 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0041820770000000002 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.929 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:1721 3.5 e28/22 3:a0e94ca9:::rbd_data.112d83e8b99.000000000000000b:head v 28'21, mlcod=28'18)", 2024-09-11T05:33:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.723009+0000", 2024-09-11T05:33:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.166539431, 2024-09-11T05:33:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003942419, 2024-09-11T05:33:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723009+0000", 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723009+0000", 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723010+0000", 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9299999999999997e-07 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.931 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723015+0000", 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000001e-06 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723025+0000", 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.8120000000000002e-06 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723031+0000", 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1449999999999996e-06 2024-09-11T05:33:14.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723073+0000", 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2382000000000002e-05 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.723093+0000", 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9967e-05 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726915+0000", 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038216959999999999 2024-09-11T05:33:14.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.726951+0000", 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6334000000000001e-05 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:1741 3.12 3:4a093325:::rbd_data.112d83e8b99.0000000000000013:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,delete] snapc 5=[5] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.728162+0000", 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.161386102, 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.004709843, 2024-09-11T05:33:14.936 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 1741 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728162+0000", 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.937 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728162+0000", 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728163+0000", 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728167+0000", 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9509999999999999e-06 2024-09-11T05:33:14.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728176+0000", 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9870000000000005e-06 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728182+0000", 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728221+0000", 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9116999999999998e-05 2024-09-11T05:33:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.940 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.940 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.940 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728269+0000", 2024-09-11T05:33:14.940 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7508e-05 2024-09-11T05:33:14.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.940 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.940 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 3", 2024-09-11T05:33:14.940 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728437+0000", 2024-09-11T05:33:14.940 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016876 2024-09-11T05:33:14.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.940 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.729189+0000", 2024-09-11T05:33:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00075146900000000005 2024-09-11T05:33:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732814+0000", 2024-09-11T05:33:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003624759 2024-09-11T05:33:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732848+0000", 2024-09-11T05:33:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4347000000000002e-05 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732872+0000", 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4176999999999999e-05 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:1740 3.18 e28/22 3:1decd148:::rbd_data.112d83e8b99.0000000000000014:head v 28'6, mlcod=25'4)", 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:02.728377+0000", 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.161170977999999, 2024-09-11T05:33:14.942 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.004462756, 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728377+0000", 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728377+0000", 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728378+0000", 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4199999999999995e-07 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728385+0000", 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.528e-06 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728396+0000", 2024-09-11T05:33:14.944 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1122e-05 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728403+0000", 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.956e-06 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728451+0000", 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7862999999999999e-05 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.945 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.728473+0000", 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2844999999999999e-05 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732801+0000", 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0043274280000000004 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:02.732840+0000", 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9271999999999999e-05 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.946 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:4286 3.4 3:2325b4aa:::rbd_data.112d517a1288.00000000000000e5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:05.611970+0000", 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 9.2775783660000002, 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0060933869999999996, 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 4286 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.947 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.948 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.948 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.948 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.611970+0000", 2024-09-11T05:33:14.948 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.948 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.948 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.948 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.948 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.611970+0000", 2024-09-11T05:33:14.948 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.948 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.948 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.948 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.948 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.611972+0000", 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0260000000000002e-06 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.611983+0000", 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0607e-05 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.612011+0000", 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8546000000000001e-05 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.949 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.612025+0000", 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.4136e-05 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.612126+0000", 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000100585 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.612136+0000", 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.026e-05 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.950 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.951 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.951 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.614741+0000", 2024-09-11T05:33:14.951 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026046089999999999 2024-09-11T05:33:14.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.951 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.951 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.951 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.614821+0000", 2024-09-11T05:33:14.951 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0107999999999999e-05 2024-09-11T05:33:14.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.951 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.951 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:14.951 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.614937+0000", 2024-09-11T05:33:14.951 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000115677 2024-09-11T05:33:14.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.952 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.952 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:14.952 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.617961+0000", 2024-09-11T05:33:14.952 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0030245010000000002 2024-09-11T05:33:14.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.952 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.952 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:14.952 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.617976+0000", 2024-09-11T05:33:14.952 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5148e-05 2024-09-11T05:33:14.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.952 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.952 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:14.953 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.618022+0000", 2024-09-11T05:33:14.953 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5469999999999997e-05 2024-09-11T05:33:14.953 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.953 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.953 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.953 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:05.618063+0000", 2024-09-11T05:33:14.953 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1714000000000001e-05 2024-09-11T05:33:14.953 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.953 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.953 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.953 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.953 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.953 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:4819 3.1 3:83efb0b6:::rbd_object_map.112deff072db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T05:33:14.954 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:06.824907+0000", 2024-09-11T05:33:14.954 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.0646415969999996, 2024-09-11T05:33:14.954 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0040344489999999998, 2024-09-11T05:33:14.954 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.954 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.954 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:14.954 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.954 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.954 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.954 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 4819 2024-09-11T05:33:14.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.954 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.954 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.955 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824907+0000", 2024-09-11T05:33:14.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.955 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.955 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824907+0000", 2024-09-11T05:33:14.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.955 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.955 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824908+0000", 2024-09-11T05:33:14.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9100000000000002e-07 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824915+0000", 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.622e-06 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824924+0000", 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4030000000000007e-06 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.824933+0000", 2024-09-11T05:33:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5219999999999996e-06 2024-09-11T05:33:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.825290+0000", 2024-09-11T05:33:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035708099999999998 2024-09-11T05:33:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.825383+0000", 2024-09-11T05:33:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2570000000000003e-05 2024-09-11T05:33:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.825792+0000", 2024-09-11T05:33:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040932799999999998 2024-09-11T05:33:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.826503+0000", 2024-09-11T05:33:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00071069600000000003 2024-09-11T05:33:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.828843+0000", 2024-09-11T05:33:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0023399430000000001 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.828900+0000", 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7496e-05 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.828941+0000", 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0896999999999998e-05 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:5109 3.1 3:83efb0b6:::rbd_object_map.112deff072db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T05:33:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:06.871763+0000", 2024-09-11T05:33:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.0177850530000008, 2024-09-11T05:33:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038804349999999998, 2024-09-11T05:33:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 5109 2024-09-11T05:33:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871763+0000", 2024-09-11T05:33:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871763+0000", 2024-09-11T05:33:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871764+0000", 2024-09-11T05:33:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:33:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871767+0000", 2024-09-11T05:33:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4400000000000001e-06 2024-09-11T05:33:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871773+0000", 2024-09-11T05:33:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6550000000000001e-06 2024-09-11T05:33:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.871776+0000", 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1650000000000002e-06 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874251+0000", 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0024749030000000001 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874299+0000", 2024-09-11T05:33:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8296e-05 2024-09-11T05:33:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874521+0000", 2024-09-11T05:33:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00022216200000000001 2024-09-11T05:33:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875489+0000", 2024-09-11T05:33:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00096752100000000005 2024-09-11T05:33:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875594+0000", 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104693 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875623+0000", 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9448e-05 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875644+0000", 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0721e-05 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.965 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:5110 3.1 3:83efb0b6:::rbd_object_map.112deff072db:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:06.872118+0000", 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.0174302789999992, 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038501579999999998, 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.966 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 5110 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872118+0000", 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872118+0000", 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.967 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872119+0000", 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4499999999999997e-07 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872122+0000", 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5080000000000001e-06 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872129+0000", 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9970000000000001e-06 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.872133+0000", 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8789999999999996e-06 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874822+0000", 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026886670000000001 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.874869+0000", 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6881000000000001e-05 2024-09-11T05:33:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875105+0000", 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000235997 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875653+0000", 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00054827700000000001 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875926+0000", 2024-09-11T05:33:14.970 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00027281000000000001 2024-09-11T05:33:14.971 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.971 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.971 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:14.971 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875951+0000", 2024-09-11T05:33:14.971 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5329000000000001e-05 2024-09-11T05:33:14.971 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.971 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.971 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.971 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:06.875968+0000", 2024-09-11T05:33:14.971 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.7167999999999999e-05 2024-09-11T05:33:14.971 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.971 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.971 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.972 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.972 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.972 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17784 3.1 3:8420d7c8:::rbd_data.112d745a9e91.000000000000000a:a [read 557056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:14.972 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:11.827840+0000", 2024-09-11T05:33:14.972 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 3.061708527, 2024-09-11T05:33:14.972 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038501099999999999, 2024-09-11T05:33:14.972 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.972 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.972 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:14.972 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.972 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.972 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.972 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17784 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827840+0000", 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827840+0000", 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.973 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827840+0000", 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4200000000000002e-07 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827842+0000", 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9410000000000001e-06 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827848+0000", 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.682e-06 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827853+0000", 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9949999999999996e-06 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.831611+0000", 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0037582969999999999 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.831649+0000", 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8031000000000002e-05 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.975 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.831690+0000", 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0822000000000003e-05 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17785 3.1 3:8420d7c8:::rbd_data.112d745a9e91.000000000000000a:a [read 606208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:11.827862+0000", 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 3.0616868049999999, 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0039380329999999996, 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.976 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.977 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:14.977 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.977 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.977 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.977 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17785 2024-09-11T05:33:14.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.977 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.977 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.977 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.977 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827862+0000", 2024-09-11T05:33:14.977 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.977 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827862+0000", 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827862+0000", 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827864+0000", 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.08e-06 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.978 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827870+0000", 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9349999999999999e-06 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827874+0000", 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2950000000000004e-06 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.831717+0000", 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038421990000000001 2024-09-11T05:33:14.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.980 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.980 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.980 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.831761+0000", 2024-09-11T05:33:14.980 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4416999999999998e-05 2024-09-11T05:33:14.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.980 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.980 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.980 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.831800+0000", 2024-09-11T05:33:14.980 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8677000000000003e-05 2024-09-11T05:33:14.980 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.980 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.980 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17786 3.1 3:8420d7c8:::rbd_data.112d745a9e91.000000000000000a:a [read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:11.827880+0000", 2024-09-11T05:33:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 3.061667956, 2024-09-11T05:33:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.004022121, 2024-09-11T05:33:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17786 2024-09-11T05:33:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.982 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.982 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.982 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.982 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827880+0000", 2024-09-11T05:33:14.982 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.982 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.982 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.982 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827880+0000", 2024-09-11T05:33:14.982 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.982 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.982 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827881+0000", 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-07 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827883+0000", 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1059999999999998e-06 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827889+0000", 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.711e-06 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.983 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.984 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827893+0000", 2024-09-11T05:33:14.984 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6589999999999998e-06 2024-09-11T05:33:14.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.984 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.984 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.984 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.831822+0000", 2024-09-11T05:33:14.984 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0039285370000000002 2024-09-11T05:33:14.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.984 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.984 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.984 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.831865+0000", 2024-09-11T05:33:14.984 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2775000000000003e-05 2024-09-11T05:33:14.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.831903+0000", 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7957999999999998e-05 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17787 3.1 3:8420d7c8:::rbd_data.112d745a9e91.000000000000000a:a [read 704512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:11.827899+0000", 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 3.0616496280000001, 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0041102329999999996, 2024-09-11T05:33:14.985 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.986 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.986 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:14.986 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.986 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.986 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.986 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17787 2024-09-11T05:33:14.986 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.986 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.986 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.986 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.986 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827899+0000", 2024-09-11T05:33:14.986 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.986 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.987 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.987 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.987 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827899+0000", 2024-09-11T05:33:14.987 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.987 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.987 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.987 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.987 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827899+0000", 2024-09-11T05:33:14.987 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3599999999999999e-07 2024-09-11T05:33:14.987 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.987 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.987 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.987 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827901+0000", 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8369999999999999e-06 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827907+0000", 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6439999999999997e-06 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827911+0000", 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.617e-06 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.988 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.989 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.831927+0000", 2024-09-11T05:33:14.989 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0040159799999999997 2024-09-11T05:33:14.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.989 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.989 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.989 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.831965+0000", 2024-09-11T05:33:14.989 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8250999999999997e-05 2024-09-11T05:33:14.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.989 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.989 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.989 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.832009+0000", 2024-09-11T05:33:14.989 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3568e-05 2024-09-11T05:33:14.989 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.990 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.990 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.990 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.990 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17788 3.1 3:8420d7c8:::rbd_data.112d745a9e91.000000000000000a:a [read 753664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:14.990 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:11.827917+0000", 2024-09-11T05:33:14.990 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 3.0616314679999999, 2024-09-11T05:33:14.990 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0041898020000000003, 2024-09-11T05:33:14.990 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:14.990 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:14.990 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:14.990 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:14.990 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17788 2024-09-11T05:33:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827917+0000", 2024-09-11T05:33:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827917+0000", 2024-09-11T05:33:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827917+0000", 2024-09-11T05:33:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.53e-07 2024-09-11T05:33:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827919+0000", 2024-09-11T05:33:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0040000000000002e-06 2024-09-11T05:33:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827925+0000", 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5589999999999996e-06 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.827929+0000", 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5990000000000004e-06 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.832029+0000", 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0040995249999999997 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.993 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.994 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:14.994 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.832068+0000", 2024-09-11T05:33:14.994 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8603000000000003e-05 2024-09-11T05:33:14.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:14.994 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:14.994 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:14.994 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.832107+0000", 2024-09-11T05:33:14.994 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9159000000000002e-05 2024-09-11T05:33:14.994 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.994 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.994 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.994 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:14.994 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:14.995 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:14.996 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:14.997 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:14.996+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:15.097 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:15.097+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:15.140 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:15.140 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:15.140 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:15.140 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:15.147 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:15.198 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:15.198+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:15.289 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:15.289 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:15.290 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:15.290 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:15.290 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:15.298 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:15.299 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:15.299+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:15.401 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:15.401 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:15.401 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:15.401 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:15.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.401 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:669 3.8 3:17968d03:::rbd_data.112da50123d8.0000000000000009:head [stat,truncate 7864320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:15.401 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:00.919760+0000", 2024-09-11T05:33:15.401 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.479822683, 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0069521119999999999, 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 669 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919760+0000", 2024-09-11T05:33:15.402 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.403 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.403 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.403 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919760+0000", 2024-09-11T05:33:15.403 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.403 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.403 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.403 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919761+0000", 2024-09-11T05:33:15.403 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1170000000000001e-06 2024-09-11T05:33:15.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.403 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.403 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.404 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919767+0000", 2024-09-11T05:33:15.404 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9200000000000001e-06 2024-09-11T05:33:15.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.404 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.404 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919785+0000", 2024-09-11T05:33:15.404 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8410000000000002e-05 2024-09-11T05:33:15.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.404 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.404 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.919968+0000", 2024-09-11T05:33:15.404 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00018297499999999999 2024-09-11T05:33:15.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920660+0000", 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00069168099999999998 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920747+0000", 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7056000000000001e-05 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920893+0000", 2024-09-11T05:33:15.405 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014623899999999999 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.921678+0000", 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00078508699999999996 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926617+0000", 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049389550000000001 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:15.406 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926666+0000", 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8738e-05 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926712+0000", 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5933999999999998e-05 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:666 3.0 e26/22 3:05ba09ea:::rbd_data.112da50123d8.0000000000000006:head v 26'8, mlcod=26'6)", 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:00.920430+0000", 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.479152837000001, 2024-09-11T05:33:15.407 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0061794570000000002, 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920430+0000", 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920430+0000", 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920430+0000", 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7000000000000004e-07 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920436+0000", 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2079999999999997e-06 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920446+0000", 2024-09-11T05:33:15.409 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.3999999999999998e-06 2024-09-11T05:33:15.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.410 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.410 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.410 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920452+0000", 2024-09-11T05:33:15.410 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2949999999999999e-06 2024-09-11T05:33:15.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.410 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.410 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.410 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920651+0000", 2024-09-11T05:33:15.410 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00019905500000000001 2024-09-11T05:33:15.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.410 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.410 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.920669+0000", 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.7850999999999999e-05 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926572+0000", 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0059027890000000003 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:00.926609+0000", 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7188999999999999e-05 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.411 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:878 3.8 3:17968d03:::rbd_data.112da50123d8.0000000000000009:head [stat,truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.099146+0000", 2024-09-11T05:33:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.30043654, 2024-09-11T05:33:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.006959682, 2024-09-11T05:33:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.412 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.413 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 878 2024-09-11T05:33:15.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.413 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.413 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.413 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.413 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099146+0000", 2024-09-11T05:33:15.413 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.413 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.413 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.413 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099146+0000", 2024-09-11T05:33:15.413 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099146+0000", 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9800000000000003e-07 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099150+0000", 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6509999999999999e-06 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099158+0000", 2024-09-11T05:33:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2779999999999993e-06 2024-09-11T05:33:15.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.415 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.415 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.415 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099165+0000", 2024-09-11T05:33:15.415 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1909999999999997e-06 2024-09-11T05:33:15.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.415 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.415 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.415 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.099981+0000", 2024-09-11T05:33:15.415 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00081619699999999995 2024-09-11T05:33:15.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.415 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.415 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.416 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100057+0000", 2024-09-11T05:33:15.416 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5980000000000001e-05 2024-09-11T05:33:15.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.416 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.416 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:15.416 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100168+0000", 2024-09-11T05:33:15.416 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000111156 2024-09-11T05:33:15.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.416 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.416 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:15.416 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.102169+0000", 2024-09-11T05:33:15.416 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0020009659999999999 2024-09-11T05:33:15.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.106034+0000", 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0038647540000000002 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.106068+0000", 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4848000000000002e-05 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.106105+0000", 2024-09-11T05:33:15.417 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7063000000000001e-05 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:873 3.c e26/22 3:316882c1:::rbd_data.112da50123d8.0000000000000004:head v 26'12, mlcod=26'9)", 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.100046+0000", 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.299536463000001, 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0060209529999999999, 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.418 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100046+0000", 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100046+0000", 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100046+0000", 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8999999999999996e-07 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.419 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100052+0000", 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3029999999999999e-06 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100061+0000", 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7860000000000002e-06 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100067+0000", 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7830000000000001e-06 2024-09-11T05:33:15.420 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.421 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.421 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.421 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100125+0000", 2024-09-11T05:33:15.421 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8013999999999997e-05 2024-09-11T05:33:15.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.421 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.421 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.421 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.100144+0000", 2024-09-11T05:33:15.421 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8442000000000001e-05 2024-09-11T05:33:15.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.421 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.421 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:15.421 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.106027+0000", 2024-09-11T05:33:15.422 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005883508 2024-09-11T05:33:15.422 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.422 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.422 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.422 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.106067+0000", 2024-09-11T05:33:15.422 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9527000000000003e-05 2024-09-11T05:33:15.422 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.422 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.422 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.422 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.422 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.422 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:936 3.8 3:17968d03:::rbd_data.112da50123d8.0000000000000009:head [stat,truncate 2621440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T05:33:15.423 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.174372+0000", 2024-09-11T05:33:15.423 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.225210635, 2024-09-11T05:33:15.423 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0062560439999999997, 2024-09-11T05:33:15.423 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.423 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.423 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:15.423 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.423 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.423 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.423 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 936 2024-09-11T05:33:15.423 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.423 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174372+0000", 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174372+0000", 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174372+0000", 2024-09-11T05:33:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:33:15.425 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.425 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.425 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.425 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174374+0000", 2024-09-11T05:33:15.425 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1050000000000002e-06 2024-09-11T05:33:15.425 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.425 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.425 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.425 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174384+0000", 2024-09-11T05:33:15.425 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9029999999999999e-06 2024-09-11T05:33:15.425 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.425 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.425 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.426 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174390+0000", 2024-09-11T05:33:15.426 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4539999999999998e-06 2024-09-11T05:33:15.426 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.426 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.426 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.426 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174907+0000", 2024-09-11T05:33:15.426 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00051710999999999999 2024-09-11T05:33:15.426 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.426 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.426 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.426 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.174978+0000", 2024-09-11T05:33:15.426 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1449e-05 2024-09-11T05:33:15.426 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175137+0000", 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000158553 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.176643+0000", 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0015064150000000001 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180572+0000", 2024-09-11T05:33:15.427 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.003928895 2024-09-11T05:33:15.428 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.428 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.428 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:15.428 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180601+0000", 2024-09-11T05:33:15.428 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8890999999999998e-05 2024-09-11T05:33:15.428 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.428 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.428 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.428 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180628+0000", 2024-09-11T05:33:15.428 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6886999999999999e-05 2024-09-11T05:33:15.428 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.428 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.428 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:931 3.c e26/22 3:316882c1:::rbd_data.112da50123d8.0000000000000004:head v 26'14, mlcod=26'11)", 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:01.175155+0000", 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.224427243999999, 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0054482369999999999, 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175155+0000", 2024-09-11T05:33:15.429 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175155+0000", 2024-09-11T05:33:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175156+0000", 2024-09-11T05:33:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8700000000000005e-07 2024-09-11T05:33:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175167+0000", 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1365999999999999e-05 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175182+0000", 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5213e-05 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175191+0000", 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4230000000000005e-06 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.431 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.432 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.432 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175280+0000", 2024-09-11T05:33:15.432 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8807999999999994e-05 2024-09-11T05:33:15.432 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.432 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.432 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.432 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.175301+0000", 2024-09-11T05:33:15.432 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1328999999999999e-05 2024-09-11T05:33:15.432 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.432 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.432 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:15.432 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180573+0000", 2024-09-11T05:33:15.432 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052722790000000004 2024-09-11T05:33:15.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.433 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.433 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.433 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:01.180603+0000", 2024-09-11T05:33:15.433 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0131999999999999e-05 2024-09-11T05:33:15.433 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.433 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.433 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.433 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.433 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16264 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 925696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.292347+0000", 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.1072352820000004, 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050427420000000002, 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16264 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.434 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292347+0000", 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292347+0000", 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292347+0000", 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.435 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.436 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292349+0000", 2024-09-11T05:33:15.436 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.03e-06 2024-09-11T05:33:15.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.436 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.436 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.436 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292355+0000", 2024-09-11T05:33:15.436 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.604e-06 2024-09-11T05:33:15.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.436 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.436 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.436 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292360+0000", 2024-09-11T05:33:15.436 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4739999999999999e-06 2024-09-11T05:33:15.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297220+0000", 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0048599619999999998 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297312+0000", 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2878000000000001e-05 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297390+0000", 2024-09-11T05:33:15.437 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7414000000000001e-05 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16265 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 974848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.292366+0000", 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.1072159099999999, 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052095570000000001, 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.438 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16265 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292366+0000", 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292366+0000", 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.439 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292367+0000", 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1100000000000002e-07 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292369+0000", 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.125e-06 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292375+0000", 2024-09-11T05:33:15.440 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7409999999999998e-06 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292379+0000", 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.493e-06 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297424+0000", 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050453090000000004 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.441 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297503+0000", 2024-09-11T05:33:15.442 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8603000000000006e-05 2024-09-11T05:33:15.442 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.442 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.442 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.442 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297576+0000", 2024-09-11T05:33:15.442 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2974999999999998e-05 2024-09-11T05:33:15.442 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.442 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.442 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.442 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.442 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.442 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16266 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 1024000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.442 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.292385+0000", 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.107197362, 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0053872410000000001, 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16266 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292385+0000", 2024-09-11T05:33:15.443 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.444 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.444 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.444 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.444 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292385+0000", 2024-09-11T05:33:15.444 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.444 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.444 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.444 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.444 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292386+0000", 2024-09-11T05:33:15.444 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:33:15.444 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.444 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.444 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292388+0000", 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.007e-06 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292393+0000", 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.292398+0000", 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6290000000000001e-06 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.445 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297615+0000", 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005217045 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297693+0000", 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8342000000000003e-05 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.297772+0000", 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9017999999999995e-05 2024-09-11T05:33:15.446 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16464 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 540672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.293929+0000", 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.1056532099999998, 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049176610000000003, 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.447 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16464 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293929+0000", 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293929+0000", 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.448 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293929+0000", 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4200000000000002e-07 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293931+0000", 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.057e-06 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293934+0000", 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0460000000000001e-06 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.449 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293943+0000", 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7080000000000003e-06 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298762+0000", 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.004818325 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298806+0000", 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4793999999999998e-05 2024-09-11T05:33:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298847+0000", 2024-09-11T05:33:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0488999999999998e-05 2024-09-11T05:33:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16465 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 589824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.293947+0000", 2024-09-11T05:33:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.1056354849999996, 2024-09-11T05:33:15.451 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050070729999999999, 2024-09-11T05:33:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16465 2024-09-11T05:33:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293947+0000", 2024-09-11T05:33:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.453 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.453 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.453 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.453 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293947+0000", 2024-09-11T05:33:15.453 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.453 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.453 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.453 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.453 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293947+0000", 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3699999999999999e-07 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293951+0000", 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0770000000000001e-06 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293956+0000", 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5530000000000003e-06 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.454 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293959+0000", 2024-09-11T05:33:15.455 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0800000000000002e-06 2024-09-11T05:33:15.455 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.455 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.455 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.455 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298871+0000", 2024-09-11T05:33:15.455 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049121190000000004 2024-09-11T05:33:15.455 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.455 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.455 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.455 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298912+0000", 2024-09-11T05:33:15.455 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0883000000000001e-05 2024-09-11T05:33:15.455 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.455 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298954+0000", 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2123999999999999e-05 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16466 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.293962+0000", 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.1056200479999996, 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050930089999999999, 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.456 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16466 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293962+0000", 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.457 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293962+0000", 2024-09-11T05:33:15.458 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.458 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.458 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.458 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.458 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293963+0000", 2024-09-11T05:33:15.458 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:33:15.458 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.458 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.458 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.458 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293964+0000", 2024-09-11T05:33:15.458 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1370000000000001e-06 2024-09-11T05:33:15.458 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.458 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293971+0000", 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8399999999999997e-06 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.293973+0000", 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.711e-06 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.298980+0000", 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050067230000000002 2024-09-11T05:33:15.459 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299018+0000", 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8118000000000003e-05 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299055+0000", 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7119000000000002e-05 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.460 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.461 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16468 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 737280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.461 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294399+0000", 2024-09-11T05:33:15.461 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.1051835179999996, 2024-09-11T05:33:15.461 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0048626579999999997, 2024-09-11T05:33:15.461 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.461 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.461 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:15.461 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.461 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.461 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.461 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16468 2024-09-11T05:33:15.461 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294399+0000", 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294399+0000", 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.462 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294399+0000", 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7100000000000002e-07 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294401+0000", 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0509999999999999e-06 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294407+0000", 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0109999999999997e-06 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.463 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.464 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294411+0000", 2024-09-11T05:33:15.464 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3560000000000001e-06 2024-09-11T05:33:15.464 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.464 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.464 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.464 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299187+0000", 2024-09-11T05:33:15.464 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0047765849999999999 2024-09-11T05:33:15.464 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.464 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.464 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.464 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299224+0000", 2024-09-11T05:33:15.464 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7153000000000002e-05 2024-09-11T05:33:15.465 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.465 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.465 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.465 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299261+0000", 2024-09-11T05:33:15.465 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7030999999999998e-05 2024-09-11T05:33:15.465 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.465 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.465 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.465 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.465 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.465 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16469 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 786432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.465 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294415+0000", 2024-09-11T05:33:15.465 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.105167668, 2024-09-11T05:33:15.466 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049499899999999996, 2024-09-11T05:33:15.466 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.466 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.466 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:15.466 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.466 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.466 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.466 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16469 2024-09-11T05:33:15.466 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.466 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.466 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.466 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.466 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294415+0000", 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294415+0000", 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294415+0000", 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.23e-07 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.467 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.468 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294416+0000", 2024-09-11T05:33:15.468 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2109999999999999e-06 2024-09-11T05:33:15.468 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.468 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.468 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.468 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294420+0000", 2024-09-11T05:33:15.468 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8480000000000003e-06 2024-09-11T05:33:15.468 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.468 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.468 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.468 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294430+0000", 2024-09-11T05:33:15.468 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0125999999999999e-05 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299285+0000", 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0048551610000000002 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299325+0000", 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9891999999999997e-05 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.469 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299365+0000", 2024-09-11T05:33:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9529e-05 2024-09-11T05:33:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16470 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 835584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294437+0000", 2024-09-11T05:33:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.1051449099999999, 2024-09-11T05:33:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050253809999999998, 2024-09-11T05:33:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16470 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294437+0000", 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.471 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294437+0000", 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294438+0000", 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294440+0000", 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1840000000000002e-06 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.472 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.473 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294446+0000", 2024-09-11T05:33:15.473 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4200000000000004e-06 2024-09-11T05:33:15.473 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.473 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.473 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.473 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294449+0000", 2024-09-11T05:33:15.473 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8210000000000002e-06 2024-09-11T05:33:15.473 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.473 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.473 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.473 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299389+0000", 2024-09-11T05:33:15.473 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049401530000000001 2024-09-11T05:33:15.473 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299427+0000", 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7299999999999999e-05 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299463+0000", 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6091999999999999e-05 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.474 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16471 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 884736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294472+0000", 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.1051100759999999, 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005104145, 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16471 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.475 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294472+0000", 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294472+0000", 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294473+0000", 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3599999999999999e-07 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.476 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294478+0000", 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5809999999999996e-06 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294482+0000", 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6229999999999999e-06 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294491+0000", 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1349999999999998e-06 2024-09-11T05:33:15.477 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299491+0000", 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050001159999999998 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299535+0000", 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.405e-05 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299576+0000", 2024-09-11T05:33:15.478 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1204000000000001e-05 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16472 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 933888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294495+0000", 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.1050869050000003, 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.005183727, 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.480 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.480 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16472 2024-09-11T05:33:15.480 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.480 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.480 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.480 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.480 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294495+0000", 2024-09-11T05:33:15.480 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.480 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.480 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.480 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.480 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294495+0000", 2024-09-11T05:33:15.480 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294496+0000", 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.15e-07 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294500+0000", 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8619999999999996e-06 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.481 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294505+0000", 2024-09-11T05:33:15.482 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4020000000000001e-06 2024-09-11T05:33:15.482 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.482 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.482 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.482 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294509+0000", 2024-09-11T05:33:15.482 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2080000000000002e-06 2024-09-11T05:33:15.482 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.482 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.482 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.482 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299603+0000", 2024-09-11T05:33:15.482 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0050937339999999999 2024-09-11T05:33:15.482 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.482 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299643+0000", 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9768999999999998e-05 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299679+0000", 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6436999999999997e-05 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16473 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294516+0000", 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.105066195, 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052687539999999996, 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16473 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294516+0000", 2024-09-11T05:33:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294516+0000", 2024-09-11T05:33:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294517+0000", 2024-09-11T05:33:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:33:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.486 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.486 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.486 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:15.486 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9209999999999999e-06 2024-09-11T05:33:15.486 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.486 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.488 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.488 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294524+0000", 2024-09-11T05:33:15.488 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8139999999999997e-06 2024-09-11T05:33:15.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.488 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.488 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.488 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294537+0000", 2024-09-11T05:33:15.488 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2415999999999999e-05 2024-09-11T05:33:15.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299704+0000", 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0051678080000000003 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299745+0000", 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0708999999999999e-05 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299785+0000", 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9712999999999997e-05 2024-09-11T05:33:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.490 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.490 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.490 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.490 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.490 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:16474 3.8 3:1109b812:::rbd_data.112d745a9e91.0000000000000019:a [read 1032192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.490 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.294544+0000", 2024-09-11T05:33:15.490 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.1050379699999997, 2024-09-11T05:33:15.490 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0053395229999999997, 2024-09-11T05:33:15.490 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.490 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.490 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:15.490 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.490 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 16474 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294544+0000", 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294544+0000", 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.492 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.492 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294545+0000", 2024-09-11T05:33:15.492 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2100000000000002e-07 2024-09-11T05:33:15.492 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.492 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.492 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.492 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294547+0000", 2024-09-11T05:33:15.492 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0779999999999998e-06 2024-09-11T05:33:15.492 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.492 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.492 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.492 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294559+0000", 2024-09-11T05:33:15.492 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2401999999999999e-05 2024-09-11T05:33:15.493 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.493 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.493 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.493 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.294566+0000", 2024-09-11T05:33:15.493 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7089999999999996e-06 2024-09-11T05:33:15.493 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.493 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.493 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.493 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299810+0000", 2024-09-11T05:33:15.493 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0052444650000000002 2024-09-11T05:33:15.493 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.493 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299847+0000", 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6514999999999999e-05 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.299884+0000", 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6933e-05 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.494 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.495 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:15.495 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.7513092270000001, 2024-09-11T05:33:15.495 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:33:15.495 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:15.495 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:15.495 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:15.495 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:15.495 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:15.495 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.495 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:33:15.495 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.495 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:15.495 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.496 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:15.496 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:15.496 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.496 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.496 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.496 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:15.496 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:15.496 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:15.496 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.496 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.496 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:15.496 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:33:15.496 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.497 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:33:15.498 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:33:15.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.498 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.498 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:15.498 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:33:15.498 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:33:15.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.498 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.498 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:15.499 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:33:15.499 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:33:15.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.499 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.499 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:33:15.499 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:33:15.499 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:33:15.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.499 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.499 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:15.499 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:33:15.499 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:33:15.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:33:15.500 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:33:15.501 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.501 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.501 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.501 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:15.501 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:15.501 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:15.501 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:15.400+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:15.502 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:15.543 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:15.543+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:15.604 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:15.603+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:15.606 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:15.606 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:15.606 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:15.606 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:15.615 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:15.701 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T05:33:15.705 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:15.705+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:15.770 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:15.771 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:15.771 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:15.771 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:15.771 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:15.771 INFO:teuthology.orchestra.run.smithi070.stdout:flattening image image_client.0-clone10 2024-09-11T05:33:15.784 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:15.807 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:15.806+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:15.907 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:15.908+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:15.929 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:15.929 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:15.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:15.930 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:15.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.930 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15742 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 483328~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.930 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:15.930 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.67968677, 2024-09-11T05:33:15.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022975045999999999, 2024-09-11T05:33:15.930 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:15.930 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:15.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:15.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:15.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:15.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15742 2024-09-11T05:33:15.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.931 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:15.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:15.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:15.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:15.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:15.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:15.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:15.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:15.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:15.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248353+0000", 2024-09-11T05:33:15.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.615e-06 2024-09-11T05:33:15.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:15.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248356+0000", 2024-09-11T05:33:15.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.641e-06 2024-09-11T05:33:15.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248360+0000", 2024-09-11T05:33:15.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:33:15.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:15.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271209+0000", 2024-09-11T05:33:15.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022848825999999999 2024-09-11T05:33:15.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271264+0000", 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5170999999999997e-05 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271326+0000", 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1389000000000005e-05 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.934 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15743 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 532480~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6796712219999996, 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023116772000000001, 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15743 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:15.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:15.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:15.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:15.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:15.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248808+0000", 2024-09-11T05:33:15.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044169199999999999 2024-09-11T05:33:15.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:15.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248812+0000", 2024-09-11T05:33:15.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6969999999999999e-06 2024-09-11T05:33:15.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:15.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248819+0000", 2024-09-11T05:33:15.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6790000000000005e-06 2024-09-11T05:33:15.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248826+0000", 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5509999999999996e-06 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271362+0000", 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022536348000000001 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271413+0000", 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0810000000000003e-05 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271483+0000", 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9994999999999996e-05 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15745 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 630784~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248860+0000", 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6791774620000002, 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022888384000000001, 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:15.939 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:15.940 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:15.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:15.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:15.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15745 2024-09-11T05:33:15.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.940 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:15.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:15.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248860+0000", 2024-09-11T05:33:15.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:15.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248860+0000", 2024-09-11T05:33:15.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:15.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248861+0000", 2024-09-11T05:33:15.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9699999999999996e-07 2024-09-11T05:33:15.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:15.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248863+0000", 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2239999999999998e-06 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248869+0000", 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248873+0000", 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4290000000000003e-06 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:15.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271654+0000", 2024-09-11T05:33:15.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022780671999999998 2024-09-11T05:33:15.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:15.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271694+0000", 2024-09-11T05:33:15.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0364000000000002e-05 2024-09-11T05:33:15.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:15.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271748+0000", 2024-09-11T05:33:15.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4329000000000001e-05 2024-09-11T05:33:15.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.944 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:15.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.944 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15746 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 679936~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.944 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:15.944 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6791419029999997, 2024-09-11T05:33:15.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022995304000000001, 2024-09-11T05:33:15.944 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:15.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:15.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:15.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15746 2024-09-11T05:33:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:15.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:15.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:15.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:15.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:33:15.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:15.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248898+0000", 2024-09-11T05:33:15.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1749999999999999e-06 2024-09-11T05:33:15.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:15.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248904+0000", 2024-09-11T05:33:15.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5759999999999996e-06 2024-09-11T05:33:15.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248909+0000", 2024-09-11T05:33:15.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9710000000000003e-06 2024-09-11T05:33:15.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:15.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271775+0000", 2024-09-11T05:33:15.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022866721 2024-09-11T05:33:15.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:15.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271833+0000", 2024-09-11T05:33:15.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7132000000000001e-05 2024-09-11T05:33:15.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:15.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271891+0000", 2024-09-11T05:33:15.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8303000000000001e-05 2024-09-11T05:33:15.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.949 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:15.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15747 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 729088~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6791233630000004, 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023120391000000001, 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15747 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.950 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:15.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:33:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248916+0000", 2024-09-11T05:33:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4270000000000001e-06 2024-09-11T05:33:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248919+0000", 2024-09-11T05:33:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.366e-06 2024-09-11T05:33:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248922+0000", 2024-09-11T05:33:15.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6790000000000001e-06 2024-09-11T05:33:15.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:15.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271914+0000", 2024-09-11T05:33:15.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022992584999999999 2024-09-11T05:33:15.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:15.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271965+0000", 2024-09-11T05:33:15.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1008999999999999e-05 2024-09-11T05:33:15.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:15.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272034+0000", 2024-09-11T05:33:15.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8980999999999996e-05 2024-09-11T05:33:15.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15748 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 778240~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6791124069999999, 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023325197999999998, 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:15.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15748 2024-09-11T05:33:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-07 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248926+0000", 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.077e-06 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248930+0000", 2024-09-11T05:33:15.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5920000000000001e-06 2024-09-11T05:33:15.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248933+0000", 2024-09-11T05:33:15.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7760000000000002e-06 2024-09-11T05:33:15.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:15.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272074+0000", 2024-09-11T05:33:15.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023141656 2024-09-11T05:33:15.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:15.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272153+0000", 2024-09-11T05:33:15.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8566999999999995e-05 2024-09-11T05:33:15.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:15.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272250+0000", 2024-09-11T05:33:15.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7217000000000001e-05 2024-09-11T05:33:15.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.962 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:15.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16376 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 925696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6338484869999998, 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023022233999999999, 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16376 2024-09-11T05:33:15.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:15.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:15.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:33:15.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:15.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294191+0000", 2024-09-11T05:33:15.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1169999999999998e-06 2024-09-11T05:33:15.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:15.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294198+0000", 2024-09-11T05:33:15.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.105e-06 2024-09-11T05:33:15.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294202+0000", 2024-09-11T05:33:15.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3490000000000002e-06 2024-09-11T05:33:15.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317070+0000", 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022868169000000001 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317141+0000", 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0947999999999999e-05 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317211+0000", 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0154999999999995e-05 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.967 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:15.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.968 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16377 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 974848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.968 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:15.968 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6338300639999996, 2024-09-11T05:33:15.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023184939000000002, 2024-09-11T05:33:15.968 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:15.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:15.968 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:15.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:15.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:15.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.969 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16377 2024-09-11T05:33:15.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.969 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:15.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:15.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:15.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:15.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:15.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:15.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294208+0000", 2024-09-11T05:33:15.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5600000000000001e-07 2024-09-11T05:33:15.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:15.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294210+0000", 2024-09-11T05:33:15.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T05:33:15.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:15.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294215+0000", 2024-09-11T05:33:15.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7989999999999999e-06 2024-09-11T05:33:15.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294220+0000", 2024-09-11T05:33:15.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6580000000000001e-06 2024-09-11T05:33:15.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:15.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317241+0000", 2024-09-11T05:33:15.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023020987999999999 2024-09-11T05:33:15.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:15.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317315+0000", 2024-09-11T05:33:15.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3496000000000002e-05 2024-09-11T05:33:15.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:15.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317392+0000", 2024-09-11T05:33:15.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7720999999999997e-05 2024-09-11T05:33:15.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.976 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:15.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.976 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16378 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 1024000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.977 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:15.977 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6338121189999999, 2024-09-11T05:33:15.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023298976999999998, 2024-09-11T05:33:15.977 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:15.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:15.977 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:15.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:15.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:15.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.978 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16378 2024-09-11T05:33:15.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.978 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:15.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:15.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:15.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:15.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:15.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:15.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294226+0000", 2024-09-11T05:33:15.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294228+0000", 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-06 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294234+0000", 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1399999999999997e-06 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294239+0000", 2024-09-11T05:33:15.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:33:15.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:15.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317420+0000", 2024-09-11T05:33:15.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023181499000000001 2024-09-11T05:33:15.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:15.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317478+0000", 2024-09-11T05:33:15.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7608999999999997e-05 2024-09-11T05:33:15.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317524+0000", 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6378999999999998e-05 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16400 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 532480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6336916610000003, 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022889597000000001, 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:15.982 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:15.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:15.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:15.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:15.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.983 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16400 2024-09-11T05:33:15.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.983 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:15.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:15.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:15.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:15.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:15.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:15.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:15.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7e-07 2024-09-11T05:33:15.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:15.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294348+0000", 2024-09-11T05:33:15.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:33:15.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:15.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294354+0000", 2024-09-11T05:33:15.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9880000000000001e-06 2024-09-11T05:33:15.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294359+0000", 2024-09-11T05:33:15.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1580000000000004e-06 2024-09-11T05:33:15.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:15.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317080+0000", 2024-09-11T05:33:15.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022720884 2024-09-11T05:33:15.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:15.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317162+0000", 2024-09-11T05:33:15.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1432000000000002e-05 2024-09-11T05:33:15.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:15.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317235+0000", 2024-09-11T05:33:15.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3705e-05 2024-09-11T05:33:15.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.987 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:15.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.987 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16401 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.987 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:15.987 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6336720299999996, 2024-09-11T05:33:15.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02302893, 2024-09-11T05:33:15.988 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:15.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:15.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:15.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:15.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:15.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.988 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16401 2024-09-11T05:33:15.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.988 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:15.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:15.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:15.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:15.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:15.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:15.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294366+0000", 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5499999999999998e-07 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294368+0000", 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294374+0000", 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1720000000000004e-06 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294379+0000", 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9089999999999999e-06 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317261+0000", 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022882442999999999 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317322+0000", 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0145000000000001e-05 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:15.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317394+0000", 2024-09-11T05:33:15.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2756000000000006e-05 2024-09-11T05:33:15.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.992 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:15.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.992 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16402 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 630784~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.992 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:15.992 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6336526339999997, 2024-09-11T05:33:15.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023196998, 2024-09-11T05:33:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16402 2024-09-11T05:33:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0900000000000002e-07 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294387+0000", 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9139999999999998e-06 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294393+0000", 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294398+0000", 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317424+0000", 2024-09-11T05:33:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023026042 2024-09-11T05:33:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317489+0000", 2024-09-11T05:33:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5488999999999996e-05 2024-09-11T05:33:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317582+0000", 2024-09-11T05:33:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2658000000000006e-05 2024-09-11T05:33:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16403 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 679936~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6336335719999999, 2024-09-11T05:33:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023338022999999999, 2024-09-11T05:33:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16403 2024-09-11T05:33:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T05:33:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294406+0000", 2024-09-11T05:33:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.902e-06 2024-09-11T05:33:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294413+0000", 2024-09-11T05:33:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3450000000000002e-06 2024-09-11T05:33:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294417+0000", 2024-09-11T05:33:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9599999999999999e-06 2024-09-11T05:33:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317608+0000", 2024-09-11T05:33:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023190137 2024-09-11T05:33:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317666+0000", 2024-09-11T05:33:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-11T05:33:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317742+0000", 2024-09-11T05:33:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6247000000000004e-05 2024-09-11T05:33:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16404 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 729088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6336142100000002, 2024-09-11T05:33:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023640379, 2024-09-11T05:33:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16404 2024-09-11T05:33:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294424+0000", 2024-09-11T05:33:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:33:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294426+0000", 2024-09-11T05:33:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0420000000000001e-06 2024-09-11T05:33:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294432+0000", 2024-09-11T05:33:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8810000000000001e-06 2024-09-11T05:33:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294436+0000", 2024-09-11T05:33:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9529999999999998e-06 2024-09-11T05:33:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317770+0000", 2024-09-11T05:33:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023333513 2024-09-11T05:33:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317900+0000", 2024-09-11T05:33:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013032699999999999 2024-09-11T05:33:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318064+0000", 2024-09-11T05:33:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016326900000000001 2024-09-11T05:33:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16405 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 778240~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6335947659999999, 2024-09-11T05:33:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023946875999999999, 2024-09-11T05:33:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16405 2024-09-11T05:33:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.15e-07 2024-09-11T05:33:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294445+0000", 2024-09-11T05:33:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.838e-06 2024-09-11T05:33:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294451+0000", 2024-09-11T05:33:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8279999999999999e-06 2024-09-11T05:33:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294455+0000", 2024-09-11T05:33:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-06 2024-09-11T05:33:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318095+0000", 2024-09-11T05:33:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023639667999999999 2024-09-11T05:33:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318161+0000", 2024-09-11T05:33:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6305999999999998e-05 2024-09-11T05:33:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318390+0000", 2024-09-11T05:33:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000228481 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16406 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 827392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6335763849999996, 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024093394000000001, 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16406 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4999999999999998e-07 2024-09-11T05:33:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294463+0000", 2024-09-11T05:33:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.108e-06 2024-09-11T05:33:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294469+0000", 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8359999999999997e-06 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294474+0000", 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3150000000000002e-06 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318421+0000", 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023947231999999999 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318492+0000", 2024-09-11T05:33:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1367999999999998e-05 2024-09-11T05:33:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318554+0000", 2024-09-11T05:33:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2185000000000002e-05 2024-09-11T05:33:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16407 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6335575430000002, 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024230683999999999, 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16407 2024-09-11T05:33:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:33:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294482+0000", 2024-09-11T05:33:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0959999999999999e-06 2024-09-11T05:33:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294488+0000", 2024-09-11T05:33:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8549999999999998e-06 2024-09-11T05:33:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294492+0000", 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2180000000000001e-06 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318583+0000", 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024090232 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318648+0000", 2024-09-11T05:33:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5538999999999997e-05 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318711+0000", 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2366000000000006e-05 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16408 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 925696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6335385550000003, 2024-09-11T05:33:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024377862, 2024-09-11T05:33:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16408 2024-09-11T05:33:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:33:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294502+0000", 2024-09-11T05:33:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4420000000000001e-06 2024-09-11T05:33:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294508+0000", 2024-09-11T05:33:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1410000000000002e-06 2024-09-11T05:33:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294512+0000", 2024-09-11T05:33:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.605e-06 2024-09-11T05:33:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318738+0000", 2024-09-11T05:33:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02422535 2024-09-11T05:33:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318816+0000", 2024-09-11T05:33:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7836999999999994e-05 2024-09-11T05:33:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318877+0000", 2024-09-11T05:33:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1058999999999999e-05 2024-09-11T05:33:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16409 3.1b 3.bc4667fb (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6335194949999998, 2024-09-11T05:33:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575657000000001, 2024-09-11T05:33:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16409 2024-09-11T05:33:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294520+0000", 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9410000000000001e-06 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294526+0000", 2024-09-11T05:33:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9649999999999996e-06 2024-09-11T05:33:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294531+0000", 2024-09-11T05:33:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5600000000000004e-06 2024-09-11T05:33:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319081+0000", 2024-09-11T05:33:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024550249 2024-09-11T05:33:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319094+0000", 2024-09-11T05:33:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2621e-05 2024-09-11T05:33:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16410 3.1b 3.bc4667fb (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6335012630000003, 2024-09-11T05:33:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024587633000000001, 2024-09-11T05:33:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16410 2024-09-11T05:33:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.15e-07 2024-09-11T05:33:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294544+0000", 2024-09-11T05:33:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6830000000000008e-06 2024-09-11T05:33:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294550+0000", 2024-09-11T05:33:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:33:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294555+0000", 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319117+0000", 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024561862 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319124+0000", 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8539999999999999e-06 2024-09-11T05:33:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.039 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:16.040 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:16.041 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-11T05:33:16.042 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:16.040+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:16.053 INFO:teuthology.orchestra.run.smithi070.stdout:1710 punch from 0x18e0b5c to 0x18eccd0, (0xc174 bytes) 2024-09-11T05:33:16.057 INFO:teuthology.orchestra.run.smithi070.stdout:1711 writesame 0x785634c thru 0x7861afa data_size 0x1(0xb7af bytes) 2024-09-11T05:33:16.083 INFO:teuthology.orchestra.run.smithi070.stdout:1712 read 0xd33b60e thru 0xd342629 (0x701c bytes) 2024-09-11T05:33:16.084 INFO:teuthology.orchestra.run.smithi070.stdout:1713 writesame 0xa0e6721 thru 0xa0f2437 data_size 0x1(0xbd17 bytes) 2024-09-11T05:33:16.111 INFO:teuthology.orchestra.run.smithi070.stdout:1714 write 0xb35971 thru 0xb40fbe (0xb64e bytes) 2024-09-11T05:33:16.117 INFO:teuthology.orchestra.run.smithi070.stdout:1715 writesame 0x4d6b62a thru 0x4d703ba data_size 0x1(0x4d91 bytes) 2024-09-11T05:33:16.131 INFO:teuthology.orchestra.run.smithi070.stdout:1716 writesame 0x15ff0f0 thru 0x16017d3 data_size 0x26(0x26e4 bytes) 2024-09-11T05:33:16.136 INFO:teuthology.orchestra.run.smithi070.stdout:1719 punch from 0xf7dbb0 to 0xf8579e, (0x7bee bytes) 2024-09-11T05:33:16.136 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:16.136 INFO:teuthology.orchestra.run.smithi070.stdout:1722 read 0x2185abf thru 0x218600b (0x54d bytes) 2024-09-11T05:33:16.136 INFO:teuthology.orchestra.run.smithi070.stdout:1723 write 0x43e8eac thru 0x43f3866 (0xa9bb bytes) 2024-09-11T05:33:16.139 INFO:teuthology.orchestra.run.smithi070.stdout:1725 read 0x7cc384c thru 0x7ccf609 (0xbdbe bytes) 2024-09-11T05:33:16.139 INFO:teuthology.orchestra.run.smithi070.stdout:1726 read 0xa6cce2b thru 0xa6d45d1 (0x77a7 bytes) 2024-09-11T05:33:16.139 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:16.139 INFO:teuthology.orchestra.run.smithi070.stdout:1728 read 0xa72f966 thru 0xa73e77f (0xee1a bytes) 2024-09-11T05:33:16.139 INFO:teuthology.orchestra.run.smithi070.stdout:1729 punch from 0x6db12a8 to 0x6db9a0f, (0x8767 bytes) 2024-09-11T05:33:16.139 INFO:teuthology.orchestra.run.smithi070.stdout:1730 punch from 0x1cc84b4 to 0x1ccec6a, (0x67b6 bytes) 2024-09-11T05:33:16.140 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:16.139+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:16.144 INFO:teuthology.orchestra.run.smithi070.stdout:1731 trunc from 0xe41bfa4 to 0x9883d52 2024-09-11T05:33:16.153 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:16.153 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:16.165 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:16.165 INFO:teuthology.orchestra.run.smithi070.stdout:1732 read 0x2ff24b8 thru 0x2ffbb44 (0x968d bytes) 2024-09-11T05:33:16.173 INFO:teuthology.orchestra.run.smithi070.stdout:1733 write 0xb66d228 thru 0xb66fe74 (0x2c4d bytes) 2024-09-11T05:33:16.175 INFO:teuthology.orchestra.run.smithi070.stdout:1734 write 0x36733e thru 0x367d54 (0xa17 bytes) 2024-09-11T05:33:16.186 INFO:teuthology.orchestra.run.smithi070.stdout:1736 write 0xba55bd3 thru 0xba59a13 (0x3e41 bytes) 2024-09-11T05:33:16.189 INFO:teuthology.orchestra.run.smithi070.stdout:1738 read 0x624b165 thru 0x624fb47 (0x49e3 bytes) 2024-09-11T05:33:16.189 INFO:teuthology.orchestra.run.smithi070.stdout:1739 writesame 0x6f50fc9 thru 0x6f536bf data_size 0x3(0x26f7 bytes) 2024-09-11T05:33:16.193 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:16.206 INFO:teuthology.orchestra.run.smithi070.stdout:1741 trunc from 0xba59a14 to 0xf3c51f 2024-09-11T05:33:16.226 INFO:teuthology.orchestra.run.smithi070.stdout:1742 punch from 0xba2ff4 to 0xbac713, (0x971f bytes) 2024-09-11T05:33:16.239 INFO:teuthology.orchestra.run.smithi070.stdout:1743 write 0x718bc29 thru 0x7196500 (0xa8d8 bytes) 2024-09-11T05:33:16.241 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:16.241+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:16.242 INFO:teuthology.orchestra.run.smithi070.stdout:1744 punch from 0x1a0ad7e to 0x1a12404, (0x7686 bytes) 2024-09-11T05:33:16.242 INFO:teuthology.orchestra.run.smithi070.stdout:1745 read 0x59c1848 thru 0x59d162d (0xfde6 bytes) 2024-09-11T05:33:16.243 INFO:teuthology.orchestra.run.smithi070.stdout:1746 read 0xb8a023 thru 0xb97bba (0xdb98 bytes) 2024-09-11T05:33:16.243 INFO:teuthology.orchestra.run.smithi070.stdout:1747 punch from 0x2db5936 to 0x2dc25dc, (0xcca6 bytes) 2024-09-11T05:33:16.243 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:16.255 INFO:teuthology.orchestra.run.smithi070.stdout:1749 write 0xcd0492e thru 0xcd10718 (0xbdeb bytes) 2024-09-11T05:33:16.258 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:16.259 INFO:teuthology.orchestra.run.smithi070.stdout:1751 writesame 0x58d817d thru 0x58e516d data_size 0x1(0xcff1 bytes) 2024-09-11T05:33:16.294 INFO:teuthology.orchestra.run.smithi070.stdout:1752 read 0x80cda4f thru 0x80ce4fc (0xaae bytes) 2024-09-11T05:33:16.295 INFO:teuthology.orchestra.run.smithi070.stdout:1753 writesame 0x74ef0e0 thru 0x74fc6be data_size 0x1(0xd5df bytes) 2024-09-11T05:33:16.299 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:16.299 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:16.299 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:16.299 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:16.299 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:16.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:16.325 INFO:teuthology.orchestra.run.smithi070.stdout:1754 punch from 0xcbea3c to 0xcc8649, (0x9c0d bytes) 2024-09-11T05:33:16.325 INFO:teuthology.orchestra.run.smithi070.stdout:1755 read 0x27c33c9 thru 0x27c6a4a (0x3682 bytes) 2024-09-11T05:33:16.326 INFO:teuthology.orchestra.run.smithi070.stdout:1756 read 0x165c188 thru 0x1662f10 (0x6d89 bytes) 2024-09-11T05:33:16.334 INFO:teuthology.orchestra.run.smithi070.stdout:1757 write 0xdea4193 thru 0xdeb315f (0xefcd bytes) 2024-09-11T05:33:16.337 INFO:teuthology.orchestra.run.smithi070.stdout:1758 read 0x2d98ae5 thru 0x2d98bc1 (0xdd bytes) 2024-09-11T05:33:16.342 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:16.341+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:16.344 INFO:teuthology.orchestra.run.smithi070.stdout:1759 trunc from 0xdeb3160 to 0x8353941 2024-09-11T05:33:16.359 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:16.359 INFO:teuthology.orchestra.run.smithi070.stdout:1761 read 0x2aff545 thru 0x2b022ea (0x2da6 bytes) 2024-09-11T05:33:16.359 INFO:teuthology.orchestra.run.smithi070.stdout:1762 punch from 0x122142b to 0x122616b, (0x4d40 bytes) 2024-09-11T05:33:16.359 INFO:teuthology.orchestra.run.smithi070.stdout:1763 write 0x22051fc thru 0x2206fc0 (0x1dc5 bytes) 2024-09-11T05:33:16.364 INFO:teuthology.orchestra.run.smithi070.stdout:1765 trunc from 0x8353941 to 0xa31a270 2024-09-11T05:33:16.373 INFO:teuthology.orchestra.run.smithi070.stdout:1766 trunc from 0xa31a270 to 0x70ea504 2024-09-11T05:33:16.384 INFO:teuthology.orchestra.run.smithi070.stdout:1767 clone 12 order 22 su 131072 sc 10 2024-09-11T05:33:16.438 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:16.438 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:16.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:16.439 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:16.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.439 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31413 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 147456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.439 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.786369+0000", 2024-09-11T05:33:16.439 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.65071854699999998, 2024-09-11T05:33:16.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017366124, 2024-09-11T05:33:16.439 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31413 2024-09-11T05:33:16.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.440 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786369+0000", 2024-09-11T05:33:16.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786369+0000", 2024-09-11T05:33:16.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786369+0000", 2024-09-11T05:33:16.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1399999999999998e-07 2024-09-11T05:33:16.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786371+0000", 2024-09-11T05:33:16.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6920000000000001e-06 2024-09-11T05:33:16.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786376+0000", 2024-09-11T05:33:16.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6629999999999998e-06 2024-09-11T05:33:16.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786381+0000", 2024-09-11T05:33:16.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6439999999999999e-06 2024-09-11T05:33:16.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.803516+0000", 2024-09-11T05:33:16.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017135294999999998 2024-09-11T05:33:16.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.803591+0000", 2024-09-11T05:33:16.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4429000000000002e-05 2024-09-11T05:33:16.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.803735+0000", 2024-09-11T05:33:16.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014408699999999999 2024-09-11T05:33:16.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.444 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.444 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31416 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 172032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.444 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.786387+0000", 2024-09-11T05:33:16.444 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.65069989100000003, 2024-09-11T05:33:16.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017548548000000001, 2024-09-11T05:33:16.444 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31416 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786387+0000", 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786387+0000", 2024-09-11T05:33:16.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786387+0000", 2024-09-11T05:33:16.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:33:16.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786389+0000", 2024-09-11T05:33:16.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.762e-06 2024-09-11T05:33:16.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786395+0000", 2024-09-11T05:33:16.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5960000000000003e-06 2024-09-11T05:33:16.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786400+0000", 2024-09-11T05:33:16.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9389999999999996e-06 2024-09-11T05:33:16.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.803762+0000", 2024-09-11T05:33:16.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017362546999999999 2024-09-11T05:33:16.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.803851+0000", 2024-09-11T05:33:16.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8620000000000002e-05 2024-09-11T05:33:16.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.803936+0000", 2024-09-11T05:33:16.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4744e-05 2024-09-11T05:33:16.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.449 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.449 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31424 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 151552~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.450 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.786405+0000", 2024-09-11T05:33:16.450 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.65068195200000001, 2024-09-11T05:33:16.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017712248, 2024-09-11T05:33:16.450 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31424 2024-09-11T05:33:16.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.450 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786405+0000", 2024-09-11T05:33:16.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786405+0000", 2024-09-11T05:33:16.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786405+0000", 2024-09-11T05:33:16.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786411+0000", 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3149999999999999e-06 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786417+0000", 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.891e-06 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786427+0000", 2024-09-11T05:33:16.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0623e-05 2024-09-11T05:33:16.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.803963+0000", 2024-09-11T05:33:16.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017535697999999999 2024-09-11T05:33:16.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.804035+0000", 2024-09-11T05:33:16.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2296e-05 2024-09-11T05:33:16.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.804117+0000", 2024-09-11T05:33:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2051000000000004e-05 2024-09-11T05:33:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31426 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 176128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.786435+0000", 2024-09-11T05:33:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.65065224399999999, 2024-09-11T05:33:16.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017857735999999999, 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31426 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786435+0000", 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786435+0000", 2024-09-11T05:33:16.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786435+0000", 2024-09-11T05:33:16.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8200000000000001e-07 2024-09-11T05:33:16.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786437+0000", 2024-09-11T05:33:16.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0059999999999999e-06 2024-09-11T05:33:16.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786443+0000", 2024-09-11T05:33:16.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6130000000000003e-06 2024-09-11T05:33:16.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786447+0000", 2024-09-11T05:33:16.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5020000000000003e-06 2024-09-11T05:33:16.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.804145+0000", 2024-09-11T05:33:16.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017697507000000001 2024-09-11T05:33:16.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.804220+0000", 2024-09-11T05:33:16.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5344000000000002e-05 2024-09-11T05:33:16.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.804293+0000", 2024-09-11T05:33:16.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2381999999999999e-05 2024-09-11T05:33:16.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.459 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.459 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31448 3.19 3:9e6d65eb:::rbd_data.112ddb772870.0000000000000003:c [read 131072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.460 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.786856+0000", 2024-09-11T05:33:16.460 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.65023055500000004, 2024-09-11T05:33:16.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018036524000000002, 2024-09-11T05:33:16.460 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.460 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31448 2024-09-11T05:33:16.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.460 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786856+0000", 2024-09-11T05:33:16.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786856+0000", 2024-09-11T05:33:16.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786857+0000", 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1099999999999995e-07 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786868+0000", 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786875+0000", 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4649999999999997e-06 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786881+0000", 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4739999999999996e-06 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.804319+0000", 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017437792000000001 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.804384+0000", 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5042999999999994e-05 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.804893+0000", 2024-09-11T05:33:16.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050937200000000001 2024-09-11T05:33:16.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.464 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.464 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31449 3.19 3:9e6d65eb:::rbd_data.112ddb772870.0000000000000003:c [read 159744~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.464 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.786891+0000", 2024-09-11T05:33:16.465 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.65019605300000005, 2024-09-11T05:33:16.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018316918000000001, 2024-09-11T05:33:16.465 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31449 2024-09-11T05:33:16.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.465 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786891+0000", 2024-09-11T05:33:16.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786891+0000", 2024-09-11T05:33:16.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786891+0000", 2024-09-11T05:33:16.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6399999999999998e-07 2024-09-11T05:33:16.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786893+0000", 2024-09-11T05:33:16.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0509999999999999e-06 2024-09-11T05:33:16.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786900+0000", 2024-09-11T05:33:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.596e-06 2024-09-11T05:33:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786905+0000", 2024-09-11T05:33:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:33:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.804922+0000", 2024-09-11T05:33:16.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018017321999999999 2024-09-11T05:33:16.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.804994+0000", 2024-09-11T05:33:16.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1835999999999995e-05 2024-09-11T05:33:16.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.805208+0000", 2024-09-11T05:33:16.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021402899999999999 2024-09-11T05:33:16.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.469 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.470 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31450 3.19 3:9e6d65eb:::rbd_data.112ddb772870.0000000000000003:c [read 188416~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.470 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.786913+0000", 2024-09-11T05:33:16.470 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.65017440900000001, 2024-09-11T05:33:16.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019185126, 2024-09-11T05:33:16.470 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31450 2024-09-11T05:33:16.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.471 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786913+0000", 2024-09-11T05:33:16.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786913+0000", 2024-09-11T05:33:16.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786913+0000", 2024-09-11T05:33:16.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7e-07 2024-09-11T05:33:16.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786915+0000", 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786921+0000", 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7629999999999997e-06 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786925+0000", 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070000000000003e-06 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.805238+0000", 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018312822999999999 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.805304+0000", 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6146e-05 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.806098+0000", 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079367700000000001 2024-09-11T05:33:16.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.475 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.475 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.475 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31451 3.19 3:9e6d65eb:::rbd_data.112ddb772870.0000000000000003:c [read 212992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.475 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.786931+0000", 2024-09-11T05:33:16.475 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.65015639999999997, 2024-09-11T05:33:16.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019812007999999999, 2024-09-11T05:33:16.475 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.475 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.475 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.476 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.476 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31451 2024-09-11T05:33:16.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.476 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786931+0000", 2024-09-11T05:33:16.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786931+0000", 2024-09-11T05:33:16.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786931+0000", 2024-09-11T05:33:16.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:33:16.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786933+0000", 2024-09-11T05:33:16.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8449999999999999e-06 2024-09-11T05:33:16.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786938+0000", 2024-09-11T05:33:16.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3449999999999996e-06 2024-09-11T05:33:16.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.786943+0000", 2024-09-11T05:33:16.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:33:16.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.806126+0000", 2024-09-11T05:33:16.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019183149 2024-09-11T05:33:16.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.806490+0000", 2024-09-11T05:33:16.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036429700000000003 2024-09-11T05:33:16.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.806743+0000", 2024-09-11T05:33:16.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025256200000000001 2024-09-11T05:33:16.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.480 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.481 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31494 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 122880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.481 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.787025+0000", 2024-09-11T05:33:16.481 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.65006186899999996, 2024-09-11T05:33:16.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019951318999999999, 2024-09-11T05:33:16.481 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31494 2024-09-11T05:33:16.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.481 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787025+0000", 2024-09-11T05:33:16.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787025+0000", 2024-09-11T05:33:16.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787026+0000", 2024-09-11T05:33:16.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1600000000000002e-07 2024-09-11T05:33:16.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787028+0000", 2024-09-11T05:33:16.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0609999999999998e-06 2024-09-11T05:33:16.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787033+0000", 2024-09-11T05:33:16.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5310000000000001e-06 2024-09-11T05:33:16.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787037+0000", 2024-09-11T05:33:16.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2320000000000003e-06 2024-09-11T05:33:16.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.806784+0000", 2024-09-11T05:33:16.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019746776000000001 2024-09-11T05:33:16.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.806873+0000", 2024-09-11T05:33:16.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8955000000000005e-05 2024-09-11T05:33:16.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.806976+0000", 2024-09-11T05:33:16.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103348 2024-09-11T05:33:16.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.485 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.485 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31497 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 180224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.485 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.787044+0000", 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.65004283900000004, 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020129134, 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31497 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787044+0000", 2024-09-11T05:33:16.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787044+0000", 2024-09-11T05:33:16.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787045+0000", 2024-09-11T05:33:16.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:33:16.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787047+0000", 2024-09-11T05:33:16.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8610000000000001e-06 2024-09-11T05:33:16.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787052+0000", 2024-09-11T05:33:16.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-06 2024-09-11T05:33:16.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787063+0000", 2024-09-11T05:33:16.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1052e-05 2024-09-11T05:33:16.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807009+0000", 2024-09-11T05:33:16.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019946162 2024-09-11T05:33:16.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807085+0000", 2024-09-11T05:33:16.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5598000000000004e-05 2024-09-11T05:33:16.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807173+0000", 2024-09-11T05:33:16.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8362999999999994e-05 2024-09-11T05:33:16.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.493 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.494 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31498 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 204800~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.494 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.787070+0000", 2024-09-11T05:33:16.494 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.65001747399999998, 2024-09-11T05:33:16.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020295035999999999, 2024-09-11T05:33:16.495 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.496 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31498 2024-09-11T05:33:16.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.496 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787070+0000", 2024-09-11T05:33:16.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787070+0000", 2024-09-11T05:33:16.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787070+0000", 2024-09-11T05:33:16.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4200000000000002e-07 2024-09-11T05:33:16.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787072+0000", 2024-09-11T05:33:16.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.001e-06 2024-09-11T05:33:16.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787079+0000", 2024-09-11T05:33:16.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0670000000000003e-06 2024-09-11T05:33:16.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787084+0000", 2024-09-11T05:33:16.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8940000000000001e-06 2024-09-11T05:33:16.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807204+0000", 2024-09-11T05:33:16.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020120504000000001 2024-09-11T05:33:16.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807275+0000", 2024-09-11T05:33:16.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0959999999999998e-05 2024-09-11T05:33:16.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807365+0000", 2024-09-11T05:33:16.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9268e-05 2024-09-11T05:33:16.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.504 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.505 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31499 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 126976~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.505 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.787090+0000", 2024-09-11T05:33:16.505 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.649996778, 2024-09-11T05:33:16.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020454529999999999, 2024-09-11T05:33:16.505 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.506 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31499 2024-09-11T05:33:16.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.507 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787090+0000", 2024-09-11T05:33:16.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787090+0000", 2024-09-11T05:33:16.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787091+0000", 2024-09-11T05:33:16.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:33:16.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787093+0000", 2024-09-11T05:33:16.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8729999999999999e-06 2024-09-11T05:33:16.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787099+0000", 2024-09-11T05:33:16.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9279999999999998e-06 2024-09-11T05:33:16.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787103+0000", 2024-09-11T05:33:16.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2509999999999996e-06 2024-09-11T05:33:16.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807395+0000", 2024-09-11T05:33:16.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020291883 2024-09-11T05:33:16.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807467+0000", 2024-09-11T05:33:16.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2405999999999998e-05 2024-09-11T05:33:16.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807545+0000", 2024-09-11T05:33:16.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7744000000000006e-05 2024-09-11T05:33:16.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.515 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.515 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31502 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 184320~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.515 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.787109+0000", 2024-09-11T05:33:16.515 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64997813800000004, 2024-09-11T05:33:16.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020623929999999999, 2024-09-11T05:33:16.516 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.516 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31502 2024-09-11T05:33:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787109+0000", 2024-09-11T05:33:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787109+0000", 2024-09-11T05:33:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787109+0000", 2024-09-11T05:33:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:33:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787117+0000", 2024-09-11T05:33:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0150000000000003e-06 2024-09-11T05:33:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787123+0000", 2024-09-11T05:33:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0390000000000001e-06 2024-09-11T05:33:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787128+0000", 2024-09-11T05:33:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.459e-06 2024-09-11T05:33:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807571+0000", 2024-09-11T05:33:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020443260000000001 2024-09-11T05:33:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807640+0000", 2024-09-11T05:33:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9224e-05 2024-09-11T05:33:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807733+0000", 2024-09-11T05:33:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2592999999999999e-05 2024-09-11T05:33:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31504 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 208896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.787272+0000", 2024-09-11T05:33:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64981545399999996, 2024-09-11T05:33:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020655551000000001, 2024-09-11T05:33:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31504 2024-09-11T05:33:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787272+0000", 2024-09-11T05:33:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787272+0000", 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787272+0000", 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4600000000000005e-07 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787281+0000", 2024-09-11T05:33:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7090000000000008e-06 2024-09-11T05:33:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787291+0000", 2024-09-11T05:33:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0181e-05 2024-09-11T05:33:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787297+0000", 2024-09-11T05:33:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8989999999999998e-06 2024-09-11T05:33:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807761+0000", 2024-09-11T05:33:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020463640000000002 2024-09-11T05:33:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807836+0000", 2024-09-11T05:33:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5777000000000003e-05 2024-09-11T05:33:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807927+0000", 2024-09-11T05:33:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0798999999999996e-05 2024-09-11T05:33:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31516 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 131072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.787381+0000", 2024-09-11T05:33:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64970567199999996, 2024-09-11T05:33:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020726967999999998, 2024-09-11T05:33:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31516 2024-09-11T05:33:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787381+0000", 2024-09-11T05:33:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787381+0000", 2024-09-11T05:33:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787382+0000", 2024-09-11T05:33:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5300000000000003e-07 2024-09-11T05:33:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787386+0000", 2024-09-11T05:33:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0690000000000003e-06 2024-09-11T05:33:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787395+0000", 2024-09-11T05:33:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8699999999999998e-06 2024-09-11T05:33:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787402+0000", 2024-09-11T05:33:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9530000000000002e-06 2024-09-11T05:33:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.807955+0000", 2024-09-11T05:33:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020553168 2024-09-11T05:33:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.808026+0000", 2024-09-11T05:33:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0290000000000006e-05 2024-09-11T05:33:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.808108+0000", 2024-09-11T05:33:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2764999999999998e-05 2024-09-11T05:33:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31517 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 155648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.787413+0000", 2024-09-11T05:33:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64967384800000005, 2024-09-11T05:33:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020888398999999998, 2024-09-11T05:33:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31517 2024-09-11T05:33:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787413+0000", 2024-09-11T05:33:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787413+0000", 2024-09-11T05:33:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787414+0000", 2024-09-11T05:33:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:33:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787427+0000", 2024-09-11T05:33:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3196999999999999e-05 2024-09-11T05:33:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787433+0000", 2024-09-11T05:33:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3230000000000003e-06 2024-09-11T05:33:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787442+0000", 2024-09-11T05:33:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2399999999999996e-06 2024-09-11T05:33:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.808135+0000", 2024-09-11T05:33:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02069263 2024-09-11T05:33:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.808217+0000", 2024-09-11T05:33:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2263999999999997e-05 2024-09-11T05:33:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.808302+0000", 2024-09-11T05:33:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4314999999999995e-05 2024-09-11T05:33:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31520 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 135168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.787451+0000", 2024-09-11T05:33:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64963652500000002, 2024-09-11T05:33:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021030647, 2024-09-11T05:33:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31520 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787451+0000", 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787451+0000", 2024-09-11T05:33:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787451+0000", 2024-09-11T05:33:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9100000000000004e-07 2024-09-11T05:33:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787453+0000", 2024-09-11T05:33:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.452e-06 2024-09-11T05:33:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787460+0000", 2024-09-11T05:33:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3980000000000004e-06 2024-09-11T05:33:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787465+0000", 2024-09-11T05:33:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9019999999999998e-06 2024-09-11T05:33:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.808327+0000", 2024-09-11T05:33:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020862524 2024-09-11T05:33:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.808397+0000", 2024-09-11T05:33:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0080000000000007e-05 2024-09-11T05:33:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.808481+0000", 2024-09-11T05:33:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3800000000000004e-05 2024-09-11T05:33:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31521 3.19 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:a [read 159744~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.787471+0000", 2024-09-11T05:33:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.649616415, 2024-09-11T05:33:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021203262, 2024-09-11T05:33:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31521 2024-09-11T05:33:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787471+0000", 2024-09-11T05:33:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787471+0000", 2024-09-11T05:33:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787471+0000", 2024-09-11T05:33:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:33:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787473+0000", 2024-09-11T05:33:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7179999999999999e-06 2024-09-11T05:33:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787478+0000", 2024-09-11T05:33:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5879999999999997e-06 2024-09-11T05:33:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.787483+0000", 2024-09-11T05:33:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7419999999999997e-06 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.808510+0000", 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021026481999999999 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.808582+0000", 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2506e-05 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.808674+0000", 2024-09-11T05:33:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1880999999999997e-05 2024-09-11T05:33:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31906 3.1a 3:5a7f3594:::rbd_data.112d30086c3b.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.821452+0000", 2024-09-11T05:33:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.61563550899999997, 2024-09-11T05:33:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021118345, 2024-09-11T05:33:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31906 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.821452+0000", 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.821452+0000", 2024-09-11T05:33:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.821452+0000", 2024-09-11T05:33:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6699999999999999e-07 2024-09-11T05:33:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.821650+0000", 2024-09-11T05:33:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000197753 2024-09-11T05:33:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.821657+0000", 2024-09-11T05:33:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6429999999999995e-06 2024-09-11T05:33:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.821663+0000", 2024-09-11T05:33:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9449999999999998e-06 2024-09-11T05:33:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.823643+0000", 2024-09-11T05:33:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019801290000000002 2024-09-11T05:33:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.823771+0000", 2024-09-11T05:33:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127265 2024-09-11T05:33:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.823986+0000", 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021566200000000001 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.828406+0000", 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044197940000000003 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.842411+0000", 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014004812 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.842536+0000", 2024-09-11T05:33:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012487899999999999 2024-09-11T05:33:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.842570+0000", 2024-09-11T05:33:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3995999999999998e-05 2024-09-11T05:33:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:31907 3.1a 3:5a7f3594:::rbd_data.112d30086c3b.0000000000000009:head [write 0~0] snapc d=[d] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:15.821674+0000", 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.61541272700000005, 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021311842000000001, 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 31907 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.821674+0000", 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.821674+0000", 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.821675+0000", 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8899999999999999e-07 2024-09-11T05:33:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.821677+0000", 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.554e-06 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.821683+0000", 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9689999999999999e-06 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.821688+0000", 2024-09-11T05:33:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8110000000000002e-06 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.827160+0000", 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054712900000000002 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.827353+0000", 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193835 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T05:33:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.827509+0000", 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015524199999999999 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.832940+0000", 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054311769999999997 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.842580+0000", 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009640338 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.842618+0000", 2024-09-11T05:33:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7608999999999999e-05 2024-09-11T05:33:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:15.842986+0000", 2024-09-11T05:33:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036842800000000002 2024-09-11T05:33:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:16.559 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:16.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:16.562 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:16.561+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:16.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:33:16.661 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:16.660+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:16.712 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:16.712 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:16.712 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:16.712 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:16.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:16.729 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:16.729 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:16.749 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:16.749 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:16.763 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone11 from 0x70ea504 (overlap 0xf3c51f) to 0xdb649b 2024-09-11T05:33:16.763 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:16.762+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:16.773 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:16.793 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:16.793 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:16.813 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:16.813 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:16.832 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:16.832 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:16.832 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-11T05:33:16.848 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:16.848 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:16.849 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:16.849 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:16.860 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:16.864 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:16.864+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:16.867 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:16.867 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:16.965 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:16.965+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:17.022 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:17.022 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:17.031 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:17.066 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:17.066+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:17.139 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:17.139 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:17.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:17.176 INFO:teuthology.orchestra.run.smithi070.stdout:truncating to largest ever: 0xede7fb1 2024-09-11T05:33:17.176 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:17.175+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:17.185 INFO:teuthology.orchestra.run.smithi070.stdout:1768 trunc from 0x70ea504 to 0xede7fb1 2024-09-11T05:33:17.193 INFO:teuthology.orchestra.run.smithi070.stdout:1769 write 0xe9580b4 thru 0xe963081 (0xafce bytes) 2024-09-11T05:33:17.197 INFO:teuthology.orchestra.run.smithi070.stdout:1770 read 0xe7a7dd4 thru 0xe7a9f6b (0x2198 bytes) 2024-09-11T05:33:17.197 INFO:teuthology.orchestra.run.smithi070.stdout:1771 punch from 0x126bc1c to 0x12724d0, (0x68b4 bytes) 2024-09-11T05:33:17.197 INFO:teuthology.orchestra.run.smithi070.stdout:1772 read 0xbf606c9 thru 0xbf68955 (0x828d bytes) 2024-09-11T05:33:17.197 INFO:teuthology.orchestra.run.smithi070.stdout:1773 read 0x7061c39 thru 0x7068d85 (0x714d bytes) 2024-09-11T05:33:17.197 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:17.197 INFO:teuthology.orchestra.run.smithi070.stdout:1775 writesame 0x586e3a5 thru 0x5875808 data_size 0xd(0x7464 bytes) 2024-09-11T05:33:17.202 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:17.202 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:17.202 INFO:teuthology.orchestra.run.smithi070.stdout:1780 writesame 0xcc701cc thru 0xcc7867d data_size 0x56(0x84b2 bytes) 2024-09-11T05:33:17.205 INFO:teuthology.orchestra.run.smithi070.stdout:1783 read 0x63087eb thru 0x631832b (0xfb41 bytes) 2024-09-11T05:33:17.205 INFO:teuthology.orchestra.run.smithi070.stdout:1786 punch from 0xe242865 to 0xe24a5f4, (0x7d8f bytes) 2024-09-11T05:33:17.205 INFO:teuthology.orchestra.run.smithi070.stdout:1787 writesame 0xcf6747f thru 0xcf758d2 data_size 0x6(0xe454 bytes) 2024-09-11T05:33:17.212 INFO:teuthology.orchestra.run.smithi070.stdout:1788 write 0x500e604 thru 0x501d11a (0xeb17 bytes) 2024-09-11T05:33:17.231 INFO:teuthology.orchestra.run.smithi070.stdout:1789 trunc from 0xede7fb1 to 0x3694aba 2024-09-11T05:33:17.256 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:17.264 INFO:teuthology.orchestra.run.smithi070.stdout:1792 write 0x63c711a thru 0x63d6a7a (0xf961 bytes) 2024-09-11T05:33:17.267 INFO:teuthology.orchestra.run.smithi070.stdout:1793 punch from 0x48686a3 to 0x486a983, (0x22e0 bytes) 2024-09-11T05:33:17.267 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:17.267 INFO:teuthology.orchestra.run.smithi070.stdout:1795 read 0x125f892 thru 0x12688e0 (0x904f bytes) 2024-09-11T05:33:17.268 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:17.267+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:17.268 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:17.269 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:17.272 INFO:teuthology.orchestra.run.smithi070.stdout:1796 trunc from 0x63d6a7b to 0xa6ccd06 2024-09-11T05:33:17.277 INFO:teuthology.orchestra.run.smithi070.stdout:1798 writesame 0x9e45478 thru 0x9e516bb data_size 0x2(0xc244 bytes) 2024-09-11T05:33:17.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:17.292 INFO:teuthology.orchestra.run.smithi070.stdout:1799 writesame 0x7ab05e8 thru 0x7abeff3 data_size 0x6(0xea0c bytes) 2024-09-11T05:33:17.299 INFO:teuthology.orchestra.run.smithi070.stdout:1800 read 0x1e21332 thru 0x1e27698 (0x6367 bytes) 2024-09-11T05:33:17.299 INFO:teuthology.orchestra.run.smithi070.stdout:1802 read 0x3dcf7df thru 0x3dd44f0 (0x4d12 bytes) 2024-09-11T05:33:17.300 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:17.300 INFO:teuthology.orchestra.run.smithi070.stdout:1804 write 0x9d5ce47 thru 0x9d67dea (0xafa4 bytes) 2024-09-11T05:33:17.303 INFO:teuthology.orchestra.run.smithi070.stdout:1805 write 0xa393337 thru 0xa39c1dd (0x8ea7 bytes) 2024-09-11T05:33:17.310 INFO:teuthology.orchestra.run.smithi070.stdout:1806 trunc from 0xa6ccd06 to 0x77a998c 2024-09-11T05:33:17.322 INFO:teuthology.orchestra.run.smithi070.stdout:1808 writesame 0x57e4f2e thru 0x57e762d data_size 0x4e(0x2700 bytes) 2024-09-11T05:33:17.331 INFO:teuthology.orchestra.run.smithi070.stdout:1809 write 0x92cd41f thru 0x92d5bc9 (0x87ab bytes) 2024-09-11T05:33:17.334 INFO:teuthology.orchestra.run.smithi070.stdout:1810 write 0x8cea71e thru 0x8ced331 (0x2c14 bytes) 2024-09-11T05:33:17.343 INFO:teuthology.orchestra.run.smithi070.stdout:1812 write 0x9eded09 thru 0x9edffbf (0x12b7 bytes) 2024-09-11T05:33:17.350 INFO:teuthology.orchestra.run.smithi070.stdout:1813 trunc from 0x9edffc0 to 0xdf7bbbe 2024-09-11T05:33:17.355 INFO:teuthology.orchestra.run.smithi070.stdout:1814 write 0xc875737 thru 0xc880d06 (0xb5d0 bytes) 2024-09-11T05:33:17.358 INFO:teuthology.orchestra.run.smithi070.stdout:1815 writesame 0x13f066 thru 0x140146 data_size 0x1(0x10e1 bytes) 2024-09-11T05:33:17.369 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:17.367+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:17.370 INFO:teuthology.orchestra.run.smithi070.stdout:1816 clone 13 order 24 su 262144 sc 3 2024-09-11T05:33:17.409 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:17.409 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:17.418 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:17.470 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:17.469+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:17.520 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:17.521 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:17.530 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:17.571 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:17.569+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:17.633 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:17.633 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:17.641 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:17.685 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:17.685+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:17.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:33:17.747 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:17.747 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:17.756 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:17.767 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone12 from 0xdf7bbbe (overlap 0x3694aba) to 0x2baa22e 2024-09-11T05:33:17.797 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:17.797+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:17.857 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-11T05:33:17.875 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:17.873+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:17.881 INFO:teuthology.orchestra.run.smithi070.stdout:1818 writesame 0x3f6f27e thru 0x3f75fbe data_size 0x1(0x6d41 bytes) 2024-09-11T05:33:17.905 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:17.905 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:17.909 INFO:teuthology.orchestra.run.smithi070.stdout:1819 write 0x37e702f thru 0x37ef297 (0x8269 bytes) 2024-09-11T05:33:17.911 INFO:teuthology.orchestra.run.smithi070.stdout:1820 read 0xb6f4996 thru 0xb6fcb34 (0x819f bytes) 2024-09-11T05:33:17.914 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:17.917 INFO:teuthology.orchestra.run.smithi070.stdout:1821 trunc from 0xdf7bbbe to 0x96b2606 2024-09-11T05:33:17.930 INFO:teuthology.orchestra.run.smithi070.stdout:1822 punch from 0x2f4ddf8 to 0x2f5aba9, (0xcdb1 bytes) 2024-09-11T05:33:17.931 INFO:teuthology.orchestra.run.smithi070.stdout:1823 read 0x21896a6 thru 0x218cdce (0x3729 bytes) 2024-09-11T05:33:17.938 INFO:teuthology.orchestra.run.smithi070.stdout:1825 trunc from 0x96b2606 to 0x2605259 2024-09-11T05:33:17.977 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:17.974+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:18.028 INFO:teuthology.orchestra.run.smithi070.stdout:1827 read 0x8f3743 thru 0x901bf5 (0xe4b3 bytes) 2024-09-11T05:33:18.030 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:18.030 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:18.035 INFO:teuthology.orchestra.run.smithi070.stdout:1828 write 0x444e817 thru 0x4456533 (0x7d1d bytes) 2024-09-11T05:33:18.038 INFO:teuthology.orchestra.run.smithi070.stdout:1829 trunc from 0x4456534 to 0x423f983 2024-09-11T05:33:18.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:18.058 INFO:teuthology.orchestra.run.smithi070.stdout:1830 write 0xb529822 thru 0xb537389 (0xdb68 bytes) 2024-09-11T05:33:18.061 INFO:teuthology.orchestra.run.smithi070.stdout:1831 punch from 0x3616775 to 0x361c492, (0x5d1d bytes) 2024-09-11T05:33:18.068 INFO:teuthology.orchestra.run.smithi070.stdout:1833 write 0xcefb5e8 thru 0xcf027ea (0x7203 bytes) 2024-09-11T05:33:18.071 INFO:teuthology.orchestra.run.smithi070.stdout:1835 read 0x1c8b200 thru 0x1c90dd5 (0x5bd6 bytes) 2024-09-11T05:33:18.071 INFO:teuthology.orchestra.run.smithi070.stdout:1836 write 0x2d06c thru 0x31c29 (0x4bbe bytes) 2024-09-11T05:33:18.073 INFO:teuthology.orchestra.run.smithi070.stdout:1837 writesame 0x76755ee thru 0x7680e9d data_size 0xc5(0xb8b0 bytes) 2024-09-11T05:33:18.077 INFO:teuthology.orchestra.run.smithi070.stdout:1838 read 0xbda2f45 thru 0xbdaf5f7 (0xc6b3 bytes) 2024-09-11T05:33:18.077 INFO:teuthology.orchestra.run.smithi070.stdout:1839 write 0x2672b1f thru 0x267a6f6 (0x7bd8 bytes) 2024-09-11T05:33:18.077 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:18.075+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:18.078 INFO:teuthology.orchestra.run.smithi070.stdout:1840 punch from 0x36aa126 to 0x36b706d, (0xcf47 bytes) 2024-09-11T05:33:18.078 INFO:teuthology.orchestra.run.smithi070.stdout:1842 read 0x9e1d6bd thru 0x9e2aadf (0xd423 bytes) 2024-09-11T05:33:18.078 INFO:teuthology.orchestra.run.smithi070.stdout:1844 write 0x3e0223 thru 0x3e1202 (0xfe0 bytes) 2024-09-11T05:33:18.079 INFO:teuthology.orchestra.run.smithi070.stdout:1845 write 0x134fe2e thru 0x13566fe (0x68d1 bytes) 2024-09-11T05:33:18.081 INFO:teuthology.orchestra.run.smithi070.stdout:1846 punch from 0xb1657e1 to 0xb174337, (0xeb56 bytes) 2024-09-11T05:33:18.081 INFO:teuthology.orchestra.run.smithi070.stdout:1847 read 0x56b71f2 thru 0x56b7ff1 (0xe00 bytes) 2024-09-11T05:33:18.081 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:18.081 INFO:teuthology.orchestra.run.smithi070.stdout:1849 read 0x3efdd40 thru 0x3f03d72 (0x6033 bytes) 2024-09-11T05:33:18.082 INFO:teuthology.orchestra.run.smithi070.stdout:1851 punch from 0x4edc265 to 0x4ee5d4a, (0x9ae5 bytes) 2024-09-11T05:33:18.082 INFO:teuthology.orchestra.run.smithi070.stdout:1852 punch from 0xaec3f79 to 0xaec6d12, (0x2d99 bytes) 2024-09-11T05:33:18.082 INFO:teuthology.orchestra.run.smithi070.stdout:1853 write 0xcdab8c5 thru 0xcdae7ff (0x2f3b bytes) 2024-09-11T05:33:18.087 INFO:teuthology.orchestra.run.smithi070.stdout:1854 trunc from 0xcf027eb to 0x8f549f6 2024-09-11T05:33:18.106 INFO:teuthology.orchestra.run.smithi070.stdout:1857 writesame 0xc92eab1 thru 0xc93191f data_size 0x1(0x2e6f bytes) 2024-09-11T05:33:18.106 INFO:teuthology.orchestra.run.smithi070.stdout:1858 writesame 0x352d683 thru 0x3535cef data_size 0x1(0x866d bytes) 2024-09-11T05:33:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:1859 write 0x76cca28 thru 0x76d9801 (0xcdda bytes) 2024-09-11T05:33:18.129 INFO:teuthology.orchestra.run.smithi070.stdout:1860 write 0x9deff03 thru 0x9dfae48 (0xaf46 bytes) 2024-09-11T05:33:18.132 INFO:teuthology.orchestra.run.smithi070.stdout:1861 read 0xa716984 thru 0xa71ab9e (0x421b bytes) 2024-09-11T05:33:18.133 INFO:teuthology.orchestra.run.smithi070.stdout:1862 write 0x6fe9bf5 thru 0x6ff510b (0xb517 bytes) 2024-09-11T05:33:18.139 INFO:teuthology.orchestra.run.smithi070.stdout:1863 write 0xd0ac849 thru 0xd0b6fdd (0xa795 bytes) 2024-09-11T05:33:18.141 INFO:teuthology.orchestra.run.smithi070.stdout:1864 read 0xfa56e4 thru 0xfac3e3 (0x6d00 bytes) 2024-09-11T05:33:18.142 INFO:teuthology.orchestra.run.smithi070.stdout:1868 read 0x6259055 thru 0x62641d0 (0xb17c bytes) 2024-09-11T05:33:18.143 INFO:teuthology.orchestra.run.smithi070.stdout:1870 punch from 0x7e8e232 to 0x7e98b27, (0xa8f5 bytes) 2024-09-11T05:33:18.143 INFO:teuthology.orchestra.run.smithi070.stdout:1871 read 0xad80c28 thru 0xad907ab (0xfb84 bytes) 2024-09-11T05:33:18.143 INFO:teuthology.orchestra.run.smithi070.stdout:1872 writesame 0xb81f4f4 thru 0xb829cc1 data_size 0x2(0xa7ce bytes) 2024-09-11T05:33:18.144 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:18.145 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:18.153 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:18.154 INFO:teuthology.orchestra.run.smithi070.stdout:1873 write 0x13d3565 thru 0x13de3c7 (0xae63 bytes) 2024-09-11T05:33:18.156 INFO:teuthology.orchestra.run.smithi070.stdout:1875 write 0x926ce18 thru 0x9272d45 (0x5f2e bytes) 2024-09-11T05:33:18.159 INFO:teuthology.orchestra.run.smithi070.stdout:1876 writesame 0x5194348 thru 0x5196555 data_size 0x3(0x220e bytes) 2024-09-11T05:33:18.162 INFO:teuthology.orchestra.run.smithi070.stdout:1877 read 0x5e69bfa thru 0x5e6ed93 (0x519a bytes) 2024-09-11T05:33:18.169 INFO:teuthology.orchestra.run.smithi070.stdout:1878 write 0xe6a2143 thru 0xe6a3201 (0x10bf bytes) 2024-09-11T05:33:18.171 INFO:teuthology.orchestra.run.smithi070.stdout:1879 write 0x3341e4a thru 0x3345ac0 (0x3c77 bytes) 2024-09-11T05:33:18.174 INFO:teuthology.orchestra.run.smithi070.stdout:1880 read 0x7c70f thru 0x7ddc3 (0x16b5 bytes) 2024-09-11T05:33:18.174 INFO:teuthology.orchestra.run.smithi070.stdout:1882 write 0x173a537 thru 0x1748ca3 (0xe76d bytes) 2024-09-11T05:33:18.176 INFO:teuthology.orchestra.run.smithi070.stdout:1885 writesame 0x88bb971 thru 0x88c427a data_size 0x9(0x890a bytes) 2024-09-11T05:33:18.177 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:18.176+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:18.180 INFO:teuthology.orchestra.run.smithi070.stdout:1886 write 0x235504c thru 0x23591cd (0x4182 bytes) 2024-09-11T05:33:18.181 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:18.181 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:18.181 INFO:teuthology.orchestra.run.smithi070.stdout:1889 read 0xc2948d4 thru 0xc29f2b0 (0xa9dd bytes) 2024-09-11T05:33:18.182 INFO:teuthology.orchestra.run.smithi070.stdout:1891 punch from 0x316ab87 to 0x31796dc, (0xeb55 bytes) 2024-09-11T05:33:18.182 INFO:teuthology.orchestra.run.smithi070.stdout:1892 write 0xb570b0f thru 0xb579af6 (0x8fe8 bytes) 2024-09-11T05:33:18.185 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:18.185 INFO:teuthology.orchestra.run.smithi070.stdout:1894 punch from 0x9b5c4ea to 0x9b6ba09, (0xf51f bytes) 2024-09-11T05:33:18.185 INFO:teuthology.orchestra.run.smithi070.stdout:1896 write 0xaf4be9 thru 0xafd95a (0x8d72 bytes) 2024-09-11T05:33:18.186 INFO:teuthology.orchestra.run.smithi070.stdout:1897 read 0x8281c20 thru 0x82850bb (0x349c bytes) 2024-09-11T05:33:18.187 INFO:teuthology.orchestra.run.smithi070.stdout:1898 read 0x4e80b3a thru 0x4e8de99 (0xd360 bytes) 2024-09-11T05:33:18.187 INFO:teuthology.orchestra.run.smithi070.stdout:1901 write 0x7124a3c thru 0x712a7bc (0x5d81 bytes) 2024-09-11T05:33:18.189 INFO:teuthology.orchestra.run.smithi070.stdout:1903 read 0xabb2986 thru 0xabbbf41 (0x95bc bytes) 2024-09-11T05:33:18.189 INFO:teuthology.orchestra.run.smithi070.stdout:1904 writesame 0x5b67627 thru 0x5b730e1 data_size 0x1(0xbabb bytes) 2024-09-11T05:33:18.219 INFO:teuthology.orchestra.run.smithi070.stdout:1905 writesame 0x9e653fa thru 0x9e69801 data_size 0x1c(0x4408 bytes) 2024-09-11T05:33:18.229 INFO:teuthology.orchestra.run.smithi070.stdout:1906 trunc from 0xe6a3202 to 0x86acb78 2024-09-11T05:33:18.255 INFO:teuthology.orchestra.run.smithi070.stdout:1907 write 0xec73c02 thru 0xec7ebf9 (0xaff8 bytes) 2024-09-11T05:33:18.257 INFO:teuthology.orchestra.run.smithi070.stdout:1908 read 0x1aefc31 thru 0x1afd0b5 (0xd485 bytes) 2024-09-11T05:33:18.258 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:18.258 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:18.258 INFO:teuthology.orchestra.run.smithi070.stdout:1909 writesame 0xba86dfc thru 0xba8ad3d data_size 0x3(0x3f42 bytes) 2024-09-11T05:33:18.263 INFO:teuthology.orchestra.run.smithi070.stdout:1910 write 0xdb0b04d thru 0xdb182ac (0xd260 bytes) 2024-09-11T05:33:18.264 INFO:teuthology.orchestra.run.smithi070.stdout:1911 writesame 0xa109ae3 thru 0xa10ad0a data_size 0xe(0x1228 bytes) 2024-09-11T05:33:18.266 INFO:teuthology.orchestra.run.smithi070.stdout:1912 writesame 0x5fb1a00 thru 0x5fb2617 data_size 0x12(0xc18 bytes) 2024-09-11T05:33:18.267 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:18.267 INFO:teuthology.orchestra.run.smithi070.stdout:1913 write 0xdf3d791 thru 0xdf46665 (0x8ed5 bytes) 2024-09-11T05:33:18.271 INFO:teuthology.orchestra.run.smithi070.stdout:1915 writesame 0x3f00c69 thru 0x3f0617f data_size 0x35(0x5517 bytes) 2024-09-11T05:33:18.273 INFO:teuthology.orchestra.run.smithi070.stdout:1916 writesame 0x14da0dc thru 0x14e9b93 data_size 0x8(0xfab8 bytes) 2024-09-11T05:33:18.277 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:18.276+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:18.279 INFO:teuthology.orchestra.run.smithi070.stdout:1917 read 0x1f567e8 thru 0x1f613e8 (0xac01 bytes) 2024-09-11T05:33:18.280 INFO:teuthology.orchestra.run.smithi070.stdout:1918 write 0x135babd thru 0x136a30e (0xe852 bytes) 2024-09-11T05:33:18.282 INFO:teuthology.orchestra.run.smithi070.stdout:1920 write 0x821579e thru 0x8218857 (0x30ba bytes) 2024-09-11T05:33:18.283 INFO:teuthology.orchestra.run.smithi070.stdout:1921 write 0xe719344 thru 0xe71fbab (0x6868 bytes) 2024-09-11T05:33:18.284 INFO:teuthology.orchestra.run.smithi070.stdout:1922 write 0x9e296a0 thru 0x9e386bb (0xf01c bytes) 2024-09-11T05:33:18.286 INFO:teuthology.orchestra.run.smithi070.stdout:1923 clone 14 order 21 su 65536 sc 15 2024-09-11T05:33:18.369 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:18.369 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:18.378 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:18.379 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:18.379+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:18.480 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:18.480 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:18.480 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:18.480+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:18.488 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:18.581 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:18.581+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:18.631 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:18.631 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:18.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:18.682 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:18.682+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:18.708 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:33:18.708 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:33:18.708 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-09-11T05:33:18.708 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T05:33:18.708 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T05:33:18.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-09-11T05:33:18.709 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T05:33:18.777 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone13 from 0xec7ebfa (overlap 0x2605259) to 0x1e6a847 2024-09-11T05:33:18.782 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:18.782+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:18.787 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:18.788 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:18.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:18.830 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:18.830 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T05:33:18.831 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:18.880 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-11T05:33:18.883 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:33:18.883 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:18.882+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:18.935 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:18.936 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:18.942 INFO:teuthology.orchestra.run.smithi070.stdout:1925 write 0x8aa6893 thru 0x8aab641 (0x4daf bytes) 2024-09-11T05:33:18.944 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:18.952 INFO:teuthology.orchestra.run.smithi070.stdout:1926 write 0x573690a thru 0x573c2ed (0x59e4 bytes) 2024-09-11T05:33:18.958 INFO:teuthology.orchestra.run.smithi070.stdout:1927 read 0x19a59e1 thru 0x19aebf0 (0x9210 bytes) 2024-09-11T05:33:18.958 INFO:teuthology.orchestra.run.smithi070.stdout:1929 read 0xd3c8ff4 thru 0xd3d24f9 (0x9506 bytes) 2024-09-11T05:33:18.965 INFO:teuthology.orchestra.run.smithi070.stdout:1930 trunc from 0xec7ebfa to 0x9f09b0a 2024-09-11T05:33:18.984 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:18.984+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:19.004 INFO:teuthology.orchestra.run.smithi070.stdout:1931 read 0x18acff thru 0x1970b6 (0xc3b8 bytes) 2024-09-11T05:33:19.005 INFO:teuthology.orchestra.run.smithi070.stdout:1932 read 0x6dbd766 thru 0x6dc3b72 (0x640d bytes) 2024-09-11T05:33:19.005 INFO:teuthology.orchestra.run.smithi070.stdout:1933 read 0x3bb67dd thru 0x3bc0f91 (0xa7b5 bytes) 2024-09-11T05:33:19.006 INFO:teuthology.orchestra.run.smithi070.stdout:1935 writesame 0x13417a8 thru 0x1341cbe data_size 0x1(0x517 bytes) 2024-09-11T05:33:19.026 INFO:teuthology.orchestra.run.smithi070.stdout:1936 punch from 0x101d741 to 0x102b37b, (0xdc3a bytes) 2024-09-11T05:33:19.026 INFO:teuthology.orchestra.run.smithi070.stdout:1937 punch from 0x143bcce to 0x1441ad4, (0x5e06 bytes) 2024-09-11T05:33:19.026 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.026 INFO:teuthology.orchestra.run.smithi070.stdout:1940 write 0x9c8cf58 thru 0x9c94dc2 (0x7e6b bytes) 2024-09-11T05:33:19.027 INFO:teuthology.orchestra.run.smithi070.stdout:1941 read 0x8bea88c thru 0x8bf6ae1 (0xc256 bytes) 2024-09-11T05:33:19.030 INFO:teuthology.orchestra.run.smithi070.stdout:1942 read 0x97cc196 thru 0x97db0d6 (0xef41 bytes) 2024-09-11T05:33:19.030 INFO:teuthology.orchestra.run.smithi070.stdout:1944 read 0x9adee3a thru 0x9ae40c6 (0x528d bytes) 2024-09-11T05:33:19.030 INFO:teuthology.orchestra.run.smithi070.stdout:1945 read 0x7368c74 thru 0x737686d (0xdbfa bytes) 2024-09-11T05:33:19.030 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:19.031 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:19.031 INFO:teuthology.orchestra.run.smithi070.stdout:1946 writesame 0x6c2c1ff thru 0x6c33ef3 data_size 0x1(0x7cf5 bytes) 2024-09-11T05:33:19.050 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:19.051 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:19.066 INFO:teuthology.orchestra.run.smithi070.stdout:1947 trunc from 0x9f09b0a to 0x138e7f1 2024-09-11T05:33:19.069 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:19.069 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:19.069 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:19.069 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:19.082 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:19.082 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:19.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:19.085 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:19.085+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:19.106 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:19.131 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:19.151 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:19.152 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:19.173 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:19.173 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:19.178 INFO:teuthology.orchestra.run.smithi070.stdout:1948 writesame 0x46d9c86 thru 0x46dd42f data_size 0x5f(0x37aa bytes) 2024-09-11T05:33:19.186 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:19.185+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:19.191 INFO:teuthology.orchestra.run.smithi070.stdout:1949 write 0xb7a2eb3 thru 0xb7a8249 (0x5397 bytes) 2024-09-11T05:33:19.191 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:19.191 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:19.204 INFO:teuthology.orchestra.run.smithi070.stdout:1950 trunc from 0xb7a824a to 0x2681d21 2024-09-11T05:33:19.228 INFO:teuthology.orchestra.run.smithi070.stdout:1951 writesame 0xac6af9d thru 0xac72908 data_size 0x26(0x796c bytes) 2024-09-11T05:33:19.228 INFO:teuthology.orchestra.run.smithi070.stdout:1952 read 0x45e1fc6 thru 0x45e60a3 (0x40de bytes) 2024-09-11T05:33:19.236 INFO:teuthology.orchestra.run.smithi070.stdout:1955 write 0xd9d6810 thru 0xd9dfef9 (0x96ea bytes) 2024-09-11T05:33:19.239 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:19.239 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:19.239 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:19.239 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:19.239 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:19.239 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.239 INFO:teuthology.orchestra.run.smithi070.stdout:1957 punch from 0x7ded567 to 0x7df268a, (0x5123 bytes) 2024-09-11T05:33:19.239 INFO:teuthology.orchestra.run.smithi070.stdout:1958 write 0x53e532f thru 0x53f0cf5 (0xb9c7 bytes) 2024-09-11T05:33:19.243 INFO:teuthology.orchestra.run.smithi070.stdout:1959 punch from 0x1d87d91 to 0x1d901c5, (0x8434 bytes) 2024-09-11T05:33:19.243 INFO:teuthology.orchestra.run.smithi070.stdout:1960 write 0xcf0d6cd thru 0xcf1446b (0x6d9f bytes) 2024-09-11T05:33:19.246 INFO:teuthology.orchestra.run.smithi070.stdout:1961 read 0xb69f6a thru 0xb74368 (0xa3ff bytes) 2024-09-11T05:33:19.247 INFO:teuthology.orchestra.run.smithi070.stdout:1965 read 0xce984a5 thru 0xcea1c7b (0x97d7 bytes) 2024-09-11T05:33:19.247 INFO:teuthology.orchestra.run.smithi070.stdout:1967 read 0x6549f0c thru 0x6559896 (0xf98b bytes) 2024-09-11T05:33:19.247 INFO:teuthology.orchestra.run.smithi070.stdout:1968 read 0x1222313 thru 0x1227e1d (0x5b0b bytes) 2024-09-11T05:33:19.247 INFO:teuthology.orchestra.run.smithi070.stdout:1970 read 0x52e2ba0 thru 0x52f1ff8 (0xf459 bytes) 2024-09-11T05:33:19.249 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:19.253 INFO:teuthology.orchestra.run.smithi070.stdout:1971 trunc from 0xd9dfefa to 0x9207c96 2024-09-11T05:33:19.263 INFO:teuthology.orchestra.run.smithi070.stdout:1972 read 0x8636a5d thru 0x863e617 (0x7bbb bytes) 2024-09-11T05:33:19.263 INFO:teuthology.orchestra.run.smithi070.stdout:1973 punch from 0x33f4d34 to 0x33f9434, (0x4700 bytes) 2024-09-11T05:33:19.263 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.263 INFO:teuthology.orchestra.run.smithi070.stdout:1976 trunc from 0x9207c96 to 0x900bcd9 2024-09-11T05:33:19.267 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.268 INFO:teuthology.orchestra.run.smithi070.stdout:1978 write 0x64fbcef thru 0x65049f2 (0x8d04 bytes) 2024-09-11T05:33:19.275 INFO:teuthology.orchestra.run.smithi070.stdout:1979 writesame 0x100cf2a thru 0x101a84a data_size 0x1(0xd921 bytes) 2024-09-11T05:33:19.287 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:19.286+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:19.314 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.322 INFO:teuthology.orchestra.run.smithi070.stdout:1981 trunc from 0x900bcd9 to 0x2730cc2 2024-09-11T05:33:19.348 INFO:teuthology.orchestra.run.smithi070.stdout:1982 write 0xaf31bc2 thru 0xaf3fedd (0xe31c bytes) 2024-09-11T05:33:19.353 INFO:teuthology.orchestra.run.smithi070.stdout:1983 read 0x4fb6632 thru 0x4fbb400 (0x4dcf bytes) 2024-09-11T05:33:19.360 INFO:teuthology.orchestra.run.smithi070.stdout:1985 trunc from 0xaf3fede to 0x5452c74 2024-09-11T05:33:19.368 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:19.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15742 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 483328~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1188304480000006, 2024-09-11T05:33:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022975045999999999, 2024-09-11T05:33:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15742 2024-09-11T05:33:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:19.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248353+0000", 2024-09-11T05:33:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.615e-06 2024-09-11T05:33:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248356+0000", 2024-09-11T05:33:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.641e-06 2024-09-11T05:33:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248360+0000", 2024-09-11T05:33:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:33:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271209+0000", 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022848825999999999 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271264+0000", 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5170999999999997e-05 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271326+0000", 2024-09-11T05:33:19.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1389000000000005e-05 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15743 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 532480~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1188149000000003, 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023116772000000001, 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15743 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248808+0000", 2024-09-11T05:33:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044169199999999999 2024-09-11T05:33:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248812+0000", 2024-09-11T05:33:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6969999999999999e-06 2024-09-11T05:33:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248819+0000", 2024-09-11T05:33:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6790000000000005e-06 2024-09-11T05:33:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248826+0000", 2024-09-11T05:33:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5509999999999996e-06 2024-09-11T05:33:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271362+0000", 2024-09-11T05:33:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022536348000000001 2024-09-11T05:33:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271413+0000", 2024-09-11T05:33:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0810000000000003e-05 2024-09-11T05:33:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271483+0000", 2024-09-11T05:33:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9994999999999996e-05 2024-09-11T05:33:19.378 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15745 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 630784~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248860+0000", 2024-09-11T05:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1183211400000008, 2024-09-11T05:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022888384000000001, 2024-09-11T05:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15745 2024-09-11T05:33:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248860+0000", 2024-09-11T05:33:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248860+0000", 2024-09-11T05:33:19.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248861+0000", 2024-09-11T05:33:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9699999999999996e-07 2024-09-11T05:33:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248863+0000", 2024-09-11T05:33:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2239999999999998e-06 2024-09-11T05:33:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248869+0000", 2024-09-11T05:33:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T05:33:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248873+0000", 2024-09-11T05:33:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4290000000000003e-06 2024-09-11T05:33:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271654+0000", 2024-09-11T05:33:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022780671999999998 2024-09-11T05:33:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271694+0000", 2024-09-11T05:33:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0364000000000002e-05 2024-09-11T05:33:19.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271748+0000", 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4329000000000001e-05 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15746 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 679936~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1182855810000003, 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022995304000000001, 2024-09-11T05:33:19.384 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15746 2024-09-11T05:33:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:33:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248898+0000", 2024-09-11T05:33:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1749999999999999e-06 2024-09-11T05:33:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248904+0000", 2024-09-11T05:33:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5759999999999996e-06 2024-09-11T05:33:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248909+0000", 2024-09-11T05:33:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9710000000000003e-06 2024-09-11T05:33:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271775+0000", 2024-09-11T05:33:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022866721 2024-09-11T05:33:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271833+0000", 2024-09-11T05:33:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7132000000000001e-05 2024-09-11T05:33:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271891+0000", 2024-09-11T05:33:19.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8303000000000001e-05 2024-09-11T05:33:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15747 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 729088~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1182670409999993, 2024-09-11T05:33:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023120391000000001, 2024-09-11T05:33:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15747 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:33:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248916+0000", 2024-09-11T05:33:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4270000000000001e-06 2024-09-11T05:33:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248919+0000", 2024-09-11T05:33:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.366e-06 2024-09-11T05:33:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248922+0000", 2024-09-11T05:33:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6790000000000001e-06 2024-09-11T05:33:19.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271914+0000", 2024-09-11T05:33:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022992584999999999 2024-09-11T05:33:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271965+0000", 2024-09-11T05:33:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1008999999999999e-05 2024-09-11T05:33:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272034+0000", 2024-09-11T05:33:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8980999999999996e-05 2024-09-11T05:33:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15748 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 778240~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1182560850000005, 2024-09-11T05:33:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023325197999999998, 2024-09-11T05:33:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15748 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:19.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-07 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248926+0000", 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.077e-06 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248930+0000", 2024-09-11T05:33:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5920000000000001e-06 2024-09-11T05:33:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248933+0000", 2024-09-11T05:33:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7760000000000002e-06 2024-09-11T05:33:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272074+0000", 2024-09-11T05:33:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023141656 2024-09-11T05:33:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272153+0000", 2024-09-11T05:33:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8566999999999995e-05 2024-09-11T05:33:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272250+0000", 2024-09-11T05:33:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7217000000000001e-05 2024-09-11T05:33:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16376 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 925696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0729921650000005, 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023022233999999999, 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16376 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.399 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:33:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294191+0000", 2024-09-11T05:33:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1169999999999998e-06 2024-09-11T05:33:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294198+0000", 2024-09-11T05:33:19.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.105e-06 2024-09-11T05:33:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294202+0000", 2024-09-11T05:33:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3490000000000002e-06 2024-09-11T05:33:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317070+0000", 2024-09-11T05:33:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022868169000000001 2024-09-11T05:33:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317141+0000", 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0947999999999999e-05 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317211+0000", 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0154999999999995e-05 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.403 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16377 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 974848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0729737420000003, 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023184939000000002, 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16377 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:19.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:19.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294208+0000", 2024-09-11T05:33:19.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5600000000000001e-07 2024-09-11T05:33:19.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294210+0000", 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294215+0000", 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7989999999999999e-06 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294220+0000", 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6580000000000001e-06 2024-09-11T05:33:19.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317241+0000", 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023020987999999999 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317315+0000", 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3496000000000002e-05 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317392+0000", 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7720999999999997e-05 2024-09-11T05:33:19.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.408 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.408 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16378 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 1024000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.408 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:19.408 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0729557970000005, 2024-09-11T05:33:19.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023298976999999998, 2024-09-11T05:33:19.408 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.409 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16378 2024-09-11T05:33:19.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.409 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:19.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:19.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294226+0000", 2024-09-11T05:33:19.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T05:33:19.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294228+0000", 2024-09-11T05:33:19.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-06 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294234+0000", 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1399999999999997e-06 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294239+0000", 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317420+0000", 2024-09-11T05:33:19.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023181499000000001 2024-09-11T05:33:19.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317478+0000", 2024-09-11T05:33:19.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7608999999999997e-05 2024-09-11T05:33:19.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317524+0000", 2024-09-11T05:33:19.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6378999999999998e-05 2024-09-11T05:33:19.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.413 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.413 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16400 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 532480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.413 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:19.413 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0728353389999992, 2024-09-11T05:33:19.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022889597000000001, 2024-09-11T05:33:19.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16400 2024-09-11T05:33:19.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.414 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:19.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:19.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:19.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7e-07 2024-09-11T05:33:19.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294348+0000", 2024-09-11T05:33:19.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:33:19.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294354+0000", 2024-09-11T05:33:19.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9880000000000001e-06 2024-09-11T05:33:19.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294359+0000", 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1580000000000004e-06 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317080+0000", 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022720884 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317162+0000", 2024-09-11T05:33:19.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1432000000000002e-05 2024-09-11T05:33:19.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317235+0000", 2024-09-11T05:33:19.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3705e-05 2024-09-11T05:33:19.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.418 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.418 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16401 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.418 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:19.418 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0728157080000003, 2024-09-11T05:33:19.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02302893, 2024-09-11T05:33:19.419 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16401 2024-09-11T05:33:19.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.419 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:19.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:19.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294366+0000", 2024-09-11T05:33:19.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5499999999999998e-07 2024-09-11T05:33:19.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294368+0000", 2024-09-11T05:33:19.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:33:19.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294374+0000", 2024-09-11T05:33:19.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1720000000000004e-06 2024-09-11T05:33:19.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294379+0000", 2024-09-11T05:33:19.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9089999999999999e-06 2024-09-11T05:33:19.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317261+0000", 2024-09-11T05:33:19.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022882442999999999 2024-09-11T05:33:19.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317322+0000", 2024-09-11T05:33:19.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0145000000000001e-05 2024-09-11T05:33:19.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317394+0000", 2024-09-11T05:33:19.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2756000000000006e-05 2024-09-11T05:33:19.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.424 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.424 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16402 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 630784~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.424 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:19.424 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0727963119999995, 2024-09-11T05:33:19.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023196998, 2024-09-11T05:33:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16402 2024-09-11T05:33:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0900000000000002e-07 2024-09-11T05:33:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294387+0000", 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9139999999999998e-06 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294393+0000", 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294398+0000", 2024-09-11T05:33:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T05:33:19.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317424+0000", 2024-09-11T05:33:19.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023026042 2024-09-11T05:33:19.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317489+0000", 2024-09-11T05:33:19.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5488999999999996e-05 2024-09-11T05:33:19.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317582+0000", 2024-09-11T05:33:19.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2658000000000006e-05 2024-09-11T05:33:19.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.429 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.429 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16403 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 679936~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.429 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:19.429 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0727772499999997, 2024-09-11T05:33:19.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023338022999999999, 2024-09-11T05:33:19.429 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16403 2024-09-11T05:33:19.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.430 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:19.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294406+0000", 2024-09-11T05:33:19.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.902e-06 2024-09-11T05:33:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294413+0000", 2024-09-11T05:33:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3450000000000002e-06 2024-09-11T05:33:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294417+0000", 2024-09-11T05:33:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9599999999999999e-06 2024-09-11T05:33:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317608+0000", 2024-09-11T05:33:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023190137 2024-09-11T05:33:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317666+0000", 2024-09-11T05:33:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-11T05:33:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317742+0000", 2024-09-11T05:33:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6247000000000004e-05 2024-09-11T05:33:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16404 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 729088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:19.435 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0727578879999999, 2024-09-11T05:33:19.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023640379, 2024-09-11T05:33:19.435 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16404 2024-09-11T05:33:19.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.435 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:19.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:19.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294424+0000", 2024-09-11T05:33:19.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:33:19.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294426+0000", 2024-09-11T05:33:19.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0420000000000001e-06 2024-09-11T05:33:19.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294432+0000", 2024-09-11T05:33:19.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8810000000000001e-06 2024-09-11T05:33:19.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294436+0000", 2024-09-11T05:33:19.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9529999999999998e-06 2024-09-11T05:33:19.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317770+0000", 2024-09-11T05:33:19.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023333513 2024-09-11T05:33:19.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317900+0000", 2024-09-11T05:33:19.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013032699999999999 2024-09-11T05:33:19.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318064+0000", 2024-09-11T05:33:19.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016326900000000001 2024-09-11T05:33:19.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.439 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.440 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16405 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 778240~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.440 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:19.440 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0727384440000005, 2024-09-11T05:33:19.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023946875999999999, 2024-09-11T05:33:19.440 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16405 2024-09-11T05:33:19.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.441 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:19.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:19.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.15e-07 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294445+0000", 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.838e-06 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294451+0000", 2024-09-11T05:33:19.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8279999999999999e-06 2024-09-11T05:33:19.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294455+0000", 2024-09-11T05:33:19.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-06 2024-09-11T05:33:19.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318095+0000", 2024-09-11T05:33:19.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023639667999999999 2024-09-11T05:33:19.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318161+0000", 2024-09-11T05:33:19.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6305999999999998e-05 2024-09-11T05:33:19.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318390+0000", 2024-09-11T05:33:19.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000228481 2024-09-11T05:33:19.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.444 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.445 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16406 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 827392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.445 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:19.445 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0727200630000002, 2024-09-11T05:33:19.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024093394000000001, 2024-09-11T05:33:19.445 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16406 2024-09-11T05:33:19.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.446 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:19.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:19.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:19.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4999999999999998e-07 2024-09-11T05:33:19.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294463+0000", 2024-09-11T05:33:19.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.108e-06 2024-09-11T05:33:19.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294469+0000", 2024-09-11T05:33:19.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8359999999999997e-06 2024-09-11T05:33:19.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294474+0000", 2024-09-11T05:33:19.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3150000000000002e-06 2024-09-11T05:33:19.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318421+0000", 2024-09-11T05:33:19.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023947231999999999 2024-09-11T05:33:19.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318492+0000", 2024-09-11T05:33:19.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1367999999999998e-05 2024-09-11T05:33:19.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318554+0000", 2024-09-11T05:33:19.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2185000000000002e-05 2024-09-11T05:33:19.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.449 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.450 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16407 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.450 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:19.450 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0727012210000009, 2024-09-11T05:33:19.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024230683999999999, 2024-09-11T05:33:19.450 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16407 2024-09-11T05:33:19.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.451 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:19.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:19.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:19.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:33:19.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294482+0000", 2024-09-11T05:33:19.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0959999999999999e-06 2024-09-11T05:33:19.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294488+0000", 2024-09-11T05:33:19.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8549999999999998e-06 2024-09-11T05:33:19.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294492+0000", 2024-09-11T05:33:19.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2180000000000001e-06 2024-09-11T05:33:19.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318583+0000", 2024-09-11T05:33:19.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024090232 2024-09-11T05:33:19.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318648+0000", 2024-09-11T05:33:19.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5538999999999997e-05 2024-09-11T05:33:19.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318711+0000", 2024-09-11T05:33:19.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2366000000000006e-05 2024-09-11T05:33:19.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.455 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.456 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16408 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 925696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.456 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:19.456 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0726822330000001, 2024-09-11T05:33:19.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024377862, 2024-09-11T05:33:19.456 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16408 2024-09-11T05:33:19.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.457 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:19.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:19.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294502+0000", 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4420000000000001e-06 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294508+0000", 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1410000000000002e-06 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294512+0000", 2024-09-11T05:33:19.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.605e-06 2024-09-11T05:33:19.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318738+0000", 2024-09-11T05:33:19.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02422535 2024-09-11T05:33:19.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318816+0000", 2024-09-11T05:33:19.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7836999999999994e-05 2024-09-11T05:33:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318877+0000", 2024-09-11T05:33:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1058999999999999e-05 2024-09-11T05:33:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16409 3.1b 3.bc4667fb (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0726631730000005, 2024-09-11T05:33:19.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575657000000001, 2024-09-11T05:33:19.461 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:19.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16409 2024-09-11T05:33:19.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.461 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294520+0000", 2024-09-11T05:33:19.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9410000000000001e-06 2024-09-11T05:33:19.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294526+0000", 2024-09-11T05:33:19.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9649999999999996e-06 2024-09-11T05:33:19.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294531+0000", 2024-09-11T05:33:19.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5600000000000004e-06 2024-09-11T05:33:19.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319081+0000", 2024-09-11T05:33:19.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024550249 2024-09-11T05:33:19.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319094+0000", 2024-09-11T05:33:19.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2621e-05 2024-09-11T05:33:19.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.465 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.465 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16410 3.1b 3.bc4667fb (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:19.465 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:19.465 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0726449410000001, 2024-09-11T05:33:19.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024587633000000001, 2024-09-11T05:33:19.465 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16410 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:19.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:19.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.15e-07 2024-09-11T05:33:19.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294544+0000", 2024-09-11T05:33:19.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6830000000000008e-06 2024-09-11T05:33:19.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294550+0000", 2024-09-11T05:33:19.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:33:19.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294555+0000", 2024-09-11T05:33:19.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:33:19.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319117+0000", 2024-09-11T05:33:19.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024561862 2024-09-11T05:33:19.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319124+0000", 2024-09-11T05:33:19.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8539999999999999e-06 2024-09-11T05:33:19.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.469 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.470 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.470 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:19.471 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.471 INFO:teuthology.orchestra.run.smithi070.stdout:1987 read 0x50509a9 thru 0x5058937 (0x7f8f bytes) 2024-09-11T05:33:19.471 INFO:teuthology.orchestra.run.smithi070.stdout:1989 write 0x15f54ed thru 0x1601a1a (0xc52e bytes) 2024-09-11T05:33:19.471 INFO:teuthology.orchestra.run.smithi070.stdout:1991 punch from 0x299e0c6 to 0x29a6d97, (0x8cd1 bytes) 2024-09-11T05:33:19.471 INFO:teuthology.orchestra.run.smithi070.stdout:1992 read 0x3a43c2c thru 0x3a51ad0 (0xdea5 bytes) 2024-09-11T05:33:19.471 INFO:teuthology.orchestra.run.smithi070.stdout:1993 trunc from 0x5452c74 to 0x474ad83 2024-09-11T05:33:19.472 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:19.474 INFO:teuthology.orchestra.run.smithi070.stdout:1994 trunc from 0x474ad83 to 0x4971961 2024-09-11T05:33:19.474 INFO:teuthology.orchestra.run.smithi070.stdout:1997 write 0xd46e787 thru 0xd477b5f (0x93d9 bytes) 2024-09-11T05:33:19.474 INFO:teuthology.orchestra.run.smithi070.stdout:1998 trunc from 0xd477b60 to 0xb00a70c 2024-09-11T05:33:19.475 INFO:teuthology.orchestra.run.smithi070.stdout:1999 read 0x83753f2 thru 0x8380ac9 (0xb6d8 bytes) 2024-09-11T05:33:19.475 INFO:teuthology.orchestra.run.smithi070.stdout:2000 read 0x4369372 thru 0x43783dd (0xf06c bytes) 2024-09-11T05:33:19.475 INFO:teuthology.orchestra.run.smithi070.stdout:2001 punch from 0x17578ac to 0x1760d5b, (0x94af bytes) 2024-09-11T05:33:19.475 INFO:teuthology.orchestra.run.smithi070.stdout:2002 write 0x9cc2e94 thru 0x9cc5c8a (0x2df7 bytes) 2024-09-11T05:33:19.475 INFO:teuthology.orchestra.run.smithi070.stdout:2005 punch from 0xa62f2d0 to 0xa6346ed, (0x541d bytes) 2024-09-11T05:33:19.475 INFO:teuthology.orchestra.run.smithi070.stdout:2007 writesame 0x4515b90 thru 0x45214aa data_size 0x1(0xb91b bytes) 2024-09-11T05:33:19.475 INFO:teuthology.orchestra.run.smithi070.stdout:2008 read 0x5736ce thru 0x57be07 (0x873a bytes) 2024-09-11T05:33:19.475 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.475 INFO:teuthology.orchestra.run.smithi070.stdout:2010 write 0xd5cc13 thru 0xd61ce2 (0x50d0 bytes) 2024-09-11T05:33:19.476 INFO:teuthology.orchestra.run.smithi070.stdout:2011 write 0x6079aed thru 0x6080000 (0x6514 bytes) 2024-09-11T05:33:19.476 INFO:teuthology.orchestra.run.smithi070.stdout:2012 read 0x2ca0f38 thru 0x2cafc41 (0xed0a bytes) 2024-09-11T05:33:19.476 INFO:teuthology.orchestra.run.smithi070.stdout:2014 write 0x23a6fda thru 0x23a9449 (0x2470 bytes) 2024-09-11T05:33:19.476 INFO:teuthology.orchestra.run.smithi070.stdout:2015 write 0x7c424ab thru 0x7c4d7a5 (0xb2fb bytes) 2024-09-11T05:33:19.476 INFO:teuthology.orchestra.run.smithi070.stdout:2016 read 0x2225330 thru 0x22265b1 (0x1282 bytes) 2024-09-11T05:33:19.476 INFO:teuthology.orchestra.run.smithi070.stdout:2017 writesame 0xe3efb50 thru 0xe3f5c76 data_size 0x77(0x6127 bytes) 2024-09-11T05:33:19.476 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:19.471+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:19.483 INFO:teuthology.orchestra.run.smithi070.stdout:2019 trunc from 0xe3f5c77 to 0xdce5e0 2024-09-11T05:33:19.499 INFO:teuthology.orchestra.run.smithi070.stdout:2020 read 0x8d8ff5 thru 0x8df985 (0x6991 bytes) 2024-09-11T05:33:19.501 INFO:teuthology.orchestra.run.smithi070.stdout:2021 trunc from 0xdce5e0 to 0x2910fa8 2024-09-11T05:33:19.509 INFO:teuthology.orchestra.run.smithi070.stdout:2024 trunc from 0x2910fa8 to 0x4cbf3b8 2024-09-11T05:33:19.514 INFO:teuthology.orchestra.run.smithi070.stdout:2025 punch from 0x29bef6 to 0x2a55d5, (0x96df bytes) 2024-09-11T05:33:19.524 INFO:teuthology.orchestra.run.smithi070.stdout:2027 trunc from 0x4cbf3b8 to 0xbb42e09 2024-09-11T05:33:19.530 INFO:teuthology.orchestra.run.smithi070.stdout:2029 trunc from 0xbb42e09 to 0xda6ca59 2024-09-11T05:33:19.535 INFO:teuthology.orchestra.run.smithi070.stdout:2030 write 0x9d853cb thru 0x9d85d7d (0x9b3 bytes) 2024-09-11T05:33:19.538 INFO:teuthology.orchestra.run.smithi070.stdout:2032 write 0xb046eaa thru 0xb053fb0 (0xd107 bytes) 2024-09-11T05:33:19.541 INFO:teuthology.orchestra.run.smithi070.stdout:2033 punch from 0x64499fe to 0x6455306, (0xb908 bytes) 2024-09-11T05:33:19.541 INFO:teuthology.orchestra.run.smithi070.stdout:2034 read 0xb46c7d9 thru 0xb46d380 (0xba8 bytes) 2024-09-11T05:33:19.541 INFO:teuthology.orchestra.run.smithi070.stdout:2035 write 0x5811cac thru 0x581909a (0x73ef bytes) 2024-09-11T05:33:19.543 INFO:teuthology.orchestra.run.smithi070.stdout:2036 write 0x4b3cedd thru 0x4b43811 (0x6935 bytes) 2024-09-11T05:33:19.546 INFO:teuthology.orchestra.run.smithi070.stdout:2037 read 0x1793a10 thru 0x17a0f01 (0xd4f2 bytes) 2024-09-11T05:33:19.547 INFO:teuthology.orchestra.run.smithi070.stdout:2038 writesame 0x5da6216 thru 0x5db55a9 data_size 0x83(0xf394 bytes) 2024-09-11T05:33:19.550 INFO:teuthology.orchestra.run.smithi070.stdout:2039 write 0xf01f49 thru 0xf0535f (0x3417 bytes) 2024-09-11T05:33:19.564 INFO:teuthology.orchestra.run.smithi070.stdout:2040 trunc from 0xda6ca59 to 0x471dae1 2024-09-11T05:33:19.571 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:19.571+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:19.574 INFO:teuthology.orchestra.run.smithi070.stdout:2042 write 0x412f2df thru 0x412f949 (0x66b bytes) 2024-09-11T05:33:19.583 INFO:teuthology.orchestra.run.smithi070.stdout:2043 write 0x56ab85e thru 0x56ae757 (0x2efa bytes) 2024-09-11T05:33:19.586 INFO:teuthology.orchestra.run.smithi070.stdout:2044 read 0x393c391 thru 0x3948289 (0xbef9 bytes) 2024-09-11T05:33:19.586 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.586 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.586 INFO:teuthology.orchestra.run.smithi070.stdout:2047 write 0x4425aef thru 0x442bf56 (0x6468 bytes) 2024-09-11T05:33:19.589 INFO:teuthology.orchestra.run.smithi070.stdout:2048 punch from 0x26679b7 to 0x2669687, (0x1cd0 bytes) 2024-09-11T05:33:19.589 INFO:teuthology.orchestra.run.smithi070.stdout:2049 punch from 0x141bd88 to 0x141d6d8, (0x1950 bytes) 2024-09-11T05:33:19.589 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.591 INFO:teuthology.orchestra.run.smithi070.stdout:2053 trunc from 0x56ae758 to 0x323af30 2024-09-11T05:33:19.601 INFO:teuthology.orchestra.run.smithi070.stdout:2054 read 0x54ceb7 thru 0x553c53 (0x6d9d bytes) 2024-09-11T05:33:19.604 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:19.604 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:19.604 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:19.604 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:19.619 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:19.619 INFO:teuthology.orchestra.run.smithi070.stdout:2055 write 0xccb8267 thru 0xccb9c3f (0x19d9 bytes) 2024-09-11T05:33:19.621 INFO:teuthology.orchestra.run.smithi070.stdout:2057 punch from 0xc606e05 to 0xc60e11a, (0x7315 bytes) 2024-09-11T05:33:19.621 INFO:teuthology.orchestra.run.smithi070.stdout:2058 write 0xbca2d6f thru 0xbcaa529 (0x77bb bytes) 2024-09-11T05:33:19.624 INFO:teuthology.orchestra.run.smithi070.stdout:2059 read 0x457a17 thru 0x4591de (0x17c8 bytes) 2024-09-11T05:33:19.624 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.624 INFO:teuthology.orchestra.run.smithi070.stdout:2061 writesame 0xa8e5b92 thru 0xa8f1246 data_size 0x3(0xb6b5 bytes) 2024-09-11T05:33:19.635 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.635 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.635 INFO:teuthology.orchestra.run.smithi070.stdout:2068 read 0xc5686f thru 0xc5837d (0x1b0f bytes) 2024-09-11T05:33:19.636 INFO:teuthology.orchestra.run.smithi070.stdout:2069 write 0x2297780 thru 0x2298a22 (0x12a3 bytes) 2024-09-11T05:33:19.639 INFO:teuthology.orchestra.run.smithi070.stdout:2070 read 0x84fe1e thru 0x856575 (0x6758 bytes) 2024-09-11T05:33:19.640 INFO:teuthology.orchestra.run.smithi070.stdout:2071 punch from 0x3699b50 to 0x36a2adc, (0x8f8c bytes) 2024-09-11T05:33:19.640 INFO:teuthology.orchestra.run.smithi070.stdout:2074 read 0x1c01cf3 thru 0x1c0ca53 (0xad61 bytes) 2024-09-11T05:33:19.640 INFO:teuthology.orchestra.run.smithi070.stdout:2076 punch from 0xa8d97ca to 0xa8dfc9a, (0x64d0 bytes) 2024-09-11T05:33:19.640 INFO:teuthology.orchestra.run.smithi070.stdout:2077 read 0x39f3f46 thru 0x3a03def (0xfeaa bytes) 2024-09-11T05:33:19.641 INFO:teuthology.orchestra.run.smithi070.stdout:2078 writesame 0x850fe02 thru 0x851d8bb data_size 0x1(0xdaba bytes) 2024-09-11T05:33:19.672 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:19.670+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:19.679 INFO:teuthology.orchestra.run.smithi070.stdout:2079 punch from 0x3aa9d1f to 0x3ab221b, (0x84fc bytes) 2024-09-11T05:33:19.679 INFO:teuthology.orchestra.run.smithi070.stdout:2080 writesame 0x296a06c thru 0x296aa10 data_size 0x1(0x9a5 bytes) 2024-09-11T05:33:19.691 INFO:teuthology.orchestra.run.smithi070.stdout:2081 write 0xd325936 thru 0xd3300f5 (0xa7c0 bytes) 2024-09-11T05:33:19.695 INFO:teuthology.orchestra.run.smithi070.stdout:2082 read 0xa7fc30 thru 0xa83c2d (0x3ffe bytes) 2024-09-11T05:33:19.696 INFO:teuthology.orchestra.run.smithi070.stdout:2084 punch from 0x1109297 to 0x1119096, (0xfdff bytes) 2024-09-11T05:33:19.696 INFO:teuthology.orchestra.run.smithi070.stdout:2085 write 0x1564c6e thru 0x156ac73 (0x6006 bytes) 2024-09-11T05:33:19.697 INFO:teuthology.orchestra.run.smithi070.stdout:2087 punch from 0x693c56a to 0x69405e9, (0x407f bytes) 2024-09-11T05:33:19.697 INFO:teuthology.orchestra.run.smithi070.stdout:2088 writesame 0xa209b12 thru 0xa20b423 data_size 0x1(0x1912 bytes) 2024-09-11T05:33:19.702 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:19.702 INFO:teuthology.orchestra.run.smithi070.stdout:2090 writesame 0x644d848 thru 0x64507cf data_size 0x4e(0x2f88 bytes) 2024-09-11T05:33:19.714 INFO:teuthology.orchestra.run.smithi070.stdout:2091 trunc from 0xd3300f6 to 0x66918fb 2024-09-11T05:33:19.728 INFO:teuthology.orchestra.run.smithi070.stdout:2092 read 0x57b4538 thru 0x57c14f0 (0xcfb9 bytes) 2024-09-11T05:33:19.728 INFO:teuthology.orchestra.run.smithi070.stdout:2096 read 0x2974701 thru 0x29820a3 (0xd9a3 bytes) 2024-09-11T05:33:19.728 INFO:teuthology.orchestra.run.smithi070.stdout:2098 read 0x54b3324 thru 0x54babae (0x788b bytes) 2024-09-11T05:33:19.728 INFO:teuthology.orchestra.run.smithi070.stdout:2099 writesame 0x48e59df thru 0x48e8369 data_size 0x5(0x298b bytes) 2024-09-11T05:33:19.744 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:19.745 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:19.745 INFO:teuthology.orchestra.run.smithi070.stdout:2101 write 0xe7ffc9e thru 0xe809661 (0x99c4 bytes) 2024-09-11T05:33:19.749 INFO:teuthology.orchestra.run.smithi070.stdout:2102 punch from 0x8341a90 to 0x8341c01, (0x171 bytes) 2024-09-11T05:33:19.749 INFO:teuthology.orchestra.run.smithi070.stdout:2103 writesame 0x8785b59 thru 0x8789095 data_size 0x15(0x353d bytes) 2024-09-11T05:33:19.752 INFO:teuthology.orchestra.run.smithi070.stdout:2104 read 0x44d2b28 thru 0x44e1285 (0xe75e bytes) 2024-09-11T05:33:19.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:19.759 INFO:teuthology.orchestra.run.smithi070.stdout:2105 trunc from 0xe809662 to 0x8de282f 2024-09-11T05:33:19.770 INFO:teuthology.orchestra.run.smithi070.stdout:2106 write 0x5f8d9a0 thru 0x5f8e32f (0x990 bytes) 2024-09-11T05:33:19.772 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:19.772+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:19.773 INFO:teuthology.orchestra.run.smithi070.stdout:2107 writesame 0x331fa68 thru 0x332dc81 data_size 0x21(0xe21a bytes) 2024-09-11T05:33:19.779 INFO:teuthology.orchestra.run.smithi070.stdout:2108 writesame 0x19dfab thru 0x19ee30 data_size 0x2(0xe86 bytes) 2024-09-11T05:33:19.788 INFO:teuthology.orchestra.run.smithi070.stdout:2109 trunc from 0x8de282f to 0x3b010cf 2024-09-11T05:33:19.799 INFO:teuthology.orchestra.run.smithi070.stdout:2110 punch from 0x2a4f985 to 0x2a5c70d, (0xcd88 bytes) 2024-09-11T05:33:19.799 INFO:teuthology.orchestra.run.smithi070.stdout:2111 read 0xec58b thru 0xf21cc (0x5c42 bytes) 2024-09-11T05:33:19.808 INFO:teuthology.orchestra.run.smithi070.stdout:2112 trunc from 0x3b010cf to 0x98aa605 2024-09-11T05:33:19.813 INFO:teuthology.orchestra.run.smithi070.stdout:2114 clone 15 order 25 su 2097152 sc 7 2024-09-11T05:33:19.873 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:19.872+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:19.874 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:19.874 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:19.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:19.874 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:19.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36428 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8126464~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081327+0000", 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79186655699999997, 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.034980137000000001, 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36428 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081327+0000", 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081327+0000", 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081328+0000", 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:33:19.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081329+0000", 2024-09-11T05:33:19.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.86e-06 2024-09-11T05:33:19.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081335+0000", 2024-09-11T05:33:19.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6289999999999998e-06 2024-09-11T05:33:19.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081340+0000", 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5759999999999999e-06 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116075+0000", 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.034735249000000003 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116129+0000", 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116307+0000", 2024-09-11T05:33:19.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017838700000000001 2024-09-11T05:33:19.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.879 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.879 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36429 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8585216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.879 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:19.879 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79184850600000001, 2024-09-11T05:33:19.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035281438999999998, 2024-09-11T05:33:19.879 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36429 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:19.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081346+0000", 2024-09-11T05:33:19.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:33:19.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081348+0000", 2024-09-11T05:33:19.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:33:19.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081355+0000", 2024-09-11T05:33:19.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2230000000000001e-06 2024-09-11T05:33:19.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081360+0000", 2024-09-11T05:33:19.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0499999999999999e-06 2024-09-11T05:33:19.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116334+0000", 2024-09-11T05:33:19.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.034973889000000001 2024-09-11T05:33:19.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116410+0000", 2024-09-11T05:33:19.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6001000000000006e-05 2024-09-11T05:33:19.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116627+0000", 2024-09-11T05:33:19.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000216956 2024-09-11T05:33:19.884 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.884 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.884 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.884 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36430 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9437184~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.884 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:19.885 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79174044300000002, 2024-09-11T05:33:19.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035492782, 2024-09-11T05:33:19.885 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.885 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.885 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.885 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.885 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.885 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.885 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36430 2024-09-11T05:33:19.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.885 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:19.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:19.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081454+0000", 2024-09-11T05:33:19.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.99e-07 2024-09-11T05:33:19.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081458+0000", 2024-09-11T05:33:19.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7160000000000001e-06 2024-09-11T05:33:19.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081468+0000", 2024-09-11T05:33:19.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9629999999999993e-06 2024-09-11T05:33:19.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081474+0000", 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2060000000000004e-06 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116658+0000", 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03518454 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116734+0000", 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5703000000000003e-05 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116946+0000", 2024-09-11T05:33:19.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211955 2024-09-11T05:33:19.889 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.889 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.889 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.889 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36431 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9895936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.889 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:19.889 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.791709318, 2024-09-11T05:33:19.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035819799999999999, 2024-09-11T05:33:19.890 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.890 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.890 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.890 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36431 2024-09-11T05:33:19.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.890 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:19.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:19.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081485+0000", 2024-09-11T05:33:19.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:33:19.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081493+0000", 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9629999999999998e-06 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081500+0000", 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7070000000000003e-06 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081504+0000", 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116993+0000", 2024-09-11T05:33:19.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035489224 2024-09-11T05:33:19.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117083+0000", 2024-09-11T05:33:19.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9560000000000003e-05 2024-09-11T05:33:19.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117304+0000", 2024-09-11T05:33:19.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221244 2024-09-11T05:33:19.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.894 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.894 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36448 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 327680~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.894 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:19.894 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79168261600000001, 2024-09-11T05:33:19.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036143304000000001, 2024-09-11T05:33:19.894 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.894 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.894 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.894 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.895 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36448 2024-09-11T05:33:19.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.895 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:19.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:19.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081512+0000", 2024-09-11T05:33:19.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:33:19.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081514+0000", 2024-09-11T05:33:19.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:33:19.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081520+0000", 2024-09-11T05:33:19.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4269999999999996e-06 2024-09-11T05:33:19.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081525+0000", 2024-09-11T05:33:19.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6140000000000002e-06 2024-09-11T05:33:19.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117333+0000", 2024-09-11T05:33:19.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035808385999999998 2024-09-11T05:33:19.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117446+0000", 2024-09-11T05:33:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113161 2024-09-11T05:33:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117654+0000", 2024-09-11T05:33:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020835800000000001 2024-09-11T05:33:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36449 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1638400~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79166338800000002, 2024-09-11T05:33:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036464895999999997, 2024-09-11T05:33:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.901 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.901 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.901 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36449 2024-09-11T05:33:19.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.902 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:19.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:19.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081531+0000", 2024-09-11T05:33:19.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:33:19.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081533+0000", 2024-09-11T05:33:19.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8649999999999999e-06 2024-09-11T05:33:19.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081538+0000", 2024-09-11T05:33:19.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7769999999999999e-06 2024-09-11T05:33:19.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081543+0000", 2024-09-11T05:33:19.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4390000000000002e-06 2024-09-11T05:33:19.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117686+0000", 2024-09-11T05:33:19.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036142760000000003 2024-09-11T05:33:19.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117768+0000", 2024-09-11T05:33:19.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2521000000000005e-05 2024-09-11T05:33:19.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117995+0000", 2024-09-11T05:33:19.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022715699999999999 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36450 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79164551999999999, 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036798323000000001, 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.906 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.907 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36450 2024-09-11T05:33:19.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.907 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:19.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:19.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081549+0000", 2024-09-11T05:33:19.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1699999999999999e-07 2024-09-11T05:33:19.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081550+0000", 2024-09-11T05:33:19.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:33:19.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081557+0000", 2024-09-11T05:33:19.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:33:19.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081561+0000", 2024-09-11T05:33:19.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2880000000000003e-06 2024-09-11T05:33:19.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118042+0000", 2024-09-11T05:33:19.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036480984000000001 2024-09-11T05:33:19.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118142+0000", 2024-09-11T05:33:19.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100043 2024-09-11T05:33:19.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118347+0000", 2024-09-11T05:33:19.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020477399999999999 2024-09-11T05:33:19.910 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.911 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.911 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.911 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36451 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4259840~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.911 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:19.911 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79162768999999999, 2024-09-11T05:33:19.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037058173, 2024-09-11T05:33:19.911 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.911 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36451 2024-09-11T05:33:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:19.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:19.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:33:19.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081568+0000", 2024-09-11T05:33:19.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:33:19.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081573+0000", 2024-09-11T05:33:19.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999998e-06 2024-09-11T05:33:19.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081575+0000", 2024-09-11T05:33:19.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.605e-06 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118377+0000", 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036801831 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118459+0000", 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1983000000000004e-05 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118624+0000", 2024-09-11T05:33:19.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000165353 2024-09-11T05:33:19.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.916 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.916 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36452 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5570560~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.916 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:19.916 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79161530899999999, 2024-09-11T05:33:19.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037358132000000002, 2024-09-11T05:33:19.916 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.916 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.916 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.917 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36452 2024-09-11T05:33:19.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.917 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:19.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:19.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081579+0000", 2024-09-11T05:33:19.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4600000000000001e-07 2024-09-11T05:33:19.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081580+0000", 2024-09-11T05:33:19.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T05:33:19.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081583+0000", 2024-09-11T05:33:19.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9119999999999998e-06 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081586+0000", 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.371e-06 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118666+0000", 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037079933000000002 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118725+0000", 2024-09-11T05:33:19.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8600000000000001e-05 2024-09-11T05:33:19.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118937+0000", 2024-09-11T05:33:19.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211931 2024-09-11T05:33:19.921 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.921 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.922 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36453 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6881280~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.922 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:19.922 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79160465899999999, 2024-09-11T05:33:19.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037649803000000003, 2024-09-11T05:33:19.922 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.922 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.922 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.922 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.922 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36453 2024-09-11T05:33:19.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.923 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:19.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081590+0000", 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081593+0000", 2024-09-11T05:33:19.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0110000000000001e-06 2024-09-11T05:33:19.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081596+0000", 2024-09-11T05:33:19.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7609999999999999e-06 2024-09-11T05:33:19.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118965+0000", 2024-09-11T05:33:19.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037368971000000001 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119037+0000", 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2300999999999998e-05 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119239+0000", 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020146000000000001 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36454 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8192000~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79159460299999995, 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037930403000000001, 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36454 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.927 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:19.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:19.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081600+0000", 2024-09-11T05:33:19.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:33:19.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081603+0000", 2024-09-11T05:33:19.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:33:19.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081606+0000", 2024-09-11T05:33:19.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4099999999999998e-06 2024-09-11T05:33:19.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119274+0000", 2024-09-11T05:33:19.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037668407000000001 2024-09-11T05:33:19.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119340+0000", 2024-09-11T05:33:19.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5685000000000006e-05 2024-09-11T05:33:19.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119530+0000", 2024-09-11T05:33:19.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000189688 2024-09-11T05:33:19.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.931 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.932 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36455 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9502720~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.932 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:19.932 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79158445399999999, 2024-09-11T05:33:19.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038210565000000002, 2024-09-11T05:33:19.932 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36455 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:19.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081610+0000", 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081611+0000", 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0279999999999999e-06 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081613+0000", 2024-09-11T05:33:19.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8430000000000001e-06 2024-09-11T05:33:19.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081616+0000", 2024-09-11T05:33:19.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6350000000000002e-06 2024-09-11T05:33:19.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119555+0000", 2024-09-11T05:33:19.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037939252999999999 2024-09-11T05:33:19.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119629+0000", 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3868999999999994e-05 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119820+0000", 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190724 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.936 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36480 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 393216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.937 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:19.937 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79157488899999995, 2024-09-11T05:33:19.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039217429999999998, 2024-09-11T05:33:19.937 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.937 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36480 2024-09-11T05:33:19.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.937 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081620+0000", 2024-09-11T05:33:19.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4900000000000004e-07 2024-09-11T05:33:19.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081624+0000", 2024-09-11T05:33:19.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:33:19.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081627+0000", 2024-09-11T05:33:19.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6520000000000002e-06 2024-09-11T05:33:19.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119851+0000", 2024-09-11T05:33:19.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038224209000000002 2024-09-11T05:33:19.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120518+0000", 2024-09-11T05:33:19.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066708900000000005 2024-09-11T05:33:19.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120836+0000", 2024-09-11T05:33:19.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031833300000000002 2024-09-11T05:33:19.941 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.941 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.942 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36481 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1703936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.942 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:19.942 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79156400199999999, 2024-09-11T05:33:19.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039545442, 2024-09-11T05:33:19.943 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36481 2024-09-11T05:33:19.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.943 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:19.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:19.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081631+0000", 2024-09-11T05:33:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0839999999999999e-06 2024-09-11T05:33:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081635+0000", 2024-09-11T05:33:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.743e-06 2024-09-11T05:33:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081637+0000", 2024-09-11T05:33:19.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.661e-06 2024-09-11T05:33:19.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120887+0000", 2024-09-11T05:33:19.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039249876000000003 2024-09-11T05:33:19.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120968+0000", 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0253999999999994e-05 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121175+0000", 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020761099999999999 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.947 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36482 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 3014656~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.948 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:19.948 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79155344100000002, 2024-09-11T05:33:19.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040344708999999999, 2024-09-11T05:33:19.948 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.948 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36482 2024-09-11T05:33:19.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.948 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:19.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:19.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081641+0000", 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081647+0000", 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081651+0000", 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2080000000000002e-06 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081654+0000", 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121203+0000", 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039549466999999998 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121267+0000", 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3713999999999993e-05 2024-09-11T05:33:19.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121985+0000", 2024-09-11T05:33:19.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071827299999999996 2024-09-11T05:33:19.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.952 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36483 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4325376~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.952 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:19.952 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79153688200000005, 2024-09-11T05:33:19.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040925571000000001, 2024-09-11T05:33:19.953 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36483 2024-09-11T05:33:19.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.953 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081661+0000", 2024-09-11T05:33:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.296e-06 2024-09-11T05:33:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081665+0000", 2024-09-11T05:33:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9269999999999998e-06 2024-09-11T05:33:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081668+0000", 2024-09-11T05:33:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.615e-06 2024-09-11T05:33:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122019+0000", 2024-09-11T05:33:19.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040350886000000002 2024-09-11T05:33:19.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122108+0000", 2024-09-11T05:33:19.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8671000000000005e-05 2024-09-11T05:33:19.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122582+0000", 2024-09-11T05:33:19.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047494900000000001 2024-09-11T05:33:19.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.957 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.957 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36484 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5636096~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.958 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:19.958 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79152245399999999, 2024-09-11T05:33:19.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041537567999999997, 2024-09-11T05:33:19.958 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36484 2024-09-11T05:33:19.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.960 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:19.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:19.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081672+0000", 2024-09-11T05:33:19.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-07 2024-09-11T05:33:19.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081673+0000", 2024-09-11T05:33:19.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.212e-06 2024-09-11T05:33:19.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081676+0000", 2024-09-11T05:33:19.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6940000000000001e-06 2024-09-11T05:33:19.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081679+0000", 2024-09-11T05:33:19.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8260000000000001e-06 2024-09-11T05:33:19.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122615+0000", 2024-09-11T05:33:19.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040935421999999999 2024-09-11T05:33:19.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122892+0000", 2024-09-11T05:33:19.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027731099999999997 2024-09-11T05:33:19.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123209+0000", 2024-09-11T05:33:19.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000316872 2024-09-11T05:33:19.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.968 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.969 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36485 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6946816~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.969 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:19.969 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.79151024400000003, 2024-09-11T05:33:19.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041869008999999999, 2024-09-11T05:33:19.970 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.970 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.971 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36485 2024-09-11T05:33:19.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.971 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:19.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:19.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:19.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:33:19.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081685+0000", 2024-09-11T05:33:19.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029e-06 2024-09-11T05:33:19.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081689+0000", 2024-09-11T05:33:19.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0709999999999996e-06 2024-09-11T05:33:19.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081692+0000", 2024-09-11T05:33:19.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389999999999999e-06 2024-09-11T05:33:19.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123245+0000", 2024-09-11T05:33:19.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041553759000000003 2024-09-11T05:33:19.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123331+0000", 2024-09-11T05:33:19.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5885999999999997e-05 2024-09-11T05:33:19.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123553+0000", 2024-09-11T05:33:19.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022129499999999999 2024-09-11T05:33:19.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.980 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.980 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.980 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36486 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8257536~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.981 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:19.981 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.791499226, 2024-09-11T05:33:19.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042204617999999999, 2024-09-11T05:33:19.981 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.981 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.981 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.982 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36486 2024-09-11T05:33:19.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.983 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:19.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:19.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:19.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:19.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081698+0000", 2024-09-11T05:33:19.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6490000000000001e-06 2024-09-11T05:33:19.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081702+0000", 2024-09-11T05:33:19.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7249999999999999e-06 2024-09-11T05:33:19.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081705+0000", 2024-09-11T05:33:19.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7379999999999999e-06 2024-09-11T05:33:19.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:19.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123583+0000", 2024-09-11T05:33:19.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041878604999999999 2024-09-11T05:33:19.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:19.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123666+0000", 2024-09-11T05:33:19.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2027000000000006e-05 2024-09-11T05:33:19.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:19.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123899+0000", 2024-09-11T05:33:19.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000233663 2024-09-11T05:33:19.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.991 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:19.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:19.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.992 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36487 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9568256~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:19.992 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:19.992 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.791486052, 2024-09-11T05:33:19.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043010712999999999, 2024-09-11T05:33:19.993 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:19.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:19.993 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:19.993 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:19.993 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:19.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:19.994 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36487 2024-09-11T05:33:19.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.994 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:19.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:19.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:19.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:19.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:19.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:19.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:19.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:19.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.16e-07 2024-09-11T05:33:19.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:19.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081709+0000", 2024-09-11T05:33:19.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2100000000000001e-06 2024-09-11T05:33:19.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:19.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081713+0000", 2024-09-11T05:33:19.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.811e-06 2024-09-11T05:33:19.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:19.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:19.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:19.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081716+0000", 2024-09-11T05:33:19.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.112e-06 2024-09-11T05:33:20.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123961+0000", 2024-09-11T05:33:20.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042244482999999999 2024-09-11T05:33:20.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124043+0000", 2024-09-11T05:33:20.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2066999999999999e-05 2024-09-11T05:33:20.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124718+0000", 2024-09-11T05:33:20.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067581399999999995 2024-09-11T05:33:20.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.003 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.003 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.004 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:20.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:20.007 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:20.004+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:20.106 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:20.105+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:20.150 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:20.150 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:20.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:20.242 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:20.241+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:20.302 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:20.302 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:20.302 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:20.302 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:20.302 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:20.308 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:20.307+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:20.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:20.409 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:20.408+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:20.455 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:20.455 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:20.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:20.455 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:20.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.455 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15700 3.e 3:708278bf:::rbd_data.112d745a9e91.0000000000000028:a [read 778240~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.455 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.219250+0000", 2024-09-11T05:33:20.456 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.234485640000001, 2024-09-11T05:33:20.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016315105999999999, 2024-09-11T05:33:20.456 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15700 2024-09-11T05:33:20.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.456 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.219250+0000", 2024-09-11T05:33:20.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.219250+0000", 2024-09-11T05:33:20.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.219250+0000", 2024-09-11T05:33:20.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:33:20.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.219252+0000", 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.753e-06 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.219258+0000", 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6629999999999998e-06 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.219262+0000", 2024-09-11T05:33:20.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.235401+0000", 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016139137000000001 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.235478+0000", 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6829000000000006e-05 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.235565+0000", 2024-09-11T05:33:20.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6794999999999998e-05 2024-09-11T05:33:20.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.460 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.460 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16456 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 933888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.460 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301812+0000", 2024-09-11T05:33:20.460 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151924056, 2024-09-11T05:33:20.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016167119000000001, 2024-09-11T05:33:20.460 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16456 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301812+0000", 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301812+0000", 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301812+0000", 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301814+0000", 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301820+0000", 2024-09-11T05:33:20.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5809999999999996e-06 2024-09-11T05:33:20.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301824+0000", 2024-09-11T05:33:20.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T05:33:20.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317842+0000", 2024-09-11T05:33:20.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016018066000000001 2024-09-11T05:33:20.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317908+0000", 2024-09-11T05:33:20.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5263000000000002e-05 2024-09-11T05:33:20.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317979+0000", 2024-09-11T05:33:20.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0994000000000005e-05 2024-09-11T05:33:20.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.464 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.465 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16457 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.465 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301830+0000", 2024-09-11T05:33:20.465 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151905742, 2024-09-11T05:33:20.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016281285999999999, 2024-09-11T05:33:20.465 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16457 2024-09-11T05:33:20.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301830+0000", 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301830+0000", 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301830+0000", 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9700000000000003e-07 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301832+0000", 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8309999999999999e-06 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301838+0000", 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9200000000000001e-06 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301843+0000", 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.617e-06 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318000+0000", 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016157292 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318061+0000", 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1181999999999998e-05 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318111+0000", 2024-09-11T05:33:20.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0146999999999999e-05 2024-09-11T05:33:20.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.469 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.469 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16458 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 1032192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.469 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301848+0000", 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151887708, 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016400989000000001, 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16458 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301848+0000", 2024-09-11T05:33:20.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301848+0000", 2024-09-11T05:33:20.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301848+0000", 2024-09-11T05:33:20.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:33:20.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301854+0000", 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.19e-06 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301861+0000", 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2110000000000003e-06 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301865+0000", 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6489999999999999e-06 2024-09-11T05:33:20.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318139+0000", 2024-09-11T05:33:20.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016273194000000001 2024-09-11T05:33:20.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318199+0000", 2024-09-11T05:33:20.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0075999999999999e-05 2024-09-11T05:33:20.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318249+0000", 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0284000000000002e-05 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16523 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 303104~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301871+0000", 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151864315999999, 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016617435, 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.474 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.475 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.475 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16523 2024-09-11T05:33:20.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.475 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301871+0000", 2024-09-11T05:33:20.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301871+0000", 2024-09-11T05:33:20.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301872+0000", 2024-09-11T05:33:20.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:33:20.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301874+0000", 2024-09-11T05:33:20.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.74e-06 2024-09-11T05:33:20.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301880+0000", 2024-09-11T05:33:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9499999999999998e-06 2024-09-11T05:33:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301885+0000", 2024-09-11T05:33:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5480000000000003e-06 2024-09-11T05:33:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318308+0000", 2024-09-11T05:33:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016423132999999999 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318382+0000", 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4395999999999997e-05 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318489+0000", 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106276 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16524 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 352256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301891+0000", 2024-09-11T05:33:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151844964, 2024-09-11T05:33:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016800582000000001, 2024-09-11T05:33:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16524 2024-09-11T05:33:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301891+0000", 2024-09-11T05:33:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301891+0000", 2024-09-11T05:33:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301891+0000", 2024-09-11T05:33:20.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:33:20.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301893+0000", 2024-09-11T05:33:20.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-06 2024-09-11T05:33:20.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301899+0000", 2024-09-11T05:33:20.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7760000000000003e-06 2024-09-11T05:33:20.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301903+0000", 2024-09-11T05:33:20.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4100000000000001e-06 2024-09-11T05:33:20.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318520+0000", 2024-09-11T05:33:20.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016616481999999998 2024-09-11T05:33:20.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318597+0000", 2024-09-11T05:33:20.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7463e-05 2024-09-11T05:33:20.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318691+0000", 2024-09-11T05:33:20.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4191000000000007e-05 2024-09-11T05:33:20.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.483 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.483 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16525 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 401408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.483 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301909+0000", 2024-09-11T05:33:20.484 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151827029, 2024-09-11T05:33:20.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016990318000000001, 2024-09-11T05:33:20.484 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16525 2024-09-11T05:33:20.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.484 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301909+0000", 2024-09-11T05:33:20.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301909+0000", 2024-09-11T05:33:20.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301909+0000", 2024-09-11T05:33:20.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.15e-07 2024-09-11T05:33:20.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301911+0000", 2024-09-11T05:33:20.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8059999999999999e-06 2024-09-11T05:33:20.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301917+0000", 2024-09-11T05:33:20.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8109999999999999e-06 2024-09-11T05:33:20.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301921+0000", 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318739+0000", 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016817444000000001 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318811+0000", 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2485999999999997e-05 2024-09-11T05:33:20.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318899+0000", 2024-09-11T05:33:20.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7699000000000002e-05 2024-09-11T05:33:20.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.488 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.488 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16526 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 450560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.488 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301927+0000", 2024-09-11T05:33:20.488 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151808774999999, 2024-09-11T05:33:20.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017138119, 2024-09-11T05:33:20.489 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16526 2024-09-11T05:33:20.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.489 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301927+0000", 2024-09-11T05:33:20.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301927+0000", 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301927+0000", 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301929+0000", 2024-09-11T05:33:20.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.787e-06 2024-09-11T05:33:20.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301934+0000", 2024-09-11T05:33:20.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3650000000000003e-06 2024-09-11T05:33:20.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301939+0000", 2024-09-11T05:33:20.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3549999999999998e-06 2024-09-11T05:33:20.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318926+0000", 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016987209 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318989+0000", 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3429000000000005e-05 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319065+0000", 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5629000000000004e-05 2024-09-11T05:33:20.492 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16527 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 499712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301944+0000", 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151791389, 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017273228000000002, 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16527 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301944+0000", 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301944+0000", 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301945+0000", 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301946+0000", 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8160000000000001e-06 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301952+0000", 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2800000000000003e-06 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301956+0000", 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8330000000000001e-06 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319092+0000", 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017135923000000001 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319152+0000", 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9317999999999997e-05 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319217+0000", 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5748999999999997e-05 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16528 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 548864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301962+0000", 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.15177336, 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017386748, 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16528 2024-09-11T05:33:20.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.498 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301962+0000", 2024-09-11T05:33:20.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301962+0000", 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301963+0000", 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301965+0000", 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967e-06 2024-09-11T05:33:20.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301970+0000", 2024-09-11T05:33:20.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6810000000000003e-06 2024-09-11T05:33:20.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301975+0000", 2024-09-11T05:33:20.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T05:33:20.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319233+0000", 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017258796 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319269+0000", 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5970999999999998e-05 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319349+0000", 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9541000000000003e-05 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16529 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 598016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301980+0000", 2024-09-11T05:33:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151755601, 2024-09-11T05:33:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017539612999999999, 2024-09-11T05:33:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16529 2024-09-11T05:33:20.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.503 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301980+0000", 2024-09-11T05:33:20.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301980+0000", 2024-09-11T05:33:20.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301980+0000", 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8000000000000002e-07 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301982+0000", 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7460000000000001e-06 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301987+0000", 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:33:20.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301992+0000", 2024-09-11T05:33:20.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5900000000000001e-06 2024-09-11T05:33:20.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319375+0000", 2024-09-11T05:33:20.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017383322 2024-09-11T05:33:20.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319439+0000", 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3888999999999998e-05 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319520+0000", 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0377999999999995e-05 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16530 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 647168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301997+0000", 2024-09-11T05:33:20.506 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151738408, 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017710232999999999, 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16530 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301997+0000", 2024-09-11T05:33:20.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301997+0000", 2024-09-11T05:33:20.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301997+0000", 2024-09-11T05:33:20.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2300000000000002e-07 2024-09-11T05:33:20.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301999+0000", 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.838e-06 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302005+0000", 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6579999999999999e-06 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302009+0000", 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2740000000000001e-06 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319547+0000", 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017538212000000001 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319622+0000", 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4602000000000002e-05 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319707+0000", 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5326000000000003e-05 2024-09-11T05:33:20.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.511 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.511 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16531 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 696320~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.511 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302016+0000", 2024-09-11T05:33:20.511 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151719156, 2024-09-11T05:33:20.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017831955, 2024-09-11T05:33:20.511 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16531 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302016+0000", 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302016+0000", 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302017+0000", 2024-09-11T05:33:20.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:33:20.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302019+0000", 2024-09-11T05:33:20.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8300000000000001e-06 2024-09-11T05:33:20.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302025+0000", 2024-09-11T05:33:20.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:33:20.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302029+0000", 2024-09-11T05:33:20.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.527e-06 2024-09-11T05:33:20.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319726+0000", 2024-09-11T05:33:20.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017697389000000001 2024-09-11T05:33:20.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319784+0000", 2024-09-11T05:33:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7198999999999999e-05 2024-09-11T05:33:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319848+0000", 2024-09-11T05:33:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4752000000000006e-05 2024-09-11T05:33:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16532 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 745472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302034+0000", 2024-09-11T05:33:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151701170000001, 2024-09-11T05:33:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018061543999999999, 2024-09-11T05:33:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16532 2024-09-11T05:33:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302034+0000", 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302034+0000", 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302035+0000", 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6199999999999999e-07 2024-09-11T05:33:20.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302037+0000", 2024-09-11T05:33:20.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.781e-06 2024-09-11T05:33:20.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302042+0000", 2024-09-11T05:33:20.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6060000000000002e-06 2024-09-11T05:33:20.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302047+0000", 2024-09-11T05:33:20.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-11T05:33:20.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319877+0000", 2024-09-11T05:33:20.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017830141000000001 2024-09-11T05:33:20.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319946+0000", 2024-09-11T05:33:20.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9715999999999995e-05 2024-09-11T05:33:20.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320096+0000", 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000149476 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16533 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 794624~2805] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302052+0000", 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151683459999999, 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018267938000000001, 2024-09-11T05:33:20.520 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16533 2024-09-11T05:33:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302052+0000", 2024-09-11T05:33:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302052+0000", 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302052+0000", 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302054+0000", 2024-09-11T05:33:20.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7090000000000001e-06 2024-09-11T05:33:20.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302060+0000", 2024-09-11T05:33:20.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9089999999999997e-06 2024-09-11T05:33:20.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302065+0000", 2024-09-11T05:33:20.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4739999999999999e-06 2024-09-11T05:33:20.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320137+0000", 2024-09-11T05:33:20.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018072263000000002 2024-09-11T05:33:20.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320186+0000", 2024-09-11T05:33:20.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8687999999999999e-05 2024-09-11T05:33:20.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320320+0000", 2024-09-11T05:33:20.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013455699999999999 2024-09-11T05:33:20.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.525 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.525 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16534 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 843776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.525 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302070+0000", 2024-09-11T05:33:20.525 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151665681000001, 2024-09-11T05:33:20.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018477103000000002, 2024-09-11T05:33:20.525 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16534 2024-09-11T05:33:20.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.526 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302070+0000", 2024-09-11T05:33:20.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302070+0000", 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302070+0000", 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.79e-07 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302077+0000", 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7399999999999998e-06 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302083+0000", 2024-09-11T05:33:20.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9349999999999999e-06 2024-09-11T05:33:20.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302088+0000", 2024-09-11T05:33:20.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T05:33:20.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320392+0000", 2024-09-11T05:33:20.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018304388000000001 2024-09-11T05:33:20.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320472+0000", 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9808000000000006e-05 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320547+0000", 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5174999999999998e-05 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.529 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16535 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 892928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302094+0000", 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151641578, 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018647352999999998, 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16535 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302094+0000", 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302094+0000", 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302094+0000", 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302096+0000", 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7969999999999999e-06 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302102+0000", 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4960000000000004e-06 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302106+0000", 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3640000000000001e-06 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320588+0000", 2024-09-11T05:33:20.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018481897000000001 2024-09-11T05:33:20.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320666+0000", 2024-09-11T05:33:20.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8436999999999995e-05 2024-09-11T05:33:20.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320741+0000", 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4988999999999996e-05 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16536 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 942080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302112+0000", 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151623949999999, 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018820859999999998, 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16536 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302112+0000", 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302112+0000", 2024-09-11T05:33:20.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302112+0000", 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302114+0000", 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8500000000000001e-06 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302120+0000", 2024-09-11T05:33:20.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-09-11T05:33:20.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302126+0000", 2024-09-11T05:33:20.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5949999999999998e-06 2024-09-11T05:33:20.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320782+0000", 2024-09-11T05:33:20.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018656244999999998 2024-09-11T05:33:20.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320864+0000", 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1317999999999996e-05 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320932+0000", 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8847e-05 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.538 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16537 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 991232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302132+0000", 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151603245, 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019069421, 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16537 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302132+0000", 2024-09-11T05:33:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302132+0000", 2024-09-11T05:33:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302133+0000", 2024-09-11T05:33:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:33:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302135+0000", 2024-09-11T05:33:20.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9690000000000001e-06 2024-09-11T05:33:20.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302140+0000", 2024-09-11T05:33:20.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7930000000000003e-06 2024-09-11T05:33:20.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302145+0000", 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.321071+0000", 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018925833999999999 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.321149+0000", 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8065999999999994e-05 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.321202+0000", 2024-09-11T05:33:20.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.304e-05 2024-09-11T05:33:20.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.543 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.543 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16538 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:20.543 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302150+0000", 2024-09-11T05:33:20.543 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.151585144, 2024-09-11T05:33:20.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019236584000000001, 2024-09-11T05:33:20.543 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:20.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16538 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302150+0000", 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:20.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302150+0000", 2024-09-11T05:33:20.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:20.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:20.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302151+0000", 2024-09-11T05:33:20.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.15e-07 2024-09-11T05:33:20.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:20.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302152+0000", 2024-09-11T05:33:20.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.694e-06 2024-09-11T05:33:20.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302158+0000", 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8189999999999997e-06 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302163+0000", 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.321238+0000", 2024-09-11T05:33:20.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019075147000000001 2024-09-11T05:33:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.321314+0000", 2024-09-11T05:33:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6235000000000004e-05 2024-09-11T05:33:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.321387+0000", 2024-09-11T05:33:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2948999999999996e-05 2024-09-11T05:33:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.548 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:20.548 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:20.548 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:20.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:20.550 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:20.548+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:20.650 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:20.649+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:20.693 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:20.693 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:20.702 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:20.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:33:20.788 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:20.788+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:20.797 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone14 from 0x98aa605 (overlap 0xdce5e0) to 0x2c2df9 2024-09-11T05:33:20.825 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:20.826 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:20.826 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:20.826 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:20.826 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:20.836 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:20.878 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:20.877+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:20.904 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-11T05:33:20.951 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:20.951+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:20.973 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:20.973 INFO:teuthology.orchestra.run.smithi070.stdout:2117 write 0x4e4ff77 thru 0x4e529d6 (0x2a60 bytes) 2024-09-11T05:33:20.989 INFO:teuthology.orchestra.run.smithi070.stdout:2118 read 0x96c6bf0 thru 0x96d6b84 (0xff95 bytes) 2024-09-11T05:33:20.990 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:20.990 INFO:teuthology.orchestra.run.smithi070.stdout:2120 read 0x76d2ce8 thru 0x76e1790 (0xeaa9 bytes) 2024-09-11T05:33:20.990 INFO:teuthology.orchestra.run.smithi070.stdout:2121 read 0x47ee917 thru 0x47f288d (0x3f77 bytes) 2024-09-11T05:33:20.990 INFO:teuthology.orchestra.run.smithi070.stdout:2122 read 0x64f7b67 thru 0x64fabdf (0x3079 bytes) 2024-09-11T05:33:20.996 INFO:teuthology.orchestra.run.smithi070.stdout:2123 writesame 0xb1e9567 thru 0xb1f7f88 data_size 0x17(0xea22 bytes) 2024-09-11T05:33:20.997 INFO:teuthology.orchestra.run.smithi070.stdout:2124 punch from 0xb1d5a84 to 0xb1d881f, (0x2d9b bytes) 2024-09-11T05:33:20.997 INFO:teuthology.orchestra.run.smithi070.stdout:2125 clone 16 order 24 su 65536 sc 10 2024-09-11T05:33:21.008 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:21.008 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:21.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:21.008 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:21.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.008 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:33:21.008 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:21.008 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.416302383999998, 2024-09-11T05:33:21.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:33:21.008 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:21.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:33:21.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:33:21.009 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:33:21.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.009 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:21.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:33:21.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:33:21.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:33:21.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:21.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:33:21.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:33:21.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:33:21.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:33:21.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:33:21.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:33:21.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.013 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15473 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 622592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.013 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211486+0000", 2024-09-11T05:33:21.013 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.795068887999999, 2024-09-11T05:33:21.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018155910000000001, 2024-09-11T05:33:21.013 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15473 2024-09-11T05:33:21.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.014 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211486+0000", 2024-09-11T05:33:21.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211486+0000", 2024-09-11T05:33:21.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211487+0000", 2024-09-11T05:33:21.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.96e-07 2024-09-11T05:33:21.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211489+0000", 2024-09-11T05:33:21.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.764e-06 2024-09-11T05:33:21.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211494+0000", 2024-09-11T05:33:21.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7950000000000004e-06 2024-09-11T05:33:21.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211499+0000", 2024-09-11T05:33:21.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4950000000000002e-06 2024-09-11T05:33:21.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229095+0000", 2024-09-11T05:33:21.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017596527000000001 2024-09-11T05:33:21.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229150+0000", 2024-09-11T05:33:21.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4580000000000003e-05 2024-09-11T05:33:21.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229642+0000", 2024-09-11T05:33:21.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049235299999999995 2024-09-11T05:33:21.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.018 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.018 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15474 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 671744~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.018 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211505+0000", 2024-09-11T05:33:21.018 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.795049894, 2024-09-11T05:33:21.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01840586, 2024-09-11T05:33:21.018 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15474 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211505+0000", 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211505+0000", 2024-09-11T05:33:21.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211506+0000", 2024-09-11T05:33:21.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:33:21.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211507+0000", 2024-09-11T05:33:21.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.624e-06 2024-09-11T05:33:21.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211514+0000", 2024-09-11T05:33:21.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:33:21.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211525+0000", 2024-09-11T05:33:21.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0988999999999999e-05 2024-09-11T05:33:21.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229676+0000", 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018150973000000001 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229749+0000", 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3617999999999999e-05 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229911+0000", 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016204699999999999 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.023 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15475 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 720896~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.023 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211531+0000", 2024-09-11T05:33:21.023 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.795024179, 2024-09-11T05:33:21.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018650106, 2024-09-11T05:33:21.023 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.023 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.023 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15475 2024-09-11T05:33:21.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.024 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211531+0000", 2024-09-11T05:33:21.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211531+0000", 2024-09-11T05:33:21.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211532+0000", 2024-09-11T05:33:21.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:33:21.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211552+0000", 2024-09-11T05:33:21.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0027999999999999e-05 2024-09-11T05:33:21.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211560+0000", 2024-09-11T05:33:21.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0919999999999998e-06 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211565+0000", 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229942+0000", 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018376786999999999 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230045+0000", 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230181+0000", 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013638600000000001 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15476 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 770048~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211573+0000", 2024-09-11T05:33:21.027 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.794982602999999, 2024-09-11T05:33:21.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018866438999999999, 2024-09-11T05:33:21.028 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.028 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.028 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.028 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.028 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.028 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15476 2024-09-11T05:33:21.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.028 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211573+0000", 2024-09-11T05:33:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211573+0000", 2024-09-11T05:33:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211573+0000", 2024-09-11T05:33:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.06e-07 2024-09-11T05:33:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211575+0000", 2024-09-11T05:33:21.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:33:21.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211582+0000", 2024-09-11T05:33:21.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:33:21.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211595+0000", 2024-09-11T05:33:21.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3387000000000001e-05 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230213+0000", 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018617999 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230284+0000", 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1317999999999997e-05 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230439+0000", 2024-09-11T05:33:21.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015468400000000001 2024-09-11T05:33:21.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.032 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.032 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15577 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 237568~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.032 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211682+0000", 2024-09-11T05:33:21.032 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.794872987, 2024-09-11T05:33:21.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018126542999999998, 2024-09-11T05:33:21.032 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.033 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15577 2024-09-11T05:33:21.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.033 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211682+0000", 2024-09-11T05:33:21.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211682+0000", 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211683+0000", 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211685+0000", 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0829999999999998e-06 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211691+0000", 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2190000000000001e-06 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211696+0000", 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8470000000000003e-06 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229646+0000", 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017949845999999998 2024-09-11T05:33:21.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229714+0000", 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7830999999999995e-05 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229809+0000", 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5346000000000005e-05 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.037 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15578 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 286720~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.037 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211703+0000", 2024-09-11T05:33:21.037 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.794852647000001, 2024-09-11T05:33:21.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018284662, 2024-09-11T05:33:21.037 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.037 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.037 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.037 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.037 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.037 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15578 2024-09-11T05:33:21.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.037 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211703+0000", 2024-09-11T05:33:21.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211703+0000", 2024-09-11T05:33:21.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211703+0000", 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.58e-07 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211705+0000", 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211711+0000", 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211716+0000", 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3529999999999997e-06 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229836+0000", 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018120831 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229903+0000", 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6840000000000004e-05 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229987+0000", 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4102000000000002e-05 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15579 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211722+0000", 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.794833520999999, 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018430720000000001, 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15579 2024-09-11T05:33:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211722+0000", 2024-09-11T05:33:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211722+0000", 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211722+0000", 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211724+0000", 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.84e-06 2024-09-11T05:33:21.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211730+0000", 2024-09-11T05:33:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0310000000000004e-06 2024-09-11T05:33:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211742+0000", 2024-09-11T05:33:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1552000000000001e-05 2024-09-11T05:33:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230018+0000", 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018276855000000002 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230077+0000", 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8517999999999998e-05 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230152+0000", 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5520999999999997e-05 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.046 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15580 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 385024~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.046 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211748+0000", 2024-09-11T05:33:21.046 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.794807277, 2024-09-11T05:33:21.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018570942, 2024-09-11T05:33:21.046 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15580 2024-09-11T05:33:21.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.047 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211748+0000", 2024-09-11T05:33:21.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211748+0000", 2024-09-11T05:33:21.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211748+0000", 2024-09-11T05:33:21.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:33:21.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211750+0000", 2024-09-11T05:33:21.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9640000000000002e-06 2024-09-11T05:33:21.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211756+0000", 2024-09-11T05:33:21.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-09-11T05:33:21.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211761+0000", 2024-09-11T05:33:21.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2810000000000002e-06 2024-09-11T05:33:21.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230177+0000", 2024-09-11T05:33:21.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018415856000000001 2024-09-11T05:33:21.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230238+0000", 2024-09-11T05:33:21.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1605000000000004e-05 2024-09-11T05:33:21.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230319+0000", 2024-09-11T05:33:21.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0761999999999997e-05 2024-09-11T05:33:21.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.050 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.050 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15581 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 434176~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.051 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211767+0000", 2024-09-11T05:33:21.051 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.794788745, 2024-09-11T05:33:21.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01871983, 2024-09-11T05:33:21.051 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.051 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.051 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.051 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15581 2024-09-11T05:33:21.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.052 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211767+0000", 2024-09-11T05:33:21.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211767+0000", 2024-09-11T05:33:21.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211767+0000", 2024-09-11T05:33:21.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:33:21.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211769+0000", 2024-09-11T05:33:21.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8589999999999999e-06 2024-09-11T05:33:21.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211775+0000", 2024-09-11T05:33:21.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3180000000000003e-06 2024-09-11T05:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211780+0000", 2024-09-11T05:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230348+0000", 2024-09-11T05:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018568307999999999 2024-09-11T05:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230406+0000", 2024-09-11T05:33:21.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8177000000000002e-05 2024-09-11T05:33:21.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230486+0000", 2024-09-11T05:33:21.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0227000000000003e-05 2024-09-11T05:33:21.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.055 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.055 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15582 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.056 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211786+0000", 2024-09-11T05:33:21.056 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.794769703, 2024-09-11T05:33:21.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018985740000000001, 2024-09-11T05:33:21.056 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.056 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.056 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15582 2024-09-11T05:33:21.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.056 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211786+0000", 2024-09-11T05:33:21.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211786+0000", 2024-09-11T05:33:21.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211786+0000", 2024-09-11T05:33:21.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.72e-07 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211794+0000", 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211805+0000", 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0942e-05 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211810+0000", 2024-09-11T05:33:21.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3600000000000004e-06 2024-09-11T05:33:21.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230513+0000", 2024-09-11T05:33:21.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018702953000000001 2024-09-11T05:33:21.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230576+0000", 2024-09-11T05:33:21.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2493e-05 2024-09-11T05:33:21.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230771+0000", 2024-09-11T05:33:21.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000195749 2024-09-11T05:33:21.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.060 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.060 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15583 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 532480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.060 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211818+0000", 2024-09-11T05:33:21.060 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.794737616999999, 2024-09-11T05:33:21.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019160989999999999, 2024-09-11T05:33:21.060 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.061 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.061 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15583 2024-09-11T05:33:21.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.061 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211818+0000", 2024-09-11T05:33:21.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211818+0000", 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211818+0000", 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6499999999999999e-07 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211824+0000", 2024-09-11T05:33:21.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4380000000000003e-06 2024-09-11T05:33:21.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211830+0000", 2024-09-11T05:33:21.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5899999999999996e-06 2024-09-11T05:33:21.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211835+0000", 2024-09-11T05:33:21.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8269999999999997e-06 2024-09-11T05:33:21.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230819+0000", 2024-09-11T05:33:21.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018984055999999999 2024-09-11T05:33:21.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230889+0000", 2024-09-11T05:33:21.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0297999999999997e-05 2024-09-11T05:33:21.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230979+0000", 2024-09-11T05:33:21.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9315999999999997e-05 2024-09-11T05:33:21.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.065 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.065 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15584 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.065 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211841+0000", 2024-09-11T05:33:21.068 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.794714148000001, 2024-09-11T05:33:21.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019316725999999999, 2024-09-11T05:33:21.068 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.068 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15584 2024-09-11T05:33:21.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.068 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211841+0000", 2024-09-11T05:33:21.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211841+0000", 2024-09-11T05:33:21.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211842+0000", 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211843+0000", 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.911e-06 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211849+0000", 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5829999999999997e-06 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211853+0000", 2024-09-11T05:33:21.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4050000000000002e-06 2024-09-11T05:33:21.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231006+0000", 2024-09-11T05:33:21.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019152848 2024-09-11T05:33:21.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231071+0000", 2024-09-11T05:33:21.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4418999999999994e-05 2024-09-11T05:33:21.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231158+0000", 2024-09-11T05:33:21.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7206000000000005e-05 2024-09-11T05:33:21.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.072 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.072 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15585 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 630784~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.072 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211860+0000", 2024-09-11T05:33:21.072 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.79469542, 2024-09-11T05:33:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019472105999999999, 2024-09-11T05:33:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15585 2024-09-11T05:33:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211860+0000", 2024-09-11T05:33:21.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211860+0000", 2024-09-11T05:33:21.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211860+0000", 2024-09-11T05:33:21.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3599999999999999e-07 2024-09-11T05:33:21.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211862+0000", 2024-09-11T05:33:21.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6920000000000001e-06 2024-09-11T05:33:21.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211868+0000", 2024-09-11T05:33:21.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3509999999999998e-06 2024-09-11T05:33:21.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211873+0000", 2024-09-11T05:33:21.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6800000000000001e-06 2024-09-11T05:33:21.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231185+0000", 2024-09-11T05:33:21.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019311979999999999 2024-09-11T05:33:21.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231250+0000", 2024-09-11T05:33:21.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4627000000000003e-05 2024-09-11T05:33:21.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231332+0000", 2024-09-11T05:33:21.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2340000000000001e-05 2024-09-11T05:33:21.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.077 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.077 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15586 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 679936~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.078 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211879+0000", 2024-09-11T05:33:21.078 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.794676436, 2024-09-11T05:33:21.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019630141, 2024-09-11T05:33:21.078 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.078 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.078 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.078 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15586 2024-09-11T05:33:21.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.078 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211879+0000", 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211879+0000", 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211879+0000", 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:33:21.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211881+0000", 2024-09-11T05:33:21.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7150000000000001e-06 2024-09-11T05:33:21.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211887+0000", 2024-09-11T05:33:21.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9499999999999998e-06 2024-09-11T05:33:21.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211892+0000", 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9080000000000003e-06 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231359+0000", 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019466954000000002 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231423+0000", 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4531999999999998e-05 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231509+0000", 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5691000000000003e-05 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15593 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 237568~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.214205+0000", 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.792350745, 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018014775, 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15593 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.214205+0000", 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.214205+0000", 2024-09-11T05:33:21.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.214205+0000", 2024-09-11T05:33:21.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:33:21.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.214213+0000", 2024-09-11T05:33:21.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.452e-06 2024-09-11T05:33:21.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.214220+0000", 2024-09-11T05:33:21.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0890000000000002e-06 2024-09-11T05:33:21.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.214224+0000", 2024-09-11T05:33:21.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6410000000000001e-06 2024-09-11T05:33:21.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231637+0000", 2024-09-11T05:33:21.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017412463 2024-09-11T05:33:21.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231745+0000", 2024-09-11T05:33:21.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108026 2024-09-11T05:33:21.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.232219+0000", 2024-09-11T05:33:21.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047457 2024-09-11T05:33:21.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.086 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.087 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15602 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 679936~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.087 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.215687+0000", 2024-09-11T05:33:21.087 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.790868587, 2024-09-11T05:33:21.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018038031, 2024-09-11T05:33:21.087 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.087 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.087 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15602 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215687+0000", 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215687+0000", 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215687+0000", 2024-09-11T05:33:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0299999999999999e-07 2024-09-11T05:33:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215689+0000", 2024-09-11T05:33:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9800000000000001e-06 2024-09-11T05:33:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215695+0000", 2024-09-11T05:33:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9039999999999997e-06 2024-09-11T05:33:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215700+0000", 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6650000000000002e-06 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233575+0000", 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017875361999999999 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233642+0000", 2024-09-11T05:33:21.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6477999999999996e-05 2024-09-11T05:33:21.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233725+0000", 2024-09-11T05:33:21.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3139000000000005e-05 2024-09-11T05:33:21.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.091 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.091 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15603 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 729088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.091 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.215708+0000", 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.790847723000001, 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018231502, 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15603 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215708+0000", 2024-09-11T05:33:21.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215708+0000", 2024-09-11T05:33:21.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215708+0000", 2024-09-11T05:33:21.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T05:33:21.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215710+0000", 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.84e-06 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215715+0000", 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.378e-06 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215720+0000", 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4329999999999997e-06 2024-09-11T05:33:21.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233754+0000", 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018034188999999999 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233836+0000", 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1965000000000006e-05 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233939+0000", 2024-09-11T05:33:21.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103334 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15604 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 778240~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.215727+0000", 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.790828679000001, 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018413735000000001, 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15604 2024-09-11T05:33:21.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.097 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215727+0000", 2024-09-11T05:33:21.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215727+0000", 2024-09-11T05:33:21.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215727+0000", 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215734+0000", 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.374e-06 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215740+0000", 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5419999999999996e-06 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215745+0000", 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6199999999999998e-06 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233982+0000", 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018237659 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.234059+0000", 2024-09-11T05:33:21.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7162000000000004e-05 2024-09-11T05:33:21.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.234140+0000", 2024-09-11T05:33:21.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0983999999999996e-05 2024-09-11T05:33:21.100 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.100 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.100 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.100 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16714 3.a 3:52147733:::rbd_data.112d745a9e91.0000000000000022:a [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.299149+0000", 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.707406753000001, 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017959678999999999, 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16714 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:21.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.299149+0000", 2024-09-11T05:33:21.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:21.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.299149+0000", 2024-09-11T05:33:21.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:21.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:21.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.299149+0000", 2024-09-11T05:33:21.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.39e-07 2024-09-11T05:33:21.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.299151+0000", 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.654e-06 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.299156+0000", 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.789e-06 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.299161+0000", 2024-09-11T05:33:21.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3069999999999996e-06 2024-09-11T05:33:21.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:21.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.316956+0000", 2024-09-11T05:33:21.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017795188 2024-09-11T05:33:21.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:21.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317032+0000", 2024-09-11T05:33:21.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5867999999999999e-05 2024-09-11T05:33:21.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:21.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:21.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:21.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317108+0000", 2024-09-11T05:33:21.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6533999999999996e-05 2024-09-11T05:33:21.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:21.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:21.105 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:21.107 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:21.107 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:21.106+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:21.208 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:21.208+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:21.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:33:21.211 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:21.211 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:21.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:21.309 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:21.309+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:21.328 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:21.329 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:21.345 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:21.345 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:21.361 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:21.361 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:21.363 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:21.364 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:21.364 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:21.364 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:21.364 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:21.372 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:21.376 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:21.377 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:21.393 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:21.394 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:21.410 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:21.410 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:21.410+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:21.411 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:21.426 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:21.427 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:21.443 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:21.443 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:21.510 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:21.510+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:21.514 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:21.514 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:21.522 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:21.612 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:21.611+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:21.665 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:21.665 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:21.674 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:21.717 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:21.717+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:21.718 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T05:33:21.779 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:21.779 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:21.788 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:21.797 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone15 from 0xb1f7f89 (overlap 0x98aa605) to 0x0 2024-09-11T05:33:21.830 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:21.830+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:21.914 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:21.914+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:21.924 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-11T05:33:21.932 INFO:teuthology.orchestra.run.smithi070.stdout:2126 writesame 0x6cd6425 thru 0x6ce289f data_size 0x1(0xc47b bytes) 2024-09-11T05:33:21.935 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:21.935 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:21.944 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:21.987 INFO:teuthology.orchestra.run.smithi070.stdout:2127 write 0x8ca4f4a thru 0x8cab739 (0x67f0 bytes) 2024-09-11T05:33:22.012 INFO:teuthology.orchestra.run.smithi070.stdout:2128 write 0x19b46f5 thru 0x19bca0f (0x831b bytes) 2024-09-11T05:33:22.014 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.014 INFO:teuthology.orchestra.run.smithi070.stdout:2131 punch from 0x98c7ab1 to 0x98cc3fc, (0x494b bytes) 2024-09-11T05:33:22.021 INFO:teuthology.orchestra.run.smithi070.stdout:2132 write 0xcc64ca8 thru 0xcc6be07 (0x7160 bytes) 2024-09-11T05:33:22.026 INFO:teuthology.orchestra.run.smithi070.stdout:2133 punch from 0x2c7baeb to 0x2c7e6e0, (0x2bf5 bytes) 2024-09-11T05:33:22.026 INFO:teuthology.orchestra.run.smithi070.stdout:2134 punch from 0x2b3bf2c to 0x2b46975, (0xaa49 bytes) 2024-09-11T05:33:22.026 INFO:teuthology.orchestra.run.smithi070.stdout:2136 write 0x6e03498 thru 0x6e12884 (0xf3ed bytes) 2024-09-11T05:33:22.027 INFO:teuthology.orchestra.run.smithi070.stdout:2137 write 0xa31cbe2 thru 0xa320df7 (0x4216 bytes) 2024-09-11T05:33:22.028 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:22.028+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:22.037 INFO:teuthology.orchestra.run.smithi070.stdout:2138 trunc from 0xcc6be08 to 0x8123864 2024-09-11T05:33:22.109 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:22.109 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:22.116 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:22.116+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:22.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:22.173 INFO:teuthology.orchestra.run.smithi070.stdout:2140 read 0x5a80a2 thru 0x5b0d92 (0x8cf1 bytes) 2024-09-11T05:33:22.188 INFO:teuthology.orchestra.run.smithi070.stdout:2141 writesame 0xedee589 thru 0xedf24f0 data_size 0x4(0x3f68 bytes) 2024-09-11T05:33:22.188 INFO:teuthology.orchestra.run.smithi070.stdout:2142 write 0xbcda067 thru 0xbce0295 (0x622f bytes) 2024-09-11T05:33:22.191 INFO:teuthology.orchestra.run.smithi070.stdout:2143 read 0x4435cbe thru 0x4436227 (0x56a bytes) 2024-09-11T05:33:22.192 INFO:teuthology.orchestra.run.smithi070.stdout:2144 punch from 0x9ddbb10 to 0x9de33d1, (0x78c1 bytes) 2024-09-11T05:33:22.192 INFO:teuthology.orchestra.run.smithi070.stdout:2145 read 0xa3a4071 thru 0xa3b0630 (0xc5c0 bytes) 2024-09-11T05:33:22.192 INFO:teuthology.orchestra.run.smithi070.stdout:2146 read 0x702bc80 thru 0x702c063 (0x3e4 bytes) 2024-09-11T05:33:22.192 INFO:teuthology.orchestra.run.smithi070.stdout:2147 write 0xeb4d01 thru 0xebdb05 (0x8e05 bytes) 2024-09-11T05:33:22.194 INFO:teuthology.orchestra.run.smithi070.stdout:2148 punch from 0xdf38745 to 0xdf3ca38, (0x42f3 bytes) 2024-09-11T05:33:22.194 INFO:teuthology.orchestra.run.smithi070.stdout:2149 write 0xad1f6e1 thru 0xad248ba (0x51da bytes) 2024-09-11T05:33:22.213 INFO:teuthology.orchestra.run.smithi070.stdout:2150 trunc from 0xedf24f1 to 0x15e7043 2024-09-11T05:33:22.217 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:22.217+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:22.245 INFO:teuthology.orchestra.run.smithi070.stdout:2151 write 0xe381d27 thru 0xe391a3b (0xfd15 bytes) 2024-09-11T05:33:22.252 INFO:teuthology.orchestra.run.smithi070.stdout:2154 trunc from 0xe391a3c to 0xdba4295 2024-09-11T05:33:22.264 INFO:teuthology.orchestra.run.smithi070.stdout:2155 trunc from 0xdba4295 to 0x86616bd 2024-09-11T05:33:22.271 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:22.271 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:22.280 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:22.286 INFO:teuthology.orchestra.run.smithi070.stdout:2156 writesame 0xd5203ba thru 0xd524ce6 data_size 0xd(0x492d bytes) 2024-09-11T05:33:22.286 INFO:teuthology.orchestra.run.smithi070.stdout:2158 write 0xcc55951 thru 0xcc5d163 (0x7813 bytes) 2024-09-11T05:33:22.299 INFO:teuthology.orchestra.run.smithi070.stdout:2159 trunc from 0xd524ce7 to 0x4a30be9 2024-09-11T05:33:22.310 INFO:teuthology.orchestra.run.smithi070.stdout:2160 write 0x53f666 thru 0x54aa04 (0xb39f bytes) 2024-09-11T05:33:22.312 INFO:teuthology.orchestra.run.smithi070.stdout:2161 read 0x2dd3504 thru 0x2de18c8 (0xe3c5 bytes) 2024-09-11T05:33:22.312 INFO:teuthology.orchestra.run.smithi070.stdout:2162 read 0x48d9dc7 thru 0x48e0150 (0x638a bytes) 2024-09-11T05:33:22.312 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.313 INFO:teuthology.orchestra.run.smithi070.stdout:2165 read 0x2eecdb7 thru 0x2ef54f5 (0x873f bytes) 2024-09-11T05:33:22.313 INFO:teuthology.orchestra.run.smithi070.stdout:2167 read 0x9cf8fe thru 0x9d0c87 (0x138a bytes) 2024-09-11T05:33:22.318 INFO:teuthology.orchestra.run.smithi070.stdout:2168 trunc from 0x4a30be9 to 0x8de03e0 2024-09-11T05:33:22.321 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:22.321+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:22.330 INFO:teuthology.orchestra.run.smithi070.stdout:2171 writesame 0x97f7303 thru 0x9806fc2 data_size 0x60(0xfcc0 bytes) 2024-09-11T05:33:22.333 INFO:teuthology.orchestra.run.smithi070.stdout:2172 trunc from 0x9806fc3 to 0x793101c 2024-09-11T05:33:22.342 INFO:teuthology.orchestra.run.smithi070.stdout:2173 punch from 0x2e54752 to 0x2e598f8, (0x51a6 bytes) 2024-09-11T05:33:22.342 INFO:teuthology.orchestra.run.smithi070.stdout:2174 write 0x3c3974c thru 0x3c40b9b (0x7450 bytes) 2024-09-11T05:33:22.358 INFO:teuthology.orchestra.run.smithi070.stdout:2176 writesame 0xeb43294 thru 0xeb5308f data_size 0xa(0xfdfc bytes) 2024-09-11T05:33:22.358 INFO:teuthology.orchestra.run.smithi070.stdout:2177 read 0x28ffaa1 thru 0x290e7d1 (0xed31 bytes) 2024-09-11T05:33:22.358 INFO:teuthology.orchestra.run.smithi070.stdout:2179 write 0x265d697 thru 0x2660f6f (0x38d9 bytes) 2024-09-11T05:33:22.360 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.360 INFO:teuthology.orchestra.run.smithi070.stdout:2181 writesame 0x2bc4ebb thru 0x2bca110 data_size 0x6(0x5256 bytes) 2024-09-11T05:33:22.363 INFO:teuthology.orchestra.run.smithi070.stdout:2183 read 0x252978d thru 0x252aa04 (0x1278 bytes) 2024-09-11T05:33:22.363 INFO:teuthology.orchestra.run.smithi070.stdout:2184 read 0x9289a9a thru 0x9294f87 (0xb4ee bytes) 2024-09-11T05:33:22.364 INFO:teuthology.orchestra.run.smithi070.stdout:2185 punch from 0x25d64ea to 0x25dd8a7, (0x73bd bytes) 2024-09-11T05:33:22.364 INFO:teuthology.orchestra.run.smithi070.stdout:2187 read 0xaa1522 thru 0xaa4c8f (0x376e bytes) 2024-09-11T05:33:22.369 INFO:teuthology.orchestra.run.smithi070.stdout:2188 trunc from 0xeb53090 to 0xa559a87 2024-09-11T05:33:22.382 INFO:teuthology.orchestra.run.smithi070.stdout:2189 write 0xba141ea thru 0xba20d59 (0xcb70 bytes) 2024-09-11T05:33:22.386 INFO:teuthology.orchestra.run.smithi070.stdout:2192 writesame 0x67aae09 thru 0x67ad33a data_size 0x6(0x2532 bytes) 2024-09-11T05:33:22.388 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.388 INFO:teuthology.orchestra.run.smithi070.stdout:2195 write 0x8bddb57 thru 0x8bdf1c5 (0x166f bytes) 2024-09-11T05:33:22.389 INFO:teuthology.orchestra.run.smithi070.stdout:2196 punch from 0x96472c0 to 0x9648d9f, (0x1adf bytes) 2024-09-11T05:33:22.389 INFO:teuthology.orchestra.run.smithi070.stdout:2197 writesame 0x3219a6f thru 0x321bc57 data_size 0x1(0x21e9 bytes) 2024-09-11T05:33:22.395 INFO:teuthology.orchestra.run.smithi070.stdout:2198 write 0x8060291 thru 0x80692d7 (0x9047 bytes) 2024-09-11T05:33:22.396 INFO:teuthology.orchestra.run.smithi070.stdout:2199 writesame 0x9362e80 thru 0x9362ff7 data_size 0x2(0x178 bytes) 2024-09-11T05:33:22.404 INFO:teuthology.orchestra.run.smithi070.stdout:2200 writesame 0xc48181f thru 0xc4853fb data_size 0x5(0x3bdd bytes) 2024-09-11T05:33:22.410 INFO:teuthology.orchestra.run.smithi070.stdout:2201 write 0xcac5802 thru 0xcacefa1 (0x97a0 bytes) 2024-09-11T05:33:22.415 INFO:teuthology.orchestra.run.smithi070.stdout:2203 read 0x5e6b49f thru 0x5e7a7f5 (0xf357 bytes) 2024-09-11T05:33:22.417 INFO:teuthology.orchestra.run.smithi070.stdout:2206 trunc from 0xcacefa2 to 0xe0d9c7a 2024-09-11T05:33:22.419 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:22.419+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:22.430 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:22.431 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:22.431 INFO:teuthology.orchestra.run.smithi070.stdout:2208 trunc from 0xe0d9c7a to 0x76036ba 2024-09-11T05:33:22.441 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:22.458 INFO:teuthology.orchestra.run.smithi070.stdout:2209 write 0xc92aafd thru 0xc933f33 (0x9437 bytes) 2024-09-11T05:33:22.461 INFO:teuthology.orchestra.run.smithi070.stdout:2212 read 0x70e7704 thru 0x70f4aee (0xd3eb bytes) 2024-09-11T05:33:22.461 INFO:teuthology.orchestra.run.smithi070.stdout:2213 write 0x3bb2c2c thru 0x3bb39cf (0xda4 bytes) 2024-09-11T05:33:22.463 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.463 INFO:teuthology.orchestra.run.smithi070.stdout:2215 writesame 0xb52e70b thru 0xb53b65b data_size 0x3(0xcf51 bytes) 2024-09-11T05:33:22.474 INFO:teuthology.orchestra.run.smithi070.stdout:2216 read 0x894ef13 thru 0x895d946 (0xea34 bytes) 2024-09-11T05:33:22.476 INFO:teuthology.orchestra.run.smithi070.stdout:2217 trunc from 0xc933f34 to 0xb323738 2024-09-11T05:33:22.483 INFO:teuthology.orchestra.run.smithi070.stdout:2218 writesame 0x3840a5e thru 0x3841100 data_size 0x1(0x6a3 bytes) 2024-09-11T05:33:22.486 INFO:teuthology.orchestra.run.smithi070.stdout:2219 punch from 0x7d92a1f to 0x7d97bc5, (0x51a6 bytes) 2024-09-11T05:33:22.486 INFO:teuthology.orchestra.run.smithi070.stdout:2221 read 0x77c85e2 thru 0x77cdf7a (0x5999 bytes) 2024-09-11T05:33:22.497 INFO:teuthology.orchestra.run.smithi070.stdout:2222 write 0xe8ea532 thru 0xe8eb948 (0x1417 bytes) 2024-09-11T05:33:22.500 INFO:teuthology.orchestra.run.smithi070.stdout:2224 writesame 0xe756aa0 thru 0xe7613f8 data_size 0x3(0xa959 bytes) 2024-09-11T05:33:22.509 INFO:teuthology.orchestra.run.smithi070.stdout:2226 writesame 0x3bacd87 thru 0x3bb8ab7 data_size 0x25(0xbd31 bytes) 2024-09-11T05:33:22.511 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.511 INFO:teuthology.orchestra.run.smithi070.stdout:2229 read 0x83374f6 thru 0x833ea0c (0x7517 bytes) 2024-09-11T05:33:22.512 INFO:teuthology.orchestra.run.smithi070.stdout:2230 punch from 0xe728d66 to 0xe7348bc, (0xbb56 bytes) 2024-09-11T05:33:22.512 INFO:teuthology.orchestra.run.smithi070.stdout:2232 read 0xb3b30f4 thru 0xb3b9e02 (0x6d0f bytes) 2024-09-11T05:33:22.512 INFO:teuthology.orchestra.run.smithi070.stdout:2233 write 0xd46185d thru 0xd46cb35 (0xb2d9 bytes) 2024-09-11T05:33:22.513 INFO:teuthology.orchestra.run.smithi070.stdout:2234 write 0x2d06b9e thru 0x2d0a068 (0x34cb bytes) 2024-09-11T05:33:22.514 INFO:teuthology.orchestra.run.smithi070.stdout:2236 read 0x22b01d6 thru 0x22ba2f9 (0xa124 bytes) 2024-09-11T05:33:22.515 INFO:teuthology.orchestra.run.smithi070.stdout:2239 write 0x40716f4 thru 0x407d01b (0xb928 bytes) 2024-09-11T05:33:22.517 INFO:teuthology.orchestra.run.smithi070.stdout:2240 punch from 0x8785eed to 0x8791760, (0xb873 bytes) 2024-09-11T05:33:22.517 INFO:teuthology.orchestra.run.smithi070.stdout:2243 read 0xb2738f9 thru 0xb27e64b (0xad53 bytes) 2024-09-11T05:33:22.517 INFO:teuthology.orchestra.run.smithi070.stdout:2244 write 0x739d469 thru 0x739da6f (0x607 bytes) 2024-09-11T05:33:22.518 INFO:teuthology.orchestra.run.smithi070.stdout:2245 write 0x66d89fe thru 0x66db82a (0x2e2d bytes) 2024-09-11T05:33:22.520 INFO:teuthology.orchestra.run.smithi070.stdout:2246 write 0x81ea6fd thru 0x81efcd9 (0x55dd bytes) 2024-09-11T05:33:22.520 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:22.520+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:22.521 INFO:teuthology.orchestra.run.smithi070.stdout:2247 punch from 0x2a43b61 to 0x2a51f84, (0xe423 bytes) 2024-09-11T05:33:22.521 INFO:teuthology.orchestra.run.smithi070.stdout:2248 read 0x523b928 thru 0x524b4ff (0xfbd8 bytes) 2024-09-11T05:33:22.521 INFO:teuthology.orchestra.run.smithi070.stdout:2249 trunc from 0xe8eb949 to 0xeaf214e 2024-09-11T05:33:22.526 INFO:teuthology.orchestra.run.smithi070.stdout:2250 write 0x721877b thru 0x7226243 (0xdac9 bytes) 2024-09-11T05:33:22.527 INFO:teuthology.orchestra.run.smithi070.stdout:2252 punch from 0xaba643f to 0xaba740e, (0xfcf bytes) 2024-09-11T05:33:22.527 INFO:teuthology.orchestra.run.smithi070.stdout:2253 read 0xbada392 thru 0xbadf366 (0x4fd5 bytes) 2024-09-11T05:33:22.528 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.528 INFO:teuthology.orchestra.run.smithi070.stdout:2256 writesame 0xe1f602c thru 0xe1fb9a8 data_size 0x1(0x597d bytes) 2024-09-11T05:33:22.541 INFO:teuthology.orchestra.run.smithi070.stdout:2257 punch from 0x55e342a to 0x55ed3a2, (0x9f78 bytes) 2024-09-11T05:33:22.541 INFO:teuthology.orchestra.run.smithi070.stdout:2258 read 0x57f4c3d thru 0x57f8a1d (0x3de1 bytes) 2024-09-11T05:33:22.555 INFO:teuthology.orchestra.run.smithi070.stdout:2259 trunc from 0xeaf214e to 0x2c40214 2024-09-11T05:33:22.569 INFO:teuthology.orchestra.run.smithi070.stdout:2260 write 0x1532894 thru 0x1536146 (0x38b3 bytes) 2024-09-11T05:33:22.571 INFO:teuthology.orchestra.run.smithi070.stdout:2261 read 0xae96f6 thru 0xaf2cc8 (0x95d3 bytes) 2024-09-11T05:33:22.573 INFO:teuthology.orchestra.run.smithi070.stdout:2262 trunc from 0x2c40214 to 0x3be495b 2024-09-11T05:33:22.594 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:22.594 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout:2263 write 0xd605313 thru 0xd6092c2 (0x3fb0 bytes) 2024-09-11T05:33:22.600 INFO:teuthology.orchestra.run.smithi070.stdout:2264 trunc from 0xd6092c3 to 0xb2fa582 2024-09-11T05:33:22.603 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:22.616 INFO:teuthology.orchestra.run.smithi070.stdout:2265 writesame 0xdf31340 thru 0xdf38b75 data_size 0x2e(0x7836 bytes) 2024-09-11T05:33:22.616 INFO:teuthology.orchestra.run.smithi070.stdout:2266 punch from 0xd483253 to 0xd4856f5, (0x24a2 bytes) 2024-09-11T05:33:22.616 INFO:teuthology.orchestra.run.smithi070.stdout:2271 punch from 0x8c1ff6 to 0x8cdd52, (0xbd5c bytes) 2024-09-11T05:33:22.616 INFO:teuthology.orchestra.run.smithi070.stdout:2272 writesame 0x31264c6 thru 0x312d7a3 data_size 0x57(0x72de bytes) 2024-09-11T05:33:22.617 INFO:teuthology.orchestra.run.smithi070.stdout:2273 write 0x9cbd118 thru 0x9cc0c0e (0x3af7 bytes) 2024-09-11T05:33:22.619 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.619 INFO:teuthology.orchestra.run.smithi070.stdout:2276 read 0x963b4b7 thru 0x964ab1e (0xf668 bytes) 2024-09-11T05:33:22.619 INFO:teuthology.orchestra.run.smithi070.stdout:2282 punch from 0xb765b48 to 0xb766e9e, (0x1356 bytes) 2024-09-11T05:33:22.620 INFO:teuthology.orchestra.run.smithi070.stdout:2283 writesame 0xa78b3b3 thru 0xa79608b data_size 0x1(0xacd9 bytes) 2024-09-11T05:33:22.620 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:22.620+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:22.648 INFO:teuthology.orchestra.run.smithi070.stdout:2285 write 0x61dfba5 thru 0x61e3812 (0x3c6e bytes) 2024-09-11T05:33:22.650 INFO:teuthology.orchestra.run.smithi070.stdout:2287 punch from 0x565e3b0 to 0x566470f, (0x635f bytes) 2024-09-11T05:33:22.662 INFO:teuthology.orchestra.run.smithi070.stdout:2288 trunc from 0xdf38b76 to 0x32b6197 2024-09-11T05:33:22.677 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.677 INFO:teuthology.orchestra.run.smithi070.stdout:2290 trunc from 0x32b6197 to 0x345ad6e 2024-09-11T05:33:22.682 INFO:teuthology.orchestra.run.smithi070.stdout:2291 read 0x32b37db thru 0x32bf154 (0xb97a bytes) 2024-09-11T05:33:22.698 INFO:teuthology.orchestra.run.smithi070.stdout:2293 write 0xbb2877d thru 0xbb35031 (0xc8b5 bytes) 2024-09-11T05:33:22.702 INFO:teuthology.orchestra.run.smithi070.stdout:2294 write 0x99d65ae thru 0x99e2f3e (0xc991 bytes) 2024-09-11T05:33:22.703 INFO:teuthology.orchestra.run.smithi070.stdout:2298 write 0x9f66f26 thru 0x9f6e018 (0x70f3 bytes) 2024-09-11T05:33:22.705 INFO:teuthology.orchestra.run.smithi070.stdout:2299 write 0x101e41 thru 0x10518c (0x334c bytes) 2024-09-11T05:33:22.709 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:22.710 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:22.718 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:22.720 INFO:teuthology.orchestra.run.smithi070.stdout:2300 trunc from 0xbb35032 to 0x47e77 2024-09-11T05:33:22.721 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:22.721+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:22.747 INFO:teuthology.orchestra.run.smithi070.stdout:2301 trunc from 0x47e77 to 0x3e4160a 2024-09-11T05:33:22.753 INFO:teuthology.orchestra.run.smithi070.stdout:2303 read 0x3ade4 thru 0x44c95 (0x9eb2 bytes) 2024-09-11T05:33:22.754 INFO:teuthology.orchestra.run.smithi070.stdout:2304 read 0xc4c4ed thru 0xc5979a (0xd2ae bytes) 2024-09-11T05:33:22.754 INFO:teuthology.orchestra.run.smithi070.stdout:2305 read 0x333cde1 thru 0x333ef35 (0x2155 bytes) 2024-09-11T05:33:22.756 INFO:teuthology.orchestra.run.smithi070.stdout:2306 trunc from 0x3e4160a to 0x25021c2 2024-09-11T05:33:22.763 INFO:teuthology.orchestra.run.smithi070.stdout:2308 read 0x24b2916 thru 0x24b3c97 (0x1382 bytes) 2024-09-11T05:33:22.763 INFO:teuthology.orchestra.run.smithi070.stdout:2309 punch from 0x1449a0c to 0x1456cc6, (0xd2ba bytes) 2024-09-11T05:33:22.763 INFO:teuthology.orchestra.run.smithi070.stdout:2310 read 0x2009d61 thru 0x2016109 (0xc3a9 bytes) 2024-09-11T05:33:22.763 INFO:teuthology.orchestra.run.smithi070.stdout:2311 punch from 0x147e69f to 0x14865dc, (0x7f3d bytes) 2024-09-11T05:33:22.783 INFO:teuthology.orchestra.run.smithi070.stdout:2312 write 0xe75b47b thru 0xe75ed8e (0x3914 bytes) 2024-09-11T05:33:22.786 INFO:teuthology.orchestra.run.smithi070.stdout:2313 punch from 0xafc51a6 to 0xafc5aab, (0x905 bytes) 2024-09-11T05:33:22.798 INFO:teuthology.orchestra.run.smithi070.stdout:2314 trunc from 0xe75ed8f to 0x4943bae 2024-09-11T05:33:22.809 INFO:teuthology.orchestra.run.smithi070.stdout:2316 read 0x716261 thru 0x71b941 (0x56e1 bytes) 2024-09-11T05:33:22.822 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:22.821+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:22.823 INFO:teuthology.orchestra.run.smithi070.stdout:2317 write 0x8c6ebe4 thru 0x8c75ea0 (0x72bd bytes) 2024-09-11T05:33:22.828 INFO:teuthology.orchestra.run.smithi070.stdout:2318 read 0x2f2cc18 thru 0x2f307c7 (0x3bb0 bytes) 2024-09-11T05:33:22.829 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.829 INFO:teuthology.orchestra.run.smithi070.stdout:2321 write 0x3f9d2a1 thru 0x3f9f70c (0x246c bytes) 2024-09-11T05:33:22.830 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:22.830 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:22.830 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.830 INFO:teuthology.orchestra.run.smithi070.stdout:2323 read 0x2f8d214 thru 0x2f9a92b (0xd718 bytes) 2024-09-11T05:33:22.839 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:22.842 INFO:teuthology.orchestra.run.smithi070.stdout:2325 write 0xd6774d6 thru 0xd686255 (0xed80 bytes) 2024-09-11T05:33:22.848 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.848 INFO:teuthology.orchestra.run.smithi070.stdout:2327 read 0xafef17e thru 0xaff318f (0x4012 bytes) 2024-09-11T05:33:22.848 INFO:teuthology.orchestra.run.smithi070.stdout:2328 punch from 0x8f13052 to 0x8f1a467, (0x7415 bytes) 2024-09-11T05:33:22.848 INFO:teuthology.orchestra.run.smithi070.stdout:2329 write 0x8ba2224 thru 0x8ba7d89 (0x5b66 bytes) 2024-09-11T05:33:22.849 INFO:teuthology.orchestra.run.smithi070.stdout:2330 punch from 0x4d6b70e to 0x4d6cc3c, (0x152e bytes) 2024-09-11T05:33:22.849 INFO:teuthology.orchestra.run.smithi070.stdout:2332 write 0x77b8ee thru 0x785c59 (0xa36c bytes) 2024-09-11T05:33:22.854 INFO:teuthology.orchestra.run.smithi070.stdout:2333 punch from 0x5eb014 to 0x5eebec, (0x3bd8 bytes) 2024-09-11T05:33:22.854 INFO:teuthology.orchestra.run.smithi070.stdout:2336 writesame 0xc60ea0e thru 0xc61abba data_size 0x15(0xc1ad bytes) 2024-09-11T05:33:22.858 INFO:teuthology.orchestra.run.smithi070.stdout:2337 read 0xb7d5356 thru 0xb7d7d16 (0x29c1 bytes) 2024-09-11T05:33:22.858 INFO:teuthology.orchestra.run.smithi070.stdout:2338 punch from 0xcc20d10 to 0xcc25bb5, (0x4ea5 bytes) 2024-09-11T05:33:22.858 INFO:teuthology.orchestra.run.smithi070.stdout:2340 writesame 0xa4d5ea0 thru 0xa4ddb8f data_size 0x8(0x7cf0 bytes) 2024-09-11T05:33:22.863 INFO:teuthology.orchestra.run.smithi070.stdout:2343 read 0x560a4c7 thru 0x560b88f (0x13c9 bytes) 2024-09-11T05:33:22.863 INFO:teuthology.orchestra.run.smithi070.stdout:2345 read 0x63893b4 thru 0x639277e (0x93cb bytes) 2024-09-11T05:33:22.863 INFO:teuthology.orchestra.run.smithi070.stdout:2346 writesame 0xc302391 thru 0xc3034fe data_size 0x17(0x116e bytes) 2024-09-11T05:33:22.866 INFO:teuthology.orchestra.run.smithi070.stdout:2347 read 0x7e98bbf thru 0x7ea6c6d (0xe0af bytes) 2024-09-11T05:33:22.872 INFO:teuthology.orchestra.run.smithi070.stdout:2348 trunc from 0xd686256 to 0x9e2c0d2 2024-09-11T05:33:22.884 INFO:teuthology.orchestra.run.smithi070.stdout:2349 writesame 0x6b01aa5 thru 0x6b0f65c data_size 0x8(0xdbb8 bytes) 2024-09-11T05:33:22.889 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.889 INFO:teuthology.orchestra.run.smithi070.stdout:2351 write 0x52b2d76 thru 0x52b5684 (0x290f bytes) 2024-09-11T05:33:22.891 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.891 INFO:teuthology.orchestra.run.smithi070.stdout:2353 writesame 0x460611b thru 0x461361b data_size 0x1(0xd501 bytes) 2024-09-11T05:33:22.923 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:22.922+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:22.934 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.935 INFO:teuthology.orchestra.run.smithi070.stdout:2355 writesame 0x35c8ffa thru 0x35cc335 data_size 0x6(0x333c bytes) 2024-09-11T05:33:22.938 INFO:teuthology.orchestra.run.smithi070.stdout:2358 read 0x36cc119 thru 0x36d2bb3 (0x6a9b bytes) 2024-09-11T05:33:22.939 INFO:teuthology.orchestra.run.smithi070.stdout:2359 read 0x668b636 thru 0x6697bae (0xc579 bytes) 2024-09-11T05:33:22.939 INFO:teuthology.orchestra.run.smithi070.stdout:2361 read 0x623ae33 thru 0x623d588 (0x2756 bytes) 2024-09-11T05:33:22.940 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.940 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.940 INFO:teuthology.orchestra.run.smithi070.stdout:2365 write 0x8da5acd thru 0x8db41e4 (0xe718 bytes) 2024-09-11T05:33:22.942 INFO:teuthology.orchestra.run.smithi070.stdout:2367 writesame 0xe1205f thru 0xe1a2bf data_size 0x1(0x8261 bytes) 2024-09-11T05:33:22.958 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:22.959 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:22.965 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.969 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:22.975 INFO:teuthology.orchestra.run.smithi070.stdout:2371 writesame 0xd16c619 thru 0xd171a7a data_size 0x7(0x5462 bytes) 2024-09-11T05:33:22.975 INFO:teuthology.orchestra.run.smithi070.stdout:2372 write 0x4acd64 thru 0x4bb624 (0xe8c1 bytes) 2024-09-11T05:33:22.977 INFO:teuthology.orchestra.run.smithi070.stdout:2374 trunc from 0xd171a7b to 0xcc16633 2024-09-11T05:33:22.985 INFO:teuthology.orchestra.run.smithi070.stdout:2375 write 0xae7c168 thru 0xae7f215 (0x30ae bytes) 2024-09-11T05:33:22.990 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.990 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.990 INFO:teuthology.orchestra.run.smithi070.stdout:2380 punch from 0xb7ef5d6 to 0xb7fb27d, (0xbca7 bytes) 2024-09-11T05:33:22.990 INFO:teuthology.orchestra.run.smithi070.stdout:2381 write 0xa117369 thru 0xa123bec (0xc884 bytes) 2024-09-11T05:33:22.993 INFO:teuthology.orchestra.run.smithi070.stdout:2382 read 0x544e6a9 thru 0x545b96e (0xd2c6 bytes) 2024-09-11T05:33:22.994 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:22.994 INFO:teuthology.orchestra.run.smithi070.stdout:2385 read 0x5836719 thru 0x584124d (0xab35 bytes) 2024-09-11T05:33:22.994 INFO:teuthology.orchestra.run.smithi070.stdout:2386 writesame 0x789b6dd thru 0x78a8f3d data_size 0x1(0xd861 bytes) 2024-09-11T05:33:23.024 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:23.023+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:23.036 INFO:teuthology.orchestra.run.smithi070.stdout:2388 punch from 0xa23be96 to 0xa244de8, (0x8f52 bytes) 2024-09-11T05:33:23.036 INFO:teuthology.orchestra.run.smithi070.stdout:2389 write 0x4cd49ca thru 0x4ce4018 (0xf64f bytes) 2024-09-11T05:33:23.039 INFO:teuthology.orchestra.run.smithi070.stdout:2391 read 0xb2ae268 thru 0xb2baba5 (0xc93e bytes) 2024-09-11T05:33:23.039 INFO:teuthology.orchestra.run.smithi070.stdout:2392 read 0x32472c9 thru 0x325166c (0xa3a4 bytes) 2024-09-11T05:33:23.054 INFO:teuthology.orchestra.run.smithi070.stdout:2393 trunc from 0xcc16633 to 0x15809f1 2024-09-11T05:33:23.082 INFO:teuthology.orchestra.run.smithi070.stdout:2394 writesame 0x9030931 thru 0x9032ba1 data_size 0x1(0x2271 bytes) 2024-09-11T05:33:23.087 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:23.087 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:23.090 INFO:teuthology.orchestra.run.smithi070.stdout:2396 trunc from 0x9032ba2 to 0x3063362 2024-09-11T05:33:23.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:23.108 INFO:teuthology.orchestra.run.smithi070.stdout:2397 trunc from 0x3063362 to 0xbc367f3 2024-09-11T05:33:23.113 INFO:teuthology.orchestra.run.smithi070.stdout:2398 read 0x10ec145 thru 0x10ee42c (0x22e8 bytes) 2024-09-11T05:33:23.113 INFO:teuthology.orchestra.run.smithi070.stdout:2400 read 0xa89e678 thru 0xa8aac83 (0xc60c bytes) 2024-09-11T05:33:23.121 INFO:teuthology.orchestra.run.smithi070.stdout:2403 write 0xd91c0a1 thru 0xd921db6 (0x5d16 bytes) 2024-09-11T05:33:23.124 INFO:teuthology.orchestra.run.smithi070.stdout:2404 write 0x898405e thru 0x8985626 (0x15c9 bytes) 2024-09-11T05:33:23.124 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:23.124+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:23.125 INFO:teuthology.orchestra.run.smithi070.stdout:2405 write 0xbfe39e8 thru 0xbfe6ca4 (0x32bd bytes) 2024-09-11T05:33:23.127 INFO:teuthology.orchestra.run.smithi070.stdout:2406 read 0x7634de7 thru 0x76355de (0x7f8 bytes) 2024-09-11T05:33:23.128 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:23.128 INFO:teuthology.orchestra.run.smithi070.stdout:2409 read 0xb0061e9 thru 0xb00d8a7 (0x76bf bytes) 2024-09-11T05:33:23.128 INFO:teuthology.orchestra.run.smithi070.stdout:2410 write 0xfad36e thru 0xfafd97 (0x2a2a bytes) 2024-09-11T05:33:23.130 INFO:teuthology.orchestra.run.smithi070.stdout:2413 read 0xa0917b1 thru 0xa09ada4 (0x95f4 bytes) 2024-09-11T05:33:23.130 INFO:teuthology.orchestra.run.smithi070.stdout:2414 punch from 0x58efd70 to 0x58fbb94, (0xbe24 bytes) 2024-09-11T05:33:23.130 INFO:teuthology.orchestra.run.smithi070.stdout:2416 punch from 0x6569899 to 0x6571874, (0x7fdb bytes) 2024-09-11T05:33:23.130 INFO:teuthology.orchestra.run.smithi070.stdout:2418 read 0xbf4e6c9 thru 0xbf5aeb9 (0xc7f1 bytes) 2024-09-11T05:33:23.130 INFO:teuthology.orchestra.run.smithi070.stdout:2419 punch from 0xc424d15 to 0xc432eb2, (0xe19d bytes) 2024-09-11T05:33:23.130 INFO:teuthology.orchestra.run.smithi070.stdout:2420 read 0xa8aa99e thru 0xa8b353c (0x8b9f bytes) 2024-09-11T05:33:23.130 INFO:teuthology.orchestra.run.smithi070.stdout:2421 write 0x53d5d25 thru 0x53dacd2 (0x4fae bytes) 2024-09-11T05:33:23.131 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:23.131 INFO:teuthology.orchestra.run.smithi070.stdout:2424 write 0xd81d26e thru 0xd81d78f (0x522 bytes) 2024-09-11T05:33:23.134 INFO:teuthology.orchestra.run.smithi070.stdout:2425 read 0x4eb55a4 thru 0x4ec4789 (0xf1e6 bytes) 2024-09-11T05:33:23.134 INFO:teuthology.orchestra.run.smithi070.stdout:2426 write 0x3799a5b thru 0x379c59c (0x2b42 bytes) 2024-09-11T05:33:23.136 INFO:teuthology.orchestra.run.smithi070.stdout:2427 read 0x684ec53 thru 0x68551e8 (0x6596 bytes) 2024-09-11T05:33:23.136 INFO:teuthology.orchestra.run.smithi070.stdout:2430 write 0x37bf594 thru 0x37c2809 (0x3276 bytes) 2024-09-11T05:33:23.137 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:23.138 INFO:teuthology.orchestra.run.smithi070.stdout:2433 read 0x2ead1f0 thru 0x2eb2ad6 (0x58e7 bytes) 2024-09-11T05:33:23.138 INFO:teuthology.orchestra.run.smithi070.stdout:2434 write 0x5adab38 thru 0x5ae2db0 (0x8279 bytes) 2024-09-11T05:33:23.140 INFO:teuthology.orchestra.run.smithi070.stdout:2436 punch from 0x25a4dd4 to 0x25a7e1f, (0x304b bytes) 2024-09-11T05:33:23.145 INFO:teuthology.orchestra.run.smithi070.stdout:2438 write 0xe7dac79 thru 0xe7dd512 (0x289a bytes) 2024-09-11T05:33:23.148 INFO:teuthology.orchestra.run.smithi070.stdout:2440 read 0x755f4f9 thru 0x756be77 (0xc97f bytes) 2024-09-11T05:33:23.149 INFO:teuthology.orchestra.run.smithi070.stdout:2441 writesame 0xb61661d thru 0xb616cce data_size 0x1(0x6b2 bytes) 2024-09-11T05:33:23.151 INFO:teuthology.orchestra.run.smithi070.stdout:2443 write 0x373f1bd thru 0x3745b85 (0x69c9 bytes) 2024-09-11T05:33:23.153 INFO:teuthology.orchestra.run.smithi070.stdout:2444 read 0x9f58471 thru 0x9f65374 (0xcf04 bytes) 2024-09-11T05:33:23.153 INFO:teuthology.orchestra.run.smithi070.stdout:2445 writesame 0x11b8781 thru 0x11c17df data_size 0x1(0x905f bytes) 2024-09-11T05:33:23.177 INFO:teuthology.orchestra.run.smithi070.stdout:2446 read 0x827ffaa thru 0x828f419 (0xf470 bytes) 2024-09-11T05:33:23.178 INFO:teuthology.orchestra.run.smithi070.stdout:2447 read 0x487fe67 thru 0x4881a51 (0x1beb bytes) 2024-09-11T05:33:23.179 INFO:teuthology.orchestra.run.smithi070.stdout:2448 trunc from 0xe7dd513 to 0xd70d668 2024-09-11T05:33:23.187 INFO:teuthology.orchestra.run.smithi070.stdout:2449 write 0x3a0dd23 thru 0x3a17eb4 (0xa192 bytes) 2024-09-11T05:33:23.190 INFO:teuthology.orchestra.run.smithi070.stdout:2450 write 0xae88a8 thru 0xaf202b (0x9784 bytes) 2024-09-11T05:33:23.192 INFO:teuthology.orchestra.run.smithi070.stdout:2451 write 0x60dde6c thru 0x60e7397 (0x952c bytes) 2024-09-11T05:33:23.193 INFO:teuthology.orchestra.run.smithi070.stdout:2452 writesame 0xc62144b thru 0xc629b9f data_size 0x41(0x8755 bytes) 2024-09-11T05:33:23.195 INFO:teuthology.orchestra.run.smithi070.stdout:2453 read 0x1ac2279 thru 0x1acb479 (0x9201 bytes) 2024-09-11T05:33:23.195 INFO:teuthology.orchestra.run.smithi070.stdout:2454 writesame 0x10974a7 thru 0x10a3244 data_size 0xd(0xbd9e bytes) 2024-09-11T05:33:23.199 INFO:teuthology.orchestra.run.smithi070.stdout:2455 read 0x4769e04 thru 0x4776369 (0xc566 bytes) 2024-09-11T05:33:23.199 INFO:teuthology.orchestra.run.smithi070.stdout:2457 write 0x67315a9 thru 0x673dc97 (0xc6ef bytes) 2024-09-11T05:33:23.201 INFO:teuthology.orchestra.run.smithi070.stdout:2458 read 0x17261bd thru 0x1732a67 (0xc8ab bytes) 2024-09-11T05:33:23.201 INFO:teuthology.orchestra.run.smithi070.stdout:2459 write 0xc6475d3 thru 0xc649681 (0x20af bytes) 2024-09-11T05:33:23.217 INFO:teuthology.orchestra.run.smithi070.stdout:2460 trunc from 0xd70d668 to 0x323903b 2024-09-11T05:33:23.225 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:23.224+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:23.228 INFO:teuthology.orchestra.run.smithi070.stdout:2461 punch from 0x315b361 to 0x3162c25, (0x78c4 bytes) 2024-09-11T05:33:23.228 INFO:teuthology.orchestra.run.smithi070.stdout:2462 read 0x1dd5d6e thru 0x1dd7bb6 (0x1e49 bytes) 2024-09-11T05:33:23.230 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:23.230 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:23.234 INFO:teuthology.orchestra.run.smithi070.stdout:2464 write 0x3ccff26 thru 0x3cdacea (0xadc5 bytes) 2024-09-11T05:33:23.241 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:23.254 INFO:teuthology.orchestra.run.smithi070.stdout:2465 write 0xd7d0177 thru 0xd7d0b14 (0x99e bytes) 2024-09-11T05:33:23.256 INFO:teuthology.orchestra.run.smithi070.stdout:2467 read 0x216fa4d thru 0x217813a (0x86ee bytes) 2024-09-11T05:33:23.256 INFO:teuthology.orchestra.run.smithi070.stdout:2468 clone 17 order 25 su 4194304 sc 12 2024-09-11T05:33:23.326 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:23.325+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:23.356 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:23.356 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:23.364 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:23.448 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:23.448+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:23.454 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:33:23.509 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:23.510 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:23.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:23.563 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:23.563+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:23.576 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:23.577 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:23.594 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:23.594 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:23.610 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:23.610 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:23.627 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36428 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8126464~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.628 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081327+0000", 2024-09-11T05:33:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5444024059999997, 2024-09-11T05:33:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.034980137000000001, 2024-09-11T05:33:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36428 2024-09-11T05:33:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.630 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081327+0000", 2024-09-11T05:33:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081327+0000", 2024-09-11T05:33:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081328+0000", 2024-09-11T05:33:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:33:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081329+0000", 2024-09-11T05:33:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.86e-06 2024-09-11T05:33:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081335+0000", 2024-09-11T05:33:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6289999999999998e-06 2024-09-11T05:33:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081340+0000", 2024-09-11T05:33:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5759999999999999e-06 2024-09-11T05:33:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116075+0000", 2024-09-11T05:33:23.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.034735249000000003 2024-09-11T05:33:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116129+0000", 2024-09-11T05:33:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-11T05:33:23.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116307+0000", 2024-09-11T05:33:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017838700000000001 2024-09-11T05:33:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36429 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8585216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.544384355, 2024-09-11T05:33:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035281438999999998, 2024-09-11T05:33:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36429 2024-09-11T05:33:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081346+0000", 2024-09-11T05:33:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:33:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081348+0000", 2024-09-11T05:33:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:33:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081355+0000", 2024-09-11T05:33:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2230000000000001e-06 2024-09-11T05:33:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081360+0000", 2024-09-11T05:33:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0499999999999999e-06 2024-09-11T05:33:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116334+0000", 2024-09-11T05:33:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.034973889000000001 2024-09-11T05:33:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116410+0000", 2024-09-11T05:33:23.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6001000000000006e-05 2024-09-11T05:33:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116627+0000", 2024-09-11T05:33:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000216956 2024-09-11T05:33:23.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36430 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9437184~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.650 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5442762920000002, 2024-09-11T05:33:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035492782, 2024-09-11T05:33:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.651 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36430 2024-09-11T05:33:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:23.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081454+0000", 2024-09-11T05:33:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.99e-07 2024-09-11T05:33:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081458+0000", 2024-09-11T05:33:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7160000000000001e-06 2024-09-11T05:33:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081468+0000", 2024-09-11T05:33:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9629999999999993e-06 2024-09-11T05:33:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081474+0000", 2024-09-11T05:33:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2060000000000004e-06 2024-09-11T05:33:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116658+0000", 2024-09-11T05:33:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03518454 2024-09-11T05:33:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116734+0000", 2024-09-11T05:33:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5703000000000003e-05 2024-09-11T05:33:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116946+0000", 2024-09-11T05:33:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211955 2024-09-11T05:33:23.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36431 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9895936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5442451669999997, 2024-09-11T05:33:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035819799999999999, 2024-09-11T05:33:23.659 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36431 2024-09-11T05:33:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081485+0000", 2024-09-11T05:33:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:33:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081493+0000", 2024-09-11T05:33:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9629999999999998e-06 2024-09-11T05:33:23.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081500+0000", 2024-09-11T05:33:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7070000000000003e-06 2024-09-11T05:33:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081504+0000", 2024-09-11T05:33:23.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:33:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116993+0000", 2024-09-11T05:33:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035489224 2024-09-11T05:33:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117083+0000", 2024-09-11T05:33:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9560000000000003e-05 2024-09-11T05:33:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117304+0000", 2024-09-11T05:33:23.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221244 2024-09-11T05:33:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36448 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 327680~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5442184650000002, 2024-09-11T05:33:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036143304000000001, 2024-09-11T05:33:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36448 2024-09-11T05:33:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081512+0000", 2024-09-11T05:33:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:33:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081514+0000", 2024-09-11T05:33:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:33:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081520+0000", 2024-09-11T05:33:23.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4269999999999996e-06 2024-09-11T05:33:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081525+0000", 2024-09-11T05:33:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6140000000000002e-06 2024-09-11T05:33:23.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117333+0000", 2024-09-11T05:33:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035808385999999998 2024-09-11T05:33:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117446+0000", 2024-09-11T05:33:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113161 2024-09-11T05:33:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117654+0000", 2024-09-11T05:33:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020835800000000001 2024-09-11T05:33:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36449 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1638400~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5441992369999999, 2024-09-11T05:33:23.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036464895999999997, 2024-09-11T05:33:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.678 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36449 2024-09-11T05:33:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081531+0000", 2024-09-11T05:33:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:33:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081533+0000", 2024-09-11T05:33:23.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8649999999999999e-06 2024-09-11T05:33:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081538+0000", 2024-09-11T05:33:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7769999999999999e-06 2024-09-11T05:33:23.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081543+0000", 2024-09-11T05:33:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4390000000000002e-06 2024-09-11T05:33:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117686+0000", 2024-09-11T05:33:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036142760000000003 2024-09-11T05:33:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117768+0000", 2024-09-11T05:33:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2521000000000005e-05 2024-09-11T05:33:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117995+0000", 2024-09-11T05:33:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022715699999999999 2024-09-11T05:33:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36450 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5441813690000004, 2024-09-11T05:33:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036798323000000001, 2024-09-11T05:33:23.688 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36450 2024-09-11T05:33:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:23.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081549+0000", 2024-09-11T05:33:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1699999999999999e-07 2024-09-11T05:33:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081550+0000", 2024-09-11T05:33:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:33:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081557+0000", 2024-09-11T05:33:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:33:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081561+0000", 2024-09-11T05:33:23.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2880000000000003e-06 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118042+0000", 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036480984000000001 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118142+0000", 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100043 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118347+0000", 2024-09-11T05:33:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020477399999999999 2024-09-11T05:33:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36451 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4259840~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5441635390000004, 2024-09-11T05:33:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037058173, 2024-09-11T05:33:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36451 2024-09-11T05:33:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:23.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:33:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081568+0000", 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081573+0000", 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999998e-06 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081575+0000", 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.605e-06 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118377+0000", 2024-09-11T05:33:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036801831 2024-09-11T05:33:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118459+0000", 2024-09-11T05:33:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1983000000000004e-05 2024-09-11T05:33:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118624+0000", 2024-09-11T05:33:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000165353 2024-09-11T05:33:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36452 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5570560~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.700 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.544151158, 2024-09-11T05:33:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037358132000000002, 2024-09-11T05:33:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36452 2024-09-11T05:33:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081579+0000", 2024-09-11T05:33:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4600000000000001e-07 2024-09-11T05:33:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081580+0000", 2024-09-11T05:33:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T05:33:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081583+0000", 2024-09-11T05:33:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9119999999999998e-06 2024-09-11T05:33:23.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081586+0000", 2024-09-11T05:33:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.371e-06 2024-09-11T05:33:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118666+0000", 2024-09-11T05:33:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037079933000000002 2024-09-11T05:33:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118725+0000", 2024-09-11T05:33:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8600000000000001e-05 2024-09-11T05:33:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118937+0000", 2024-09-11T05:33:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211931 2024-09-11T05:33:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36453 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6881280~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5441405079999999, 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037649803000000003, 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36453 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:23.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T05:33:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081590+0000", 2024-09-11T05:33:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-11T05:33:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081593+0000", 2024-09-11T05:33:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0110000000000001e-06 2024-09-11T05:33:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081596+0000", 2024-09-11T05:33:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7609999999999999e-06 2024-09-11T05:33:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118965+0000", 2024-09-11T05:33:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037368971000000001 2024-09-11T05:33:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119037+0000", 2024-09-11T05:33:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2300999999999998e-05 2024-09-11T05:33:23.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119239+0000", 2024-09-11T05:33:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020146000000000001 2024-09-11T05:33:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36454 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8192000~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5441304520000001, 2024-09-11T05:33:23.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037930403000000001, 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36454 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:23.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081600+0000", 2024-09-11T05:33:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:33:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081603+0000", 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081606+0000", 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4099999999999998e-06 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119274+0000", 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037668407000000001 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119340+0000", 2024-09-11T05:33:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5685000000000006e-05 2024-09-11T05:33:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119530+0000", 2024-09-11T05:33:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000189688 2024-09-11T05:33:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36455 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9502720~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5441203029999997, 2024-09-11T05:33:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038210565000000002, 2024-09-11T05:33:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36455 2024-09-11T05:33:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081610+0000", 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081611+0000", 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0279999999999999e-06 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081613+0000", 2024-09-11T05:33:23.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8430000000000001e-06 2024-09-11T05:33:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081616+0000", 2024-09-11T05:33:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6350000000000002e-06 2024-09-11T05:33:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119555+0000", 2024-09-11T05:33:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037939252999999999 2024-09-11T05:33:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119629+0000", 2024-09-11T05:33:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3868999999999994e-05 2024-09-11T05:33:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119820+0000", 2024-09-11T05:33:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190724 2024-09-11T05:33:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.720 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36480 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 393216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5441107379999996, 2024-09-11T05:33:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039217429999999998, 2024-09-11T05:33:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36480 2024-09-11T05:33:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:23.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081620+0000", 2024-09-11T05:33:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4900000000000004e-07 2024-09-11T05:33:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081624+0000", 2024-09-11T05:33:23.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:33:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081627+0000", 2024-09-11T05:33:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6520000000000002e-06 2024-09-11T05:33:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119851+0000", 2024-09-11T05:33:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038224209000000002 2024-09-11T05:33:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120518+0000", 2024-09-11T05:33:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066708900000000005 2024-09-11T05:33:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120836+0000", 2024-09-11T05:33:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031833300000000002 2024-09-11T05:33:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36481 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1703936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5440998510000004, 2024-09-11T05:33:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039545442, 2024-09-11T05:33:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36481 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081631+0000", 2024-09-11T05:33:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0839999999999999e-06 2024-09-11T05:33:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081635+0000", 2024-09-11T05:33:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.743e-06 2024-09-11T05:33:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081637+0000", 2024-09-11T05:33:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.661e-06 2024-09-11T05:33:23.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120887+0000", 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039249876000000003 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120968+0000", 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0253999999999994e-05 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121175+0000", 2024-09-11T05:33:23.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020761099999999999 2024-09-11T05:33:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36482 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 3014656~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5440892899999996, 2024-09-11T05:33:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040344708999999999, 2024-09-11T05:33:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36482 2024-09-11T05:33:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081641+0000", 2024-09-11T05:33:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081647+0000", 2024-09-11T05:33:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:33:23.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081651+0000", 2024-09-11T05:33:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2080000000000002e-06 2024-09-11T05:33:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081654+0000", 2024-09-11T05:33:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:33:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121203+0000", 2024-09-11T05:33:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039549466999999998 2024-09-11T05:33:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121267+0000", 2024-09-11T05:33:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3713999999999993e-05 2024-09-11T05:33:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121985+0000", 2024-09-11T05:33:23.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071827299999999996 2024-09-11T05:33:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36483 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4325376~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.544072731, 2024-09-11T05:33:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040925571000000001, 2024-09-11T05:33:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36483 2024-09-11T05:33:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081661+0000", 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.296e-06 2024-09-11T05:33:23.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081665+0000", 2024-09-11T05:33:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9269999999999998e-06 2024-09-11T05:33:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081668+0000", 2024-09-11T05:33:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.615e-06 2024-09-11T05:33:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122019+0000", 2024-09-11T05:33:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040350886000000002 2024-09-11T05:33:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122108+0000", 2024-09-11T05:33:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8671000000000005e-05 2024-09-11T05:33:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122582+0000", 2024-09-11T05:33:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047494900000000001 2024-09-11T05:33:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36484 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5636096~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5440583029999999, 2024-09-11T05:33:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041537567999999997, 2024-09-11T05:33:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36484 2024-09-11T05:33:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081672+0000", 2024-09-11T05:33:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-07 2024-09-11T05:33:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081673+0000", 2024-09-11T05:33:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.212e-06 2024-09-11T05:33:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081676+0000", 2024-09-11T05:33:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6940000000000001e-06 2024-09-11T05:33:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081679+0000", 2024-09-11T05:33:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8260000000000001e-06 2024-09-11T05:33:23.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122615+0000", 2024-09-11T05:33:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040935421999999999 2024-09-11T05:33:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122892+0000", 2024-09-11T05:33:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027731099999999997 2024-09-11T05:33:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123209+0000", 2024-09-11T05:33:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000316872 2024-09-11T05:33:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36485 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6946816~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5440460930000004, 2024-09-11T05:33:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041869008999999999, 2024-09-11T05:33:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.751 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36485 2024-09-11T05:33:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:33:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081685+0000", 2024-09-11T05:33:23.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029e-06 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081689+0000", 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0709999999999996e-06 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081692+0000", 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389999999999999e-06 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123245+0000", 2024-09-11T05:33:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041553759000000003 2024-09-11T05:33:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123331+0000", 2024-09-11T05:33:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5885999999999997e-05 2024-09-11T05:33:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123553+0000", 2024-09-11T05:33:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022129499999999999 2024-09-11T05:33:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.755 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36486 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8257536~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.544035075, 2024-09-11T05:33:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042204617999999999, 2024-09-11T05:33:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36486 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081698+0000", 2024-09-11T05:33:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6490000000000001e-06 2024-09-11T05:33:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081702+0000", 2024-09-11T05:33:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7249999999999999e-06 2024-09-11T05:33:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081705+0000", 2024-09-11T05:33:23.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7379999999999999e-06 2024-09-11T05:33:23.760 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123583+0000", 2024-09-11T05:33:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041878604999999999 2024-09-11T05:33:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123666+0000", 2024-09-11T05:33:23.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2027000000000006e-05 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123899+0000", 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000233663 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36487 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9568256~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5440219009999998, 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043010712999999999, 2024-09-11T05:33:23.762 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36487 2024-09-11T05:33:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:23.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.16e-07 2024-09-11T05:33:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081709+0000", 2024-09-11T05:33:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2100000000000001e-06 2024-09-11T05:33:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081713+0000", 2024-09-11T05:33:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.811e-06 2024-09-11T05:33:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081716+0000", 2024-09-11T05:33:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.112e-06 2024-09-11T05:33:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123961+0000", 2024-09-11T05:33:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042244482999999999 2024-09-11T05:33:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124043+0000", 2024-09-11T05:33:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2066999999999999e-05 2024-09-11T05:33:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124718+0000", 2024-09-11T05:33:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067581399999999995 2024-09-11T05:33:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.767 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.768 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.768 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:23.768 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:23.769 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:23.769 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:23.770 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:23.770 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:23.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:33:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:23.803 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:23.802+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:23.811 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone16 from 0xd7d0b15 (overlap 0x47e77) to 0x15923 2024-09-11T05:33:23.840 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:33:23.840 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T05:33:23.872 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:23.871+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:23.923 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-11T05:33:23.923 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:41892 3.5 3:a0293753:::rbd_header.112d8f01d5d:head [watch watch cookie 140342687656960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-11T05:33:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:23.921893+0000", 2024-09-11T05:33:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0013425749999999999, 2024-09-11T05:33:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001370011, 2024-09-11T05:33:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 41892 2024-09-11T05:33:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.921893+0000", 2024-09-11T05:33:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.921893+0000", 2024-09-11T05:33:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.921894+0000", 2024-09-11T05:33:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6600000000000005e-07 2024-09-11T05:33:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.921898+0000", 2024-09-11T05:33:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-11T05:33:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.921908+0000", 2024-09-11T05:33:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.859e-06 2024-09-11T05:33:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.921913+0000", 2024-09-11T05:33:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:33:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.921957+0000", 2024-09-11T05:33:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4498e-05 2024-09-11T05:33:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.922023+0000", 2024-09-11T05:33:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6370000000000003e-05 2024-09-11T05:33:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.922156+0000", 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132476 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.922842+0000", 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00068580300000000002 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.923190+0000", 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034853800000000002 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.923246+0000", 2024-09-11T05:33:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5547000000000002e-05 2024-09-11T05:33:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4397.0:41892 3.5 e43/22 ondisk, result = 0)", 2024-09-11T05:33:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:23.923110+0000", 2024-09-11T05:33:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00012546500000000001, 2024-09-11T05:33:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025725299999999998, 2024-09-11T05:33:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.923110+0000", 2024-09-11T05:33:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.923110+0000", 2024-09-11T05:33:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.923111+0000", 2024-09-11T05:33:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5900000000000005e-07 2024-09-11T05:33:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.923116+0000", 2024-09-11T05:33:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8289999999999998e-06 2024-09-11T05:33:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.923128+0000", 2024-09-11T05:33:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1832e-05 2024-09-11T05:33:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.923135+0000", 2024-09-11T05:33:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.917e-06 2024-09-11T05:33:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.923177+0000", 2024-09-11T05:33:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2107999999999997e-05 2024-09-11T05:33:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.923185+0000", 2024-09-11T05:33:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9999999999999996e-06 2024-09-11T05:33:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:23.923371+0000", 2024-09-11T05:33:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018660700000000001 2024-09-11T05:33:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 2 2024-09-11T05:33:23.935 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:23.936 INFO:teuthology.orchestra.run.smithi070.stdout:2469 write 0x19ced44 thru 0x19d5a64 (0x6d21 bytes) 2024-09-11T05:33:23.936 INFO:teuthology.orchestra.run.smithi070.stdout:2472 writesame 0x9968697 thru 0x996db1c data_size 0x2(0x5486 bytes) 2024-09-11T05:33:23.937 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:23.944 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:23.946 INFO:teuthology.orchestra.run.smithi070.stdout:2474 trunc from 0xd7d0b15 to 0xbba47ac 2024-09-11T05:33:23.973 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:23.973+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:23.974 INFO:teuthology.orchestra.run.smithi070.stdout:2476 trunc from 0xbba47ac to 0x93cf80d 2024-09-11T05:33:23.992 INFO:teuthology.orchestra.run.smithi070.stdout:2477 trunc from 0x93cf80d to 0x89e631b 2024-09-11T05:33:24.000 INFO:teuthology.orchestra.run.smithi070.stdout:2479 punch from 0x7863f39 to 0x78687a3, (0x486a bytes) 2024-09-11T05:33:24.007 INFO:teuthology.orchestra.run.smithi070.stdout:2481 trunc from 0x89e631b to 0x35c1e8e 2024-09-11T05:33:24.016 INFO:teuthology.orchestra.run.smithi070.stdout:2482 read 0x9603e5 thru 0x961c51 (0x186d bytes) 2024-09-11T05:33:24.029 INFO:teuthology.orchestra.run.smithi070.stdout:2485 write 0x8ba54f6 thru 0x8ba91e5 (0x3cf0 bytes) 2024-09-11T05:33:24.031 INFO:teuthology.orchestra.run.smithi070.stdout:2486 read 0x5a2c6ff thru 0x5a32dae (0x66b0 bytes) 2024-09-11T05:33:24.031 INFO:teuthology.orchestra.run.smithi070.stdout:2487 punch from 0x53b35e6 to 0x53c0bd0, (0xd5ea bytes) 2024-09-11T05:33:24.033 INFO:teuthology.orchestra.run.smithi070.stdout:2489 trunc from 0x8ba91e6 to 0x79f96c3 2024-09-11T05:33:24.051 INFO:teuthology.orchestra.run.smithi070.stdout:2492 write 0xae10e3f thru 0xae1b118 (0xa2da bytes) 2024-09-11T05:33:24.056 INFO:teuthology.orchestra.run.smithi070.stdout:2493 trunc from 0xae1b119 to 0x7df7059 2024-09-11T05:33:24.064 INFO:teuthology.orchestra.run.smithi070.stdout:2494 punch from 0x4bca9a3 to 0x4bd806c, (0xd6c9 bytes) 2024-09-11T05:33:24.065 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:24.065 INFO:teuthology.orchestra.run.smithi070.stdout:2496 writesame 0x8445d0 thru 0x850c38 data_size 0x1(0xc669 bytes) 2024-09-11T05:33:24.074 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:24.073+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:24.081 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:24.081 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:24.091 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:24.093 INFO:teuthology.orchestra.run.smithi070.stdout:2497 write 0xcc8f00 thru 0xcce707 (0x5808 bytes) 2024-09-11T05:33:24.104 INFO:teuthology.orchestra.run.smithi070.stdout:2498 write 0x950a9de thru 0x9511bdc (0x71ff bytes) 2024-09-11T05:33:24.105 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:24.106 INFO:teuthology.orchestra.run.smithi070.stdout:2500 read 0x8ea50f2 thru 0x8ea615e (0x106d bytes) 2024-09-11T05:33:24.106 INFO:teuthology.orchestra.run.smithi070.stdout:2501 write 0x779b28a thru 0x77a2374 (0x70eb bytes) 2024-09-11T05:33:24.107 INFO:teuthology.orchestra.run.smithi070.stdout:2502 read 0x6cb8e23 thru 0x6cbdf53 (0x5131 bytes) 2024-09-11T05:33:24.108 INFO:teuthology.orchestra.run.smithi070.stdout:2503 read 0x7ed5894 thru 0x7edf3de (0x9b4b bytes) 2024-09-11T05:33:24.109 INFO:teuthology.orchestra.run.smithi070.stdout:2504 punch from 0x72a8de to 0x72c63c, (0x1d5e bytes) 2024-09-11T05:33:24.109 INFO:teuthology.orchestra.run.smithi070.stdout:2505 read 0x3ca3b24 thru 0x3cb277a (0xec57 bytes) 2024-09-11T05:33:24.109 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:24.109 INFO:teuthology.orchestra.run.smithi070.stdout:2508 read 0x6b4776b thru 0x6b48ad2 (0x1368 bytes) 2024-09-11T05:33:24.109 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:24.110 INFO:teuthology.orchestra.run.smithi070.stdout:2510 write 0x69766a9 thru 0x6978a02 (0x235a bytes) 2024-09-11T05:33:24.111 INFO:teuthology.orchestra.run.smithi070.stdout:2512 write 0x60734a5 thru 0x607a93c (0x7498 bytes) 2024-09-11T05:33:24.112 INFO:teuthology.orchestra.run.smithi070.stdout:2513 clone 18 order 20 su 8192 sc 6 2024-09-11T05:33:24.175 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:24.174+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:24.202 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15700 3.e 3:708278bf:::rbd_data.112d745a9e91.0000000000000028:a [read 778240~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.219250+0000", 2024-09-11T05:33:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.980997428, 2024-09-11T05:33:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016315105999999999, 2024-09-11T05:33:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15700 2024-09-11T05:33:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.219250+0000", 2024-09-11T05:33:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.219250+0000", 2024-09-11T05:33:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.219250+0000", 2024-09-11T05:33:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:33:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.219252+0000", 2024-09-11T05:33:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.753e-06 2024-09-11T05:33:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.219258+0000", 2024-09-11T05:33:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6629999999999998e-06 2024-09-11T05:33:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.219262+0000", 2024-09-11T05:33:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:33:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.235401+0000", 2024-09-11T05:33:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016139137000000001 2024-09-11T05:33:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.235478+0000", 2024-09-11T05:33:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6829000000000006e-05 2024-09-11T05:33:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.235565+0000", 2024-09-11T05:33:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6794999999999998e-05 2024-09-11T05:33:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16456 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 933888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301812+0000", 2024-09-11T05:33:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898435844, 2024-09-11T05:33:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016167119000000001, 2024-09-11T05:33:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16456 2024-09-11T05:33:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301812+0000", 2024-09-11T05:33:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301812+0000", 2024-09-11T05:33:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301812+0000", 2024-09-11T05:33:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T05:33:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301814+0000", 2024-09-11T05:33:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:33:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301820+0000", 2024-09-11T05:33:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5809999999999996e-06 2024-09-11T05:33:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301824+0000", 2024-09-11T05:33:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T05:33:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317842+0000", 2024-09-11T05:33:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016018066000000001 2024-09-11T05:33:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317908+0000", 2024-09-11T05:33:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5263000000000002e-05 2024-09-11T05:33:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317979+0000", 2024-09-11T05:33:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0994000000000005e-05 2024-09-11T05:33:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16457 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301830+0000", 2024-09-11T05:33:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.89841753, 2024-09-11T05:33:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016281285999999999, 2024-09-11T05:33:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16457 2024-09-11T05:33:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301830+0000", 2024-09-11T05:33:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301830+0000", 2024-09-11T05:33:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301830+0000", 2024-09-11T05:33:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9700000000000003e-07 2024-09-11T05:33:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301832+0000", 2024-09-11T05:33:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8309999999999999e-06 2024-09-11T05:33:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301838+0000", 2024-09-11T05:33:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9200000000000001e-06 2024-09-11T05:33:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301843+0000", 2024-09-11T05:33:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.617e-06 2024-09-11T05:33:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318000+0000", 2024-09-11T05:33:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016157292 2024-09-11T05:33:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318061+0000", 2024-09-11T05:33:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1181999999999998e-05 2024-09-11T05:33:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318111+0000", 2024-09-11T05:33:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0146999999999999e-05 2024-09-11T05:33:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16458 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 1032192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301848+0000", 2024-09-11T05:33:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898399496, 2024-09-11T05:33:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016400989000000001, 2024-09-11T05:33:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16458 2024-09-11T05:33:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301848+0000", 2024-09-11T05:33:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301848+0000", 2024-09-11T05:33:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301848+0000", 2024-09-11T05:33:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:33:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301854+0000", 2024-09-11T05:33:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.19e-06 2024-09-11T05:33:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301861+0000", 2024-09-11T05:33:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2110000000000003e-06 2024-09-11T05:33:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301865+0000", 2024-09-11T05:33:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6489999999999999e-06 2024-09-11T05:33:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318139+0000", 2024-09-11T05:33:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016273194000000001 2024-09-11T05:33:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318199+0000", 2024-09-11T05:33:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0075999999999999e-05 2024-09-11T05:33:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318249+0000", 2024-09-11T05:33:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0284000000000002e-05 2024-09-11T05:33:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16523 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 303104~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301871+0000", 2024-09-11T05:33:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898376104, 2024-09-11T05:33:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016617435, 2024-09-11T05:33:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16523 2024-09-11T05:33:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301871+0000", 2024-09-11T05:33:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301871+0000", 2024-09-11T05:33:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301872+0000", 2024-09-11T05:33:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:33:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301874+0000", 2024-09-11T05:33:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.74e-06 2024-09-11T05:33:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301880+0000", 2024-09-11T05:33:24.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9499999999999998e-06 2024-09-11T05:33:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301885+0000", 2024-09-11T05:33:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5480000000000003e-06 2024-09-11T05:33:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318308+0000", 2024-09-11T05:33:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016423132999999999 2024-09-11T05:33:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318382+0000", 2024-09-11T05:33:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4395999999999997e-05 2024-09-11T05:33:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318489+0000", 2024-09-11T05:33:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106276 2024-09-11T05:33:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.231 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16524 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 352256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301891+0000", 2024-09-11T05:33:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898356752, 2024-09-11T05:33:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016800582000000001, 2024-09-11T05:33:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.232 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16524 2024-09-11T05:33:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301891+0000", 2024-09-11T05:33:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301891+0000", 2024-09-11T05:33:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301891+0000", 2024-09-11T05:33:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0499999999999999e-07 2024-09-11T05:33:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301893+0000", 2024-09-11T05:33:24.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-06 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301899+0000", 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7760000000000003e-06 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301903+0000", 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4100000000000001e-06 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318520+0000", 2024-09-11T05:33:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016616481999999998 2024-09-11T05:33:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318597+0000", 2024-09-11T05:33:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7463e-05 2024-09-11T05:33:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318691+0000", 2024-09-11T05:33:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4191000000000007e-05 2024-09-11T05:33:24.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16525 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 401408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301909+0000", 2024-09-11T05:33:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898338816999999, 2024-09-11T05:33:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016990318000000001, 2024-09-11T05:33:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16525 2024-09-11T05:33:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301909+0000", 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301909+0000", 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301909+0000", 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.15e-07 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301911+0000", 2024-09-11T05:33:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8059999999999999e-06 2024-09-11T05:33:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301917+0000", 2024-09-11T05:33:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8109999999999999e-06 2024-09-11T05:33:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301921+0000", 2024-09-11T05:33:24.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T05:33:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318739+0000", 2024-09-11T05:33:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016817444000000001 2024-09-11T05:33:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318811+0000", 2024-09-11T05:33:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2485999999999997e-05 2024-09-11T05:33:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318899+0000", 2024-09-11T05:33:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7699000000000002e-05 2024-09-11T05:33:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16526 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 450560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301927+0000", 2024-09-11T05:33:24.242 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898320563, 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017138119, 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16526 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301927+0000", 2024-09-11T05:33:24.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301927+0000", 2024-09-11T05:33:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301927+0000", 2024-09-11T05:33:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:33:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301929+0000", 2024-09-11T05:33:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.787e-06 2024-09-11T05:33:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301934+0000", 2024-09-11T05:33:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3650000000000003e-06 2024-09-11T05:33:24.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301939+0000", 2024-09-11T05:33:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3549999999999998e-06 2024-09-11T05:33:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318926+0000", 2024-09-11T05:33:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016987209 2024-09-11T05:33:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318989+0000", 2024-09-11T05:33:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3429000000000005e-05 2024-09-11T05:33:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319065+0000", 2024-09-11T05:33:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5629000000000004e-05 2024-09-11T05:33:24.248 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16527 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 499712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301944+0000", 2024-09-11T05:33:24.249 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898303177000001, 2024-09-11T05:33:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017273228000000002, 2024-09-11T05:33:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.250 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16527 2024-09-11T05:33:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301944+0000", 2024-09-11T05:33:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301944+0000", 2024-09-11T05:33:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301945+0000", 2024-09-11T05:33:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T05:33:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301946+0000", 2024-09-11T05:33:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8160000000000001e-06 2024-09-11T05:33:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301952+0000", 2024-09-11T05:33:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2800000000000003e-06 2024-09-11T05:33:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301956+0000", 2024-09-11T05:33:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8330000000000001e-06 2024-09-11T05:33:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319092+0000", 2024-09-11T05:33:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017135923000000001 2024-09-11T05:33:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319152+0000", 2024-09-11T05:33:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9317999999999997e-05 2024-09-11T05:33:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319217+0000", 2024-09-11T05:33:24.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5748999999999997e-05 2024-09-11T05:33:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16528 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 548864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.257 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301962+0000", 2024-09-11T05:33:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898285147999999, 2024-09-11T05:33:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017386748, 2024-09-11T05:33:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16528 2024-09-11T05:33:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301962+0000", 2024-09-11T05:33:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301962+0000", 2024-09-11T05:33:24.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301963+0000", 2024-09-11T05:33:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:33:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301965+0000", 2024-09-11T05:33:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967e-06 2024-09-11T05:33:24.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301970+0000", 2024-09-11T05:33:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6810000000000003e-06 2024-09-11T05:33:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301975+0000", 2024-09-11T05:33:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T05:33:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319233+0000", 2024-09-11T05:33:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017258796 2024-09-11T05:33:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319269+0000", 2024-09-11T05:33:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5970999999999998e-05 2024-09-11T05:33:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319349+0000", 2024-09-11T05:33:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9541000000000003e-05 2024-09-11T05:33:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16529 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 598016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301980+0000", 2024-09-11T05:33:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898267389000001, 2024-09-11T05:33:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017539612999999999, 2024-09-11T05:33:24.263 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16529 2024-09-11T05:33:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301980+0000", 2024-09-11T05:33:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301980+0000", 2024-09-11T05:33:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301980+0000", 2024-09-11T05:33:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8000000000000002e-07 2024-09-11T05:33:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301982+0000", 2024-09-11T05:33:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7460000000000001e-06 2024-09-11T05:33:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301987+0000", 2024-09-11T05:33:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4079999999999997e-06 2024-09-11T05:33:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301992+0000", 2024-09-11T05:33:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5900000000000001e-06 2024-09-11T05:33:24.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319375+0000", 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017383322 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319439+0000", 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3888999999999998e-05 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319520+0000", 2024-09-11T05:33:24.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0377999999999995e-05 2024-09-11T05:33:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16530 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 647168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.301997+0000", 2024-09-11T05:33:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898250195999999, 2024-09-11T05:33:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017710232999999999, 2024-09-11T05:33:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16530 2024-09-11T05:33:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301997+0000", 2024-09-11T05:33:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301997+0000", 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301997+0000", 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2300000000000002e-07 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.301999+0000", 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.838e-06 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302005+0000", 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6579999999999999e-06 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302009+0000", 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2740000000000001e-06 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319547+0000", 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017538212000000001 2024-09-11T05:33:24.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319622+0000", 2024-09-11T05:33:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4602000000000002e-05 2024-09-11T05:33:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319707+0000", 2024-09-11T05:33:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5326000000000003e-05 2024-09-11T05:33:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16531 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 696320~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302016+0000", 2024-09-11T05:33:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898230944, 2024-09-11T05:33:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017831955, 2024-09-11T05:33:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16531 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302016+0000", 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302016+0000", 2024-09-11T05:33:24.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302017+0000", 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302019+0000", 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8300000000000001e-06 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302025+0000", 2024-09-11T05:33:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:33:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302029+0000", 2024-09-11T05:33:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.527e-06 2024-09-11T05:33:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319726+0000", 2024-09-11T05:33:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017697389000000001 2024-09-11T05:33:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319784+0000", 2024-09-11T05:33:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7198999999999999e-05 2024-09-11T05:33:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319848+0000", 2024-09-11T05:33:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4752000000000006e-05 2024-09-11T05:33:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16532 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 745472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302034+0000", 2024-09-11T05:33:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898212958, 2024-09-11T05:33:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018061543999999999, 2024-09-11T05:33:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16532 2024-09-11T05:33:24.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302034+0000", 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302034+0000", 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302035+0000", 2024-09-11T05:33:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6199999999999999e-07 2024-09-11T05:33:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302037+0000", 2024-09-11T05:33:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.781e-06 2024-09-11T05:33:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302042+0000", 2024-09-11T05:33:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6060000000000002e-06 2024-09-11T05:33:24.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302047+0000", 2024-09-11T05:33:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-11T05:33:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319877+0000", 2024-09-11T05:33:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017830141000000001 2024-09-11T05:33:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319946+0000", 2024-09-11T05:33:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9715999999999995e-05 2024-09-11T05:33:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320096+0000", 2024-09-11T05:33:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000149476 2024-09-11T05:33:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16533 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 794624~2805] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302052+0000", 2024-09-11T05:33:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898195248, 2024-09-11T05:33:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018267938000000001, 2024-09-11T05:33:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.283 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16533 2024-09-11T05:33:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302052+0000", 2024-09-11T05:33:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302052+0000", 2024-09-11T05:33:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302052+0000", 2024-09-11T05:33:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:33:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302054+0000", 2024-09-11T05:33:24.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7090000000000001e-06 2024-09-11T05:33:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302060+0000", 2024-09-11T05:33:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9089999999999997e-06 2024-09-11T05:33:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302065+0000", 2024-09-11T05:33:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4739999999999999e-06 2024-09-11T05:33:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320137+0000", 2024-09-11T05:33:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018072263000000002 2024-09-11T05:33:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320186+0000", 2024-09-11T05:33:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8687999999999999e-05 2024-09-11T05:33:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320320+0000", 2024-09-11T05:33:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013455699999999999 2024-09-11T05:33:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16534 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 843776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302070+0000", 2024-09-11T05:33:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898177469, 2024-09-11T05:33:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018477103000000002, 2024-09-11T05:33:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16534 2024-09-11T05:33:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302070+0000", 2024-09-11T05:33:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302070+0000", 2024-09-11T05:33:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302070+0000", 2024-09-11T05:33:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.79e-07 2024-09-11T05:33:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302077+0000", 2024-09-11T05:33:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7399999999999998e-06 2024-09-11T05:33:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302083+0000", 2024-09-11T05:33:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9349999999999999e-06 2024-09-11T05:33:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302088+0000", 2024-09-11T05:33:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T05:33:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320392+0000", 2024-09-11T05:33:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018304388000000001 2024-09-11T05:33:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320472+0000", 2024-09-11T05:33:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9808000000000006e-05 2024-09-11T05:33:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320547+0000", 2024-09-11T05:33:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5174999999999998e-05 2024-09-11T05:33:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16535 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 892928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302094+0000", 2024-09-11T05:33:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898153366000001, 2024-09-11T05:33:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018647352999999998, 2024-09-11T05:33:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16535 2024-09-11T05:33:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302094+0000", 2024-09-11T05:33:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302094+0000", 2024-09-11T05:33:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302094+0000", 2024-09-11T05:33:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:33:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302096+0000", 2024-09-11T05:33:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7969999999999999e-06 2024-09-11T05:33:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302102+0000", 2024-09-11T05:33:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4960000000000004e-06 2024-09-11T05:33:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302106+0000", 2024-09-11T05:33:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3640000000000001e-06 2024-09-11T05:33:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320588+0000", 2024-09-11T05:33:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018481897000000001 2024-09-11T05:33:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320666+0000", 2024-09-11T05:33:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8436999999999995e-05 2024-09-11T05:33:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320741+0000", 2024-09-11T05:33:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4988999999999996e-05 2024-09-11T05:33:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16536 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 942080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302112+0000", 2024-09-11T05:33:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898135738000001, 2024-09-11T05:33:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018820859999999998, 2024-09-11T05:33:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16536 2024-09-11T05:33:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302112+0000", 2024-09-11T05:33:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302112+0000", 2024-09-11T05:33:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302112+0000", 2024-09-11T05:33:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:33:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302114+0000", 2024-09-11T05:33:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8500000000000001e-06 2024-09-11T05:33:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302120+0000", 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6529999999999997e-06 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302126+0000", 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5949999999999998e-06 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320782+0000", 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018656244999999998 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320864+0000", 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1317999999999996e-05 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.320932+0000", 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8847e-05 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.303 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16537 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 991232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302132+0000", 2024-09-11T05:33:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898115033, 2024-09-11T05:33:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019069421, 2024-09-11T05:33:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16537 2024-09-11T05:33:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302132+0000", 2024-09-11T05:33:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302132+0000", 2024-09-11T05:33:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302133+0000", 2024-09-11T05:33:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:33:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302135+0000", 2024-09-11T05:33:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9690000000000001e-06 2024-09-11T05:33:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302140+0000", 2024-09-11T05:33:24.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7930000000000003e-06 2024-09-11T05:33:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302145+0000", 2024-09-11T05:33:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T05:33:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.321071+0000", 2024-09-11T05:33:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018925833999999999 2024-09-11T05:33:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.321149+0000", 2024-09-11T05:33:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8065999999999994e-05 2024-09-11T05:33:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.321202+0000", 2024-09-11T05:33:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.304e-05 2024-09-11T05:33:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.308 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16538 3.e 3:75e385fd:::rbd_data.112d745a9e91.0000000000000018:a [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.302150+0000", 2024-09-11T05:33:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.898096932, 2024-09-11T05:33:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019236584000000001, 2024-09-11T05:33:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16538 2024-09-11T05:33:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302150+0000", 2024-09-11T05:33:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302150+0000", 2024-09-11T05:33:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302151+0000", 2024-09-11T05:33:24.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.15e-07 2024-09-11T05:33:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302152+0000", 2024-09-11T05:33:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.694e-06 2024-09-11T05:33:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302158+0000", 2024-09-11T05:33:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8189999999999997e-06 2024-09-11T05:33:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.302163+0000", 2024-09-11T05:33:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-09-11T05:33:24.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.321238+0000", 2024-09-11T05:33:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019075147000000001 2024-09-11T05:33:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.321314+0000", 2024-09-11T05:33:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6235000000000004e-05 2024-09-11T05:33:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.321387+0000", 2024-09-11T05:33:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2948999999999996e-05 2024-09-11T05:33:24.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.315 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.315 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:24.317 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:24.318 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:24.316+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:24.418 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:24.417+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:24.461 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:24.461 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:24.469 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:24.519 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:24.518+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:24.572 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:24.572 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:24.580 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:24.620 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:24.620+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:24.685 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:33:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:24.685 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.092499257999997, 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:33:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:33:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:33:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:33:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:33:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:33:24.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:33:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:33:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:33:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:33:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:24.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:33:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:33:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:33:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:33:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:33:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:33:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15473 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 622592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211486+0000", 2024-09-11T05:33:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.471265762, 2024-09-11T05:33:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018155910000000001, 2024-09-11T05:33:24.691 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15473 2024-09-11T05:33:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211486+0000", 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211486+0000", 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211487+0000", 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.96e-07 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211489+0000", 2024-09-11T05:33:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.764e-06 2024-09-11T05:33:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211494+0000", 2024-09-11T05:33:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7950000000000004e-06 2024-09-11T05:33:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211499+0000", 2024-09-11T05:33:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4950000000000002e-06 2024-09-11T05:33:24.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229095+0000", 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017596527000000001 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229150+0000", 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4580000000000003e-05 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229642+0000", 2024-09-11T05:33:24.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049235299999999995 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15474 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 671744~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211505+0000", 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.471246768, 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01840586, 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15474 2024-09-11T05:33:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211505+0000", 2024-09-11T05:33:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211505+0000", 2024-09-11T05:33:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211506+0000", 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9900000000000001e-07 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211507+0000", 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.624e-06 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211514+0000", 2024-09-11T05:33:24.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211525+0000", 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0988999999999999e-05 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229676+0000", 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018150973000000001 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229749+0000", 2024-09-11T05:33:24.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3617999999999999e-05 2024-09-11T05:33:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229911+0000", 2024-09-11T05:33:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016204699999999999 2024-09-11T05:33:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15475 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 720896~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211531+0000", 2024-09-11T05:33:24.700 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.471221053000001, 2024-09-11T05:33:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018650106, 2024-09-11T05:33:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15475 2024-09-11T05:33:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211531+0000", 2024-09-11T05:33:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211531+0000", 2024-09-11T05:33:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211532+0000", 2024-09-11T05:33:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1699999999999999e-07 2024-09-11T05:33:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211552+0000", 2024-09-11T05:33:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0027999999999999e-05 2024-09-11T05:33:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211560+0000", 2024-09-11T05:33:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0919999999999998e-06 2024-09-11T05:33:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211565+0000", 2024-09-11T05:33:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3959999999999997e-06 2024-09-11T05:33:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229942+0000", 2024-09-11T05:33:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018376786999999999 2024-09-11T05:33:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230045+0000", 2024-09-11T05:33:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103 2024-09-11T05:33:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230181+0000", 2024-09-11T05:33:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013638600000000001 2024-09-11T05:33:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15476 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 770048~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211573+0000", 2024-09-11T05:33:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.471179477, 2024-09-11T05:33:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018866438999999999, 2024-09-11T05:33:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15476 2024-09-11T05:33:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211573+0000", 2024-09-11T05:33:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211573+0000", 2024-09-11T05:33:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211573+0000", 2024-09-11T05:33:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.06e-07 2024-09-11T05:33:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211575+0000", 2024-09-11T05:33:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0839999999999999e-06 2024-09-11T05:33:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211582+0000", 2024-09-11T05:33:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4609999999999996e-06 2024-09-11T05:33:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211595+0000", 2024-09-11T05:33:24.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3387000000000001e-05 2024-09-11T05:33:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230213+0000", 2024-09-11T05:33:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018617999 2024-09-11T05:33:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230284+0000", 2024-09-11T05:33:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1317999999999997e-05 2024-09-11T05:33:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230439+0000", 2024-09-11T05:33:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015468400000000001 2024-09-11T05:33:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15577 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 237568~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211682+0000", 2024-09-11T05:33:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.471069861, 2024-09-11T05:33:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018126542999999998, 2024-09-11T05:33:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15577 2024-09-11T05:33:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211682+0000", 2024-09-11T05:33:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211682+0000", 2024-09-11T05:33:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211683+0000", 2024-09-11T05:33:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:33:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211685+0000", 2024-09-11T05:33:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0829999999999998e-06 2024-09-11T05:33:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211691+0000", 2024-09-11T05:33:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2190000000000001e-06 2024-09-11T05:33:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211696+0000", 2024-09-11T05:33:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8470000000000003e-06 2024-09-11T05:33:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229646+0000", 2024-09-11T05:33:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017949845999999998 2024-09-11T05:33:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229714+0000", 2024-09-11T05:33:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7830999999999995e-05 2024-09-11T05:33:24.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229809+0000", 2024-09-11T05:33:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5346000000000005e-05 2024-09-11T05:33:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15578 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 286720~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211703+0000", 2024-09-11T05:33:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.471049520999999, 2024-09-11T05:33:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018284662, 2024-09-11T05:33:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15578 2024-09-11T05:33:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211703+0000", 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211703+0000", 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211703+0000", 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.58e-07 2024-09-11T05:33:24.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211705+0000", 2024-09-11T05:33:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9290000000000001e-06 2024-09-11T05:33:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211711+0000", 2024-09-11T05:33:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:33:24.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211716+0000", 2024-09-11T05:33:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3529999999999997e-06 2024-09-11T05:33:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229836+0000", 2024-09-11T05:33:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018120831 2024-09-11T05:33:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229903+0000", 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6840000000000004e-05 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.229987+0000", 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4102000000000002e-05 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15579 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.721 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211722+0000", 2024-09-11T05:33:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.471030395, 2024-09-11T05:33:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018430720000000001, 2024-09-11T05:33:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15579 2024-09-11T05:33:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211722+0000", 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211722+0000", 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211722+0000", 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211724+0000", 2024-09-11T05:33:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.84e-06 2024-09-11T05:33:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211730+0000", 2024-09-11T05:33:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0310000000000004e-06 2024-09-11T05:33:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211742+0000", 2024-09-11T05:33:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1552000000000001e-05 2024-09-11T05:33:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230018+0000", 2024-09-11T05:33:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018276855000000002 2024-09-11T05:33:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230077+0000", 2024-09-11T05:33:24.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8517999999999998e-05 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230152+0000", 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5520999999999997e-05 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15580 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 385024~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211748+0000", 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.471004151000001, 2024-09-11T05:33:24.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018570942, 2024-09-11T05:33:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15580 2024-09-11T05:33:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211748+0000", 2024-09-11T05:33:24.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211748+0000", 2024-09-11T05:33:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211748+0000", 2024-09-11T05:33:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:33:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211750+0000", 2024-09-11T05:33:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9640000000000002e-06 2024-09-11T05:33:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211756+0000", 2024-09-11T05:33:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-09-11T05:33:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211761+0000", 2024-09-11T05:33:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2810000000000002e-06 2024-09-11T05:33:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230177+0000", 2024-09-11T05:33:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018415856000000001 2024-09-11T05:33:24.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230238+0000", 2024-09-11T05:33:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1605000000000004e-05 2024-09-11T05:33:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230319+0000", 2024-09-11T05:33:24.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0761999999999997e-05 2024-09-11T05:33:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15581 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 434176~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211767+0000", 2024-09-11T05:33:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.470985619, 2024-09-11T05:33:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01871983, 2024-09-11T05:33:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15581 2024-09-11T05:33:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211767+0000", 2024-09-11T05:33:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211767+0000", 2024-09-11T05:33:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211767+0000", 2024-09-11T05:33:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:33:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211769+0000", 2024-09-11T05:33:24.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8589999999999999e-06 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211775+0000", 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3180000000000003e-06 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211780+0000", 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230348+0000", 2024-09-11T05:33:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018568307999999999 2024-09-11T05:33:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230406+0000", 2024-09-11T05:33:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8177000000000002e-05 2024-09-11T05:33:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230486+0000", 2024-09-11T05:33:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0227000000000003e-05 2024-09-11T05:33:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15582 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 483328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211786+0000", 2024-09-11T05:33:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.470966577, 2024-09-11T05:33:24.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018985740000000001, 2024-09-11T05:33:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15582 2024-09-11T05:33:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211786+0000", 2024-09-11T05:33:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211786+0000", 2024-09-11T05:33:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211786+0000", 2024-09-11T05:33:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.72e-07 2024-09-11T05:33:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211794+0000", 2024-09-11T05:33:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8709999999999997e-06 2024-09-11T05:33:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211805+0000", 2024-09-11T05:33:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0942e-05 2024-09-11T05:33:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211810+0000", 2024-09-11T05:33:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3600000000000004e-06 2024-09-11T05:33:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230513+0000", 2024-09-11T05:33:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018702953000000001 2024-09-11T05:33:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230576+0000", 2024-09-11T05:33:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2493e-05 2024-09-11T05:33:24.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230771+0000", 2024-09-11T05:33:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000195749 2024-09-11T05:33:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15583 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 532480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.742 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211818+0000", 2024-09-11T05:33:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.470934491, 2024-09-11T05:33:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019160989999999999, 2024-09-11T05:33:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15583 2024-09-11T05:33:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211818+0000", 2024-09-11T05:33:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211818+0000", 2024-09-11T05:33:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211818+0000", 2024-09-11T05:33:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6499999999999999e-07 2024-09-11T05:33:24.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211824+0000", 2024-09-11T05:33:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4380000000000003e-06 2024-09-11T05:33:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211830+0000", 2024-09-11T05:33:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5899999999999996e-06 2024-09-11T05:33:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211835+0000", 2024-09-11T05:33:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8269999999999997e-06 2024-09-11T05:33:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230819+0000", 2024-09-11T05:33:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018984055999999999 2024-09-11T05:33:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230889+0000", 2024-09-11T05:33:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0297999999999997e-05 2024-09-11T05:33:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.230979+0000", 2024-09-11T05:33:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9315999999999997e-05 2024-09-11T05:33:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15584 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211841+0000", 2024-09-11T05:33:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.470911021999999, 2024-09-11T05:33:24.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019316725999999999, 2024-09-11T05:33:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15584 2024-09-11T05:33:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211841+0000", 2024-09-11T05:33:24.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211841+0000", 2024-09-11T05:33:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211842+0000", 2024-09-11T05:33:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211843+0000", 2024-09-11T05:33:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.911e-06 2024-09-11T05:33:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211849+0000", 2024-09-11T05:33:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5829999999999997e-06 2024-09-11T05:33:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211853+0000", 2024-09-11T05:33:24.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4050000000000002e-06 2024-09-11T05:33:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231006+0000", 2024-09-11T05:33:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019152848 2024-09-11T05:33:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231071+0000", 2024-09-11T05:33:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4418999999999994e-05 2024-09-11T05:33:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231158+0000", 2024-09-11T05:33:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7206000000000005e-05 2024-09-11T05:33:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15585 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 630784~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211860+0000", 2024-09-11T05:33:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.470892294, 2024-09-11T05:33:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019472105999999999, 2024-09-11T05:33:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15585 2024-09-11T05:33:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211860+0000", 2024-09-11T05:33:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211860+0000", 2024-09-11T05:33:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211860+0000", 2024-09-11T05:33:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3599999999999999e-07 2024-09-11T05:33:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211862+0000", 2024-09-11T05:33:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6920000000000001e-06 2024-09-11T05:33:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211868+0000", 2024-09-11T05:33:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3509999999999998e-06 2024-09-11T05:33:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211873+0000", 2024-09-11T05:33:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6800000000000001e-06 2024-09-11T05:33:24.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231185+0000", 2024-09-11T05:33:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019311979999999999 2024-09-11T05:33:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231250+0000", 2024-09-11T05:33:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4627000000000003e-05 2024-09-11T05:33:24.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231332+0000", 2024-09-11T05:33:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2340000000000001e-05 2024-09-11T05:33:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15586 3.9 3:90cb8843:::rbd_data.112d745a9e91.0000000000000025:a [read 679936~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.760 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.211879+0000", 2024-09-11T05:33:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.47087331, 2024-09-11T05:33:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019630141, 2024-09-11T05:33:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15586 2024-09-11T05:33:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211879+0000", 2024-09-11T05:33:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211879+0000", 2024-09-11T05:33:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211879+0000", 2024-09-11T05:33:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:33:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211881+0000", 2024-09-11T05:33:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7150000000000001e-06 2024-09-11T05:33:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211887+0000", 2024-09-11T05:33:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9499999999999998e-06 2024-09-11T05:33:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.211892+0000", 2024-09-11T05:33:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9080000000000003e-06 2024-09-11T05:33:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231359+0000", 2024-09-11T05:33:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019466954000000002 2024-09-11T05:33:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231423+0000", 2024-09-11T05:33:24.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4531999999999998e-05 2024-09-11T05:33:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231509+0000", 2024-09-11T05:33:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5691000000000003e-05 2024-09-11T05:33:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15593 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 237568~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.765 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.214205+0000", 2024-09-11T05:33:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.468547619000001, 2024-09-11T05:33:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018014775, 2024-09-11T05:33:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15593 2024-09-11T05:33:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.214205+0000", 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.214205+0000", 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.214205+0000", 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.214213+0000", 2024-09-11T05:33:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.452e-06 2024-09-11T05:33:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.214220+0000", 2024-09-11T05:33:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0890000000000002e-06 2024-09-11T05:33:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.214224+0000", 2024-09-11T05:33:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6410000000000001e-06 2024-09-11T05:33:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231637+0000", 2024-09-11T05:33:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017412463 2024-09-11T05:33:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.231745+0000", 2024-09-11T05:33:24.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108026 2024-09-11T05:33:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.232219+0000", 2024-09-11T05:33:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047457 2024-09-11T05:33:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15602 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 679936~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.215687+0000", 2024-09-11T05:33:24.770 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.467065461000001, 2024-09-11T05:33:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018038031, 2024-09-11T05:33:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15602 2024-09-11T05:33:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215687+0000", 2024-09-11T05:33:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215687+0000", 2024-09-11T05:33:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215687+0000", 2024-09-11T05:33:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0299999999999999e-07 2024-09-11T05:33:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215689+0000", 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9800000000000001e-06 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215695+0000", 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9039999999999997e-06 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215700+0000", 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6650000000000002e-06 2024-09-11T05:33:24.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233575+0000", 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017875361999999999 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233642+0000", 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6477999999999996e-05 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233725+0000", 2024-09-11T05:33:24.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3139000000000005e-05 2024-09-11T05:33:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15603 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 729088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.215708+0000", 2024-09-11T05:33:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.467044596999999, 2024-09-11T05:33:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018231502, 2024-09-11T05:33:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15603 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215708+0000", 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215708+0000", 2024-09-11T05:33:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215708+0000", 2024-09-11T05:33:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T05:33:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215710+0000", 2024-09-11T05:33:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.84e-06 2024-09-11T05:33:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215715+0000", 2024-09-11T05:33:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.378e-06 2024-09-11T05:33:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215720+0000", 2024-09-11T05:33:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4329999999999997e-06 2024-09-11T05:33:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233754+0000", 2024-09-11T05:33:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018034188999999999 2024-09-11T05:33:24.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233836+0000", 2024-09-11T05:33:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1965000000000006e-05 2024-09-11T05:33:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233939+0000", 2024-09-11T05:33:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103334 2024-09-11T05:33:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15604 3.a 3:523ff05b:::rbd_data.112d745a9e91.0000000000000026:a [read 778240~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.215727+0000", 2024-09-11T05:33:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.467025552999999, 2024-09-11T05:33:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018413735000000001, 2024-09-11T05:33:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15604 2024-09-11T05:33:24.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215727+0000", 2024-09-11T05:33:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215727+0000", 2024-09-11T05:33:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215727+0000", 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215734+0000", 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.374e-06 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215740+0000", 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5419999999999996e-06 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.215745+0000", 2024-09-11T05:33:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6199999999999998e-06 2024-09-11T05:33:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.233982+0000", 2024-09-11T05:33:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018237659 2024-09-11T05:33:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.234059+0000", 2024-09-11T05:33:24.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7162000000000004e-05 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.234140+0000", 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0983999999999996e-05 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16714 3.a 3:52147733:::rbd_data.112d745a9e91.0000000000000022:a [read 1040384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.299149+0000", 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.383603626999999, 2024-09-11T05:33:24.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017959678999999999, 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16714 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.299149+0000", 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.299149+0000", 2024-09-11T05:33:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.299149+0000", 2024-09-11T05:33:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.39e-07 2024-09-11T05:33:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:24.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.299151+0000", 2024-09-11T05:33:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.654e-06 2024-09-11T05:33:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.299156+0000", 2024-09-11T05:33:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.789e-06 2024-09-11T05:33:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:24.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.299161+0000", 2024-09-11T05:33:24.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3069999999999996e-06 2024-09-11T05:33:24.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:24.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.316956+0000", 2024-09-11T05:33:24.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017795188 2024-09-11T05:33:24.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:24.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317032+0000", 2024-09-11T05:33:24.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5867999999999999e-05 2024-09-11T05:33:24.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:24.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:24.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:24.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317108+0000", 2024-09-11T05:33:24.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6533999999999996e-05 2024-09-11T05:33:24.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.790 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:24.790 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:24.790 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:24.792 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:24.793 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T05:33:24.793 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T05:33:24.795 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T05:33:24.796 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:24.790+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:24.833 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone17 from 0x9511bdd (overlap 0x35c1e8e) to 0x25a1563 2024-09-11T05:33:24.892 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:24.891+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:24.903 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:24.903 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:24.903 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:24.903 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:24.912 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:24.993 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-11T05:33:24.993 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:24.991+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:25.010 INFO:teuthology.orchestra.run.smithi070.stdout:2515 write 0xd59ae55 thru 0xd5aa31e (0xf4ca bytes) 2024-09-11T05:33:25.016 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:25.016 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:25.016 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:25.017 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:25.017 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:25.018 INFO:teuthology.orchestra.run.smithi070.stdout:2516 punch from 0x9c2052e to 0x9c2275b, (0x222d bytes) 2024-09-11T05:33:25.018 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:25.018 INFO:teuthology.orchestra.run.smithi070.stdout:2518 punch from 0x594075d to 0x594bcca, (0xb56d bytes) 2024-09-11T05:33:25.018 INFO:teuthology.orchestra.run.smithi070.stdout:2519 read 0x6dd2eca thru 0x6de2d38 (0xfe6f bytes) 2024-09-11T05:33:25.019 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:25.019 INFO:teuthology.orchestra.run.smithi070.stdout:2523 punch from 0x329ca81 to 0x32a9838, (0xcdb7 bytes) 2024-09-11T05:33:25.019 INFO:teuthology.orchestra.run.smithi070.stdout:2524 writesame 0x1c4c51d thru 0x1c5633f data_size 0x1(0x9e23 bytes) 2024-09-11T05:33:25.025 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:25.109 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:25.108+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:25.111 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:25.111 INFO:teuthology.orchestra.run.smithi070.stdout:2526 read 0x4aac607 thru 0x4aba81f (0xe219 bytes) 2024-09-11T05:33:25.113 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:25.113 INFO:teuthology.orchestra.run.smithi070.stdout:2528 write 0xa0c6637 thru 0xa0ccf3a (0x6904 bytes) 2024-09-11T05:33:25.118 INFO:teuthology.orchestra.run.smithi070.stdout:2529 writesame 0x7314251 thru 0x731572f data_size 0xd(0x14df bytes) 2024-09-11T05:33:25.140 INFO:teuthology.orchestra.run.smithi070.stdout:2530 read 0x9f5fd66 thru 0x9f6405a (0x42f5 bytes) 2024-09-11T05:33:25.141 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:25.141 INFO:teuthology.orchestra.run.smithi070.stdout:2533 read 0x8d4abb7 thru 0x8d558a7 (0xacf1 bytes) 2024-09-11T05:33:25.143 INFO:teuthology.orchestra.run.smithi070.stdout:2534 trunc from 0xd5aa31f to 0xc30b8f8 2024-09-11T05:33:25.154 INFO:teuthology.orchestra.run.smithi070.stdout:2535 writesame 0x44757e3 thru 0x447f82b data_size 0x1(0xa049 bytes) 2024-09-11T05:33:25.171 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:25.171 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:25.171 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:25.171 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:33:25.171 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:25.180 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:25.221 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:25.220+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:25.248 INFO:teuthology.orchestra.run.smithi070.stdout:2536 read 0x4291c1a thru 0x4294809 (0x2bf0 bytes) 2024-09-11T05:33:25.249 INFO:teuthology.orchestra.run.smithi070.stdout:2537 punch from 0x1c3e3a2 to 0x1c44bed, (0x684b bytes) 2024-09-11T05:33:25.249 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:25.250 INFO:teuthology.orchestra.run.smithi070.stdout:2539 read 0xd289fd thru 0xd30970 (0x7f74 bytes) 2024-09-11T05:33:25.255 INFO:teuthology.orchestra.run.smithi070.stdout:2540 trunc from 0xc30b8f8 to 0x775375a 2024-09-11T05:33:25.295 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:25.294+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:25.325 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:25.325 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:25.325 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:25.326 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:25.334 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:25.344 INFO:teuthology.orchestra.run.smithi070.stdout:2541 trunc from 0x775375a to 0xc797c3e 2024-09-11T05:33:25.349 INFO:teuthology.orchestra.run.smithi070.stdout:2543 write 0x38966b9 thru 0x389cf31 (0x6879 bytes) 2024-09-11T05:33:25.397 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:25.396+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:25.403 INFO:teuthology.orchestra.run.smithi070.stdout:2544 read 0x3687d2e thru 0x3693e96 (0xc169 bytes) 2024-09-11T05:33:25.404 INFO:teuthology.orchestra.run.smithi070.stdout:2545 punch from 0x4fff167 to 0x500ed86, (0xfc1f bytes) 2024-09-11T05:33:25.404 INFO:teuthology.orchestra.run.smithi070.stdout:2548 punch from 0x351558c to 0x352533b, (0xfdaf bytes) 2024-09-11T05:33:25.405 INFO:teuthology.orchestra.run.smithi070.stdout:2549 trunc from 0xc797c3e to 0xc3cf90f 2024-09-11T05:33:25.417 INFO:teuthology.orchestra.run.smithi070.stdout:2550 trunc from 0xc3cf90f to 0x52f0042 2024-09-11T05:33:25.489 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:25.493 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:25.493 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:25.493 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:25.493 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:25.497 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:25.496+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:25.499 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:25.500 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:25.509 INFO:teuthology.orchestra.run.smithi070.stdout:2552 write 0x8cfc1d5 thru 0x8d080e7 (0xbf13 bytes) 2024-09-11T05:33:25.523 INFO:teuthology.orchestra.run.smithi070.stdout:2554 trunc from 0x8d080e8 to 0xdd5ef74 2024-09-11T05:33:25.528 INFO:teuthology.orchestra.run.smithi070.stdout:2555 writesame 0xfcd6d6 thru 0xfdb0f3 data_size 0x1(0xda1e bytes) 2024-09-11T05:33:25.598 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:25.597+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:25.614 INFO:teuthology.orchestra.run.smithi070.stdout:2557 read 0x31f062d thru 0x31f522f (0x4c03 bytes) 2024-09-11T05:33:25.620 INFO:teuthology.orchestra.run.smithi070.stdout:2559 trunc from 0xdd5ef74 to 0x98d7c4a 2024-09-11T05:33:25.626 INFO:teuthology.orchestra.run.smithi070.stdout:2560 read 0x177c8 thru 0x1c137 (0x4970 bytes) 2024-09-11T05:33:25.628 INFO:teuthology.orchestra.run.smithi070.stdout:2562 punch from 0x43e0229 to 0x43f002c, (0xfe03 bytes) 2024-09-11T05:33:25.628 INFO:teuthology.orchestra.run.smithi070.stdout:2564 writesame 0x863dabc thru 0x864b472 data_size 0x47(0xd9b7 bytes) 2024-09-11T05:33:25.645 INFO:teuthology.orchestra.run.smithi070.stdout:2565 write 0xe30c969 thru 0xe3107c5 (0x3e5d bytes) 2024-09-11T05:33:25.649 INFO:teuthology.orchestra.run.smithi070.stdout:2566 punch from 0x2d84fb2 to 0x2d893b6, (0x4404 bytes) 2024-09-11T05:33:25.649 INFO:teuthology.orchestra.run.smithi070.stdout:2567 punch from 0xb8866c1 to 0xb89092d, (0xa26c bytes) 2024-09-11T05:33:25.649 INFO:teuthology.orchestra.run.smithi070.stdout:2568 punch from 0x9415c8d to 0x9417321, (0x1694 bytes) 2024-09-11T05:33:25.649 INFO:teuthology.orchestra.run.smithi070.stdout:2570 read 0x2a2f9c0 thru 0x2a3ba9b (0xc0dc bytes) 2024-09-11T05:33:25.650 INFO:teuthology.orchestra.run.smithi070.stdout:2572 clone 19 order 18 su 4096 sc 14 2024-09-11T05:33:25.655 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:25.655 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:25.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:25.656 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:25.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.656 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45827 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 6897664~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.656 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366795+0000", 2024-09-11T05:33:25.656 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.28748829799999998, 2024-09-11T05:33:25.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031094567, 2024-09-11T05:33:25.656 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.656 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.656 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.656 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45827 2024-09-11T05:33:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366795+0000", 2024-09-11T05:33:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366795+0000", 2024-09-11T05:33:25.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366795+0000", 2024-09-11T05:33:25.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6499999999999999e-07 2024-09-11T05:33:25.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366797+0000", 2024-09-11T05:33:25.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2340000000000001e-06 2024-09-11T05:33:25.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366803+0000", 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.631e-06 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366809+0000", 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7490000000000004e-06 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397796+0000", 2024-09-11T05:33:25.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030987737000000001 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397838+0000", 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1859e-05 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397889+0000", 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0892e-05 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45828 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 6946816~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366815+0000", 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.28746818000000002, 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031189219000000001, 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45828 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.661 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366815+0000", 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366815+0000", 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366815+0000", 2024-09-11T05:33:25.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3599999999999999e-07 2024-09-11T05:33:25.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366817+0000", 2024-09-11T05:33:25.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0190000000000001e-06 2024-09-11T05:33:25.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366823+0000", 2024-09-11T05:33:25.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7049999999999996e-06 2024-09-11T05:33:25.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366829+0000", 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7490000000000001e-06 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397914+0000", 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031084157000000001 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397955+0000", 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1561999999999999e-05 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398004+0000", 2024-09-11T05:33:25.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8690999999999998e-05 2024-09-11T05:33:25.665 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.665 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.665 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.665 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45829 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 6995968~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.665 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:25.665 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.28744760899999999, 2024-09-11T05:33:25.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031286190999999998, 2024-09-11T05:33:25.665 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.666 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.666 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.666 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.666 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.666 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.666 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45829 2024-09-11T05:33:25.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.666 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.666 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.666 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.666 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366836+0000", 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4199999999999996e-07 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.667 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.668 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366838+0000", 2024-09-11T05:33:25.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9929999999999998e-06 2024-09-11T05:33:25.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.668 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.668 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366844+0000", 2024-09-11T05:33:25.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0430000000000004e-06 2024-09-11T05:33:25.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.668 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.668 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366848+0000", 2024-09-11T05:33:25.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6040000000000003e-06 2024-09-11T05:33:25.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398029+0000", 2024-09-11T05:33:25.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031180349 2024-09-11T05:33:25.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398070+0000", 2024-09-11T05:33:25.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1421999999999997e-05 2024-09-11T05:33:25.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398121+0000", 2024-09-11T05:33:25.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1238e-05 2024-09-11T05:33:25.670 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.670 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.670 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.670 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45830 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7045120~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.670 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:25.670 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.287428038, 2024-09-11T05:33:25.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031383187999999999, 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45830 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:25.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:25.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.51e-07 2024-09-11T05:33:25.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366857+0000", 2024-09-11T05:33:25.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9259999999999999e-06 2024-09-11T05:33:25.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366863+0000", 2024-09-11T05:33:25.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7069999999999997e-06 2024-09-11T05:33:25.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366868+0000", 2024-09-11T05:33:25.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7380000000000002e-06 2024-09-11T05:33:25.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398147+0000", 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031279757999999998 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398189+0000", 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1597999999999997e-05 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398238+0000", 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.901e-05 2024-09-11T05:33:25.674 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.675 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.675 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.675 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45831 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7094272~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.675 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:25.675 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.28740891099999999, 2024-09-11T05:33:25.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031481960000000003, 2024-09-11T05:33:25.675 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.675 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.675 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.675 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.675 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.676 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.676 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45831 2024-09-11T05:33:25.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.676 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:25.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:25.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:25.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4200000000000002e-07 2024-09-11T05:33:25.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366876+0000", 2024-09-11T05:33:25.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0020000000000001e-06 2024-09-11T05:33:25.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366882+0000", 2024-09-11T05:33:25.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7690000000000002e-06 2024-09-11T05:33:25.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366887+0000", 2024-09-11T05:33:25.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119999999999999e-06 2024-09-11T05:33:25.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398263+0000", 2024-09-11T05:33:25.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031376023000000003 2024-09-11T05:33:25.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398306+0000", 2024-09-11T05:33:25.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3220999999999998e-05 2024-09-11T05:33:25.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398356+0000", 2024-09-11T05:33:25.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:33:25.680 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.680 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.680 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45832 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7143424~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.28739029100000002, 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031581625000000002, 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45832 2024-09-11T05:33:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367199+0000", 2024-09-11T05:33:25.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00030624 2024-09-11T05:33:25.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367205+0000", 2024-09-11T05:33:25.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1090000000000003e-06 2024-09-11T05:33:25.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367213+0000", 2024-09-11T05:33:25.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8979999999999996e-06 2024-09-11T05:33:25.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367219+0000", 2024-09-11T05:33:25.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:33:25.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398380+0000", 2024-09-11T05:33:25.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031160931999999999 2024-09-11T05:33:25.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398425+0000", 2024-09-11T05:33:25.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4548000000000001e-05 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398474+0000", 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9298000000000001e-05 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45833 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7192576~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.287049006, 2024-09-11T05:33:25.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031369229999999998, 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45833 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9400000000000005e-07 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367237+0000", 2024-09-11T05:33:25.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4439999999999998e-06 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367243+0000", 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367249+0000", 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2240000000000003e-06 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398507+0000", 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031257994999999997 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398551+0000", 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4178000000000003e-05 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398603+0000", 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2178000000000001e-05 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.689 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.690 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45834 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7241728~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.690 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:25.690 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.28702727500000003, 2024-09-11T05:33:25.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031466477, 2024-09-11T05:33:25.690 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.690 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.690 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.690 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.691 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.691 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.691 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45834 2024-09-11T05:33:25.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.691 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.691 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.691 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.691 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:25.691 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.691 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.691 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.692 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:25.692 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.692 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.692 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.692 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:25.692 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5200000000000002e-07 2024-09-11T05:33:25.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.692 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.692 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.692 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367258+0000", 2024-09-11T05:33:25.692 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1110000000000002e-06 2024-09-11T05:33:25.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367264+0000", 2024-09-11T05:33:25.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0290000000000002e-06 2024-09-11T05:33:25.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367269+0000", 2024-09-11T05:33:25.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:33:25.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398628+0000", 2024-09-11T05:33:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031358587 2024-09-11T05:33:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398671+0000", 2024-09-11T05:33:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3035999999999999e-05 2024-09-11T05:33:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398722+0000", 2024-09-11T05:33:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1511000000000002e-05 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45835 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7290880~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.287007701, 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031565589999999998, 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.696 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.696 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45835 2024-09-11T05:33:25.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.696 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.696 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.696 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:25.696 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.696 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.696 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:25.696 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.697 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.697 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367276+0000", 2024-09-11T05:33:25.697 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.96e-07 2024-09-11T05:33:25.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.697 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.697 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367278+0000", 2024-09-11T05:33:25.697 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0279999999999999e-06 2024-09-11T05:33:25.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.697 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367283+0000", 2024-09-11T05:33:25.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8340000000000004e-06 2024-09-11T05:33:25.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367289+0000", 2024-09-11T05:33:25.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:33:25.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398747+0000", 2024-09-11T05:33:25.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031458211999999999 2024-09-11T05:33:25.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398788+0000", 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0998999999999998e-05 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398841+0000", 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2465e-05 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.700 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45836 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7340032~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.700 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:25.700 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.28698762500000002, 2024-09-11T05:33:25.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031663635000000002, 2024-09-11T05:33:25.700 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.700 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.700 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.700 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.700 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.700 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.700 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45836 2024-09-11T05:33:25.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.700 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368490+0000", 2024-09-11T05:33:25.701 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0011952410000000001 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368494+0000", 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4649999999999999e-06 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368503+0000", 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0920000000000004e-06 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368509+0000", 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4130000000000003e-06 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398865+0000", 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030355473000000001 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398907+0000", 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1882999999999999e-05 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.704 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398959+0000", 2024-09-11T05:33:25.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2067999999999997e-05 2024-09-11T05:33:25.704 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.704 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.704 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.704 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45842 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7634944~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.704 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368634+0000", 2024-09-11T05:33:25.704 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.285648438, 2024-09-11T05:33:25.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031057715999999999, 2024-09-11T05:33:25.704 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.704 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45842 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368634+0000", 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368634+0000", 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368635+0000", 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368637+0000", 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0449999999999999e-06 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.707 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.707 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368643+0000", 2024-09-11T05:33:25.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:33:25.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.707 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.707 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.707 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368647+0000", 2024-09-11T05:33:25.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7079999999999996e-06 2024-09-11T05:33:25.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.707 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.707 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.707 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399597+0000", 2024-09-11T05:33:25.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030949081999999999 2024-09-11T05:33:25.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.708 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.708 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399640+0000", 2024-09-11T05:33:25.708 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3158000000000003e-05 2024-09-11T05:33:25.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.708 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399692+0000", 2024-09-11T05:33:25.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2448000000000003e-05 2024-09-11T05:33:25.709 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.709 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.709 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.709 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45843 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7684096~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.710 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368655+0000", 2024-09-11T05:33:25.710 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.28562781799999998, 2024-09-11T05:33:25.710 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031152040999999998, 2024-09-11T05:33:25.710 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.710 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.710 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.710 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.710 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.711 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.711 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45843 2024-09-11T05:33:25.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.711 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.711 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.711 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.711 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368655+0000", 2024-09-11T05:33:25.711 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.712 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.712 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.712 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368655+0000", 2024-09-11T05:33:25.712 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.712 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.712 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368655+0000", 2024-09-11T05:33:25.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:33:25.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368657+0000", 2024-09-11T05:33:25.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.08e-06 2024-09-11T05:33:25.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.714 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368664+0000", 2024-09-11T05:33:25.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0959999999999997e-06 2024-09-11T05:33:25.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.714 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368668+0000", 2024-09-11T05:33:25.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6829999999999999e-06 2024-09-11T05:33:25.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.715 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399716+0000", 2024-09-11T05:33:25.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031047748 2024-09-11T05:33:25.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.716 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399757+0000", 2024-09-11T05:33:25.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1056000000000001e-05 2024-09-11T05:33:25.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.716 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399807+0000", 2024-09-11T05:33:25.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0046999999999997e-05 2024-09-11T05:33:25.717 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.717 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.717 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.717 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45844 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7733248~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.717 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:25.717 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.285608482, 2024-09-11T05:33:25.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031248306, 2024-09-11T05:33:25.718 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.718 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.718 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.718 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.718 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.718 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.718 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45844 2024-09-11T05:33:25.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.719 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.719 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.719 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:25.719 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.719 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.720 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:25.720 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.720 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.720 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368675+0000", 2024-09-11T05:33:25.720 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4700000000000001e-07 2024-09-11T05:33:25.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.721 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.721 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368680+0000", 2024-09-11T05:33:25.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3750000000000002e-06 2024-09-11T05:33:25.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.721 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.721 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368687+0000", 2024-09-11T05:33:25.722 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3080000000000004e-06 2024-09-11T05:33:25.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.722 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.722 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.722 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368692+0000", 2024-09-11T05:33:25.722 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2329999999999997e-06 2024-09-11T05:33:25.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.722 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399832+0000", 2024-09-11T05:33:25.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031139723000000001 2024-09-11T05:33:25.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399872+0000", 2024-09-11T05:33:25.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0880000000000002e-05 2024-09-11T05:33:25.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.724 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399923+0000", 2024-09-11T05:33:25.724 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.024e-05 2024-09-11T05:33:25.724 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.724 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.724 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.724 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45845 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7782400~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.724 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:25.724 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.285584648, 2024-09-11T05:33:25.724 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031339210999999999, 2024-09-11T05:33:25.724 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.724 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.725 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.725 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.725 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.725 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.725 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45845 2024-09-11T05:33:25.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.725 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.725 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.725 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:25.725 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.725 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368699+0000", 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368701+0000", 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0389999999999999e-06 2024-09-11T05:33:25.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368706+0000", 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5570000000000003e-06 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368711+0000", 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0930000000000002e-06 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399947+0000", 2024-09-11T05:33:25.727 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031235810999999999 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399989+0000", 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1430000000000001e-05 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400037+0000", 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8838999999999998e-05 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.729 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.729 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45846 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7831552~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.729 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:25.729 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.285565548, 2024-09-11T05:33:25.729 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031434484999999998, 2024-09-11T05:33:25.729 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.729 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.729 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.729 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.729 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.729 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.729 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45846 2024-09-11T05:33:25.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.730 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.730 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:25.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.730 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:25.731 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.731 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.731 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368718+0000", 2024-09-11T05:33:25.731 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6600000000000002e-07 2024-09-11T05:33:25.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368720+0000", 2024-09-11T05:33:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0140000000000001e-06 2024-09-11T05:33:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368726+0000", 2024-09-11T05:33:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8719999999999999e-06 2024-09-11T05:33:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368730+0000", 2024-09-11T05:33:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:33:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400061+0000", 2024-09-11T05:33:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031331141 2024-09-11T05:33:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400102+0000", 2024-09-11T05:33:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0419e-05 2024-09-11T05:33:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400152+0000", 2024-09-11T05:33:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9926000000000003e-05 2024-09-11T05:33:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.738 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45847 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7880704~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.738 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:25.738 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.28554643699999999, 2024-09-11T05:33:25.738 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031531412000000002, 2024-09-11T05:33:25.738 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.739 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.739 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.739 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.739 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.739 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.739 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45847 2024-09-11T05:33:25.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.740 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.740 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.740 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.740 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:25.740 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.741 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.741 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.741 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:25.741 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.742 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.742 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.742 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368737+0000", 2024-09-11T05:33:25.742 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:33:25.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.743 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.743 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.743 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368739+0000", 2024-09-11T05:33:25.743 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.81e-06 2024-09-11T05:33:25.743 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.744 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.744 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.744 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368744+0000", 2024-09-11T05:33:25.744 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8919999999999997e-06 2024-09-11T05:33:25.744 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.744 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.745 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.745 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368749+0000", 2024-09-11T05:33:25.745 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7149999999999997e-06 2024-09-11T05:33:25.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.745 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.745 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.746 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400176+0000", 2024-09-11T05:33:25.746 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031426740000000002 2024-09-11T05:33:25.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.746 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.746 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.746 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400218+0000", 2024-09-11T05:33:25.747 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2338e-05 2024-09-11T05:33:25.747 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.747 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.747 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.747 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400268+0000", 2024-09-11T05:33:25.747 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9580000000000003e-05 2024-09-11T05:33:25.748 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.748 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.748 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.748 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.748 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45848 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7929856~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.749 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:25.749 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.285527641, 2024-09-11T05:33:25.749 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031629162000000002, 2024-09-11T05:33:25.749 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.749 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.750 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.750 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.750 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.750 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.750 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45848 2024-09-11T05:33:25.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.751 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.751 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.751 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:25.751 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.751 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.752 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:25.752 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.752 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.752 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.752 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368756+0000", 2024-09-11T05:33:25.752 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:33:25.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.752 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.752 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.752 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368758+0000", 2024-09-11T05:33:25.752 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.951e-06 2024-09-11T05:33:25.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.753 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.753 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368763+0000", 2024-09-11T05:33:25.753 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.801e-06 2024-09-11T05:33:25.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.753 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.753 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368768+0000", 2024-09-11T05:33:25.753 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1100000000000002e-06 2024-09-11T05:33:25.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.753 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.753 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400292+0000", 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031524033 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400336+0000", 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3272999999999997e-05 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400384+0000", 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8634999999999998e-05 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45849 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7979008~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.28550824899999999, 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031732415, 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45849 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.755 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.756 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.756 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:25.756 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.756 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.756 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:25.756 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.756 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.756 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0100000000000005e-07 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368777+0000", 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0260000000000002e-06 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368783+0000", 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7089999999999999e-06 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.757 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368788+0000", 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4029999999999998e-06 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400409+0000", 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031620663 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400453+0000", 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4376999999999999e-05 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400507+0000", 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3736000000000002e-05 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45850 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8028160~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.28548878700000002, 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031830000999999997, 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.759 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45850 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.760 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.761 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:25.761 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.761 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.761 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.761 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368795+0000", 2024-09-11T05:33:25.761 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0399999999999996e-07 2024-09-11T05:33:25.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.761 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.761 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.761 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368796+0000", 2024-09-11T05:33:25.761 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.933e-06 2024-09-11T05:33:25.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368803+0000", 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0619999999999997e-06 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368807+0000", 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.685e-06 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400531+0000", 2024-09-11T05:33:25.762 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031723784999999997 2024-09-11T05:33:25.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.763 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.763 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.763 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400573+0000", 2024-09-11T05:33:25.763 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2079999999999997e-05 2024-09-11T05:33:25.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.763 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.763 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.763 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400624+0000", 2024-09-11T05:33:25.763 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0952000000000003e-05 2024-09-11T05:33:25.763 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.763 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.763 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45851 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8077312~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.285469794, 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031929358999999997, 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45851 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.764 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:25.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.765 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:25.765 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:25.765 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.765 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:25.765 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:25.765 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:25.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.765 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:25.765 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370488+0000", 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.001674743 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370491+0000", 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.444e-06 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370500+0000", 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0650000000000005e-06 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.766 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:25.767 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370507+0000", 2024-09-11T05:33:25.767 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:33:25.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.767 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.767 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:25.767 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400648+0000", 2024-09-11T05:33:25.767 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030141889000000002 2024-09-11T05:33:25.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.767 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.767 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:25.767 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400691+0000", 2024-09-11T05:33:25.767 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2290999999999999e-05 2024-09-11T05:33:25.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:25.768 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:25.768 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:25.768 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400742+0000", 2024-09-11T05:33:25.768 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1717e-05 2024-09-11T05:33:25.768 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.768 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.768 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.768 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:25.768 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:25.768 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:25.770 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T05:33:25.770 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:25.771 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:25.768+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:25.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T05:33:25.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:33:25.841 INFO:teuthology.orchestra.run.smithi070.stdout:leaving image image_client.0-clone18 intact 2024-09-11T05:33:25.881 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:25.881+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:25.913 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:25.913 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:25.913 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:25.913 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:25.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:25.950 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:25.951 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:25.971 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:25.970+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:25.987 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:25.987 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:26.003 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:26.003 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:26.021 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:26.021 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:26.026 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:26.026 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:26.026 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:26.027 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:26.027 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:26.035 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:26.039 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:26.039 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:26.056 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:26.056 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:26.074 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:26.074 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:26.079 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:26.078+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:26.100 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-11T05:33:26.140 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:26.140 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:26.148 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:26.151 INFO:teuthology.orchestra.run.smithi070.stdout:2573 read 0xcff9f4c thru 0xcffa9fd (0xab2 bytes) 2024-09-11T05:33:26.153 INFO:teuthology.orchestra.run.smithi070.stdout:2574 read 0x5063141 thru 0x506aa0b (0x78cb bytes) 2024-09-11T05:33:26.154 INFO:teuthology.orchestra.run.smithi070.stdout:2575 write 0xbd5f9c5 thru 0xbd679fa (0x8036 bytes) 2024-09-11T05:33:26.167 INFO:teuthology.orchestra.run.smithi070.stdout:2576 write 0x7cf75fe thru 0x7d04d28 (0xd72b bytes) 2024-09-11T05:33:26.189 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:26.188+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:26.196 INFO:teuthology.orchestra.run.smithi070.stdout:2577 trunc from 0xe3107c6 to 0x25129fe 2024-09-11T05:33:26.274 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:26.273+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:26.294 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:26.294 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:26.303 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:26.310 INFO:teuthology.orchestra.run.smithi070.stdout:2578 read 0x19dc776 thru 0x19e6bc4 (0xa44f bytes) 2024-09-11T05:33:26.319 INFO:teuthology.orchestra.run.smithi070.stdout:2579 trunc from 0x25129fe to 0x8b0ca19 2024-09-11T05:33:26.325 INFO:teuthology.orchestra.run.smithi070.stdout:2580 writesame 0xc2f5d6 thru 0xc2f8d8 data_size 0x1(0x303 bytes) 2024-09-11T05:33:26.339 INFO:teuthology.orchestra.run.smithi070.stdout:2581 write 0x8cff349 thru 0x8d09595 (0xa24d bytes) 2024-09-11T05:33:26.351 INFO:teuthology.orchestra.run.smithi070.stdout:2582 write 0x22f5d63 thru 0x22fea70 (0x8d0e bytes) 2024-09-11T05:33:26.375 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:26.374+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:26.429 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:26.429 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:26.434 INFO:teuthology.orchestra.run.smithi070.stdout:2583 read 0x89dbb0f thru 0x89e0bfd (0x50ef bytes) 2024-09-11T05:33:26.439 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:26.442 INFO:teuthology.orchestra.run.smithi070.stdout:2584 trunc from 0x8d09596 to 0x2a1fb30 2024-09-11T05:33:26.453 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:26.456 INFO:teuthology.orchestra.run.smithi070.stdout:2586 trunc from 0x2a1fb30 to 0x4e5208d 2024-09-11T05:33:26.461 INFO:teuthology.orchestra.run.smithi070.stdout:2587 punch from 0x34b5f09 to 0x34ba665, (0x475c bytes) 2024-09-11T05:33:26.461 INFO:teuthology.orchestra.run.smithi070.stdout:2588 read 0x47999c8 thru 0x47a00ef (0x6728 bytes) 2024-09-11T05:33:26.462 INFO:teuthology.orchestra.run.smithi070.stdout:2590 read 0x48ceeb1 thru 0x48d3d7b (0x4ecb bytes) 2024-09-11T05:33:26.462 INFO:teuthology.orchestra.run.smithi070.stdout:2591 read 0x19a59f3 thru 0x19abfe0 (0x65ee bytes) 2024-09-11T05:33:26.462 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:26.462 INFO:teuthology.orchestra.run.smithi070.stdout:2593 read 0x56e948 thru 0x57663f (0x7cf8 bytes) 2024-09-11T05:33:26.475 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:26.475+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:26.478 INFO:teuthology.orchestra.run.smithi070.stdout:2594 write 0xc946a10 thru 0xc952f25 (0xc516 bytes) 2024-09-11T05:33:26.492 INFO:teuthology.orchestra.run.smithi070.stdout:2595 trunc from 0xc952f26 to 0xc9c804a 2024-09-11T05:33:26.497 INFO:teuthology.orchestra.run.smithi070.stdout:2597 write 0x771fec5 thru 0x7725e4f (0x5f8b bytes) 2024-09-11T05:33:26.506 INFO:teuthology.orchestra.run.smithi070.stdout:2598 read 0xbb46280 thru 0xbb51629 (0xb3aa bytes) 2024-09-11T05:33:26.506 INFO:teuthology.orchestra.run.smithi070.stdout:2600 write 0xa0f52 thru 0xac536 (0xb5e5 bytes) 2024-09-11T05:33:26.576 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:26.575+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:26.598 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:26.598 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:26.608 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:26.644 INFO:teuthology.orchestra.run.smithi070.stdout:2602 write 0x10ecf40 thru 0x10fc064 (0xf125 bytes) 2024-09-11T05:33:26.678 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:26.676+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:26.740 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T05:33:26.752 INFO:teuthology.orchestra.run.smithi070.stdout:2605 read 0x5423c8d thru 0x542f7cb (0xbb3f bytes) 2024-09-11T05:33:26.752 INFO:teuthology.orchestra.run.smithi070.stdout:2606 punch from 0x87d9ee1 to 0x87e2654, (0x8773 bytes) 2024-09-11T05:33:26.752 INFO:teuthology.orchestra.run.smithi070.stdout:2608 write 0xb68777b thru 0xb694635 (0xcebb bytes) 2024-09-11T05:33:26.753 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:26.753 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:26.757 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T05:33:26.766 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:26.779 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:26.777+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:26.779 INFO:teuthology.orchestra.run.smithi070.stdout:2609 trunc from 0xc9c804a to 0x43e757c 2024-09-11T05:33:26.795 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:33:26.809 INFO:teuthology.orchestra.run.smithi070.stdout:2610 write 0x7a0fde2 thru 0x7a1808e (0x82ad bytes) 2024-09-11T05:33:26.823 INFO:teuthology.orchestra.run.smithi070.stdout:2611 write 0x436a269 thru 0x436b01a (0xdb2 bytes) 2024-09-11T05:33:26.827 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:26.835 INFO:teuthology.orchestra.run.smithi070.stdout:2613 writesame 0x92228f1 thru 0x922f821 data_size 0x1f(0xcf31 bytes) 2024-09-11T05:33:26.835 INFO:teuthology.orchestra.run.smithi070.stdout:2615 writesame 0x403c3b0 thru 0x4042080 data_size 0x1(0x5cd1 bytes) 2024-09-11T05:33:26.853 INFO:teuthology.orchestra.run.smithi070.stdout:2616 read 0x200e62e thru 0x2011560 (0x2f33 bytes) 2024-09-11T05:33:26.855 INFO:teuthology.orchestra.run.smithi070.stdout:2617 trunc from 0x922f822 to 0xa18ee39 2024-09-11T05:33:26.860 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:26.860 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:26.860 INFO:teuthology.orchestra.run.smithi070.stdout:2620 punch from 0x703d03 to 0x70888c, (0x4b89 bytes) 2024-09-11T05:33:26.860 INFO:teuthology.orchestra.run.smithi070.stdout:2621 read 0x40e907d thru 0x40f7c3d (0xebc1 bytes) 2024-09-11T05:33:26.870 INFO:teuthology.orchestra.run.smithi070.stdout:2622 write 0xcea009f thru 0xcea3213 (0x3175 bytes) 2024-09-11T05:33:26.878 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:26.879 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:26.878+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:26.888 INFO:teuthology.orchestra.run.smithi070.stdout:2624 trunc from 0xcea3214 to 0x5467c28 2024-09-11T05:33:26.905 INFO:teuthology.orchestra.run.smithi070.stdout:2625 trunc from 0x5467c28 to 0x6223595 2024-09-11T05:33:26.911 INFO:teuthology.orchestra.run.smithi070.stdout:2626 trunc from 0x6223595 to 0x6729939 2024-09-11T05:33:26.917 INFO:teuthology.orchestra.run.smithi070.stdout:2628 read 0x3ba9d2f thru 0x3bb7ed6 (0xe1a8 bytes) 2024-09-11T05:33:26.921 INFO:teuthology.orchestra.run.smithi070.stdout:2629 trunc from 0x6729939 to 0x41754ef 2024-09-11T05:33:26.922 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:26.923 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:26.934 INFO:teuthology.orchestra.run.smithi070.stdout:2630 read 0x3c50d73 thru 0x3c5a0d8 (0x9366 bytes) 2024-09-11T05:33:26.936 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:26.947 INFO:teuthology.orchestra.run.smithi070.stdout:2632 writesame 0xa0ad96d thru 0xa0b60dd data_size 0x1(0x8771 bytes) 2024-09-11T05:33:26.959 INFO:teuthology.orchestra.run.smithi070.stdout:2635 trunc from 0xa0b60de to 0x4eda92 2024-09-11T05:33:26.980 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:26.979+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:27.080 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:27.080+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:27.098 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:27.099 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:27.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:27.143 INFO:teuthology.orchestra.run.smithi070.stdout:2636 punch from 0x35c9c3 to 0x3662a6, (0x98e3 bytes) 2024-09-11T05:33:27.144 INFO:teuthology.orchestra.run.smithi070.stdout:2637 read 0x3a08df thru 0x3a9ca1 (0x93c3 bytes) 2024-09-11T05:33:27.144 INFO:teuthology.orchestra.run.smithi070.stdout:2639 read 0x1da0b3 thru 0x1db784 (0x16d2 bytes) 2024-09-11T05:33:27.146 INFO:teuthology.orchestra.run.smithi070.stdout:2640 punch from 0x3346a7 to 0x3442d2, (0xfc2b bytes) 2024-09-11T05:33:27.146 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:27.146 INFO:teuthology.orchestra.run.smithi070.stdout:2642 read 0x16e7cb thru 0x174d21 (0x6557 bytes) 2024-09-11T05:33:27.146 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:27.157 INFO:teuthology.orchestra.run.smithi070.stdout:2645 write 0x51326ae thru 0x513e4e4 (0xbe37 bytes) 2024-09-11T05:33:27.176 INFO:teuthology.orchestra.run.smithi070.stdout:2646 read 0x2555f37 thru 0x255df07 (0x7fd1 bytes) 2024-09-11T05:33:27.181 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:27.181+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:27.182 INFO:teuthology.orchestra.run.smithi070.stdout:2647 write 0x5aa313b thru 0x5ab0377 (0xd23d bytes) 2024-09-11T05:33:27.204 INFO:teuthology.orchestra.run.smithi070.stdout:2650 read 0xbfc545 thru 0xc0c140 (0xfbfc bytes) 2024-09-11T05:33:27.204 INFO:teuthology.orchestra.run.smithi070.stdout:2651 punch from 0x342abb4 to 0x342d05a, (0x24a6 bytes) 2024-09-11T05:33:27.216 INFO:teuthology.orchestra.run.smithi070.stdout:2652 writesame 0xadc98d1 thru 0xadd3228 data_size 0x1c(0x9958 bytes) 2024-09-11T05:33:27.216 INFO:teuthology.orchestra.run.smithi070.stdout:2653 write 0x3aed3a6 thru 0x3af6924 (0x957f bytes) 2024-09-11T05:33:27.230 INFO:teuthology.orchestra.run.smithi070.stdout:2654 read 0x8d79b83 thru 0x8d7f109 (0x5587 bytes) 2024-09-11T05:33:27.238 INFO:teuthology.orchestra.run.smithi070.stdout:2656 writesame 0xcd93338 thru 0xcd93d68 data_size 0x1(0xa31 bytes) 2024-09-11T05:33:27.238 INFO:teuthology.orchestra.run.smithi070.stdout:2657 punch from 0x6b86553 to 0x6b91572, (0xb01f bytes) 2024-09-11T05:33:27.238 INFO:teuthology.orchestra.run.smithi070.stdout:2658 punch from 0xc1f5186 to 0xc204957, (0xf7d1 bytes) 2024-09-11T05:33:27.238 INFO:teuthology.orchestra.run.smithi070.stdout:2659 punch from 0x2f93f95 to 0x2fa0405, (0xc470 bytes) 2024-09-11T05:33:27.239 INFO:teuthology.orchestra.run.smithi070.stdout:2661 trunc from 0xcd93d69 to 0xdadf628 2024-09-11T05:33:27.245 INFO:teuthology.orchestra.run.smithi070.stdout:2662 writesame 0x7eb6fd8 thru 0x7ebaaca data_size 0x1(0x3af3 bytes) 2024-09-11T05:33:27.255 INFO:teuthology.orchestra.run.smithi070.stdout:2663 write 0x11df83e thru 0x11e7939 (0x80fc bytes) 2024-09-11T05:33:27.267 INFO:teuthology.orchestra.run.smithi070.stdout:2664 trunc from 0xdadf628 to 0xd4880fd 2024-09-11T05:33:27.273 INFO:teuthology.orchestra.run.smithi070.stdout:2666 write 0xca99031 thru 0xcaa3a93 (0xaa63 bytes) 2024-09-11T05:33:27.281 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:27.281 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:27.282 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:27.282+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:27.286 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:27.286 INFO:teuthology.orchestra.run.smithi070.stdout:2669 write 0x98a336d thru 0x98a7795 (0x4429 bytes) 2024-09-11T05:33:27.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:27.304 INFO:teuthology.orchestra.run.smithi070.stdout:2670 trunc from 0xd4880fd to 0x3b92cc4 2024-09-11T05:33:27.324 INFO:teuthology.orchestra.run.smithi070.stdout:2671 read 0x1dee86e thru 0x1dfcc97 (0xe42a bytes) 2024-09-11T05:33:27.324 INFO:teuthology.orchestra.run.smithi070.stdout:2672 punch from 0xeabaa0 to 0xeac08b, (0x5eb bytes) 2024-09-11T05:33:27.337 INFO:teuthology.orchestra.run.smithi070.stdout:2673 writesame 0x9a96b07 thru 0x9aa3fcb data_size 0x1(0xd4c5 bytes) 2024-09-11T05:33:27.337 INFO:teuthology.orchestra.run.smithi070.stdout:2674 read 0x3f3f52a thru 0x3f469c3 (0x749a bytes) 2024-09-11T05:33:27.337 INFO:teuthology.orchestra.run.smithi070.stdout:2675 read 0x314a159 thru 0x314ca2b (0x28d3 bytes) 2024-09-11T05:33:27.338 INFO:teuthology.orchestra.run.smithi070.stdout:2676 flatten 2024-09-11T05:33:27.356 INFO:teuthology.orchestra.run.smithi070.stdout:2678 punch from 0x14f45da to 0x1500c12, (0xc638 bytes) 2024-09-11T05:33:27.368 INFO:teuthology.orchestra.run.smithi070.stdout:2679 write 0xe2fe561 thru 0xe2fefda (0xa7a bytes) 2024-09-11T05:33:27.371 INFO:teuthology.orchestra.run.smithi070.stdout:2680 read 0x24c0441 thru 0x24c232a (0x1eea bytes) 2024-09-11T05:33:27.371 INFO:teuthology.orchestra.run.smithi070.stdout:2683 write 0xdc4451 thru 0xdcaa25 (0x65d5 bytes) 2024-09-11T05:33:27.384 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:27.382+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:27.387 INFO:teuthology.orchestra.run.smithi070.stdout:2684 trunc from 0xe2fefdb to 0x7cb3592 2024-09-11T05:33:27.397 INFO:teuthology.orchestra.run.smithi070.stdout:2685 writesame 0x21e49c4 thru 0x21f05b5 data_size 0xb(0xbbf2 bytes) 2024-09-11T05:33:27.413 INFO:teuthology.orchestra.run.smithi070.stdout:2686 read 0x1ca73dc thru 0x1caae8b (0x3ab0 bytes) 2024-09-11T05:33:27.413 INFO:teuthology.orchestra.run.smithi070.stdout:2688 writesame 0x650cea6 thru 0x650cea6 data_size 0x1(0x1 bytes) 2024-09-11T05:33:27.416 INFO:teuthology.orchestra.run.smithi070.stdout:2691 punch from 0x4ca78f6 to 0x4cab093, (0x379d bytes) 2024-09-11T05:33:27.416 INFO:teuthology.orchestra.run.smithi070.stdout:2692 punch from 0x30c369b to 0x30cf769, (0xc0ce bytes) 2024-09-11T05:33:27.424 INFO:teuthology.orchestra.run.smithi070.stdout:2694 write 0xa8b8637 thru 0xa8c4206 (0xbbd0 bytes) 2024-09-11T05:33:27.434 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:27.434 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:27.442 INFO:teuthology.orchestra.run.smithi070.stdout:2695 write 0x7680c73 thru 0x768e554 (0xd8e2 bytes) 2024-09-11T05:33:27.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:27.457 INFO:teuthology.orchestra.run.smithi070.stdout:2697 write 0xfb3524 thru 0xfb3837 (0x314 bytes) 2024-09-11T05:33:27.459 INFO:teuthology.orchestra.run.smithi070.stdout:2699 write 0x11eccf3 thru 0x11f40ed (0x73fb bytes) 2024-09-11T05:33:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:2701 write 0x66e258 thru 0x674e5b (0x6c04 bytes) 2024-09-11T05:33:27.468 INFO:teuthology.orchestra.run.smithi070.stdout:2703 trunc from 0xa8c4207 to 0xbfed982 2024-09-11T05:33:27.473 INFO:teuthology.orchestra.run.smithi070.stdout:2704 read 0x44017a0 thru 0x44047c1 (0x3022 bytes) 2024-09-11T05:33:27.474 INFO:teuthology.orchestra.run.smithi070.stdout:2705 read 0x81544e8 thru 0x8161306 (0xce1f bytes) 2024-09-11T05:33:27.477 INFO:teuthology.orchestra.run.smithi070.stdout:2707 trunc from 0xbfed982 to 0x9033733 2024-09-11T05:33:27.484 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:27.484+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:27.495 INFO:teuthology.orchestra.run.smithi070.stdout:2708 trunc from 0x9033733 to 0x4ca3365 2024-09-11T05:33:27.507 INFO:teuthology.orchestra.run.smithi070.stdout:2709 writesame 0x2f9da9b thru 0x2fa43a5 data_size 0x1(0x690b bytes) 2024-09-11T05:33:27.526 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:27.526 INFO:teuthology.orchestra.run.smithi070.stdout:2711 punch from 0x3f2b4bb to 0x3f33adb, (0x8620 bytes) 2024-09-11T05:33:27.543 INFO:teuthology.orchestra.run.smithi070.stdout:2712 write 0xebc82b3 thru 0xebc97b6 (0x1504 bytes) 2024-09-11T05:33:27.553 INFO:teuthology.orchestra.run.smithi070.stdout:2713 trunc from 0xebc97b7 to 0xa22f0e9 2024-09-11T05:33:27.563 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:27.568 INFO:teuthology.orchestra.run.smithi070.stdout:2717 trunc from 0xa22f0e9 to 0xe57cdbe 2024-09-11T05:33:27.573 INFO:teuthology.orchestra.run.smithi070.stdout:2719 trunc from 0xe57cdbe to 0xe1bebad 2024-09-11T05:33:27.578 INFO:teuthology.orchestra.run.smithi070.stdout:2720 write 0x5103146 thru 0x5104fd2 (0x1e8d bytes) 2024-09-11T05:33:27.584 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:27.584 INFO:teuthology.orchestra.run.smithi070.stdout:2722 write 0x1d162ce thru 0x1d256d2 (0xf405 bytes) 2024-09-11T05:33:27.585 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:27.585+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:27.586 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:27.587 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:27.598 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:27.599 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:27.599 INFO:teuthology.orchestra.run.smithi070.stdout:2726 punch from 0xac49bc8 to 0xac4fabd, (0x5ef5 bytes) 2024-09-11T05:33:27.599 INFO:teuthology.orchestra.run.smithi070.stdout:2727 write 0xa60746e thru 0xa60aa19 (0x35ac bytes) 2024-09-11T05:33:27.600 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:27.604 INFO:teuthology.orchestra.run.smithi070.stdout:2729 read 0x52e52e6 thru 0x52f097b (0xb696 bytes) 2024-09-11T05:33:27.605 INFO:teuthology.orchestra.run.smithi070.stdout:2730 write 0x7d0bba7 thru 0x7d14e0a (0x9264 bytes) 2024-09-11T05:33:27.617 INFO:teuthology.orchestra.run.smithi070.stdout:2731 read 0xe00dcd1 thru 0xe018454 (0xa784 bytes) 2024-09-11T05:33:27.631 INFO:teuthology.orchestra.run.smithi070.stdout:2732 trunc from 0xe1bebad to 0x348e62e 2024-09-11T05:33:27.655 INFO:teuthology.orchestra.run.smithi070.stdout:2734 writesame 0x7066665 thru 0x706ecb1 data_size 0x1(0x864d bytes) 2024-09-11T05:33:27.656 INFO:teuthology.orchestra.run.smithi070.stdout:2737 read 0x546587c thru 0x5466e9a (0x161f bytes) 2024-09-11T05:33:27.656 INFO:teuthology.orchestra.run.smithi070.stdout:2738 punch from 0x6787941 to 0x6793d0c, (0xc3cb bytes) 2024-09-11T05:33:27.661 INFO:teuthology.orchestra.run.smithi070.stdout:2739 write 0x76f6763 thru 0x76fe534 (0x7dd2 bytes) 2024-09-11T05:33:27.677 INFO:teuthology.orchestra.run.smithi070.stdout:2741 trunc from 0x76fe535 to 0xb722d04 2024-09-11T05:33:27.686 INFO:teuthology.orchestra.run.smithi070.stdout:2742 trunc from 0xb722d04 to 0x7e25c06 2024-09-11T05:33:27.687 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:27.686+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:27.692 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:27.692 INFO:teuthology.orchestra.run.smithi070.stdout:2744 punch from 0x4c2db20 to 0x4c2f26e, (0x174e bytes) 2024-09-11T05:33:27.692 INFO:teuthology.orchestra.run.smithi070.stdout:2746 write 0x852c91 thru 0x85dd08 (0xb078 bytes) 2024-09-11T05:33:27.708 INFO:teuthology.orchestra.run.smithi070.stdout:2747 clone 20 order 21 su 16384 sc 8 2024-09-11T05:33:27.730 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:27.730 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:27.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:27.748 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T05:33:27.750 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T05:33:27.766 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-11T05:33:27.787 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:27.786+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:27.878 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:27.878 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:27.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:27.889 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:27.888+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:27.963 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-11T05:33:27.989 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:27.989+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:28.063 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:28.063 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:28.076 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:28.090 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:33:28.091 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:28.090+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:28.193 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:28.191+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:28.293 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:28.291+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:28.316 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:28.316 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:28.330 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:28.343 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:28.343 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:28.365 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:28.365 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:28.388 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:28.388 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:28.394 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:28.393+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:28.406 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:28.406 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:28.437 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:28.440 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:28.469 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:28.493 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:28.493 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:28.494 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:28.494+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:28.499 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:28.499 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:28.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:28.516 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:28.516 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:28.595 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:28.595+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:28.624 INFO:teuthology.orchestra.run.smithi070.stdout:2748 write 0xc7701a1 thru 0xc77742f (0x728f bytes) 2024-09-11T05:33:28.625 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:33:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.033847919999999, 2024-09-11T05:33:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:33:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:33:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:33:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:33:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:33:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:33:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:33:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:33:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:33:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.45691266, 2024-09-11T05:33:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:33:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:33:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:33:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:33:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:33:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:33:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:33:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:33:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:33:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:33:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:33:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:33:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:33:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:33:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:33:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:33:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:33:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:33:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4568938610000002, 2024-09-11T05:33:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:33:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:33:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:33:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:33:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:33:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:33:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:33:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:33:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:33:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:33:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:33:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:33:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:33:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:33:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:33:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.45686983, 2024-09-11T05:33:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:33:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:33:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:33:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:33:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:33:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:33:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:33:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:33:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:33:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:33:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:33:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:33:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:33:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:33:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:33:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4567930420000001, 2024-09-11T05:33:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:33:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:33:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:33:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:33:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4567657189999998, 2024-09-11T05:33:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:33:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:33:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:33:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:33:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:33:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:33:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:33:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:33:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:33:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.456747171, 2024-09-11T05:33:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:33:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:33:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:33:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:33:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:33:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:33:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:33:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:33:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:33:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:33:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:33:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:33:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:33:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:33:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:33:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:33:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4567291, 2024-09-11T05:33:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:33:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:33:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:33:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:33:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:33:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:33:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:33:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:33:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:33:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:33:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:33:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:33:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:33:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:33:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:33:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:33:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4551314570000002, 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:33:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:33:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:33:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:33:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:33:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:33:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:33:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:33:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:33:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:33:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:33:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:33:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:33:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4551111309999998, 2024-09-11T05:33:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:33:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:33:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:33:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:33:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:33:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:33:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:33:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:33:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:33:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:33:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:33:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:33:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4550721329999998, 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:33:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:33:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:33:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:33:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:33:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:33:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:33:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:33:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:33:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4550514909999999, 2024-09-11T05:33:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:33:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:33:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:33:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:33:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:33:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:33:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:33:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:33:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:33:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:33:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:33:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4549286280000002, 2024-09-11T05:33:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:33:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:33:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:33:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:33:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:33:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:33:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:33:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:33:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:33:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:33:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:33:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:33:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:33:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:33:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:33:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:33:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4547690709999999, 2024-09-11T05:33:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:33:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:33:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:33:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:33:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:33:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:33:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:33:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:33:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:33:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:33:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:33:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:33:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:33:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4530844040000002, 2024-09-11T05:33:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:33:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:33:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:33:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:33:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:33:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:33:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:33:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:33:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:33:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:33:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:33:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:33:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:33:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:33:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4530563989999998, 2024-09-11T05:33:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:33:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:33:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:33:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:33:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:33:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:33:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:33:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:33:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:33:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:33:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:33:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:33:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:33:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:33:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:33:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44388 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8118272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:33:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4516650659999999, 2024-09-11T05:33:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044546074999999997, 2024-09-11T05:33:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44388 2024-09-11T05:33:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172487+0000", 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172490+0000", 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5090000000000002e-06 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172497+0000", 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172502+0000", 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2000000000000002e-06 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216878+0000", 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044375900000000003 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216925+0000", 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7058999999999998e-05 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216982+0000", 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6932000000000003e-05 2024-09-11T05:33:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.451589936, 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.710 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:33:28.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.710 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:33:28.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:33:28.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:33:28.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:33:28.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:33:28.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:33:28.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:33:28.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:33:28.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:33:28.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:33:28.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:33:28.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:33:28.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.713 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:33:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4514046349999998, 2024-09-11T05:33:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:33:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:33:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:33:28.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:33:28.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:33:28.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:33:28.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:33:28.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:33:28.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:33:28.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:33:28.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:33:28.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:33:28.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:33:28.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:33:28.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:33:28.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:33:28.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:33:28.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:33:28.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.718 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.719 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:28.719 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:33:28.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.45123318, 2024-09-11T05:33:28.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:33:28.719 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:28.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:28.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:28.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:28.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:28.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:28.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:33:28.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.720 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:28.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:28.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:33:28.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:28.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:33:28.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:28.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:28.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:33:28.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:33:28.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:28.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:33:28.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:33:28.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:28.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:33:28.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:33:28.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:28.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:33:28.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:33:28.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:28.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:33:28.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:33:28.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:28.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:33:28.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:33:28.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:28.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:28.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:28.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:33:28.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:33:28.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.723 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:28.724 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:28.724 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:28.725 INFO:teuthology.orchestra.run.smithi070.stdout:2749 read 0xbd8c7ca thru 0xbd92488 (0x5cbf bytes) 2024-09-11T05:33:28.725 INFO:teuthology.orchestra.run.smithi070.stdout:2752 punch from 0x2423089 to 0x242d755, (0xa6cc bytes) 2024-09-11T05:33:28.725 INFO:teuthology.orchestra.run.smithi070.stdout:2753 read 0x7ec4e1f thru 0x7ec86d7 (0x38b9 bytes) 2024-09-11T05:33:28.725 INFO:teuthology.orchestra.run.smithi070.stdout:2754 write 0x2cbd7a2 thru 0x2cc3e57 (0x66b6 bytes) 2024-09-11T05:33:28.726 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:28.727 INFO:teuthology.orchestra.run.smithi070.stdout:2756 punch from 0x204951c to 0x204da09, (0x44ed bytes) 2024-09-11T05:33:28.727 INFO:teuthology.orchestra.run.smithi070.stdout:2757 trunc from 0xc777430 to 0x6ec6659 2024-09-11T05:33:28.727 INFO:teuthology.orchestra.run.smithi070.stdout:2758 read 0x3b78fba thru 0x3b86b8c (0xdbd3 bytes) 2024-09-11T05:33:28.727 INFO:teuthology.orchestra.run.smithi070.stdout:2760 punch from 0x12fedd7 to 0x130ad30, (0xbf59 bytes) 2024-09-11T05:33:28.727 INFO:teuthology.orchestra.run.smithi070.stdout:2761 trunc from 0x6ec6659 to 0x181bc2f 2024-09-11T05:33:28.728 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:28.724+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:28.757 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.5 to 1 (10000) 2024-09-11T05:33:28.760 INFO:teuthology.orchestra.run.smithi070.stdout:2762 write 0x6cbc163 thru 0x6cbf0a2 (0x2f40 bytes) 2024-09-11T05:33:28.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-11T05:33:28.772 INFO:teuthology.orchestra.run.smithi070.stdout:2766 write 0x7b5804a thru 0x7b65a0e (0xd9c5 bytes) 2024-09-11T05:33:28.778 INFO:teuthology.orchestra.run.smithi070.stdout:2767 writesame 0x19b9939 thru 0x19c899c data_size 0x11(0xf064 bytes) 2024-09-11T05:33:28.783 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:28.783 INFO:teuthology.orchestra.run.smithi070.stdout:2770 writesame 0x3288c0c thru 0x32904c5 data_size 0x12(0x78ba bytes) 2024-09-11T05:33:28.788 INFO:teuthology.orchestra.run.smithi070.stdout:2772 punch from 0x49e6043 to 0x49f1057, (0xb014 bytes) 2024-09-11T05:33:28.788 INFO:teuthology.orchestra.run.smithi070.stdout:2773 read 0x1a25e63 thru 0x1a33810 (0xd9ae bytes) 2024-09-11T05:33:28.788 INFO:teuthology.orchestra.run.smithi070.stdout:2774 write 0x9b4a3d thru 0x9b9ad2 (0x5096 bytes) 2024-09-11T05:33:28.823 INFO:teuthology.orchestra.run.smithi070.stdout:2775 punch from 0x529a74a to 0x52a7ad1, (0xd387 bytes) 2024-09-11T05:33:28.826 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:28.825+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:28.828 INFO:teuthology.orchestra.run.smithi070.stdout:2776 write 0x81359d5 thru 0x813d06b (0x7697 bytes) 2024-09-11T05:33:28.836 INFO:teuthology.orchestra.run.smithi070.stdout:2778 read 0x4fc6f36 thru 0x4fd5e88 (0xef53 bytes) 2024-09-11T05:33:28.845 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:28.845 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:28.845 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:28.845 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:28.847 INFO:teuthology.orchestra.run.smithi070.stdout:2779 writesame 0xc70c8bb thru 0xc71b70d data_size 0x3(0xee53 bytes) 2024-09-11T05:33:28.847 INFO:teuthology.orchestra.run.smithi070.stdout:2780 write 0x5dd876e thru 0x5de6625 (0xdeb8 bytes) 2024-09-11T05:33:28.855 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:28.856 INFO:teuthology.orchestra.run.smithi070.stdout:2781 writesame 0x9387ab9 thru 0x9396020 data_size 0xc(0xe568 bytes) 2024-09-11T05:33:28.863 INFO:teuthology.orchestra.run.smithi070.stdout:2782 read 0x14f11b0 thru 0x14f9da3 (0x8bf4 bytes) 2024-09-11T05:33:28.864 INFO:teuthology.orchestra.run.smithi070.stdout:2784 punch from 0x438d186 to 0x438e0ca, (0xf44 bytes) 2024-09-11T05:33:28.864 INFO:teuthology.orchestra.run.smithi070.stdout:2785 write 0x1920437 thru 0x192b550 (0xb11a bytes) 2024-09-11T05:33:28.865 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:28.865 INFO:teuthology.orchestra.run.smithi070.stdout:2788 write 0xc218225 thru 0xc226e19 (0xebf5 bytes) 2024-09-11T05:33:28.871 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:28.871 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:28.871 INFO:teuthology.orchestra.run.smithi070.stdout:2791 read 0x92af356 thru 0x92b8b10 (0x97bb bytes) 2024-09-11T05:33:28.871 INFO:teuthology.orchestra.run.smithi070.stdout:2793 write 0x964705f thru 0x965547e (0xe420 bytes) 2024-09-11T05:33:28.878 INFO:teuthology.orchestra.run.smithi070.stdout:2795 write 0xcae39ec thru 0xcae5dc0 (0x23d5 bytes) 2024-09-11T05:33:28.887 INFO:teuthology.orchestra.run.smithi070.stdout:2796 trunc from 0xcae5dc1 to 0x5cc0b88 2024-09-11T05:33:28.905 INFO:teuthology.orchestra.run.smithi070.stdout:2797 trunc from 0x5cc0b88 to 0x7f97a8b 2024-09-11T05:33:28.910 INFO:teuthology.orchestra.run.smithi070.stdout:2799 punch from 0x1392842 to 0x139d546, (0xad04 bytes) 2024-09-11T05:33:28.910 INFO:teuthology.orchestra.run.smithi070.stdout:2800 read 0x5828f8a thru 0x5838bd0 (0xfc47 bytes) 2024-09-11T05:33:28.911 INFO:teuthology.orchestra.run.smithi070.stdout:2801 read 0x4029ccf thru 0x403880c (0xeb3e bytes) 2024-09-11T05:33:28.911 INFO:teuthology.orchestra.run.smithi070.stdout:2802 read 0x74a733d thru 0x74b016f (0x8e33 bytes) 2024-09-11T05:33:28.911 INFO:teuthology.orchestra.run.smithi070.stdout:2803 punch from 0x67a3832 to 0x67a94df, (0x5cad bytes) 2024-09-11T05:33:28.915 INFO:teuthology.orchestra.run.smithi070.stdout:2804 trunc from 0x7f97a8b to 0xb02f9b8 2024-09-11T05:33:28.920 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:28.920 INFO:teuthology.orchestra.run.smithi070.stdout:2806 read 0x120a404 thru 0x1219404 (0xf001 bytes) 2024-09-11T05:33:28.921 INFO:teuthology.orchestra.run.smithi070.stdout:2807 read 0xa132f thru 0xb0021 (0xecf3 bytes) 2024-09-11T05:33:28.922 INFO:teuthology.orchestra.run.smithi070.stdout:2808 read 0xa573ea4 thru 0xa57b594 (0x76f1 bytes) 2024-09-11T05:33:28.922 INFO:teuthology.orchestra.run.smithi070.stdout:2809 read 0xae9e634 thru 0xaeaadd5 (0xc7a2 bytes) 2024-09-11T05:33:28.922 INFO:teuthology.orchestra.run.smithi070.stdout:2810 write 0xea64b8 thru 0xea73fc (0xf45 bytes) 2024-09-11T05:33:28.930 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:28.927+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:28.953 INFO:teuthology.orchestra.run.smithi070.stdout:2811 trunc from 0xb02f9b8 to 0x41f1f9a 2024-09-11T05:33:28.962 INFO:teuthology.orchestra.run.smithi070.stdout:2812 read 0x1270353 thru 0x12770c9 (0x6d77 bytes) 2024-09-11T05:33:28.978 INFO:teuthology.orchestra.run.smithi070.stdout:2813 writesame 0xcf21a0d thru 0xcf273c9 data_size 0x1(0x59bd bytes) 2024-09-11T05:33:28.978 INFO:teuthology.orchestra.run.smithi070.stdout:2815 read 0x4a5d30c thru 0x4a5e8b0 (0x15a5 bytes) 2024-09-11T05:33:28.979 INFO:teuthology.orchestra.run.smithi070.stdout:2816 write 0x8c32558 thru 0x8c38dce (0x6877 bytes) 2024-09-11T05:33:28.983 INFO:teuthology.orchestra.run.smithi070.stdout:2817 write 0xccf702e thru 0xccfd04f (0x6022 bytes) 2024-09-11T05:33:28.988 INFO:teuthology.orchestra.run.smithi070.stdout:2819 punch from 0xc49f671 to 0xc49fa93, (0x422 bytes) 2024-09-11T05:33:28.988 INFO:teuthology.orchestra.run.smithi070.stdout:2821 read 0xa61198b thru 0xa618d82 (0x73f8 bytes) 2024-09-11T05:33:28.988 INFO:teuthology.orchestra.run.smithi070.stdout:2822 read 0xba431b1 thru 0xba486ad (0x54fd bytes) 2024-09-11T05:33:28.988 INFO:teuthology.orchestra.run.smithi070.stdout:2823 write 0xb525eed thru 0xb52cadc (0x6bf0 bytes) 2024-09-11T05:33:28.992 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:28.992 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:28.992 INFO:teuthology.orchestra.run.smithi070.stdout:2826 read 0x3a96e3e thru 0x3aa6df5 (0xffb8 bytes) 2024-09-11T05:33:28.992 INFO:teuthology.orchestra.run.smithi070.stdout:2827 read 0x9e8be99 thru 0x9e9b011 (0xf179 bytes) 2024-09-11T05:33:28.992 INFO:teuthology.orchestra.run.smithi070.stdout:2829 writesame 0x8df948 thru 0x8e5a1b data_size 0x2(0x60d4 bytes) 2024-09-11T05:33:29.014 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:29.015 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:29.015 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:29.015 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:29.015 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:29.024 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:29.033 INFO:teuthology.orchestra.run.smithi070.stdout:2831 read 0x31652b8 thru 0x31710e0 (0xbe29 bytes) 2024-09-11T05:33:29.034 INFO:teuthology.orchestra.run.smithi070.stdout:2832 punch from 0xbd32824 to 0xbd33f64, (0x1740 bytes) 2024-09-11T05:33:29.034 INFO:teuthology.orchestra.run.smithi070.stdout:2834 write 0xaa5902b thru 0xaa66637 (0xd60d bytes) 2024-09-11T05:33:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:2835 read 0x450de09 thru 0x4516f18 (0x9110 bytes) 2024-09-11T05:33:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:2837 read 0x1fcc92f thru 0x1fd6fe4 (0xa6b6 bytes) 2024-09-11T05:33:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:2838 read 0xbc1c46a thru 0xbc2a532 (0xe0c9 bytes) 2024-09-11T05:33:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:2839 punch from 0x36bb483 to 0x36c127a, (0x5df7 bytes) 2024-09-11T05:33:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:2840 read 0xcae50a5 thru 0xcae8ff8 (0x3f54 bytes) 2024-09-11T05:33:29.040 INFO:teuthology.orchestra.run.smithi070.stdout:2842 read 0x9f8c355 thru 0x9f924d7 (0x6183 bytes) 2024-09-11T05:33:29.041 INFO:teuthology.orchestra.run.smithi070.stdout:2843 trunc from 0xcf273ca to 0xbbe6b51 2024-09-11T05:33:29.052 INFO:teuthology.orchestra.run.smithi070.stdout:2844 read 0x418c0ac thru 0x419716c (0xb0c1 bytes) 2024-09-11T05:33:29.053 INFO:teuthology.orchestra.run.smithi070.stdout:2845 punch from 0x2ce2600 to 0x2cee049, (0xba49 bytes) 2024-09-11T05:33:29.053 INFO:teuthology.orchestra.run.smithi070.stdout:2846 write 0x936728e thru 0x9369318 (0x208b bytes) 2024-09-11T05:33:29.058 INFO:teuthology.orchestra.run.smithi070.stdout:2847 write 0x2cab46 thru 0x2d5fe4 (0xb49f bytes) 2024-09-11T05:33:29.067 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:29.066+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:29.107 INFO:teuthology.orchestra.run.smithi070.stdout:2849 read 0x8f54692 thru 0x8f5b1f0 (0x6b5f bytes) 2024-09-11T05:33:29.108 INFO:teuthology.orchestra.run.smithi070.stdout:2850 write 0x4cf85f6 thru 0x4d0830a (0xfd15 bytes) 2024-09-11T05:33:29.118 INFO:teuthology.orchestra.run.smithi070.stdout:2851 writesame 0x4835af4 thru 0x48387af data_size 0xe(0x2cbc bytes) 2024-09-11T05:33:29.120 INFO:teuthology.orchestra.run.smithi070.stdout:2852 writesame 0x8ac08 thru 0x99f16 data_size 0x7(0xf30f bytes) 2024-09-11T05:33:29.127 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:29.126+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:29.129 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.130 INFO:teuthology.orchestra.run.smithi070.stdout:2854 write 0x4c74bc0 thru 0x4c80981 (0xbdc2 bytes) 2024-09-11T05:33:29.134 INFO:teuthology.orchestra.run.smithi070.stdout:2855 trunc from 0xbbe6b51 to 0x9acedce 2024-09-11T05:33:29.143 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:29.144 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:29.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:29.144 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:33:29.144 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:29.147 INFO:teuthology.orchestra.run.smithi070.stdout:2857 read 0x21c0305 thru 0x21cac1e (0xa91a bytes) 2024-09-11T05:33:29.147 INFO:teuthology.orchestra.run.smithi070.stdout:2858 read 0x808b0af thru 0x808b297 (0x1e9 bytes) 2024-09-11T05:33:29.147 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.147 INFO:teuthology.orchestra.run.smithi070.stdout:2860 punch from 0x96e12fc to 0x96e8512, (0x7216 bytes) 2024-09-11T05:33:29.149 INFO:teuthology.orchestra.run.smithi070.stdout:2861 trunc from 0x9acedce to 0xc090154 2024-09-11T05:33:29.153 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:29.155 INFO:teuthology.orchestra.run.smithi070.stdout:2862 writesame 0x98580ca thru 0x9861426 data_size 0x19(0x935d bytes) 2024-09-11T05:33:29.159 INFO:teuthology.orchestra.run.smithi070.stdout:2863 write 0xaa578d5 thru 0xaa5b4c6 (0x3bf2 bytes) 2024-09-11T05:33:29.162 INFO:teuthology.orchestra.run.smithi070.stdout:2864 punch from 0x34a5e2d to 0x34b1faf, (0xc182 bytes) 2024-09-11T05:33:29.162 INFO:teuthology.orchestra.run.smithi070.stdout:2865 punch from 0x2622064 to 0x262f451, (0xd3ed bytes) 2024-09-11T05:33:29.162 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.162 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.162 INFO:teuthology.orchestra.run.smithi070.stdout:2868 read 0xa1baae thru 0xa28654 (0xcba7 bytes) 2024-09-11T05:33:29.163 INFO:teuthology.orchestra.run.smithi070.stdout:2869 read 0x8dd8b9e thru 0x8de432f (0xb792 bytes) 2024-09-11T05:33:29.163 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.163 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.163 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.163 INFO:teuthology.orchestra.run.smithi070.stdout:2874 read 0x6402bfa thru 0x6412ae9 (0xfef0 bytes) 2024-09-11T05:33:29.164 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.164 INFO:teuthology.orchestra.run.smithi070.stdout:2877 read 0x5b1647d thru 0x5b26215 (0xfd99 bytes) 2024-09-11T05:33:29.164 INFO:teuthology.orchestra.run.smithi070.stdout:2878 write 0x26835 thru 0x2d967 (0x7133 bytes) 2024-09-11T05:33:29.165 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.172 INFO:teuthology.orchestra.run.smithi070.stdout:2880 write 0xda50473 thru 0xda5104c (0xbda bytes) 2024-09-11T05:33:29.177 INFO:teuthology.orchestra.run.smithi070.stdout:2881 trunc from 0xda5104d to 0xb6f0038 2024-09-11T05:33:29.186 INFO:teuthology.orchestra.run.smithi070.stdout:2882 writesame 0xae06105 thru 0xae08f82 data_size 0xb(0x2e7e bytes) 2024-09-11T05:33:29.198 INFO:teuthology.orchestra.run.smithi070.stdout:2883 writesame 0xd6f846d thru 0xd70680f data_size 0x25(0xe3a3 bytes) 2024-09-11T05:33:29.213 INFO:teuthology.orchestra.run.smithi070.stdout:2884 trunc from 0xd706810 to 0xeb41c2 2024-09-11T05:33:29.228 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:29.227+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:29.230 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.230 INFO:teuthology.orchestra.run.smithi070.stdout:2888 read 0xdd150e thru 0xddcbdd (0xb6d0 bytes) 2024-09-11T05:33:29.230 INFO:teuthology.orchestra.run.smithi070.stdout:2890 read 0xb0139f thru 0xb08299 (0x6efb bytes) 2024-09-11T05:33:29.247 INFO:teuthology.orchestra.run.smithi070.stdout:2891 write 0x9c96fc6 thru 0x9c999d5 (0x2a10 bytes) 2024-09-11T05:33:29.260 INFO:teuthology.orchestra.run.smithi070.stdout:2895 write 0xd03cc5f thru 0xd044c9a (0x803c bytes) 2024-09-11T05:33:29.264 INFO:teuthology.orchestra.run.smithi070.stdout:2896 punch from 0xc765567 to 0xc76db48, (0x85e1 bytes) 2024-09-11T05:33:29.270 INFO:teuthology.orchestra.run.smithi070.stdout:2897 write 0xdffd553 thru 0xdffd855 (0x303 bytes) 2024-09-11T05:33:29.272 INFO:teuthology.orchestra.run.smithi070.stdout:2898 write 0x809e992 thru 0x80a46b6 (0x5d25 bytes) 2024-09-11T05:33:29.276 INFO:teuthology.orchestra.run.smithi070.stdout:2899 writesame 0x1d80a1c thru 0x1d85d72 data_size 0x11(0x5357 bytes) 2024-09-11T05:33:29.280 INFO:teuthology.orchestra.run.smithi070.stdout:2901 read 0xabe1067 thru 0xabeef12 (0xdeac bytes) 2024-09-11T05:33:29.280 INFO:teuthology.orchestra.run.smithi070.stdout:2902 read 0x2b0e9ca thru 0x2b1c1a9 (0xd7e0 bytes) 2024-09-11T05:33:29.280 INFO:teuthology.orchestra.run.smithi070.stdout:2903 write 0x37f0b1c thru 0x37f38eb (0x2dd0 bytes) 2024-09-11T05:33:29.283 INFO:teuthology.orchestra.run.smithi070.stdout:2904 writesame 0x63dfe65 thru 0x63e708e data_size 0x3(0x722a bytes) 2024-09-11T05:33:29.291 INFO:teuthology.orchestra.run.smithi070.stdout:2905 read 0xbe5df9a thru 0xbe5ffcd (0x2034 bytes) 2024-09-11T05:33:29.305 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:29.305 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:29.305 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:29.305 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:29.307 INFO:teuthology.orchestra.run.smithi070.stdout:2907 trunc from 0xdffd856 to 0x4bd1a9 2024-09-11T05:33:29.315 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:29.322 INFO:teuthology.orchestra.run.smithi070.stdout:2909 punch from 0x17637e to 0x1843f5, (0xe077 bytes) 2024-09-11T05:33:29.322 INFO:teuthology.orchestra.run.smithi070.stdout:2910 read 0x42c98 thru 0x438de (0xc47 bytes) 2024-09-11T05:33:29.329 INFO:teuthology.orchestra.run.smithi070.stdout:2911 write 0xec085e thru 0xec7ed1 (0x7674 bytes) 2024-09-11T05:33:29.345 INFO:teuthology.orchestra.run.smithi070.stdout:2912 write 0x883a047 thru 0x8847791 (0xd74b bytes) 2024-09-11T05:33:29.350 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.350 INFO:teuthology.orchestra.run.smithi070.stdout:2914 writesame 0x2655f2e thru 0x2656481 data_size 0xb(0x554 bytes) 2024-09-11T05:33:29.353 INFO:teuthology.orchestra.run.smithi070.stdout:2915 write 0x65e7352 thru 0x65eca3a (0x56e9 bytes) 2024-09-11T05:33:29.357 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.357 INFO:teuthology.orchestra.run.smithi070.stdout:2917 trunc from 0x8847792 to 0x82140d6 2024-09-11T05:33:29.358 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:29.357+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:29.364 INFO:teuthology.orchestra.run.smithi070.stdout:2918 punch from 0x2df5d8c to 0x2df9b9f, (0x3e13 bytes) 2024-09-11T05:33:29.367 INFO:teuthology.orchestra.run.smithi070.stdout:2921 trunc from 0x82140d6 to 0x5158336 2024-09-11T05:33:29.378 INFO:teuthology.orchestra.run.smithi070.stdout:2922 writesame 0x42db082 thru 0x42dbcd4 data_size 0x1(0xc53 bytes) 2024-09-11T05:33:29.392 INFO:teuthology.orchestra.run.smithi070.stdout:2923 writesame 0x82b9491 thru 0x82bc98b data_size 0x21(0x34fb bytes) 2024-09-11T05:33:29.392 INFO:teuthology.orchestra.run.smithi070.stdout:2924 write 0x5d119e8 thru 0x5d14bbf (0x31d8 bytes) 2024-09-11T05:33:29.408 INFO:teuthology.orchestra.run.smithi070.stdout:2925 write 0xdd8d40e thru 0xdd9225b (0x4e4e bytes) 2024-09-11T05:33:29.411 INFO:teuthology.orchestra.run.smithi070.stdout:2926 read 0xbd7224c thru 0xbd787cc (0x6581 bytes) 2024-09-11T05:33:29.417 INFO:teuthology.orchestra.run.smithi070.stdout:2927 writesame 0xe658aee thru 0xe65d298 data_size 0x1(0x47ab bytes) 2024-09-11T05:33:29.417 INFO:teuthology.orchestra.run.smithi070.stdout:2928 read 0x8a1ff0f thru 0x8a2bf3c (0xc02e bytes) 2024-09-11T05:33:29.417 INFO:teuthology.orchestra.run.smithi070.stdout:2930 write 0x6b10ff thru 0x6b8357 (0x7259 bytes) 2024-09-11T05:33:29.426 INFO:teuthology.orchestra.run.smithi070.stdout:2931 trunc from 0xe65d299 to 0x817a93d 2024-09-11T05:33:29.426 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:29.427 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:29.427 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:29.427 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:29.427 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:29.429 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:29.428+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:29.435 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.437 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:29.445 INFO:teuthology.orchestra.run.smithi070.stdout:2934 trunc from 0x817a93d to 0x241f10 2024-09-11T05:33:29.457 INFO:teuthology.orchestra.run.smithi070.stdout:2935 punch from 0x20ce6b to 0x2175fa, (0xa78f bytes) 2024-09-11T05:33:29.457 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.457 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.457 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.457 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.475 INFO:teuthology.orchestra.run.smithi070.stdout:2940 writesame 0xa526090 thru 0xa534934 data_size 0x1(0xe8a5 bytes) 2024-09-11T05:33:29.485 INFO:teuthology.orchestra.run.smithi070.stdout:2941 trunc from 0xa534935 to 0x1e4c8c9 2024-09-11T05:33:29.491 INFO:teuthology.orchestra.run.smithi070.stdout:2942 read 0x1d603cd thru 0x1d69043 (0x8c77 bytes) 2024-09-11T05:33:29.504 INFO:teuthology.orchestra.run.smithi070.stdout:2943 trunc from 0x1e4c8c9 to 0xcb3caca 2024-09-11T05:33:29.509 INFO:teuthology.orchestra.run.smithi070.stdout:2944 writesame 0x4315d5d thru 0x432311c data_size 0xb0(0xd3c0 bytes) 2024-09-11T05:33:29.514 INFO:teuthology.orchestra.run.smithi070.stdout:2946 read 0x8426769 thru 0x842b263 (0x4afb bytes) 2024-09-11T05:33:29.515 INFO:teuthology.orchestra.run.smithi070.stdout:2950 read 0x9e100a1 thru 0x9e1d87a (0xd7da bytes) 2024-09-11T05:33:29.515 INFO:teuthology.orchestra.run.smithi070.stdout:2951 read 0x9a88257 thru 0x9a8bb05 (0x38af bytes) 2024-09-11T05:33:29.515 INFO:teuthology.orchestra.run.smithi070.stdout:2953 read 0x2e13a55 thru 0x2e2354e (0xfafa bytes) 2024-09-11T05:33:29.522 INFO:teuthology.orchestra.run.smithi070.stdout:2955 writesame 0xd9235bd thru 0xd92c9f9 data_size 0x1(0x943d bytes) 2024-09-11T05:33:29.522 INFO:teuthology.orchestra.run.smithi070.stdout:2958 read 0x215afb6 thru 0x215d278 (0x22c3 bytes) 2024-09-11T05:33:29.522 INFO:teuthology.orchestra.run.smithi070.stdout:2959 read 0x43d3ab thru 0x441cb7 (0x490d bytes) 2024-09-11T05:33:29.522 INFO:teuthology.orchestra.run.smithi070.stdout:2960 read 0x17a15cf thru 0x17a7dbf (0x67f1 bytes) 2024-09-11T05:33:29.523 INFO:teuthology.orchestra.run.smithi070.stdout:2961 write 0xcd5078b thru 0xcd5a96e (0xa1e4 bytes) 2024-09-11T05:33:29.526 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.526 INFO:teuthology.orchestra.run.smithi070.stdout:2963 punch from 0x8dffa8f to 0x8e04f0e, (0x547f bytes) 2024-09-11T05:33:29.526 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.526 INFO:teuthology.orchestra.run.smithi070.stdout:2965 read 0x35b5604 thru 0x35c00ae (0xaaab bytes) 2024-09-11T05:33:29.526 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.529 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:29.528+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:29.539 INFO:teuthology.orchestra.run.smithi070.stdout:2968 trunc from 0xd92c9fa to 0x33bf551 2024-09-11T05:33:29.549 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.549 INFO:teuthology.orchestra.run.smithi070.stdout:2970 punch from 0x26967b9 to 0x269f3e3, (0x8c2a bytes) 2024-09-11T05:33:29.549 INFO:teuthology.orchestra.run.smithi070.stdout:2971 write 0x21f6966 thru 0x2203c77 (0xd312 bytes) 2024-09-11T05:33:29.564 INFO:teuthology.orchestra.run.smithi070.stdout:2972 trunc from 0x33bf551 to 0xbed9b3c 2024-09-11T05:33:29.570 INFO:teuthology.orchestra.run.smithi070.stdout:2973 read 0x4c67560 thru 0x4c77064 (0xfb05 bytes) 2024-09-11T05:33:29.576 INFO:teuthology.orchestra.run.smithi070.stdout:2974 write 0xc030dcd thru 0xc030f80 (0x1b4 bytes) 2024-09-11T05:33:29.579 INFO:teuthology.orchestra.run.smithi070.stdout:2975 write 0x8fb98f5 thru 0x8fbed77 (0x5483 bytes) 2024-09-11T05:33:29.582 INFO:teuthology.orchestra.run.smithi070.stdout:2976 read 0x803584e thru 0x8038701 (0x2eb4 bytes) 2024-09-11T05:33:29.582 INFO:teuthology.orchestra.run.smithi070.stdout:2977 write 0x9c742a5 thru 0x9c754aa (0x1206 bytes) 2024-09-11T05:33:29.585 INFO:teuthology.orchestra.run.smithi070.stdout:2979 write 0x831ef7 thru 0x83bc8d (0x9d97 bytes) 2024-09-11T05:33:29.586 INFO:teuthology.orchestra.run.smithi070.stdout:2983 write 0xa4b16bd thru 0xa4b38f9 (0x223d bytes) 2024-09-11T05:33:29.589 INFO:teuthology.orchestra.run.smithi070.stdout:2985 read 0x18ae28a thru 0x18b9c17 (0xb98e bytes) 2024-09-11T05:33:29.589 INFO:teuthology.orchestra.run.smithi070.stdout:2986 write 0x68ef262 thru 0x68f9262 (0xa001 bytes) 2024-09-11T05:33:29.590 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:29.590 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:29.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:29.590 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:29.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.591 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45827 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 6897664~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.591 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366795+0000", 2024-09-11T05:33:29.591 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2220719310000003, 2024-09-11T05:33:29.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031094567, 2024-09-11T05:33:29.591 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.591 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.591 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.591 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.591 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.591 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.591 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45827 2024-09-11T05:33:29.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.591 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366795+0000", 2024-09-11T05:33:29.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366795+0000", 2024-09-11T05:33:29.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366795+0000", 2024-09-11T05:33:29.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6499999999999999e-07 2024-09-11T05:33:29.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366797+0000", 2024-09-11T05:33:29.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2340000000000001e-06 2024-09-11T05:33:29.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366803+0000", 2024-09-11T05:33:29.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.631e-06 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366809+0000", 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7490000000000004e-06 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397796+0000", 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030987737000000001 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397838+0000", 2024-09-11T05:33:29.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1859e-05 2024-09-11T05:33:29.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.595 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397889+0000", 2024-09-11T05:33:29.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0892e-05 2024-09-11T05:33:29.595 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.595 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.595 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.595 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45828 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 6946816~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.595 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366815+0000", 2024-09-11T05:33:29.596 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2220518130000002, 2024-09-11T05:33:29.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031189219000000001, 2024-09-11T05:33:29.596 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.596 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.596 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.596 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.596 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.596 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.596 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45828 2024-09-11T05:33:29.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.596 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.597 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366815+0000", 2024-09-11T05:33:29.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.597 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.600 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366815+0000", 2024-09-11T05:33:29.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.600 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.600 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366815+0000", 2024-09-11T05:33:29.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3599999999999999e-07 2024-09-11T05:33:29.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.601 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366817+0000", 2024-09-11T05:33:29.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0190000000000001e-06 2024-09-11T05:33:29.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.601 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366823+0000", 2024-09-11T05:33:29.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7049999999999996e-06 2024-09-11T05:33:29.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366829+0000", 2024-09-11T05:33:29.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7490000000000001e-06 2024-09-11T05:33:29.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397914+0000", 2024-09-11T05:33:29.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031084157000000001 2024-09-11T05:33:29.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397955+0000", 2024-09-11T05:33:29.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1561999999999999e-05 2024-09-11T05:33:29.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398004+0000", 2024-09-11T05:33:29.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8690999999999998e-05 2024-09-11T05:33:29.603 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.603 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.603 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.603 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45829 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 6995968~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.603 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:29.603 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2220312419999999, 2024-09-11T05:33:29.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031286190999999998, 2024-09-11T05:33:29.604 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.604 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.604 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.604 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.604 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.604 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.604 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45829 2024-09-11T05:33:29.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.604 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.604 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.604 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.604 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:29.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:29.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366836+0000", 2024-09-11T05:33:29.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4199999999999996e-07 2024-09-11T05:33:29.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366838+0000", 2024-09-11T05:33:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9929999999999998e-06 2024-09-11T05:33:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366844+0000", 2024-09-11T05:33:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0430000000000004e-06 2024-09-11T05:33:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366848+0000", 2024-09-11T05:33:29.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6040000000000003e-06 2024-09-11T05:33:29.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.607 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.607 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.607 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398029+0000", 2024-09-11T05:33:29.607 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031180349 2024-09-11T05:33:29.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.607 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.607 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.607 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398070+0000", 2024-09-11T05:33:29.607 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1421999999999997e-05 2024-09-11T05:33:29.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.607 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.607 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.608 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398121+0000", 2024-09-11T05:33:29.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1238e-05 2024-09-11T05:33:29.608 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.608 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.608 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.608 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.608 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45830 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7045120~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.608 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:29.608 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2220116709999997, 2024-09-11T05:33:29.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031383187999999999, 2024-09-11T05:33:29.608 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.609 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.609 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.609 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.609 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.609 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.609 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45830 2024-09-11T05:33:29.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.609 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.609 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.609 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.609 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:29.609 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.51e-07 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.610 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366857+0000", 2024-09-11T05:33:29.611 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9259999999999999e-06 2024-09-11T05:33:29.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.611 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.611 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.611 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366863+0000", 2024-09-11T05:33:29.611 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7069999999999997e-06 2024-09-11T05:33:29.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.611 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.611 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.611 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366868+0000", 2024-09-11T05:33:29.611 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7380000000000002e-06 2024-09-11T05:33:29.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.611 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.612 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.612 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398147+0000", 2024-09-11T05:33:29.612 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031279757999999998 2024-09-11T05:33:29.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.612 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.612 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.612 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398189+0000", 2024-09-11T05:33:29.612 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1597999999999997e-05 2024-09-11T05:33:29.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.612 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398238+0000", 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.901e-05 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45831 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7094272~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2219925439999999, 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031481960000000003, 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.613 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.614 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.614 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.614 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.614 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.614 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45831 2024-09-11T05:33:29.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.614 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.614 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.614 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.614 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:29.614 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.614 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.615 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:29.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.615 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:29.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4200000000000002e-07 2024-09-11T05:33:29.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.615 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366876+0000", 2024-09-11T05:33:29.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0020000000000001e-06 2024-09-11T05:33:29.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.616 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366882+0000", 2024-09-11T05:33:29.616 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7690000000000002e-06 2024-09-11T05:33:29.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.616 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366887+0000", 2024-09-11T05:33:29.616 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119999999999999e-06 2024-09-11T05:33:29.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.617 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398263+0000", 2024-09-11T05:33:29.617 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031376023000000003 2024-09-11T05:33:29.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.617 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.617 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398306+0000", 2024-09-11T05:33:29.617 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3220999999999998e-05 2024-09-11T05:33:29.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.617 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.617 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398356+0000", 2024-09-11T05:33:29.617 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:33:29.617 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.618 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.618 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.618 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.618 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45832 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7143424~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.618 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:29.618 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2219739240000003, 2024-09-11T05:33:29.618 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031581625000000002, 2024-09-11T05:33:29.618 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.618 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.618 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.618 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45832 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:29.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.620 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.620 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367199+0000", 2024-09-11T05:33:29.620 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00030624 2024-09-11T05:33:29.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.620 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.620 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367205+0000", 2024-09-11T05:33:29.620 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1090000000000003e-06 2024-09-11T05:33:29.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367213+0000", 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8979999999999996e-06 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367219+0000", 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398380+0000", 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031160931999999999 2024-09-11T05:33:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398425+0000", 2024-09-11T05:33:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4548000000000001e-05 2024-09-11T05:33:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398474+0000", 2024-09-11T05:33:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9298000000000001e-05 2024-09-11T05:33:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.623 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45833 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7192576~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.623 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:29.623 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2216326390000001, 2024-09-11T05:33:29.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031369229999999998, 2024-09-11T05:33:29.623 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.623 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.623 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.623 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.623 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.623 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.623 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45833 2024-09-11T05:33:29.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.625 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:29.625 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9400000000000005e-07 2024-09-11T05:33:29.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.625 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.625 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.625 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367237+0000", 2024-09-11T05:33:29.625 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4439999999999998e-06 2024-09-11T05:33:29.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.625 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.625 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.625 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367243+0000", 2024-09-11T05:33:29.625 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:33:29.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367249+0000", 2024-09-11T05:33:29.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2240000000000003e-06 2024-09-11T05:33:29.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398507+0000", 2024-09-11T05:33:29.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031257994999999997 2024-09-11T05:33:29.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398551+0000", 2024-09-11T05:33:29.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4178000000000003e-05 2024-09-11T05:33:29.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398603+0000", 2024-09-11T05:33:29.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2178000000000001e-05 2024-09-11T05:33:29.627 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.627 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.627 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.627 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45834 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7241728~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.628 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:29.628 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2216109079999997, 2024-09-11T05:33:29.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031466477, 2024-09-11T05:33:29.628 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.628 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.628 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.628 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.628 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.628 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.628 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45834 2024-09-11T05:33:29.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.629 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:29.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:29.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:29.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5200000000000002e-07 2024-09-11T05:33:29.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367258+0000", 2024-09-11T05:33:29.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1110000000000002e-06 2024-09-11T05:33:29.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367264+0000", 2024-09-11T05:33:29.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0290000000000002e-06 2024-09-11T05:33:29.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.631 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.631 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367269+0000", 2024-09-11T05:33:29.631 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:33:29.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.631 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.631 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398628+0000", 2024-09-11T05:33:29.631 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031358587 2024-09-11T05:33:29.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.631 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398671+0000", 2024-09-11T05:33:29.632 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3035999999999999e-05 2024-09-11T05:33:29.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398722+0000", 2024-09-11T05:33:29.632 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1511000000000002e-05 2024-09-11T05:33:29.632 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.632 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.632 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.633 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45835 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7290880~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.633 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:29.633 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2215913340000002, 2024-09-11T05:33:29.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031565589999999998, 2024-09-11T05:33:29.633 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.633 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.633 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.634 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.634 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.634 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.634 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45835 2024-09-11T05:33:29.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.634 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:29.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:29.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367276+0000", 2024-09-11T05:33:29.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.96e-07 2024-09-11T05:33:29.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367278+0000", 2024-09-11T05:33:29.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0279999999999999e-06 2024-09-11T05:33:29.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.636 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367283+0000", 2024-09-11T05:33:29.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8340000000000004e-06 2024-09-11T05:33:29.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.636 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367289+0000", 2024-09-11T05:33:29.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:33:29.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398747+0000", 2024-09-11T05:33:29.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031458211999999999 2024-09-11T05:33:29.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398788+0000", 2024-09-11T05:33:29.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0998999999999998e-05 2024-09-11T05:33:29.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398841+0000", 2024-09-11T05:33:29.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2465e-05 2024-09-11T05:33:29.638 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.638 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.638 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.638 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45836 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7340032~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.638 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:29.638 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.221571258, 2024-09-11T05:33:29.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031663635000000002, 2024-09-11T05:33:29.639 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.639 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.639 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.639 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.639 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.639 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.639 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45836 2024-09-11T05:33:29.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.639 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.640 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:29.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.640 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.640 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:29.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.640 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.640 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368490+0000", 2024-09-11T05:33:29.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0011952410000000001 2024-09-11T05:33:29.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.641 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368494+0000", 2024-09-11T05:33:29.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4649999999999999e-06 2024-09-11T05:33:29.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.641 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368503+0000", 2024-09-11T05:33:29.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0920000000000004e-06 2024-09-11T05:33:29.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368509+0000", 2024-09-11T05:33:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4130000000000003e-06 2024-09-11T05:33:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398865+0000", 2024-09-11T05:33:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030355473000000001 2024-09-11T05:33:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398907+0000", 2024-09-11T05:33:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1882999999999999e-05 2024-09-11T05:33:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398959+0000", 2024-09-11T05:33:29.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2067999999999997e-05 2024-09-11T05:33:29.643 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.643 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.643 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.643 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45842 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7634944~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.644 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368634+0000", 2024-09-11T05:33:29.644 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2202320709999999, 2024-09-11T05:33:29.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031057715999999999, 2024-09-11T05:33:29.644 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.644 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.644 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.644 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.644 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.644 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.644 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45842 2024-09-11T05:33:29.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.644 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368634+0000", 2024-09-11T05:33:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368634+0000", 2024-09-11T05:33:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368635+0000", 2024-09-11T05:33:29.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:33:29.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368637+0000", 2024-09-11T05:33:29.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0449999999999999e-06 2024-09-11T05:33:29.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368643+0000", 2024-09-11T05:33:29.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:33:29.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368647+0000", 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7079999999999996e-06 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399597+0000", 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030949081999999999 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399640+0000", 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3158000000000003e-05 2024-09-11T05:33:29.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399692+0000", 2024-09-11T05:33:29.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2448000000000003e-05 2024-09-11T05:33:29.648 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.648 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.648 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.649 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45843 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7684096~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.649 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368655+0000", 2024-09-11T05:33:29.649 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2202114509999999, 2024-09-11T05:33:29.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031152040999999998, 2024-09-11T05:33:29.649 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.649 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.649 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.649 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.649 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.649 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.649 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45843 2024-09-11T05:33:29.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.650 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368655+0000", 2024-09-11T05:33:29.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368655+0000", 2024-09-11T05:33:29.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368655+0000", 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368657+0000", 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.08e-06 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368664+0000", 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0959999999999997e-06 2024-09-11T05:33:29.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368668+0000", 2024-09-11T05:33:29.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6829999999999999e-06 2024-09-11T05:33:29.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399716+0000", 2024-09-11T05:33:29.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031047748 2024-09-11T05:33:29.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399757+0000", 2024-09-11T05:33:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1056000000000001e-05 2024-09-11T05:33:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399807+0000", 2024-09-11T05:33:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0046999999999997e-05 2024-09-11T05:33:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45844 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7733248~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2201921149999997, 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031248306, 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45844 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.654 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.655 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:29.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.655 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.655 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:29.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368675+0000", 2024-09-11T05:33:29.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4700000000000001e-07 2024-09-11T05:33:29.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368680+0000", 2024-09-11T05:33:29.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3750000000000002e-06 2024-09-11T05:33:29.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368687+0000", 2024-09-11T05:33:29.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3080000000000004e-06 2024-09-11T05:33:29.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368692+0000", 2024-09-11T05:33:29.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2329999999999997e-06 2024-09-11T05:33:29.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399832+0000", 2024-09-11T05:33:29.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031139723000000001 2024-09-11T05:33:29.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399872+0000", 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0880000000000002e-05 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399923+0000", 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.024e-05 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.659 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45845 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7782400~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.659 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:29.659 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2201682810000003, 2024-09-11T05:33:29.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031339210999999999, 2024-09-11T05:33:29.659 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.659 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.659 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.659 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.659 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.659 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.659 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45845 2024-09-11T05:33:29.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.659 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:29.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:29.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368699+0000", 2024-09-11T05:33:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:33:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368701+0000", 2024-09-11T05:33:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0389999999999999e-06 2024-09-11T05:33:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368706+0000", 2024-09-11T05:33:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5570000000000003e-06 2024-09-11T05:33:29.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368711+0000", 2024-09-11T05:33:29.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0930000000000002e-06 2024-09-11T05:33:29.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399947+0000", 2024-09-11T05:33:29.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031235810999999999 2024-09-11T05:33:29.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399989+0000", 2024-09-11T05:33:29.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1430000000000001e-05 2024-09-11T05:33:29.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400037+0000", 2024-09-11T05:33:29.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8838999999999998e-05 2024-09-11T05:33:29.663 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.663 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.663 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.663 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45846 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7831552~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.664 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:29.664 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.220149181, 2024-09-11T05:33:29.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031434484999999998, 2024-09-11T05:33:29.664 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.664 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.664 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.664 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.664 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.664 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.664 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45846 2024-09-11T05:33:29.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.664 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368718+0000", 2024-09-11T05:33:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6600000000000002e-07 2024-09-11T05:33:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368720+0000", 2024-09-11T05:33:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0140000000000001e-06 2024-09-11T05:33:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368726+0000", 2024-09-11T05:33:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8719999999999999e-06 2024-09-11T05:33:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.667 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.667 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368730+0000", 2024-09-11T05:33:29.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:33:29.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.667 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.667 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400061+0000", 2024-09-11T05:33:29.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031331141 2024-09-11T05:33:29.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.667 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.667 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400102+0000", 2024-09-11T05:33:29.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0419e-05 2024-09-11T05:33:29.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.668 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.668 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400152+0000", 2024-09-11T05:33:29.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9926000000000003e-05 2024-09-11T05:33:29.668 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.668 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.668 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.668 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45847 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7880704~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.668 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:29.669 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2201300699999997, 2024-09-11T05:33:29.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031531412000000002, 2024-09-11T05:33:29.669 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.669 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.669 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.669 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.669 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.669 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.669 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45847 2024-09-11T05:33:29.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.669 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:29.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:29.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368737+0000", 2024-09-11T05:33:29.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:33:29.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368739+0000", 2024-09-11T05:33:29.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.81e-06 2024-09-11T05:33:29.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368744+0000", 2024-09-11T05:33:29.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8919999999999997e-06 2024-09-11T05:33:29.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368749+0000", 2024-09-11T05:33:29.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7149999999999997e-06 2024-09-11T05:33:29.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400176+0000", 2024-09-11T05:33:29.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031426740000000002 2024-09-11T05:33:29.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400218+0000", 2024-09-11T05:33:29.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2338e-05 2024-09-11T05:33:29.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400268+0000", 2024-09-11T05:33:29.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9580000000000003e-05 2024-09-11T05:33:29.673 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.673 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.673 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.673 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45848 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7929856~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.673 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:29.674 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2201112739999997, 2024-09-11T05:33:29.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031629162000000002, 2024-09-11T05:33:29.674 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.674 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.674 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.674 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.674 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.674 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.674 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45848 2024-09-11T05:33:29.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.674 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368756+0000", 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368758+0000", 2024-09-11T05:33:29.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.951e-06 2024-09-11T05:33:29.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368763+0000", 2024-09-11T05:33:29.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.801e-06 2024-09-11T05:33:29.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368768+0000", 2024-09-11T05:33:29.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1100000000000002e-06 2024-09-11T05:33:29.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400292+0000", 2024-09-11T05:33:29.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031524033 2024-09-11T05:33:29.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400336+0000", 2024-09-11T05:33:29.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3272999999999997e-05 2024-09-11T05:33:29.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400384+0000", 2024-09-11T05:33:29.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8634999999999998e-05 2024-09-11T05:33:29.678 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.678 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.678 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.678 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45849 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7979008~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.678 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:29.678 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2200918820000002, 2024-09-11T05:33:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031732415, 2024-09-11T05:33:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45849 2024-09-11T05:33:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:29.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:29.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:29.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0100000000000005e-07 2024-09-11T05:33:29.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368777+0000", 2024-09-11T05:33:29.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0260000000000002e-06 2024-09-11T05:33:29.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368783+0000", 2024-09-11T05:33:29.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7089999999999999e-06 2024-09-11T05:33:29.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368788+0000", 2024-09-11T05:33:29.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4029999999999998e-06 2024-09-11T05:33:29.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400409+0000", 2024-09-11T05:33:29.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031620663 2024-09-11T05:33:29.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400453+0000", 2024-09-11T05:33:29.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4376999999999999e-05 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400507+0000", 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3736000000000002e-05 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45850 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8028160~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2200724200000002, 2024-09-11T05:33:29.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031830000999999997, 2024-09-11T05:33:29.684 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.684 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.684 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.684 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.684 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.684 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.684 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45850 2024-09-11T05:33:29.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.684 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:29.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:29.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368795+0000", 2024-09-11T05:33:29.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0399999999999996e-07 2024-09-11T05:33:29.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368796+0000", 2024-09-11T05:33:29.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.933e-06 2024-09-11T05:33:29.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368803+0000", 2024-09-11T05:33:29.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0619999999999997e-06 2024-09-11T05:33:29.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368807+0000", 2024-09-11T05:33:29.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.685e-06 2024-09-11T05:33:29.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400531+0000", 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031723784999999997 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400573+0000", 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2079999999999997e-05 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400624+0000", 2024-09-11T05:33:29.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0952000000000003e-05 2024-09-11T05:33:29.688 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.688 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.688 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.688 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45851 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8077312~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:29.688 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:29.688 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.2200534269999999, 2024-09-11T05:33:29.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031929358999999997, 2024-09-11T05:33:29.688 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:29.688 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:29.688 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:29.688 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:29.689 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:29.689 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:29.689 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45851 2024-09-11T05:33:29.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.689 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:29.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:29.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:29.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:29.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370488+0000", 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.001674743 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370491+0000", 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.444e-06 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:29.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370500+0000", 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0650000000000005e-06 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370507+0000", 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400648+0000", 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030141889000000002 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.691 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:29.692 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400691+0000", 2024-09-11T05:33:29.692 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2290999999999999e-05 2024-09-11T05:33:29.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:29.692 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:29.692 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:29.692 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400742+0000", 2024-09-11T05:33:29.692 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1717e-05 2024-09-11T05:33:29.692 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.692 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.692 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.692 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:29.692 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:29.692 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:29.694 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:29.695 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:29.692+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:29.696 INFO:teuthology.orchestra.run.smithi070.stdout:2987 write 0xc236127 thru 0xc24544a (0xf324 bytes) 2024-09-11T05:33:29.696 INFO:teuthology.orchestra.run.smithi070.stdout:2988 write 0x4cd848f thru 0x4ce093a (0x84ac bytes) 2024-09-11T05:33:29.696 INFO:teuthology.orchestra.run.smithi070.stdout:2989 write 0x8fdc3dc thru 0x8fec2e4 (0xff09 bytes) 2024-09-11T05:33:29.696 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.696 INFO:teuthology.orchestra.run.smithi070.stdout:2991 trunc from 0xc24544b to 0xec53cd2 2024-09-11T05:33:29.696 INFO:teuthology.orchestra.run.smithi070.stdout:2992 trunc from 0xec53cd2 to 0x8ad4e53 2024-09-11T05:33:29.696 INFO:teuthology.orchestra.run.smithi070.stdout:2993 punch from 0x3276e22 to 0x3280e1e, (0x9ffc bytes) 2024-09-11T05:33:29.697 INFO:teuthology.orchestra.run.smithi070.stdout:2994 writesame 0xa024068 thru 0xa024cbf data_size 0x14(0xc58 bytes) 2024-09-11T05:33:29.697 INFO:teuthology.orchestra.run.smithi070.stdout:2995 trunc from 0xa024cc0 to 0xcdae98f 2024-09-11T05:33:29.697 INFO:teuthology.orchestra.run.smithi070.stdout:2997 punch from 0x6b659ea to 0x6b6a8ab, (0x4ec1 bytes) 2024-09-11T05:33:29.697 INFO:teuthology.orchestra.run.smithi070.stdout:2999 write 0x7e68b3a thru 0x7e76998 (0xde5f bytes) 2024-09-11T05:33:29.697 INFO:teuthology.orchestra.run.smithi070.stdout:3000 write 0x8bd5f67 thru 0x8bd9388 (0x3422 bytes) 2024-09-11T05:33:29.697 INFO:teuthology.orchestra.run.smithi070.stdout:3001 read 0xc9a2900 thru 0xc9b183d (0xef3e bytes) 2024-09-11T05:33:29.697 INFO:teuthology.orchestra.run.smithi070.stdout:3003 read 0x965e1c8 thru 0x966cbcd (0xea06 bytes) 2024-09-11T05:33:29.697 INFO:teuthology.orchestra.run.smithi070.stdout:3004 read 0x46ccddb thru 0x46dc1ff (0xf425 bytes) 2024-09-11T05:33:29.697 INFO:teuthology.orchestra.run.smithi070.stdout:3005 read 0xf6615d thru 0xf72432 (0xc2d6 bytes) 2024-09-11T05:33:29.697 INFO:teuthology.orchestra.run.smithi070.stdout:3006 punch from 0x34c4dda to 0x34c70cd, (0x22f3 bytes) 2024-09-11T05:33:29.697 INFO:teuthology.orchestra.run.smithi070.stdout:3007 write 0xc88c6e7 thru 0xc88d331 (0xc4b bytes) 2024-09-11T05:33:29.697 INFO:teuthology.orchestra.run.smithi070.stdout:3008 trunc from 0xcdae98f to 0x11db5c8 2024-09-11T05:33:29.705 INFO:teuthology.orchestra.run.smithi070.stdout:3009 read 0x11072d3 thru 0x1108c90 (0x19be bytes) 2024-09-11T05:33:29.719 INFO:teuthology.orchestra.run.smithi070.stdout:3011 write 0x81280e7 thru 0x81323eb (0xa305 bytes) 2024-09-11T05:33:29.723 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.723 INFO:teuthology.orchestra.run.smithi070.stdout:3015 read 0xd8aa8d thru 0xd8ca50 (0x1fc4 bytes) 2024-09-11T05:33:29.723 INFO:teuthology.orchestra.run.smithi070.stdout:3017 read 0x1499456 thru 0x149cf3b (0x3ae6 bytes) 2024-09-11T05:33:29.723 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.723 INFO:teuthology.orchestra.run.smithi070.stdout:3019 punch from 0x9526b0 to 0x952add, (0x42d bytes) 2024-09-11T05:33:29.723 INFO:teuthology.orchestra.run.smithi070.stdout:3020 punch from 0x774be1e to 0x7755d55, (0x9f37 bytes) 2024-09-11T05:33:29.724 INFO:teuthology.orchestra.run.smithi070.stdout:3021 punch from 0x5db546c to 0x5dc0481, (0xb015 bytes) 2024-09-11T05:33:29.724 INFO:teuthology.orchestra.run.smithi070.stdout:3023 read 0x227561a thru 0x2275eed (0x8d4 bytes) 2024-09-11T05:33:29.724 INFO:teuthology.orchestra.run.smithi070.stdout:3024 read 0x628653b thru 0x6288a2e (0x24f4 bytes) 2024-09-11T05:33:29.724 INFO:teuthology.orchestra.run.smithi070.stdout:3026 write 0x701336f thru 0x701f2cd (0xbf5f bytes) 2024-09-11T05:33:29.728 INFO:teuthology.orchestra.run.smithi070.stdout:3027 read 0x4d99a2b thru 0x4d9be89 (0x245f bytes) 2024-09-11T05:33:29.728 INFO:teuthology.orchestra.run.smithi070.stdout:3028 write 0x4b3fa11 thru 0x4b40ffc (0x15ec bytes) 2024-09-11T05:33:29.734 INFO:teuthology.orchestra.run.smithi070.stdout:3029 trunc from 0x81323ec to 0x5e8d906 2024-09-11T05:33:29.756 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.6 to 1 (10000) 2024-09-11T05:33:29.763 INFO:teuthology.orchestra.run.smithi070.stdout:3030 write 0xaff2b6c thru 0xaffae67 (0x82fc bytes) 2024-09-11T05:33:29.768 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:33:29.769 INFO:teuthology.orchestra.run.smithi070.stdout:3031 writesame 0x3954c91 thru 0x3958885 data_size 0x1(0x3bf5 bytes) 2024-09-11T05:33:29.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-11T05:33:29.779 INFO:teuthology.orchestra.run.smithi070.stdout:3033 writesame 0x8071ec4 thru 0x807d6b4 data_size 0x1f(0xb7f1 bytes) 2024-09-11T05:33:29.785 INFO:teuthology.orchestra.run.smithi070.stdout:3034 punch from 0xab72f1b to 0xab81784, (0xe869 bytes) 2024-09-11T05:33:29.785 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.785 INFO:teuthology.orchestra.run.smithi070.stdout:3036 writesame 0x1aa5cc5 thru 0x1aae0ea data_size 0x55(0x8426 bytes) 2024-09-11T05:33:29.789 INFO:teuthology.orchestra.run.smithi070.stdout:3037 read 0x712c4c thru 0x71db6f (0xaf24 bytes) 2024-09-11T05:33:29.793 INFO:teuthology.orchestra.run.smithi070.stdout:3038 trunc from 0xaffae68 to 0x88da828 2024-09-11T05:33:29.794 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:29.793+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:29.806 INFO:teuthology.orchestra.run.smithi070.stdout:3040 read 0x2612eb6 thru 0x261dd56 (0xaea1 bytes) 2024-09-11T05:33:29.806 INFO:teuthology.orchestra.run.smithi070.stdout:3041 punch from 0x88d897d to 0x88da828, (0x1eab bytes) 2024-09-11T05:33:29.806 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.817 INFO:teuthology.orchestra.run.smithi070.stdout:3043 write 0xc7a2b0d thru 0xc7b296c (0xfe60 bytes) 2024-09-11T05:33:29.823 INFO:teuthology.orchestra.run.smithi070.stdout:3044 read 0x50313df thru 0x503d7c5 (0xc3e7 bytes) 2024-09-11T05:33:29.824 INFO:teuthology.orchestra.run.smithi070.stdout:3045 trunc from 0xc7b296d to 0xbf1bdc0 2024-09-11T05:33:29.834 INFO:teuthology.orchestra.run.smithi070.stdout:3046 read 0xf90642 thru 0xfa00ae (0xfa6d bytes) 2024-09-11T05:33:29.835 INFO:teuthology.orchestra.run.smithi070.stdout:3047 read 0x2566113 thru 0x2571e62 (0xbd50 bytes) 2024-09-11T05:33:29.835 INFO:teuthology.orchestra.run.smithi070.stdout:3048 read 0x2ead2a9 thru 0x2eb4bed (0x7945 bytes) 2024-09-11T05:33:29.835 INFO:teuthology.orchestra.run.smithi070.stdout:3049 write 0x559e3b3 thru 0x55a61ee (0x7e3c bytes) 2024-09-11T05:33:29.839 INFO:teuthology.orchestra.run.smithi070.stdout:3050 writesame 0x413bf76 thru 0x4142466 data_size 0x1(0x64f1 bytes) 2024-09-11T05:33:29.849 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:29.849 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:29.850 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:29.850 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:29.858 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:29.860 INFO:teuthology.orchestra.run.smithi070.stdout:3052 read 0xbbed8fe thru 0xbbfb908 (0xe00b bytes) 2024-09-11T05:33:29.860 INFO:teuthology.orchestra.run.smithi070.stdout:3054 punch from 0x439bcb2 to 0x439f32a, (0x3678 bytes) 2024-09-11T05:33:29.872 INFO:teuthology.orchestra.run.smithi070.stdout:3056 trunc from 0xbf1bdc0 to 0x34cae3e 2024-09-11T05:33:29.885 INFO:teuthology.orchestra.run.smithi070.stdout:3057 read 0x2fe2b0d thru 0x2fe344e (0x942 bytes) 2024-09-11T05:33:29.885 INFO:teuthology.orchestra.run.smithi070.stdout:3058 read 0x14251c3 thru 0x142a2de (0x511c bytes) 2024-09-11T05:33:29.885 INFO:teuthology.orchestra.run.smithi070.stdout:3059 write 0xa0bfba thru 0xa175b0 (0xb5f7 bytes) 2024-09-11T05:33:29.896 INFO:teuthology.orchestra.run.smithi070.stdout:3062 writesame 0x591c21a thru 0x591cbbf data_size 0x13(0x9a6 bytes) 2024-09-11T05:33:29.899 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:29.898+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:29.906 INFO:teuthology.orchestra.run.smithi070.stdout:3063 write 0x8dedd6f thru 0x8dfb564 (0xd7f6 bytes) 2024-09-11T05:33:29.911 INFO:teuthology.orchestra.run.smithi070.stdout:3064 punch from 0x1f612d3 to 0x1f6aa15, (0x9742 bytes) 2024-09-11T05:33:29.911 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.911 INFO:teuthology.orchestra.run.smithi070.stdout:3068 write 0x186b1ed thru 0x1877715 (0xc529 bytes) 2024-09-11T05:33:29.915 INFO:teuthology.orchestra.run.smithi070.stdout:3069 read 0x3bd5874 thru 0x3bde965 (0x90f2 bytes) 2024-09-11T05:33:29.915 INFO:teuthology.orchestra.run.smithi070.stdout:3070 writesame 0x477bd9d thru 0x4780853 data_size 0x1(0x4ab7 bytes) 2024-09-11T05:33:29.927 INFO:teuthology.orchestra.run.smithi070.stdout:3072 write 0x19a8451 thru 0x19b6bf3 (0xe7a3 bytes) 2024-09-11T05:33:29.938 INFO:teuthology.orchestra.run.smithi070.stdout:3073 write 0xb628977 thru 0xb63363f (0xacc9 bytes) 2024-09-11T05:33:29.944 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:29.952 INFO:teuthology.orchestra.run.smithi070.stdout:3075 write 0xddc71d5 thru 0xddd6c1d (0xfa49 bytes) 2024-09-11T05:33:29.959 INFO:teuthology.orchestra.run.smithi070.stdout:3076 write 0xda22e0e thru 0xda29904 (0x6af7 bytes) 2024-09-11T05:33:29.963 INFO:teuthology.orchestra.run.smithi070.stdout:3077 read 0x3d539e thru 0x3d805f (0x2cc2 bytes) 2024-09-11T05:33:29.963 INFO:teuthology.orchestra.run.smithi070.stdout:3081 read 0x99d4169 thru 0x99e22f2 (0xe18a bytes) 2024-09-11T05:33:29.963 INFO:teuthology.orchestra.run.smithi070.stdout:3082 read 0x271b672 thru 0x2727141 (0xbad0 bytes) 2024-09-11T05:33:29.964 INFO:teuthology.orchestra.run.smithi070.stdout:3083 write 0x83fa86b thru 0x840895c (0xe0f2 bytes) 2024-09-11T05:33:29.972 INFO:teuthology.orchestra.run.smithi070.stdout:3084 read 0xf54acd thru 0xf54bda (0x10e bytes) 2024-09-11T05:33:29.972 INFO:teuthology.orchestra.run.smithi070.stdout:3085 writesame 0xa870d15 thru 0xa875488 data_size 0x22(0x4774 bytes) 2024-09-11T05:33:29.980 INFO:teuthology.orchestra.run.smithi070.stdout:3090 read 0xd6792c4 thru 0xd682ada (0x9817 bytes) 2024-09-11T05:33:29.980 INFO:teuthology.orchestra.run.smithi070.stdout:3091 write 0x1dbbe6d thru 0x1dc619b (0xa32f bytes) 2024-09-11T05:33:29.995 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:29.994+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:30.002 INFO:teuthology.orchestra.run.smithi070.stdout:3093 trunc from 0xddd6c1e to 0x3263c47 2024-09-11T05:33:30.012 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:30.013 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:30.022 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:30.039 INFO:teuthology.orchestra.run.smithi070.stdout:3094 writesame 0xd1f7dbf thru 0xd1ffced data_size 0x1(0x7f2f bytes) 2024-09-11T05:33:30.039 INFO:teuthology.orchestra.run.smithi070.stdout:3096 read 0x5ebce1e thru 0x5ec60b9 (0x929c bytes) 2024-09-11T05:33:30.039 INFO:teuthology.orchestra.run.smithi070.stdout:3097 write 0x10e0aaf thru 0x10e5106 (0x4658 bytes) 2024-09-11T05:33:30.041 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:30.041 INFO:teuthology.orchestra.run.smithi070.stdout:3099 write 0x7c9536 thru 0x7ceffc (0x5ac7 bytes) 2024-09-11T05:33:30.042 INFO:teuthology.orchestra.run.smithi070.stdout:3101 read 0xcf157a thru 0xcfe3f6 (0xce7d bytes) 2024-09-11T05:33:30.043 INFO:teuthology.orchestra.run.smithi070.stdout:3104 read 0xcfbc122 thru 0xcfcaba1 (0xea80 bytes) 2024-09-11T05:33:30.043 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:30.043 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:30.043 INFO:teuthology.orchestra.run.smithi070.stdout:3108 read 0x9601b9e thru 0x960781b (0x5c7e bytes) 2024-09-11T05:33:30.053 INFO:teuthology.orchestra.run.smithi070.stdout:3112 trunc from 0xd1ffcee to 0x4a1a2a1 2024-09-11T05:33:30.059 INFO:teuthology.orchestra.run.smithi070.stdout:3115 punch from 0x344ea6c to 0x345beb4, (0xd448 bytes) 2024-09-11T05:33:30.059 INFO:teuthology.orchestra.run.smithi070.stdout:3117 write 0x3ce079d thru 0x3cecd34 (0xc598 bytes) 2024-09-11T05:33:30.080 INFO:teuthology.orchestra.run.smithi070.stdout:3118 write 0xbb6ed79 thru 0xbb7ce95 (0xe11d bytes) 2024-09-11T05:33:30.086 INFO:teuthology.orchestra.run.smithi070.stdout:3120 write 0x201ee20 thru 0x20276cf (0x88b0 bytes) 2024-09-11T05:33:30.090 INFO:teuthology.orchestra.run.smithi070.stdout:3121 read 0x45703da thru 0x457c012 (0xbc39 bytes) 2024-09-11T05:33:30.090 INFO:teuthology.orchestra.run.smithi070.stdout:3122 punch from 0x33b5fe2 to 0x33ba4e0, (0x44fe bytes) 2024-09-11T05:33:30.090 INFO:teuthology.orchestra.run.smithi070.stdout:3123 write 0x3c1b20f thru 0x3c27280 (0xc072 bytes) 2024-09-11T05:33:30.093 INFO:teuthology.orchestra.run.smithi070.stdout:3124 write 0xd69cd7 thru 0xd790ff (0xf429 bytes) 2024-09-11T05:33:30.095 INFO:teuthology.orchestra.run.smithi070.stdout:3126 write 0x8cc507b thru 0x8cd4820 (0xf7a6 bytes) 2024-09-11T05:33:30.096 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:30.095+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:30.102 INFO:teuthology.orchestra.run.smithi070.stdout:3127 write 0x820ebca thru 0x8212e15 (0x424c bytes) 2024-09-11T05:33:30.113 INFO:teuthology.orchestra.run.smithi070.stdout:3128 write 0xe5ff2de thru 0xe601b78 (0x289b bytes) 2024-09-11T05:33:30.117 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:30.117 INFO:teuthology.orchestra.run.smithi070.stdout:3130 punch from 0x6332231 to 0x633b166, (0x8f35 bytes) 2024-09-11T05:33:30.126 INFO:teuthology.orchestra.run.smithi070.stdout:3132 trunc from 0xe601b79 to 0x6f1076c 2024-09-11T05:33:30.139 INFO:teuthology.orchestra.run.smithi070.stdout:3133 writesame 0x36cfdbd thru 0x36d9f89 data_size 0x1(0xa1cd bytes) 2024-09-11T05:33:30.174 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:30.174 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:30.174 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:30.174 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:30.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.174 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47407 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2646016~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.174 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567880+0000", 2024-09-11T05:33:30.174 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.604831109, 2024-09-11T05:33:30.174 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036075284999999999, 2024-09-11T05:33:30.174 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.174 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.174 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.174 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.175 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.175 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.175 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47407 2024-09-11T05:33:30.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.175 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567880+0000", 2024-09-11T05:33:30.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567880+0000", 2024-09-11T05:33:30.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567881+0000", 2024-09-11T05:33:30.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6100000000000002e-07 2024-09-11T05:33:30.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567882+0000", 2024-09-11T05:33:30.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0070000000000001e-06 2024-09-11T05:33:30.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567885+0000", 2024-09-11T05:33:30.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8899999999999999e-06 2024-09-11T05:33:30.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.178 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.178 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567887+0000", 2024-09-11T05:33:30.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4719999999999998e-06 2024-09-11T05:33:30.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.178 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.178 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.178 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.603862+0000", 2024-09-11T05:33:30.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.035975311000000003 2024-09-11T05:33:30.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.178 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.178 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.178 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.603902+0000", 2024-09-11T05:33:30.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9855999999999999e-05 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.603956+0000", 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3488e-05 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47408 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2695168~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567890+0000", 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6048217249999999, 2024-09-11T05:33:30.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036177099999999997, 2024-09-11T05:33:30.180 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.180 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.180 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.180 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.180 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.180 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.180 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47408 2024-09-11T05:33:30.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.180 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.180 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.180 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567890+0000", 2024-09-11T05:33:30.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.181 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567890+0000", 2024-09-11T05:33:30.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.181 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567890+0000", 2024-09-11T05:33:30.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.46e-07 2024-09-11T05:33:30.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567891+0000", 2024-09-11T05:33:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9999999999999996e-07 2024-09-11T05:33:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567894+0000", 2024-09-11T05:33:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8779999999999998e-06 2024-09-11T05:33:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567896+0000", 2024-09-11T05:33:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.486e-06 2024-09-11T05:33:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.603981+0000", 2024-09-11T05:33:30.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036085035000000001 2024-09-11T05:33:30.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604019+0000", 2024-09-11T05:33:30.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7304000000000001e-05 2024-09-11T05:33:30.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604067+0000", 2024-09-11T05:33:30.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8151e-05 2024-09-11T05:33:30.184 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.184 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.184 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.184 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47409 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.184 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567899+0000", 2024-09-11T05:33:30.184 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.604812302, 2024-09-11T05:33:30.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036285126000000001, 2024-09-11T05:33:30.184 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.184 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.185 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.185 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.185 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.185 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.185 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47409 2024-09-11T05:33:30.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.186 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567899+0000", 2024-09-11T05:33:30.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.187 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567899+0000", 2024-09-11T05:33:30.187 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.187 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.187 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.187 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.187 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567900+0000", 2024-09-11T05:33:30.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6300000000000001e-07 2024-09-11T05:33:30.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.188 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.188 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567900+0000", 2024-09-11T05:33:30.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2399999999999996e-07 2024-09-11T05:33:30.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.188 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.188 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567903+0000", 2024-09-11T05:33:30.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:33:30.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567906+0000", 2024-09-11T05:33:30.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.418e-06 2024-09-11T05:33:30.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604091+0000", 2024-09-11T05:33:30.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036185011000000003 2024-09-11T05:33:30.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604131+0000", 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0268999999999997e-05 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604184+0000", 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3418999999999998e-05 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.190 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47410 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2793472~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567908+0000", 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6048031490000003, 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036387492, 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47410 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567908+0000", 2024-09-11T05:33:30.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.192 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567908+0000", 2024-09-11T05:33:30.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.192 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567909+0000", 2024-09-11T05:33:30.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3099999999999999e-07 2024-09-11T05:33:30.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567910+0000", 2024-09-11T05:33:30.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:33:30.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567913+0000", 2024-09-11T05:33:30.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9739999999999998e-06 2024-09-11T05:33:30.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567916+0000", 2024-09-11T05:33:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5780000000000001e-06 2024-09-11T05:33:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604211+0000", 2024-09-11T05:33:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036294802000000001 2024-09-11T05:33:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604248+0000", 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7455e-05 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604296+0000", 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7896999999999999e-05 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47411 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2842624~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567919+0000", 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6047930289999996, 2024-09-11T05:33:30.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036497626999999998, 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47411 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567919+0000", 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567919+0000", 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567919+0000", 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1e-07 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567920+0000", 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.3399999999999997e-07 2024-09-11T05:33:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567923+0000", 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8720000000000002e-06 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567925+0000", 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4719999999999998e-06 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604320+0000", 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036394911000000002 2024-09-11T05:33:30.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604362+0000", 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1918000000000001e-05 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604416+0000", 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.431e-05 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.200 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47412 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2891776~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.200 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567928+0000", 2024-09-11T05:33:30.200 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6047831800000001, 2024-09-11T05:33:30.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036604599000000002, 2024-09-11T05:33:30.200 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.200 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.200 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.200 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.200 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.200 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.200 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47412 2024-09-11T05:33:30.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.200 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567928+0000", 2024-09-11T05:33:30.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567928+0000", 2024-09-11T05:33:30.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567929+0000", 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567930+0000", 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9500000000000001e-07 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567933+0000", 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0000000000000001e-06 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.202 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567935+0000", 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.542e-06 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604442+0000", 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036506826999999999 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604477+0000", 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5126000000000002e-05 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604533+0000", 2024-09-11T05:33:30.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5999999999999999e-05 2024-09-11T05:33:30.204 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.204 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.204 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.204 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47413 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2940928~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.204 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567938+0000", 2024-09-11T05:33:30.204 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6047738100000002, 2024-09-11T05:33:30.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036712675, 2024-09-11T05:33:30.205 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.205 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.205 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.205 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.205 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.205 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.205 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47413 2024-09-11T05:33:30.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.205 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567938+0000", 2024-09-11T05:33:30.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567938+0000", 2024-09-11T05:33:30.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567938+0000", 2024-09-11T05:33:30.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:33:30.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567941+0000", 2024-09-11T05:33:30.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.185e-06 2024-09-11T05:33:30.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567944+0000", 2024-09-11T05:33:30.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:33:30.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567947+0000", 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4959999999999999e-06 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604558+0000", 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036611128 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604598+0000", 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0225999999999997e-05 2024-09-11T05:33:30.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604650+0000", 2024-09-11T05:33:30.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2333999999999997e-05 2024-09-11T05:33:30.209 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.209 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.209 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.209 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47414 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.209 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567950+0000", 2024-09-11T05:33:30.209 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6047612630000003, 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036811337999999999, 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47414 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567950+0000", 2024-09-11T05:33:30.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567950+0000", 2024-09-11T05:33:30.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567951+0000", 2024-09-11T05:33:30.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:30.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567952+0000", 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.049e-06 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567955+0000", 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2899999999999998e-06 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567958+0000", 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1350000000000001e-06 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604675+0000", 2024-09-11T05:33:30.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036717340000000001 2024-09-11T05:33:30.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604714+0000", 2024-09-11T05:33:30.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8271e-05 2024-09-11T05:33:30.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604762+0000", 2024-09-11T05:33:30.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8040000000000001e-05 2024-09-11T05:33:30.213 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47415 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3039232~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567961+0000", 2024-09-11T05:33:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6047501329999996, 2024-09-11T05:33:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036915079000000003, 2024-09-11T05:33:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47415 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567961+0000", 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567961+0000", 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.216 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.216 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.216 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567962+0000", 2024-09-11T05:33:30.216 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:33:30.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.216 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.216 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.216 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567963+0000", 2024-09-11T05:33:30.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0049999999999999e-06 2024-09-11T05:33:30.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567966+0000", 2024-09-11T05:33:30.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9100000000000001e-06 2024-09-11T05:33:30.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567968+0000", 2024-09-11T05:33:30.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.762e-06 2024-09-11T05:33:30.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604785+0000", 2024-09-11T05:33:30.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036816509999999997 2024-09-11T05:33:30.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604824+0000", 2024-09-11T05:33:30.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9248000000000001e-05 2024-09-11T05:33:30.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604877+0000", 2024-09-11T05:33:30.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2429999999999998e-05 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47416 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3088384~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567971+0000", 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6047404820000004, 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037015625000000003, 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.219 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.220 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.220 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47416 2024-09-11T05:33:30.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.220 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567971+0000", 2024-09-11T05:33:30.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567971+0000", 2024-09-11T05:33:30.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.221 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567971+0000", 2024-09-11T05:33:30.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:33:30.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.221 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567973+0000", 2024-09-11T05:33:30.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.4839999999999999e-06 2024-09-11T05:33:30.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567976+0000", 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.044e-06 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567979+0000", 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8449999999999999e-06 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604904+0000", 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036924962999999998 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.223 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.223 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604940+0000", 2024-09-11T05:33:30.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6774999999999999e-05 2024-09-11T05:33:30.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.223 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.223 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.223 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604987+0000", 2024-09-11T05:33:30.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6304999999999998e-05 2024-09-11T05:33:30.223 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.223 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.223 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.223 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47417 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3137536~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567982+0000", 2024-09-11T05:33:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6047299720000003, 2024-09-11T05:33:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037125624000000003, 2024-09-11T05:33:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47417 2024-09-11T05:33:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567982+0000", 2024-09-11T05:33:30.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567982+0000", 2024-09-11T05:33:30.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567982+0000", 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1199999999999999e-07 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567983+0000", 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.3500000000000005e-07 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567986+0000", 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8310000000000001e-06 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567988+0000", 2024-09-11T05:33:30.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6469999999999998e-06 2024-09-11T05:33:30.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.227 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605011+0000", 2024-09-11T05:33:30.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037022503999999998 2024-09-11T05:33:30.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.227 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605051+0000", 2024-09-11T05:33:30.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9938999999999998e-05 2024-09-11T05:33:30.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605107+0000", 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6555999999999999e-05 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47418 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3186688~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567991+0000", 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.604720554, 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037227773999999998, 2024-09-11T05:33:30.228 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.229 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.229 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.229 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.229 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.229 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.229 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47418 2024-09-11T05:33:30.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.229 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567991+0000", 2024-09-11T05:33:30.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567991+0000", 2024-09-11T05:33:30.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.568045+0000", 2024-09-11T05:33:30.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3993000000000003e-05 2024-09-11T05:33:30.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.568047+0000", 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.413e-06 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.568052+0000", 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5059999999999997e-06 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.568056+0000", 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6569999999999999e-06 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.232 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.232 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605133+0000", 2024-09-11T05:33:30.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037077150000000003 2024-09-11T05:33:30.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.232 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.232 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.232 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605170+0000", 2024-09-11T05:33:30.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7741000000000003e-05 2024-09-11T05:33:30.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.232 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.232 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.233 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605219+0000", 2024-09-11T05:33:30.233 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8313999999999999e-05 2024-09-11T05:33:30.233 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.233 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.233 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.233 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47419 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.233 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.568060+0000", 2024-09-11T05:33:30.233 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6046510930000002, 2024-09-11T05:33:30.233 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037282006999999999, 2024-09-11T05:33:30.233 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.233 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47419 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.568060+0000", 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.234 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.235 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.568060+0000", 2024-09-11T05:33:30.235 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.235 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.235 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.235 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569490+0000", 2024-09-11T05:33:30.235 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0014297940000000001 2024-09-11T05:33:30.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.235 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.235 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.235 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569494+0000", 2024-09-11T05:33:30.235 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0339999999999998e-06 2024-09-11T05:33:30.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569502+0000", 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1040000000000007e-06 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569507+0000", 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0910000000000003e-06 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605242+0000", 2024-09-11T05:33:30.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.035735847000000001 2024-09-11T05:33:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605289+0000", 2024-09-11T05:33:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6726e-05 2024-09-11T05:33:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605342+0000", 2024-09-11T05:33:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3411000000000001e-05 2024-09-11T05:33:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.237 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47421 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3334144~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569532+0000", 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6031797010000002, 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036049808000000003, 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47421 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.238 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569532+0000", 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569532+0000", 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569532+0000", 2024-09-11T05:33:30.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8900000000000001e-07 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569534+0000", 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6339999999999999e-06 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569541+0000", 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3300000000000001e-06 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.240 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569545+0000", 2024-09-11T05:33:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.636e-06 2024-09-11T05:33:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605480+0000", 2024-09-11T05:33:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.035935421000000002 2024-09-11T05:33:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605527+0000", 2024-09-11T05:33:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7203000000000002e-05 2024-09-11T05:33:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605582+0000", 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4295000000000001e-05 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47422 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3383296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569549+0000", 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6031627870000005, 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036146018000000002, 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.242 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47422 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569549+0000", 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569549+0000", 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569549+0000", 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569550+0000", 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3430000000000001e-06 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.245 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.245 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569554+0000", 2024-09-11T05:33:30.245 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.134e-06 2024-09-11T05:33:30.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.245 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.245 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.245 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569557+0000", 2024-09-11T05:33:30.245 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0460000000000001e-06 2024-09-11T05:33:30.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.245 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.245 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.245 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605608+0000", 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036051894000000001 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605646+0000", 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7283999999999997e-05 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605695+0000", 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9052999999999999e-05 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.246 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47423 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3432448~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569560+0000", 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.603151971, 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036258024999999999, 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47423 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.247 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.248 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.248 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569560+0000", 2024-09-11T05:33:30.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.248 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.248 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569560+0000", 2024-09-11T05:33:30.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.248 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.248 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569560+0000", 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9799999999999999e-07 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569561+0000", 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0550000000000001e-06 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569565+0000", 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1289999999999998e-06 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569568+0000", 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3969999999999998e-06 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605720+0000", 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036151533 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605763+0000", 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3142999999999997e-05 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.250 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605818+0000", 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4469999999999999e-05 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47424 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569572+0000", 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6031399620000002, 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036345455999999998, 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.251 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47424 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569572+0000", 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569572+0000", 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569572+0000", 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.29e-07 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569573+0000", 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2950000000000001e-06 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569576+0000", 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.021e-06 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569579+0000", 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.604e-06 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605832+0000", 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036253286000000003 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.254 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605869+0000", 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7045999999999997e-05 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605917+0000", 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7975000000000001e-05 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47425 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3530752~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569581+0000", 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6031301569999998, 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036458552999999998, 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47425 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569581+0000", 2024-09-11T05:33:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569581+0000", 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569582+0000", 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.04e-07 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.257 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569586+0000", 2024-09-11T05:33:30.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5029999999999999e-06 2024-09-11T05:33:30.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.258 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569589+0000", 2024-09-11T05:33:30.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1879999999999998e-06 2024-09-11T05:33:30.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.258 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569592+0000", 2024-09-11T05:33:30.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4040000000000002e-06 2024-09-11T05:33:30.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605942+0000", 2024-09-11T05:33:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036350683000000002 2024-09-11T05:33:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605986+0000", 2024-09-11T05:33:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3585999999999999e-05 2024-09-11T05:33:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606040+0000", 2024-09-11T05:33:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3984999999999999e-05 2024-09-11T05:33:30.260 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.260 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.260 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.260 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.260 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47426 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3579904~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.260 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569595+0000", 2024-09-11T05:33:30.260 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6031168420000004, 2024-09-11T05:33:30.260 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036554735999999997, 2024-09-11T05:33:30.260 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.260 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.260 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.260 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47426 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569595+0000", 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569595+0000", 2024-09-11T05:33:30.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569595+0000", 2024-09-11T05:33:30.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:30.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569596+0000", 2024-09-11T05:33:30.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0869999999999999e-06 2024-09-11T05:33:30.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569599+0000", 2024-09-11T05:33:30.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8439999999999998e-06 2024-09-11T05:33:30.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569601+0000", 2024-09-11T05:33:30.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4899999999999999e-06 2024-09-11T05:33:30.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606066+0000", 2024-09-11T05:33:30.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036464609000000002 2024-09-11T05:33:30.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.264 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.264 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.264 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606104+0000", 2024-09-11T05:33:30.264 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7521000000000002e-05 2024-09-11T05:33:30.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.264 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.264 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.264 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606149+0000", 2024-09-11T05:33:30.264 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5972e-05 2024-09-11T05:33:30.264 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.264 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.264 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.265 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47427 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3629056~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.265 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569605+0000", 2024-09-11T05:33:30.265 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6031067600000002, 2024-09-11T05:33:30.265 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036661568999999998, 2024-09-11T05:33:30.265 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.265 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.265 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:30.265 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.265 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.265 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.265 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47427 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569605+0000", 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569605+0000", 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.571489+0000", 2024-09-11T05:33:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0018838349999999999 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.571492+0000", 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7100000000000001e-06 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.571500+0000", 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8040000000000002e-06 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.571505+0000", 2024-09-11T05:33:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4680000000000003e-06 2024-09-11T05:33:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606174+0000", 2024-09-11T05:33:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.034669750999999999 2024-09-11T05:33:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606215+0000", 2024-09-11T05:33:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0299000000000002e-05 2024-09-11T05:33:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.269 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606266+0000", 2024-09-11T05:33:30.269 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1702000000000001e-05 2024-09-11T05:33:30.269 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.269 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.269 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.269 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.269 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.269 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:30.271 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:30.272 INFO:teuthology.orchestra.run.smithi070.stdout:3134 write 0xb3a9c58 thru 0xb3abde3 (0x218c bytes) 2024-09-11T05:33:30.272 INFO:teuthology.orchestra.run.smithi070.stdout:3135 trunc from 0xb3abde4 to 0x1d88f2d 2024-09-11T05:33:30.272 INFO:teuthology.orchestra.run.smithi070.stdout:3136 read 0xfdf815 thru 0xfe696b (0x7157 bytes) 2024-09-11T05:33:30.272 INFO:teuthology.orchestra.run.smithi070.stdout:3137 read 0x6e6936 thru 0x6f610b (0xf7d6 bytes) 2024-09-11T05:33:30.272 INFO:teuthology.orchestra.run.smithi070.stdout:3138 write 0x7ab8c8a thru 0x7ac657a (0xd8f1 bytes) 2024-09-11T05:33:30.272 INFO:teuthology.orchestra.run.smithi070.stdout:3139 writesame 0x7d57ec9 thru 0x7d59052 data_size 0x5(0x118a bytes) 2024-09-11T05:33:30.272 INFO:teuthology.orchestra.run.smithi070.stdout:3141 read 0x5205ca1 thru 0x5205ca4 (0x4 bytes) 2024-09-11T05:33:30.273 INFO:teuthology.orchestra.run.smithi070.stdout:3142 punch from 0x3ff4a7e to 0x3ff5472, (0x9f4 bytes) 2024-09-11T05:33:30.273 INFO:teuthology.orchestra.run.smithi070.stdout:3145 read 0x5f0a546 thru 0x5f0d8e7 (0x33a2 bytes) 2024-09-11T05:33:30.273 INFO:teuthology.orchestra.run.smithi070.stdout:3146 writesame 0x6094a4a thru 0x60999b9 data_size 0x29(0x4f70 bytes) 2024-09-11T05:33:30.273 INFO:teuthology.orchestra.run.smithi070.stdout:3147 read 0x3e26206 thru 0x3e29700 (0x34fb bytes) 2024-09-11T05:33:30.273 INFO:teuthology.orchestra.run.smithi070.stdout:3148 write 0x5a580cc thru 0x5a61123 (0x9058 bytes) 2024-09-11T05:33:30.273 INFO:teuthology.orchestra.run.smithi070.stdout:3150 writesame 0x4a33659 thru 0x4a41e4b data_size 0x1(0xe7f3 bytes) 2024-09-11T05:33:30.273 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:30.270+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:30.280 INFO:teuthology.orchestra.run.smithi070.stdout:3151 read 0x6ae7271 thru 0x6af62dd (0xf06d bytes) 2024-09-11T05:33:30.281 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:30.284 INFO:teuthology.orchestra.run.smithi070.stdout:3153 trunc from 0x7d59053 to 0x5b6e0dc 2024-09-11T05:33:30.298 INFO:teuthology.orchestra.run.smithi070.stdout:3154 write 0x4cf7688 thru 0x4d0486e (0xd1e7 bytes) 2024-09-11T05:33:30.302 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:30.312 INFO:teuthology.orchestra.run.smithi070.stdout:3156 writesame 0x9629f3e thru 0x96388ed data_size 0x8(0xe9b0 bytes) 2024-09-11T05:33:30.326 INFO:teuthology.orchestra.run.smithi070.stdout:3157 write 0xec6bccc thru 0xec74686 (0x89bb bytes) 2024-09-11T05:33:30.332 INFO:teuthology.orchestra.run.smithi070.stdout:3158 read 0x6a023b8 thru 0x6a09556 (0x719f bytes) 2024-09-11T05:33:30.332 INFO:teuthology.orchestra.run.smithi070.stdout:3160 write 0xc586260 thru 0xc593ae5 (0xd886 bytes) 2024-09-11T05:33:30.337 INFO:teuthology.orchestra.run.smithi070.stdout:3161 read 0x3bbb069 thru 0x3bc689f (0xb837 bytes) 2024-09-11T05:33:30.337 INFO:teuthology.orchestra.run.smithi070.stdout:3164 write 0x1e525f thru 0x1ed84d (0x85ef bytes) 2024-09-11T05:33:30.352 INFO:teuthology.orchestra.run.smithi070.stdout:3166 trunc from 0xec74687 to 0x2e3f947 2024-09-11T05:33:30.365 INFO:teuthology.orchestra.run.smithi070.stdout:3167 read 0x29b3362 thru 0x29b9213 (0x5eb2 bytes) 2024-09-11T05:33:30.371 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:30.370+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:30.384 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:30.384 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:30.384 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:30.384 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:30.385 INFO:teuthology.orchestra.run.smithi070.stdout:3168 writesame 0xd152d26 thru 0xd156877 data_size 0x3(0x3b52 bytes) 2024-09-11T05:33:30.385 INFO:teuthology.orchestra.run.smithi070.stdout:3169 write 0x2348d1d thru 0x23531c4 (0xa4a8 bytes) 2024-09-11T05:33:30.392 INFO:teuthology.orchestra.run.smithi070.stdout:3170 punch from 0x6c94c75 to 0x6c98658, (0x39e3 bytes) 2024-09-11T05:33:30.392 INFO:teuthology.orchestra.run.smithi070.stdout:3171 write 0x92946cc thru 0x929b251 (0x6b86 bytes) 2024-09-11T05:33:30.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:30.397 INFO:teuthology.orchestra.run.smithi070.stdout:3173 clone 21 order 25 su 8388608 sc 6 2024-09-11T05:33:30.477 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:30.476+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:30.529 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:33:30.536 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:30.536 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:30.536 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:30.536 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:30.537 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:30.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:30.588 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:30.587+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:30.650 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:30.666 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:30.667 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:30.673 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:30.672+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:30.682 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:30.682 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:30.694 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 20.045169995999998, 2024-09-11T05:33:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:33:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:33:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:30.697 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.697 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.697 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:33:30.697 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:33:30.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.697 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:33:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.700 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.700 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:30.700 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:33:30.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:33:30.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.700 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.700 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:30.700 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:33:30.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:33:30.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.700 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.700 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:30.700 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:33:30.701 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:33:30.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.701 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.701 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.701 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:33:30.701 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:33:30.701 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.701 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.701 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.701 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.701 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46373 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.701 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430582+0000", 2024-09-11T05:33:30.702 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.262860774, 2024-09-11T05:33:30.702 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022968048000000001, 2024-09-11T05:33:30.702 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.702 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.702 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.702 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.702 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.702 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.702 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46373 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430582+0000", 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430582+0000", 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.704 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430583+0000", 2024-09-11T05:33:30.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.99e-07 2024-09-11T05:33:30.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.704 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.704 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430585+0000", 2024-09-11T05:33:30.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0470000000000001e-06 2024-09-11T05:33:30.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.705 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430591+0000", 2024-09-11T05:33:30.705 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1550000000000004e-06 2024-09-11T05:33:30.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.705 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430601+0000", 2024-09-11T05:33:30.705 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0097e-05 2024-09-11T05:33:30.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.706 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453542+0000", 2024-09-11T05:33:30.706 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022940853000000001 2024-09-11T05:33:30.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.706 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.706 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453550+0000", 2024-09-11T05:33:30.706 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2970000000000004e-06 2024-09-11T05:33:30.706 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.706 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.706 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.706 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46375 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.707 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430626+0000", 2024-09-11T05:33:30.707 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2628169649999998, 2024-09-11T05:33:30.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.02296014, 2024-09-11T05:33:30.707 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.707 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.707 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.707 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.707 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.707 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.707 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46375 2024-09-11T05:33:30.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.708 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.708 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.708 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430626+0000", 2024-09-11T05:33:30.708 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.708 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.708 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430626+0000", 2024-09-11T05:33:30.708 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.709 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430627+0000", 2024-09-11T05:33:30.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.58e-07 2024-09-11T05:33:30.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.709 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430628+0000", 2024-09-11T05:33:30.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.821e-06 2024-09-11T05:33:30.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.710 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.710 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430634+0000", 2024-09-11T05:33:30.710 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.519e-06 2024-09-11T05:33:30.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.710 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.710 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430639+0000", 2024-09-11T05:33:30.710 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8520000000000003e-06 2024-09-11T05:33:30.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.711 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.711 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453579+0000", 2024-09-11T05:33:30.711 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022940072999999998 2024-09-11T05:33:30.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.711 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.711 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.711 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453586+0000", 2024-09-11T05:33:30.711 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5170000000000002e-06 2024-09-11T05:33:30.711 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.711 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.711 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.712 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.712 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46387 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.712 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430892+0000", 2024-09-11T05:33:30.712 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2625514520000003, 2024-09-11T05:33:30.712 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022967451999999999, 2024-09-11T05:33:30.712 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.712 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.712 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.712 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.712 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.712 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.712 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46387 2024-09-11T05:33:30.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.713 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430892+0000", 2024-09-11T05:33:30.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430892+0000", 2024-09-11T05:33:30.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.714 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430892+0000", 2024-09-11T05:33:30.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:33:30.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.714 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430894+0000", 2024-09-11T05:33:30.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:33:30.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.715 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430899+0000", 2024-09-11T05:33:30.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3630000000000002e-06 2024-09-11T05:33:30.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.715 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430904+0000", 2024-09-11T05:33:30.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:33:30.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.716 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453851+0000", 2024-09-11T05:33:30.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022947116 2024-09-11T05:33:30.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.716 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453859+0000", 2024-09-11T05:33:30.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3820000000000004e-06 2024-09-11T05:33:30.716 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.716 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.717 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.717 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46389 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.717 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430946+0000", 2024-09-11T05:33:30.717 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2624973700000002, 2024-09-11T05:33:30.717 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022968111999999999, 2024-09-11T05:33:30.717 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.717 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.717 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.717 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.717 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.718 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.718 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46389 2024-09-11T05:33:30.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.718 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.718 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.718 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.718 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430946+0000", 2024-09-11T05:33:30.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.718 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.718 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.718 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430946+0000", 2024-09-11T05:33:30.719 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.719 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.719 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430946+0000", 2024-09-11T05:33:30.719 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:33:30.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.719 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.719 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430953+0000", 2024-09-11T05:33:30.719 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5169999999999996e-06 2024-09-11T05:33:30.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.720 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.720 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430959+0000", 2024-09-11T05:33:30.720 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8590000000000001e-06 2024-09-11T05:33:30.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.720 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.720 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430963+0000", 2024-09-11T05:33:30.720 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5820000000000003e-06 2024-09-11T05:33:30.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.721 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453905+0000", 2024-09-11T05:33:30.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022941868000000001 2024-09-11T05:33:30.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.721 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.721 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453914+0000", 2024-09-11T05:33:30.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8049999999999996e-06 2024-09-11T05:33:30.721 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.721 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.721 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.722 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.722 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46390 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.722 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430969+0000", 2024-09-11T05:33:30.722 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2624738100000004, 2024-09-11T05:33:30.722 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022962268000000001, 2024-09-11T05:33:30.722 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.722 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.722 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.722 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.722 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.722 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.722 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46390 2024-09-11T05:33:30.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.723 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430969+0000", 2024-09-11T05:33:30.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430969+0000", 2024-09-11T05:33:30.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.724 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.724 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430970+0000", 2024-09-11T05:33:30.724 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:33:30.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.724 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.724 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430972+0000", 2024-09-11T05:33:30.724 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.968e-06 2024-09-11T05:33:30.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.725 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430977+0000", 2024-09-11T05:33:30.725 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6960000000000002e-06 2024-09-11T05:33:30.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.725 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.725 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430982+0000", 2024-09-11T05:33:30.725 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3529999999999997e-06 2024-09-11T05:33:30.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.725 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.725 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453927+0000", 2024-09-11T05:33:30.726 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022945139 2024-09-11T05:33:30.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.726 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.726 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.726 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453932+0000", 2024-09-11T05:33:30.726 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7210000000000002e-06 2024-09-11T05:33:30.726 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.726 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.726 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.726 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.726 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46391 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.727 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430987+0000", 2024-09-11T05:33:30.727 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2624559309999999, 2024-09-11T05:33:30.727 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022979535999999998, 2024-09-11T05:33:30.727 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.727 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.727 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.727 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.727 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.727 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.727 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46391 2024-09-11T05:33:30.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.727 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.728 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430987+0000", 2024-09-11T05:33:30.728 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.728 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430987+0000", 2024-09-11T05:33:30.729 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.730 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430988+0000", 2024-09-11T05:33:30.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:33:30.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.730 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.731 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430993+0000", 2024-09-11T05:33:30.731 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2349999999999999e-06 2024-09-11T05:33:30.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.731 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.731 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430999+0000", 2024-09-11T05:33:30.731 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7359999999999998e-06 2024-09-11T05:33:30.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.731 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.731 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431008+0000", 2024-09-11T05:33:30.731 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2420000000000006e-06 2024-09-11T05:33:30.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.732 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.732 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.732 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453958+0000", 2024-09-11T05:33:30.732 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022950310000000002 2024-09-11T05:33:30.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.732 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.732 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.732 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453967+0000", 2024-09-11T05:33:30.732 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:33:30.732 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.733 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.733 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.733 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.733 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.733 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46392 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.733 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431014+0000", 2024-09-11T05:33:30.733 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2624291330000004, 2024-09-11T05:33:30.733 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022970832, 2024-09-11T05:33:30.733 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.733 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.733 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.733 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46392 2024-09-11T05:33:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431014+0000", 2024-09-11T05:33:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431014+0000", 2024-09-11T05:33:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431015+0000", 2024-09-11T05:33:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6700000000000003e-07 2024-09-11T05:33:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431017+0000", 2024-09-11T05:33:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1119999999999999e-06 2024-09-11T05:33:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431023+0000", 2024-09-11T05:33:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9569999999999999e-06 2024-09-11T05:33:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431027+0000", 2024-09-11T05:33:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7530000000000001e-06 2024-09-11T05:33:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453980+0000", 2024-09-11T05:33:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022952745 2024-09-11T05:33:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453985+0000", 2024-09-11T05:33:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6979999999999997e-06 2024-09-11T05:33:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46393 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431033+0000", 2024-09-11T05:33:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2624100440000001, 2024-09-11T05:33:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.02299064, 2024-09-11T05:33:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46393 2024-09-11T05:33:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431033+0000", 2024-09-11T05:33:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431033+0000", 2024-09-11T05:33:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431034+0000", 2024-09-11T05:33:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5900000000000002e-07 2024-09-11T05:33:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431043+0000", 2024-09-11T05:33:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9420000000000007e-06 2024-09-11T05:33:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431049+0000", 2024-09-11T05:33:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9259999999999997e-06 2024-09-11T05:33:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431054+0000", 2024-09-11T05:33:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5739999999999997e-06 2024-09-11T05:33:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454014+0000", 2024-09-11T05:33:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022960332999999999 2024-09-11T05:33:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454024+0000", 2024-09-11T05:33:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4059999999999994e-06 2024-09-11T05:33:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46394 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431064+0000", 2024-09-11T05:33:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2623787130000004, 2024-09-11T05:33:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022975287, 2024-09-11T05:33:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46394 2024-09-11T05:33:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431064+0000", 2024-09-11T05:33:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431064+0000", 2024-09-11T05:33:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431065+0000", 2024-09-11T05:33:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7e-07 2024-09-11T05:33:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431067+0000", 2024-09-11T05:33:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:33:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431072+0000", 2024-09-11T05:33:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7640000000000002e-06 2024-09-11T05:33:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431077+0000", 2024-09-11T05:33:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6319999999999999e-06 2024-09-11T05:33:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454036+0000", 2024-09-11T05:33:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022958668000000002 2024-09-11T05:33:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454040+0000", 2024-09-11T05:33:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9380000000000002e-06 2024-09-11T05:33:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46395 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431096+0000", 2024-09-11T05:33:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2623474369999999, 2024-09-11T05:33:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022966864, 2024-09-11T05:33:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46395 2024-09-11T05:33:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431096+0000", 2024-09-11T05:33:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431096+0000", 2024-09-11T05:33:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431096+0000", 2024-09-11T05:33:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6000000000000004e-07 2024-09-11T05:33:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431098+0000", 2024-09-11T05:33:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1500000000000002e-06 2024-09-11T05:33:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431105+0000", 2024-09-11T05:33:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2090000000000002e-06 2024-09-11T05:33:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431114+0000", 2024-09-11T05:33:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5799999999999998e-06 2024-09-11T05:33:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454055+0000", 2024-09-11T05:33:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022940533999999999 2024-09-11T05:33:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454063+0000", 2024-09-11T05:33:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8310000000000001e-06 2024-09-11T05:33:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46399 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431176+0000", 2024-09-11T05:33:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2622676070000001, 2024-09-11T05:33:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022967634000000001, 2024-09-11T05:33:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46399 2024-09-11T05:33:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431176+0000", 2024-09-11T05:33:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431176+0000", 2024-09-11T05:33:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431176+0000", 2024-09-11T05:33:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6100000000000001e-07 2024-09-11T05:33:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431178+0000", 2024-09-11T05:33:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:33:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431184+0000", 2024-09-11T05:33:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3239999999999999e-06 2024-09-11T05:33:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431189+0000", 2024-09-11T05:33:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7049999999999998e-06 2024-09-11T05:33:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454135+0000", 2024-09-11T05:33:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022945579000000001 2024-09-11T05:33:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454143+0000", 2024-09-11T05:33:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6179999999999995e-06 2024-09-11T05:33:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46400 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431195+0000", 2024-09-11T05:33:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2622477080000003, 2024-09-11T05:33:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022966688999999998, 2024-09-11T05:33:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46400 2024-09-11T05:33:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431195+0000", 2024-09-11T05:33:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431195+0000", 2024-09-11T05:33:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431196+0000", 2024-09-11T05:33:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.53e-07 2024-09-11T05:33:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431199+0000", 2024-09-11T05:33:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9210000000000001e-06 2024-09-11T05:33:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431204+0000", 2024-09-11T05:33:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8100000000000003e-06 2024-09-11T05:33:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431209+0000", 2024-09-11T05:33:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6210000000000003e-06 2024-09-11T05:33:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454156+0000", 2024-09-11T05:33:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022946785000000001 2024-09-11T05:33:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454162+0000", 2024-09-11T05:33:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1990000000000003e-06 2024-09-11T05:33:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46401 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431214+0000", 2024-09-11T05:33:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2622287380000001, 2024-09-11T05:33:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022973299999999999, 2024-09-11T05:33:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46401 2024-09-11T05:33:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431214+0000", 2024-09-11T05:33:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431214+0000", 2024-09-11T05:33:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431215+0000", 2024-09-11T05:33:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.03e-07 2024-09-11T05:33:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431217+0000", 2024-09-11T05:33:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.866e-06 2024-09-11T05:33:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431222+0000", 2024-09-11T05:33:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7749999999999998e-06 2024-09-11T05:33:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431227+0000", 2024-09-11T05:33:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0039999999999999e-06 2024-09-11T05:33:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454180+0000", 2024-09-11T05:33:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022952337 2024-09-11T05:33:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454188+0000", 2024-09-11T05:33:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9149999999999996e-06 2024-09-11T05:33:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46402 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431233+0000", 2024-09-11T05:33:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.26220994, 2024-09-11T05:33:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022970022999999999, 2024-09-11T05:33:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46402 2024-09-11T05:33:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431233+0000", 2024-09-11T05:33:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431233+0000", 2024-09-11T05:33:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431234+0000", 2024-09-11T05:33:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:33:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431235+0000", 2024-09-11T05:33:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.813e-06 2024-09-11T05:33:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431241+0000", 2024-09-11T05:33:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4399999999999996e-06 2024-09-11T05:33:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431245+0000", 2024-09-11T05:33:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:33:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454198+0000", 2024-09-11T05:33:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022952381000000001 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454203+0000", 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.48e-06 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46403 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431251+0000", 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2621921910000005, 2024-09-11T05:33:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022983025000000001, 2024-09-11T05:33:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46403 2024-09-11T05:33:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431251+0000", 2024-09-11T05:33:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431251+0000", 2024-09-11T05:33:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431251+0000", 2024-09-11T05:33:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:33:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431257+0000", 2024-09-11T05:33:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.643e-06 2024-09-11T05:33:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431264+0000", 2024-09-11T05:33:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2010000000000002e-06 2024-09-11T05:33:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431270+0000", 2024-09-11T05:33:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:33:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454225+0000", 2024-09-11T05:33:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022955350999999999 2024-09-11T05:33:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454234+0000", 2024-09-11T05:33:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7679999999999997e-06 2024-09-11T05:33:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46404 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431282+0000", 2024-09-11T05:33:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2621615190000002, 2024-09-11T05:33:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022967751000000002, 2024-09-11T05:33:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46404 2024-09-11T05:33:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431282+0000", 2024-09-11T05:33:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431282+0000", 2024-09-11T05:33:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431282+0000", 2024-09-11T05:33:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000003e-07 2024-09-11T05:33:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431284+0000", 2024-09-11T05:33:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0640000000000001e-06 2024-09-11T05:33:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431290+0000", 2024-09-11T05:33:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1149999999999999e-06 2024-09-11T05:33:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431295+0000", 2024-09-11T05:33:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.651e-06 2024-09-11T05:33:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454245+0000", 2024-09-11T05:33:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.02295003 2024-09-11T05:33:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454249+0000", 2024-09-11T05:33:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3170000000000003e-06 2024-09-11T05:33:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46447 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431301+0000", 2024-09-11T05:33:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2621419149999999, 2024-09-11T05:33:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022973720999999999, 2024-09-11T05:33:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46447 2024-09-11T05:33:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431301+0000", 2024-09-11T05:33:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431301+0000", 2024-09-11T05:33:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431302+0000", 2024-09-11T05:33:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6899999999999998e-07 2024-09-11T05:33:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431304+0000", 2024-09-11T05:33:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.99e-06 2024-09-11T05:33:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431309+0000", 2024-09-11T05:33:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7169999999999996e-06 2024-09-11T05:33:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431314+0000", 2024-09-11T05:33:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000003e-06 2024-09-11T05:33:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454266+0000", 2024-09-11T05:33:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022952426000000001 2024-09-11T05:33:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454275+0000", 2024-09-11T05:33:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8189999999999998e-06 2024-09-11T05:33:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46448 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431319+0000", 2024-09-11T05:33:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2621240680000003, 2024-09-11T05:33:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022969360000000001, 2024-09-11T05:33:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46448 2024-09-11T05:33:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431319+0000", 2024-09-11T05:33:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431319+0000", 2024-09-11T05:33:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431319+0000", 2024-09-11T05:33:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:33:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431321+0000", 2024-09-11T05:33:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6810000000000001e-06 2024-09-11T05:33:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431327+0000", 2024-09-11T05:33:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7459999999999997e-06 2024-09-11T05:33:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431331+0000", 2024-09-11T05:33:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5210000000000004e-06 2024-09-11T05:33:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454285+0000", 2024-09-11T05:33:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022953431 2024-09-11T05:33:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454288+0000", 2024-09-11T05:33:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:33:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46449 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431337+0000", 2024-09-11T05:33:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.2621061759999996, 2024-09-11T05:33:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022974029999999999, 2024-09-11T05:33:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46449 2024-09-11T05:33:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431337+0000", 2024-09-11T05:33:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431337+0000", 2024-09-11T05:33:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431337+0000", 2024-09-11T05:33:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431339+0000", 2024-09-11T05:33:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.793e-06 2024-09-11T05:33:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431345+0000", 2024-09-11T05:33:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.541e-06 2024-09-11T05:33:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431349+0000", 2024-09-11T05:33:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3270000000000002e-06 2024-09-11T05:33:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454302+0000", 2024-09-11T05:33:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022953106000000001 2024-09-11T05:33:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454311+0000", 2024-09-11T05:33:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9090000000000006e-06 2024-09-11T05:33:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:30.795 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:30.796 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:30.796 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:30.797 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:30.798 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:30.798 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:30.795+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:30.798 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:30.799 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:30.799 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T05:33:30.801 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.7 to 1 (10000) 2024-09-11T05:33:30.801 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:30.802 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:30.804 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T05:33:30.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:33:30.825 INFO:teuthology.orchestra.run.smithi070.stdout:flattening image image_client.0-clone20 2024-09-11T05:33:30.897 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:30.896+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:30.936 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:30.936 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:30.948 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:30.972 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-11T05:33:30.998 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:30.998+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:31.073 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:31.073 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:31.082 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:31.124 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:31.123+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:31.142 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:33:31.142 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:33:31.155 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-11T05:33:30.763654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655738718,"num_objects":1197,"num_object_clones":378,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":379,"num_read":74251,"num_read_kb":277895,"num_write":9838,"num_write_kb":162370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7885,"ondisk_log_size":7885,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":491904,"kb_used_data":231436,"kb_used_omap":10,"kb_used_meta":259765,"kb_avail":660110976,"statfs":{"total":676457349120,"available":675953639424,"internally_reserved":0,"allocated":236990464,"data_stored":321383914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11157,"internal_metadata":265999467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42418429,"num_objects":193,"num_object_clones":18,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":11,"num_read":17647,"num_read_kb":44627,"num_write":2062,"num_write_kb":19983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.025355"},"pg_stats":[{"pgid":"3.1f","version":"46'409","reported_seq":2209,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759590+0000","last_change":"2024-09-11T05:32:57.613041+0000","last_active":"2024-09-11T05:33:27.759590+0000","last_peered":"2024-09-11T05:33:27.759590+0000","last_clean":"2024-09-11T05:33:27.759590+0000","last_became_active":"2024-09-11T05:32:55.616706+0000","last_became_peered":"2024-09-11T05:32:55.616706+0000","last_unstale":"2024-09-11T05:33:27.759590+0000","last_undegraded":"2024-09-11T05:33:27.759590+0000","last_fullsized":"2024-09-11T05:33:27.759590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:08:29.403813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069887699999999998,"stat_sum":{"num_bytes":23175684,"num_objects":32,"num_object_clones":9,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":10,"num_read":3259,"num_read_kb":11515,"num_write":605,"num_write_kb":7659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"46'125","reported_seq":2099,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759556+0000","last_change":"2024-09-11T05:32:57.612693+0000","last_active":"2024-09-11T05:33:27.759556+0000","last_peered":"2024-09-11T05:33:27.759556+0000","last_clean":"2024-09-11T05:33:27.759556+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:33:27.759556+0000","last_undegraded":"2024-09-11T05:33:27.759556+0000","last_fullsized":"2024-09-11T05:33:27.759556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:27:50.649372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039696399999999998,"stat_sum":{"num_bytes":29063301,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":14,"num_read":1957,"num_read_kb":12294,"num_write":114,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"46'124","reported_seq":477,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759252+0000","last_change":"2024-09-11T05:32:57.891873+0000","last_active":"2024-09-11T05:33:27.759252+0000","last_peered":"2024-09-11T05:33:27.759252+0000","last_clean":"2024-09-11T05:33:27.759252+0000","last_became_active":"2024-09-11T05:32:55.615674+0000","last_became_peered":"2024-09-11T05:32:55.615674+0000","last_unstale":"2024-09-11T05:33:27.759252+0000","last_undegraded":"2024-09-11T05:33:27.759252+0000","last_fullsized":"2024-09-11T05:33:27.759252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:32.910315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057469400000000005,"stat_sum":{"num_bytes":19352437,"num_objects":34,"num_object_clones":12,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":11,"num_read":321,"num_read_kb":3004,"num_write":119,"num_write_kb":2748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"47'298","reported_seq":2100,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.947861+0000","last_change":"2024-09-11T05:32:57.610640+0000","last_active":"2024-09-11T05:33:27.947861+0000","last_peered":"2024-09-11T05:33:27.947861+0000","last_clean":"2024-09-11T05:33:27.947861+0000","last_became_active":"2024-09-11T05:32:55.611900+0000","last_became_peered":"2024-09-11T05:32:55.611900+0000","last_unstale":"2024-09-11T05:33:27.947861+0000","last_undegraded":"2024-09-11T05:33:27.947861+0000","last_fullsized":"2024-09-11T05:33:27.947861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:37.822046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060489099999999998,"stat_sum":{"num_bytes":53416441,"num_objects":40,"num_object_clones":13,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":13,"num_read":3702,"num_read_kb":24280,"num_write":359,"num_write_kb":14067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"46'339","reported_seq":886,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.747891+0000","last_change":"2024-09-11T05:32:57.607436+0000","last_active":"2024-09-11T05:33:27.747891+0000","last_peered":"2024-09-11T05:33:27.747891+0000","last_clean":"2024-09-11T05:33:27.747891+0000","last_became_active":"2024-09-11T05:32:55.616210+0000","last_became_peered":"2024-09-11T05:32:55.616210+0000","last_unstale":"2024-09-11T05:33:27.747891+0000","last_undegraded":"2024-09-11T05:33:27.747891+0000","last_fullsized":"2024-09-11T05:33:27.747891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:11.555855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061541299999999998,"stat_sum":{"num_bytes":6996582,"num_objects":35,"num_object_clones":11,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":13,"num_read":1610,"num_read_kb":3279,"num_write":499,"num_write_kb":1969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'173","reported_seq":2392,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.958172+0000","last_change":"2024-09-11T05:32:57.611081+0000","last_active":"2024-09-11T05:33:27.958172+0000","last_peered":"2024-09-11T05:33:27.958172+0000","last_clean":"2024-09-11T05:33:27.958172+0000","last_became_active":"2024-09-11T05:32:55.612495+0000","last_became_peered":"2024-09-11T05:32:55.612495+0000","last_unstale":"2024-09-11T05:33:27.958172+0000","last_undegraded":"2024-09-11T05:33:27.958172+0000","last_fullsized":"2024-09-11T05:33:27.958172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:12:13.546356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049061,"stat_sum":{"num_bytes":28412017,"num_objects":48,"num_object_clones":18,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":17,"num_read":3263,"num_read_kb":8979,"num_write":171,"num_write_kb":5101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"47'871","reported_seq":1847,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.885743+0000","last_change":"2024-09-11T05:32:57.610393+0000","last_active":"2024-09-11T05:33:27.885743+0000","last_peered":"2024-09-11T05:33:27.885743+0000","last_clean":"2024-09-11T05:33:27.885743+0000","last_became_active":"2024-09-11T05:32:55.616919+0000","last_became_peered":"2024-09-11T05:32:55.616919+0000","last_unstale":"2024-09-11T05:33:27.885743+0000","last_undegraded":"2024-09-11T05:33:27.885743+0000","last_fullsized":"2024-09-11T05:33:27.885743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:05:00.243846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050971999999999996,"stat_sum":{"num_bytes":9683963,"num_objects":31,"num_object_clones":10,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":9,"num_read":4976,"num_read_kb":7122,"num_write":1464,"num_write_kb":3954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"47'312","reported_seq":1718,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.959899+0000","last_change":"2024-09-11T05:32:57.613299+0000","last_active":"2024-09-11T05:33:27.959899+0000","last_peered":"2024-09-11T05:33:27.959899+0000","last_clean":"2024-09-11T05:33:27.959899+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:33:27.959899+0000","last_undegraded":"2024-09-11T05:33:27.959899+0000","last_fullsized":"2024-09-11T05:33:27.959899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:47:05.393683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084187599999999997,"stat_sum":{"num_bytes":5820459,"num_objects":33,"num_object_clones":9,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":10,"num_read":2432,"num_read_kb":4773,"num_write":446,"num_write_kb":3213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"46'472","reported_seq":1244,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759594+0000","last_change":"2024-09-11T05:32:57.613037+0000","last_active":"2024-09-11T05:33:27.759594+0000","last_peered":"2024-09-11T05:33:27.759594+0000","last_clean":"2024-09-11T05:33:27.759594+0000","last_became_active":"2024-09-11T05:32:55.620957+0000","last_became_peered":"2024-09-11T05:32:55.620957+0000","last_unstale":"2024-09-11T05:33:27.759594+0000","last_undegraded":"2024-09-11T05:33:27.759594+0000","last_fullsized":"2024-09-11T05:33:27.759594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:25.664339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065268399999999995,"stat_sum":{"num_bytes":39405704,"num_objects":33,"num_object_clones":12,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":9,"num_read":2432,"num_read_kb":22527,"num_write":743,"num_write_kb":16347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"46'114","reported_seq":1644,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.763175+0000","last_change":"2024-09-11T05:32:57.891156+0000","last_active":"2024-09-11T05:33:27.763175+0000","last_peered":"2024-09-11T05:33:27.763175+0000","last_clean":"2024-09-11T05:33:27.763175+0000","last_became_active":"2024-09-11T05:32:55.618120+0000","last_became_peered":"2024-09-11T05:32:55.618120+0000","last_unstale":"2024-09-11T05:33:27.763175+0000","last_undegraded":"2024-09-11T05:33:27.763175+0000","last_fullsized":"2024-09-11T05:33:27.763175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:43.189535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057970299999999999,"stat_sum":{"num_bytes":13043372,"num_objects":28,"num_object_clones":8,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":7,"num_read":1503,"num_read_kb":5708,"num_write":107,"num_write_kb":1775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"46'304","reported_seq":1716,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.748071+0000","last_change":"2024-09-11T05:32:57.607444+0000","last_active":"2024-09-11T05:33:27.748071+0000","last_peered":"2024-09-11T05:33:27.748071+0000","last_clean":"2024-09-11T05:33:27.748071+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:33:27.748071+0000","last_undegraded":"2024-09-11T05:33:27.748071+0000","last_fullsized":"2024-09-11T05:33:27.748071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:05.052323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066300199999999999,"stat_sum":{"num_bytes":14563777,"num_objects":44,"num_object_clones":13,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":16,"num_read":2235,"num_read_kb":5584,"num_write":417,"num_write_kb":3854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"46'137","reported_seq":1979,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759241+0000","last_change":"2024-09-11T05:32:57.890899+0000","last_active":"2024-09-11T05:33:27.759241+0000","last_peered":"2024-09-11T05:33:27.759241+0000","last_clean":"2024-09-11T05:33:27.759241+0000","last_became_active":"2024-09-11T05:32:55.617623+0000","last_became_peered":"2024-09-11T05:32:55.617623+0000","last_unstale":"2024-09-11T05:33:27.759241+0000","last_undegraded":"2024-09-11T05:33:27.759241+0000","last_fullsized":"2024-09-11T05:33:27.759241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:37:44.481340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073758600000000004,"stat_sum":{"num_bytes":14416982,"num_objects":44,"num_object_clones":14,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":13,"num_read":1825,"num_read_kb":7911,"num_write":136,"num_write_kb":6331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":71,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759373+0000","last_change":"2024-09-11T05:32:47.598023+0000","last_active":"2024-09-11T05:33:27.759373+0000","last_peered":"2024-09-11T05:33:27.759373+0000","last_clean":"2024-09-11T05:33:27.759373+0000","last_became_active":"2024-09-11T05:32:45.702003+0000","last_became_peered":"2024-09-11T05:32:45.702003+0000","last_unstale":"2024-09-11T05:33:27.759373+0000","last_undegraded":"2024-09-11T05:33:27.759373+0000","last_fullsized":"2024-09-11T05:33:27.759373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:08.654916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"47'124","reported_seq":2139,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.785879+0000","last_change":"2024-09-11T05:32:57.659941+0000","last_active":"2024-09-11T05:33:27.785879+0000","last_peered":"2024-09-11T05:33:27.785879+0000","last_clean":"2024-09-11T05:33:27.785879+0000","last_became_active":"2024-09-11T05:32:55.613342+0000","last_became_peered":"2024-09-11T05:32:55.613342+0000","last_unstale":"2024-09-11T05:33:27.785879+0000","last_undegraded":"2024-09-11T05:33:27.785879+0000","last_fullsized":"2024-09-11T05:33:27.785879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:59.783999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033519099999999998,"stat_sum":{"num_bytes":9619398,"num_objects":37,"num_object_clones":11,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":1971,"num_read_kb":629,"num_write":112,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.747963+0000","last_change":"2024-09-11T05:32:55.614406+0000","last_active":"2024-09-11T05:33:27.747963+0000","last_peered":"2024-09-11T05:33:27.747963+0000","last_clean":"2024-09-11T05:33:27.747963+0000","last_became_active":"2024-09-11T05:32:55.614125+0000","last_became_peered":"2024-09-11T05:32:55.614125+0000","last_unstale":"2024-09-11T05:33:27.747963+0000","last_undegraded":"2024-09-11T05:33:27.747963+0000","last_fullsized":"2024-09-11T05:33:27.747963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:06:59.971006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"46'173","reported_seq":1547,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.951423+0000","last_change":"2024-09-11T05:32:57.618706+0000","last_active":"2024-09-11T05:33:27.951423+0000","last_peered":"2024-09-11T05:33:27.951423+0000","last_clean":"2024-09-11T05:33:27.951423+0000","last_became_active":"2024-09-11T05:32:55.615465+0000","last_became_peered":"2024-09-11T05:32:55.615465+0000","last_unstale":"2024-09-11T05:33:27.951423+0000","last_undegraded":"2024-09-11T05:33:27.951423+0000","last_fullsized":"2024-09-11T05:33:27.951423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:21:14.536036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099597899999999992,"stat_sum":{"num_bytes":18988984,"num_objects":46,"num_object_clones":18,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":20,"num_read":2136,"num_read_kb":4847,"num_write":152,"num_write_kb":4740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759439+0000","last_change":"2024-09-11T05:32:55.611737+0000","last_active":"2024-09-11T05:33:27.759439+0000","last_peered":"2024-09-11T05:33:27.759439+0000","last_clean":"2024-09-11T05:33:27.759439+0000","last_became_active":"2024-09-11T05:32:55.611432+0000","last_became_peered":"2024-09-11T05:32:55.611432+0000","last_unstale":"2024-09-11T05:33:27.759439+0000","last_undegraded":"2024-09-11T05:33:27.759439+0000","last_fullsized":"2024-09-11T05:33:27.759439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:16.067863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"47'354","reported_seq":1697,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.960620+0000","last_change":"2024-09-11T05:32:57.618700+0000","last_active":"2024-09-11T05:33:27.960620+0000","last_peered":"2024-09-11T05:33:27.960620+0000","last_clean":"2024-09-11T05:33:27.960620+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:33:27.960620+0000","last_undegraded":"2024-09-11T05:33:27.960620+0000","last_fullsized":"2024-09-11T05:33:27.960620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:50.176576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010906679999999999,"stat_sum":{"num_bytes":8362623,"num_objects":43,"num_object_clones":13,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":15,"num_read":3366,"num_read_kb":5738,"num_write":423,"num_write_kb":5546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759408+0000","last_change":"2024-09-11T05:33:02.663770+0000","last_active":"2024-09-11T05:33:27.759408+0000","last_peered":"2024-09-11T05:33:27.759408+0000","last_clean":"2024-09-11T05:33:27.759408+0000","last_became_active":"2024-09-11T05:33:02.663542+0000","last_became_peered":"2024-09-11T05:33:02.663542+0000","last_unstale":"2024-09-11T05:33:27.759408+0000","last_undegraded":"2024-09-11T05:33:27.759408+0000","last_fullsized":"2024-09-11T05:33:27.759408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:36.032555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"46'196","reported_seq":1615,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.926976+0000","last_change":"2024-09-11T05:32:57.890326+0000","last_active":"2024-09-11T05:33:27.926976+0000","last_peered":"2024-09-11T05:33:27.926976+0000","last_clean":"2024-09-11T05:33:27.926976+0000","last_became_active":"2024-09-11T05:32:55.611732+0000","last_became_peered":"2024-09-11T05:32:55.611732+0000","last_unstale":"2024-09-11T05:33:27.926976+0000","last_undegraded":"2024-09-11T05:33:27.926976+0000","last_fullsized":"2024-09-11T05:33:27.926976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:10.714409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045416500000000003,"stat_sum":{"num_bytes":17839938,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":15,"num_read":2173,"num_read_kb":7647,"num_write":181,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"46'264","reported_seq":2289,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.914371+0000","last_change":"2024-09-11T05:32:57.607689+0000","last_active":"2024-09-11T05:33:27.914371+0000","last_peered":"2024-09-11T05:33:27.914371+0000","last_clean":"2024-09-11T05:33:27.914371+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:33:27.914371+0000","last_undegraded":"2024-09-11T05:33:27.914371+0000","last_fullsized":"2024-09-11T05:33:27.914371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:02.845888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074095900000000002,"stat_sum":{"num_bytes":21461549,"num_objects":29,"num_object_clones":8,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":8,"num_read":2811,"num_read_kb":7335,"num_write":338,"num_write_kb":3793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":73,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759064+0000","last_change":"2024-09-11T05:32:47.597956+0000","last_active":"2024-09-11T05:33:27.759064+0000","last_peered":"2024-09-11T05:33:27.759064+0000","last_clean":"2024-09-11T05:33:27.759064+0000","last_became_active":"2024-09-11T05:32:45.702439+0000","last_became_peered":"2024-09-11T05:32:45.702439+0000","last_unstale":"2024-09-11T05:33:27.759064+0000","last_undegraded":"2024-09-11T05:33:27.759064+0000","last_fullsized":"2024-09-11T05:33:27.759064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:27:05.110151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195137,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"46'134","reported_seq":1066,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759381+0000","last_change":"2024-09-11T05:32:57.612724+0000","last_active":"2024-09-11T05:33:27.759381+0000","last_peered":"2024-09-11T05:33:27.759381+0000","last_clean":"2024-09-11T05:33:27.759381+0000","last_became_active":"2024-09-11T05:32:55.613283+0000","last_became_peered":"2024-09-11T05:32:55.613283+0000","last_unstale":"2024-09-11T05:33:27.759381+0000","last_undegraded":"2024-09-11T05:33:27.759381+0000","last_fullsized":"2024-09-11T05:33:27.759381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:12:23.882314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041242399999999999,"stat_sum":{"num_bytes":11883443,"num_objects":34,"num_object_clones":10,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":13,"num_read":910,"num_read_kb":4332,"num_write":130,"num_write_kb":1907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":71,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.785750+0000","last_change":"2024-09-11T05:32:47.726973+0000","last_active":"2024-09-11T05:33:27.785750+0000","last_peered":"2024-09-11T05:33:27.785750+0000","last_clean":"2024-09-11T05:33:27.785750+0000","last_became_active":"2024-09-11T05:32:45.585103+0000","last_became_peered":"2024-09-11T05:32:45.585103+0000","last_unstale":"2024-09-11T05:33:27.785750+0000","last_undegraded":"2024-09-11T05:33:27.785750+0000","last_fullsized":"2024-09-11T05:33:27.785750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:07:32.584388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039722200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"46'271","reported_seq":3361,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.920928+0000","last_change":"2024-09-11T05:32:57.617928+0000","last_active":"2024-09-11T05:33:27.920928+0000","last_peered":"2024-09-11T05:33:27.920928+0000","last_clean":"2024-09-11T05:33:27.920928+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:33:27.920928+0000","last_undegraded":"2024-09-11T05:33:27.920928+0000","last_fullsized":"2024-09-11T05:33:27.920928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:19.647873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045617500000000002,"stat_sum":{"num_bytes":26238675,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":10,"num_read":4929,"num_read_kb":12232,"num_write":261,"num_write_kb":2539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":71,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.758814+0000","last_change":"2024-09-11T05:32:47.597556+0000","last_active":"2024-09-11T05:33:27.758814+0000","last_peered":"2024-09-11T05:33:27.758814+0000","last_clean":"2024-09-11T05:33:27.758814+0000","last_became_active":"2024-09-11T05:32:45.585150+0000","last_became_peered":"2024-09-11T05:32:45.585150+0000","last_unstale":"2024-09-11T05:33:27.758814+0000","last_undegraded":"2024-09-11T05:33:27.758814+0000","last_fullsized":"2024-09-11T05:33:27.758814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:57:16.674978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077988099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"46'145","reported_seq":1869,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.938785+0000","last_change":"2024-09-11T05:32:57.890067+0000","last_active":"2024-09-11T05:33:27.938785+0000","last_peered":"2024-09-11T05:33:27.938785+0000","last_clean":"2024-09-11T05:33:27.938785+0000","last_became_active":"2024-09-11T05:32:55.616909+0000","last_became_peered":"2024-09-11T05:32:55.616909+0000","last_unstale":"2024-09-11T05:33:27.938785+0000","last_undegraded":"2024-09-11T05:33:27.938785+0000","last_fullsized":"2024-09-11T05:33:27.938785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:47.139887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054678799999999998,"stat_sum":{"num_bytes":26714752,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":9,"num_read":2762,"num_read_kb":9353,"num_write":161,"num_write_kb":4740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":72,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759521+0000","last_change":"2024-09-11T05:32:47.597195+0000","last_active":"2024-09-11T05:33:27.759521+0000","last_peered":"2024-09-11T05:33:27.759521+0000","last_clean":"2024-09-11T05:33:27.759521+0000","last_became_active":"2024-09-11T05:32:45.582294+0000","last_became_peered":"2024-09-11T05:32:45.582294+0000","last_unstale":"2024-09-11T05:33:27.759521+0000","last_undegraded":"2024-09-11T05:33:27.759521+0000","last_fullsized":"2024-09-11T05:33:27.759521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:49:22.206673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045578900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":222,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.756428+0000","last_change":"2024-09-11T05:32:39.551254+0000","last_active":"2024-09-11T05:33:27.756428+0000","last_peered":"2024-09-11T05:33:27.756428+0000","last_clean":"2024-09-11T05:33:27.756428+0000","last_became_active":"2024-09-11T05:32:39.550968+0000","last_became_peered":"2024-09-11T05:32:39.550968+0000","last_unstale":"2024-09-11T05:33:27.756428+0000","last_undegraded":"2024-09-11T05:33:27.756428+0000","last_fullsized":"2024-09-11T05:33:27.756428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:09.466849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"46'271","reported_seq":2201,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.905637+0000","last_change":"2024-09-11T05:32:57.660171+0000","last_active":"2024-09-11T05:33:27.905637+0000","last_peered":"2024-09-11T05:33:27.905637+0000","last_clean":"2024-09-11T05:33:27.905637+0000","last_became_active":"2024-09-11T05:32:55.611842+0000","last_became_peered":"2024-09-11T05:32:55.611842+0000","last_unstale":"2024-09-11T05:33:27.905637+0000","last_undegraded":"2024-09-11T05:33:27.905637+0000","last_fullsized":"2024-09-11T05:33:27.905637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:07:37.866338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042237200000000001,"stat_sum":{"num_bytes":26698694,"num_objects":40,"num_object_clones":14,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":12,"num_read":3148,"num_read_kb":8393,"num_write":285,"num_write_kb":4985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"46'135","reported_seq":1472,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.758993+0000","last_change":"2024-09-11T05:32:57.890158+0000","last_active":"2024-09-11T05:33:27.758993+0000","last_peered":"2024-09-11T05:33:27.758993+0000","last_clean":"2024-09-11T05:33:27.758993+0000","last_became_active":"2024-09-11T05:32:55.617893+0000","last_became_peered":"2024-09-11T05:32:55.617893+0000","last_unstale":"2024-09-11T05:33:27.758993+0000","last_undegraded":"2024-09-11T05:33:27.758993+0000","last_fullsized":"2024-09-11T05:33:27.758993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:15:38.953208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038649399999999998,"stat_sum":{"num_bytes":17499137,"num_objects":39,"num_object_clones":15,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":11,"num_read":1310,"num_read_kb":8048,"num_write":138,"num_write_kb":7671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"47'152","reported_seq":1611,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.796729+0000","last_change":"2024-09-11T05:32:57.891151+0000","last_active":"2024-09-11T05:33:27.796729+0000","last_peered":"2024-09-11T05:33:27.796729+0000","last_clean":"2024-09-11T05:33:27.796729+0000","last_became_active":"2024-09-11T05:32:55.617635+0000","last_became_peered":"2024-09-11T05:32:55.617635+0000","last_unstale":"2024-09-11T05:33:27.796729+0000","last_undegraded":"2024-09-11T05:33:27.796729+0000","last_fullsized":"2024-09-11T05:33:27.796729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:38.772202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039096600000000002,"stat_sum":{"num_bytes":9225625,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":8,"num_read":1449,"num_read_kb":6843,"num_write":147,"num_write_kb":2592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"46'133","reported_seq":1188,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.785867+0000","last_change":"2024-09-11T05:32:57.659963+0000","last_active":"2024-09-11T05:33:27.785867+0000","last_peered":"2024-09-11T05:33:27.785867+0000","last_clean":"2024-09-11T05:33:27.785867+0000","last_became_active":"2024-09-11T05:32:55.612809+0000","last_became_peered":"2024-09-11T05:32:55.612809+0000","last_unstale":"2024-09-11T05:33:27.785867+0000","last_undegraded":"2024-09-11T05:33:27.785867+0000","last_fullsized":"2024-09-11T05:33:27.785867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:31:00.935945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035048700000000002,"stat_sum":{"num_bytes":23171922,"num_objects":30,"num_object_clones":7,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":8,"num_read":1057,"num_read_kb":21671,"num_write":147,"num_write_kb":15764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"46'135","reported_seq":1439,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.747948+0000","last_change":"2024-09-11T05:32:57.607220+0000","last_active":"2024-09-11T05:33:27.747948+0000","last_peered":"2024-09-11T05:33:27.747948+0000","last_clean":"2024-09-11T05:33:27.747948+0000","last_became_active":"2024-09-11T05:32:55.611273+0000","last_became_peered":"2024-09-11T05:32:55.611273+0000","last_unstale":"2024-09-11T05:33:27.747948+0000","last_undegraded":"2024-09-11T05:33:27.747948+0000","last_fullsized":"2024-09-11T05:33:27.747948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:26.257216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055575600000000002,"stat_sum":{"num_bytes":20980330,"num_objects":45,"num_object_clones":16,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":13,"num_read":1312,"num_read_kb":7725,"num_write":128,"num_write_kb":3190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"46'156","reported_seq":1485,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759447+0000","last_change":"2024-09-11T05:32:57.891891+0000","last_active":"2024-09-11T05:33:27.759447+0000","last_peered":"2024-09-11T05:33:27.759447+0000","last_clean":"2024-09-11T05:33:27.759447+0000","last_became_active":"2024-09-11T05:32:55.614392+0000","last_became_peered":"2024-09-11T05:32:55.614392+0000","last_unstale":"2024-09-11T05:33:27.759447+0000","last_undegraded":"2024-09-11T05:33:27.759447+0000","last_fullsized":"2024-09-11T05:33:27.759447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:40.730590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000425738,"stat_sum":{"num_bytes":23481821,"num_objects":34,"num_object_clones":12,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":6,"num_read":1342,"num_read_kb":9269,"num_write":158,"num_write_kb":8777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"46'172","reported_seq":1725,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.763282+0000","last_change":"2024-09-11T05:32:57.891358+0000","last_active":"2024-09-11T05:33:27.763282+0000","last_peered":"2024-09-11T05:33:27.763282+0000","last_clean":"2024-09-11T05:33:27.763282+0000","last_became_active":"2024-09-11T05:32:55.610903+0000","last_became_peered":"2024-09-11T05:32:55.610903+0000","last_unstale":"2024-09-11T05:33:27.763282+0000","last_undegraded":"2024-09-11T05:33:27.763282+0000","last_fullsized":"2024-09-11T05:33:27.763282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:08.320753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060018099999999998,"stat_sum":{"num_bytes":17245889,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":1546,"num_read_kb":8775,"num_write":169,"num_write_kb":2864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"46'347","reported_seq":2765,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.747990+0000","last_change":"2024-09-11T05:32:57.607163+0000","last_active":"2024-09-11T05:33:27.747990+0000","last_peered":"2024-09-11T05:33:27.747990+0000","last_clean":"2024-09-11T05:33:27.747990+0000","last_became_active":"2024-09-11T05:32:55.614915+0000","last_became_peered":"2024-09-11T05:32:55.614915+0000","last_unstale":"2024-09-11T05:33:27.747990+0000","last_undegraded":"2024-09-11T05:33:27.747990+0000","last_fullsized":"2024-09-11T05:33:27.747990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:41:18.601888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050988100000000001,"stat_sum":{"num_bytes":26693486,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":4421,"num_read_kb":8684,"num_write":368,"num_write_kb":4084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"46'117","reported_seq":1233,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.756449+0000","last_change":"2024-09-11T05:32:57.610399+0000","last_active":"2024-09-11T05:33:27.756449+0000","last_peered":"2024-09-11T05:33:27.756449+0000","last_clean":"2024-09-11T05:33:27.756449+0000","last_became_active":"2024-09-11T05:32:55.614295+0000","last_became_peered":"2024-09-11T05:32:55.614295+0000","last_unstale":"2024-09-11T05:33:27.756449+0000","last_undegraded":"2024-09-11T05:33:27.756449+0000","last_fullsized":"2024-09-11T05:33:27.756449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:12.299597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054624999999999997,"stat_sum":{"num_bytes":27560218,"num_objects":40,"num_object_clones":16,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":17,"num_read":1080,"num_read_kb":5901,"num_write":99,"num_write_kb":1838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"47'396","reported_seq":957,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.909263+0000","last_change":"2024-09-11T05:32:57.890065+0000","last_active":"2024-09-11T05:33:27.909263+0000","last_peered":"2024-09-11T05:33:27.909263+0000","last_clean":"2024-09-11T05:33:27.909263+0000","last_became_active":"2024-09-11T05:32:55.617684+0000","last_became_peered":"2024-09-11T05:32:55.617684+0000","last_unstale":"2024-09-11T05:33:27.909263+0000","last_undegraded":"2024-09-11T05:33:27.909263+0000","last_fullsized":"2024-09-11T05:33:27.909263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:42.931363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065996499999999999,"stat_sum":{"num_bytes":7150152,"num_objects":36,"num_object_clones":11,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":14,"num_read":2198,"num_read_kb":2471,"num_write":612,"num_write_kb":3345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"46'166","reported_seq":1174,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.752508+0000","last_change":"2024-09-11T05:32:57.617941+0000","last_active":"2024-09-11T05:33:27.752508+0000","last_peered":"2024-09-11T05:33:27.752508+0000","last_clean":"2024-09-11T05:33:27.752508+0000","last_became_active":"2024-09-11T05:32:55.617445+0000","last_became_peered":"2024-09-11T05:32:55.617445+0000","last_unstale":"2024-09-11T05:33:27.752508+0000","last_undegraded":"2024-09-11T05:33:27.752508+0000","last_fullsized":"2024-09-11T05:33:27.752508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:16.585621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046356899999999999,"stat_sum":{"num_bytes":20608975,"num_objects":28,"num_object_clones":9,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":11,"num_read":986,"num_read_kb":4026,"num_write":162,"num_write_kb":4648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"46'246","reported_seq":3293,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759146+0000","last_change":"2024-09-11T05:32:57.890965+0000","last_active":"2024-09-11T05:33:27.759146+0000","last_peered":"2024-09-11T05:33:27.759146+0000","last_clean":"2024-09-11T05:33:27.759146+0000","last_became_active":"2024-09-11T05:32:55.618294+0000","last_became_peered":"2024-09-11T05:32:55.618294+0000","last_unstale":"2024-09-11T05:33:27.759146+0000","last_undegraded":"2024-09-11T05:33:27.759146+0000","last_fullsized":"2024-09-11T05:33:27.759146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:58:46.429048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049377000000000004,"stat_sum":{"num_bytes":36372001,"num_objects":39,"num_object_clones":14,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":12,"num_read":3713,"num_read_kb":16900,"num_write":326,"num_write_kb":3337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":655148331,"num_objects":1193,"num_object_clones":378,"num_object_copies":2386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1193,"num_whiteouts":379,"num_read":74135,"num_read_kb":277795,"num_write":9677,"num_write_kb":159952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233897984,"data_stored":320324000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7765,"ondisk_log_size":7765,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52480,"kb_used_data":21296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94319360,"statfs":{"total":96636764160,"available":96583024640,"internally_reserved":0,"allocated":21807104,"data_stored":32912052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65300,"kb_used_data":29672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94306540,"statfs":{"total":96636764160,"available":96569896960,"internally_reserved":0,"allocated":30384128,"data_stored":44162455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69584,"kb_used_data":33956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94302256,"statfs":{"total":96636764160,"available":96565510144,"internally_reserved":0,"allocated":34770944,"data_stored":48133057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":0,"seq":60129542156,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81060,"kb_used_data":41552,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94290780,"statfs":{"total":96636764160,"available":96553758720,"internally_reserved":0,"allocated":42549248,"data_stored":56371529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73412,"kb_used_data":33908,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94298428,"statfs":{"total":96636764160,"available":96561590272,"internally_reserved":0,"allocated":34721792,"data_stored":39863467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77036,"kb_used_data":37532,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94294804,"statfs":{"total":96636764160,"available":96557879296,"internally_reserved":0,"allocated":38432768,"data_stored":53509416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73032,"kb_used_data":33520,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94298808,"statfs":{"total":96636764160,"available":96561979392,"internally_reserved":0,"allocated":34324480,"data_stored":46431938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33792000,"data_stored":46200917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37355520,"data_stored":52724480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35000320,"data_stored":40422335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42844160,"data_stored":56941180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33705984,"data_stored":47364850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29908992,"data_stored":43980026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":21291008,"data_stored":32690212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:33:31.157 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:33:31.164 INFO:teuthology.orchestra.run.smithi070.stdout:3175 write 0x185678f thru 0x185ceea (0x675c bytes) 2024-09-11T05:33:31.186 INFO:teuthology.orchestra.run.smithi070.stdout:3176 trunc from 0xd156878 to 0x21629ff 2024-09-11T05:33:31.202 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:31.200+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:31.206 INFO:teuthology.orchestra.run.smithi070.stdout:3178 read 0x1da00ee thru 0x1dabc01 (0xbb14 bytes) 2024-09-11T05:33:31.218 INFO:teuthology.orchestra.run.smithi070.stdout:3180 write 0x77218a5 thru 0x772874c (0x6ea8 bytes) 2024-09-11T05:33:31.219 INFO:teuthology.orchestra.run.smithi070.stdout:3181 read 0x25b4a69 thru 0x25c2c2d (0xe1c5 bytes) 2024-09-11T05:33:31.219 INFO:teuthology.orchestra.run.smithi070.stdout:3182 read 0xacd5d7 thru 0xad225d (0x4c87 bytes) 2024-09-11T05:33:31.220 INFO:teuthology.orchestra.run.smithi070.stdout:3184 read 0x9c2251 thru 0x9c3e38 (0x1be8 bytes) 2024-09-11T05:33:31.220 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.220 INFO:teuthology.orchestra.run.smithi070.stdout:3187 punch from 0x5b663ba to 0x5b6909f, (0x2ce5 bytes) 2024-09-11T05:33:31.220 INFO:teuthology.orchestra.run.smithi070.stdout:3188 write 0x2bfc116 thru 0x2bfd650 (0x153b bytes) 2024-09-11T05:33:31.224 INFO:teuthology.orchestra.run.smithi070.stdout:3189 write 0x1aabda5 thru 0x1aac10f (0x36b bytes) 2024-09-11T05:33:31.225 INFO:teuthology.orchestra.run.smithi070.stdout:3190 read 0x4d979f9 thru 0x4da1609 (0x9c11 bytes) 2024-09-11T05:33:31.225 INFO:teuthology.orchestra.run.smithi070.stdout:3191 write 0x72569ae thru 0x7258eb1 (0x2504 bytes) 2024-09-11T05:33:31.227 INFO:teuthology.orchestra.run.smithi070.stdout:3193 read 0x24dd55 thru 0x25259d (0x4849 bytes) 2024-09-11T05:33:31.227 INFO:teuthology.orchestra.run.smithi070.stdout:3194 read 0x34b710d thru 0x34b8c3e (0x1b32 bytes) 2024-09-11T05:33:31.228 INFO:teuthology.orchestra.run.smithi070.stdout:3195 read 0x47d82fb thru 0x47dda69 (0x576f bytes) 2024-09-11T05:33:31.242 INFO:teuthology.orchestra.run.smithi070.stdout:3196 writesame 0xeaff897 thru 0xeb0b2ac data_size 0x1(0xba16 bytes) 2024-09-11T05:33:31.242 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:31.242 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:31.243 INFO:teuthology.orchestra.run.smithi070.stdout:3197 write 0xc923062 thru 0xc92b330 (0x82cf bytes) 2024-09-11T05:33:31.245 INFO:teuthology.orchestra.run.smithi070.stdout:3198 write 0x5bd4a78 thru 0x5be37ff (0xed88 bytes) 2024-09-11T05:33:31.247 INFO:teuthology.orchestra.run.smithi070.stdout:3200 write 0x937a5c4 thru 0x9385e96 (0xb8d3 bytes) 2024-09-11T05:33:31.249 INFO:teuthology.orchestra.run.smithi070.stdout:3201 write 0xa7a7ac1 thru 0xa7aeaf8 (0x7038 bytes) 2024-09-11T05:33:31.250 INFO:teuthology.orchestra.run.smithi070.stdout:3202 writesame 0x6cf1527 thru 0x6cf64af data_size 0xb(0x4f89 bytes) 2024-09-11T05:33:31.253 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:31.253 INFO:teuthology.orchestra.run.smithi070.stdout:3203 writesame 0x57de00a thru 0x57e9193 data_size 0x5a(0xb18a bytes) 2024-09-11T05:33:31.255 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.256 INFO:teuthology.orchestra.run.smithi070.stdout:3206 write 0x4dc8a09 thru 0x4dd3e0d (0xb405 bytes) 2024-09-11T05:33:31.257 INFO:teuthology.orchestra.run.smithi070.stdout:3207 write 0xdcb89a3 thru 0xdcc4804 (0xbe62 bytes) 2024-09-11T05:33:31.260 INFO:teuthology.orchestra.run.smithi070.stdout:3208 read 0xd0bf55f thru 0xd0c566c (0x610e bytes) 2024-09-11T05:33:31.260 INFO:teuthology.orchestra.run.smithi070.stdout:3209 read 0x1e51157 thru 0x1e57aeb (0x6995 bytes) 2024-09-11T05:33:31.261 INFO:teuthology.orchestra.run.smithi070.stdout:3211 write 0x4dceb10 thru 0x4dd7d93 (0x9284 bytes) 2024-09-11T05:33:31.262 INFO:teuthology.orchestra.run.smithi070.stdout:3212 writesame 0x1d1126b thru 0x1d1df0e data_size 0xe(0xcca4 bytes) 2024-09-11T05:33:31.267 INFO:teuthology.orchestra.run.smithi070.stdout:3213 write 0x6828fe1 thru 0x682dcec (0x4d0c bytes) 2024-09-11T05:33:31.268 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.268 INFO:teuthology.orchestra.run.smithi070.stdout:3215 punch from 0x9ccada0 to 0x9cd7e72, (0xd0d2 bytes) 2024-09-11T05:33:31.268 INFO:teuthology.orchestra.run.smithi070.stdout:3216 write 0xd5d2124 thru 0xd5e0ffe (0xeedb bytes) 2024-09-11T05:33:31.272 INFO:teuthology.orchestra.run.smithi070.stdout:3217 writesame 0xb216464 thru 0xb221e3b data_size 0x4c(0xb9d8 bytes) 2024-09-11T05:33:31.274 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.274 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.274 INFO:teuthology.orchestra.run.smithi070.stdout:3220 write 0x900b1e1 thru 0x9016d7f (0xbb9f bytes) 2024-09-11T05:33:31.276 INFO:teuthology.orchestra.run.smithi070.stdout:3221 write 0x6673210 thru 0x667af55 (0x7d46 bytes) 2024-09-11T05:33:31.277 INFO:teuthology.orchestra.run.smithi070.stdout:3226 write 0xc8f416b thru 0xc8fa986 (0x681c bytes) 2024-09-11T05:33:31.279 INFO:teuthology.orchestra.run.smithi070.stdout:3227 write 0x98e250f thru 0x98f1622 (0xf114 bytes) 2024-09-11T05:33:31.280 INFO:teuthology.orchestra.run.smithi070.stdout:3228 read 0x17bf204 thru 0x17ca3d0 (0xb1cd bytes) 2024-09-11T05:33:31.281 INFO:teuthology.orchestra.run.smithi070.stdout:3229 writesame 0x5761b81 thru 0x5765a17 data_size 0x15(0x3e97 bytes) 2024-09-11T05:33:31.283 INFO:teuthology.orchestra.run.smithi070.stdout:3230 read 0x66c5b33 thru 0x66cf8c2 (0x9d90 bytes) 2024-09-11T05:33:31.284 INFO:teuthology.orchestra.run.smithi070.stdout:3231 read 0xd93b618 thru 0xd944a20 (0x9409 bytes) 2024-09-11T05:33:31.284 INFO:teuthology.orchestra.run.smithi070.stdout:3233 writesame 0x621243c thru 0x6212fb8 data_size 0x1(0xb7d bytes) 2024-09-11T05:33:31.287 INFO:teuthology.orchestra.run.smithi070.stdout:3234 punch from 0xe9cb187 to 0xe9cf145, (0x3fbe bytes) 2024-09-11T05:33:31.288 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.288 INFO:teuthology.orchestra.run.smithi070.stdout:3236 writesame 0xb564818 thru 0xb57288b data_size 0x55(0xe074 bytes) 2024-09-11T05:33:31.289 INFO:teuthology.orchestra.run.smithi070.stdout:3237 read 0x9d7e14 thru 0x9e4a08 (0xcbf5 bytes) 2024-09-11T05:33:31.305 INFO:teuthology.orchestra.run.smithi070.stdout:3239 trunc from 0xeb0b2ad to 0x2aebcb1 2024-09-11T05:33:31.305 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:31.304+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:31.332 INFO:teuthology.orchestra.run.smithi070.stdout:3240 write 0xae5c6e3 thru 0xae5e2fc (0x1c1a bytes) 2024-09-11T05:33:31.334 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.334 INFO:teuthology.orchestra.run.smithi070.stdout:3242 write 0x7400413 thru 0x740e2e0 (0xdece bytes) 2024-09-11T05:33:31.335 INFO:teuthology.orchestra.run.smithi070.stdout:3244 read 0x3767e49 thru 0x376fa01 (0x7bb9 bytes) 2024-09-11T05:33:31.336 INFO:teuthology.orchestra.run.smithi070.stdout:3246 read 0x4db3116 thru 0x4db5bdb (0x2ac6 bytes) 2024-09-11T05:33:31.336 INFO:teuthology.orchestra.run.smithi070.stdout:3247 read 0x68a003f thru 0x68a23e7 (0x23a9 bytes) 2024-09-11T05:33:31.337 INFO:teuthology.orchestra.run.smithi070.stdout:3248 writesame 0x4f2cb9d thru 0x4f389a9 data_size 0x1(0xbe0d bytes) 2024-09-11T05:33:31.372 INFO:teuthology.orchestra.run.smithi070.stdout:3250 punch from 0x66c5ef7 to 0x66cd809, (0x7912 bytes) 2024-09-11T05:33:31.379 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:31.380 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:31.380 INFO:teuthology.orchestra.run.smithi070.stdout:3252 write 0xca703e1 thru 0xca7673c (0x635c bytes) 2024-09-11T05:33:31.383 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.383 INFO:teuthology.orchestra.run.smithi070.stdout:3256 write 0x5e587e thru 0x5e7cab (0x242e bytes) 2024-09-11T05:33:31.384 INFO:teuthology.orchestra.run.smithi070.stdout:3257 punch from 0x188d77a to 0x189cc12, (0xf498 bytes) 2024-09-11T05:33:31.385 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.385 INFO:teuthology.orchestra.run.smithi070.stdout:3260 write 0xba18459 thru 0xba1faae (0x7656 bytes) 2024-09-11T05:33:31.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:31.393 INFO:teuthology.orchestra.run.smithi070.stdout:3261 writesame 0xdf10413 thru 0xdf172e5 data_size 0x31(0x6ed3 bytes) 2024-09-11T05:33:31.410 INFO:teuthology.orchestra.run.smithi070.stdout:3262 trunc from 0xdf172e6 to 0x158dc4b 2024-09-11T05:33:31.411 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:31.410+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:31.433 INFO:teuthology.orchestra.run.smithi070.stdout:3263 punch from 0x14de569 to 0x14e705c, (0x8af3 bytes) 2024-09-11T05:33:31.446 INFO:teuthology.orchestra.run.smithi070.stdout:3264 writesame 0x7ed260f thru 0x7ed6ae3 data_size 0x1(0x44d5 bytes) 2024-09-11T05:33:31.456 INFO:teuthology.orchestra.run.smithi070.stdout:3265 writesame 0xba363a3 thru 0xba39446 data_size 0x16(0x30a4 bytes) 2024-09-11T05:33:31.457 INFO:teuthology.orchestra.run.smithi070.stdout:3266 trunc from 0xba39447 to 0xce7c79f 2024-09-11T05:33:31.463 INFO:teuthology.orchestra.run.smithi070.stdout:3267 writesame 0x3b819f2 thru 0x3b86f76 data_size 0x1(0x5585 bytes) 2024-09-11T05:33:31.481 INFO:teuthology.orchestra.run.smithi070.stdout:3268 write 0xadcad13 thru 0xadd6645 (0xb933 bytes) 2024-09-11T05:33:31.486 INFO:teuthology.orchestra.run.smithi070.stdout:3271 write 0x9bc089e thru 0x9bc172a (0xe8d bytes) 2024-09-11T05:33:31.487 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.498 INFO:teuthology.orchestra.run.smithi070.stdout:3273 trunc from 0xce7c79f to 0x334664d 2024-09-11T05:33:31.505 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:33:31.506 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:33:31.507 INFO:teuthology.orchestra.run.smithi070.stdout:3276 punch from 0x29a8cca to 0x29b54e7, (0xc81d bytes) 2024-09-11T05:33:31.507 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.508 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:31.507+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:31.516 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:31.516 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:31.517 INFO:teuthology.orchestra.run.smithi070.stdout:3278 write 0x7724802 thru 0x772a737 (0x5f36 bytes) 2024-09-11T05:33:31.518 INFO:teuthology.orchestra.run.smithi070.stdout:3280 read 0x6658a7a thru 0x665ef4d (0x64d4 bytes) 2024-09-11T05:33:31.518 INFO:teuthology.orchestra.run.smithi070.stdout:3284 read 0x1d9268f thru 0x1d95821 (0x3193 bytes) 2024-09-11T05:33:31.519 INFO:teuthology.orchestra.run.smithi070.stdout:3287 punch from 0x586da15 to 0x5873b4f, (0x613a bytes) 2024-09-11T05:33:31.520 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-11T05:33:30.763654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655738718,"num_objects":1197,"num_object_clones":378,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":379,"num_read":74251,"num_read_kb":277895,"num_write":9838,"num_write_kb":162370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7885,"ondisk_log_size":7885,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":491904,"kb_used_data":231436,"kb_used_omap":10,"kb_used_meta":259765,"kb_avail":660110976,"statfs":{"total":676457349120,"available":675953639424,"internally_reserved":0,"allocated":236990464,"data_stored":321383914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11157,"internal_metadata":265999467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42418429,"num_objects":193,"num_object_clones":18,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":11,"num_read":17647,"num_read_kb":44627,"num_write":2062,"num_write_kb":19983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.025355"},"pg_stats":[{"pgid":"3.1f","version":"46'409","reported_seq":2209,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759590+0000","last_change":"2024-09-11T05:32:57.613041+0000","last_active":"2024-09-11T05:33:27.759590+0000","last_peered":"2024-09-11T05:33:27.759590+0000","last_clean":"2024-09-11T05:33:27.759590+0000","last_became_active":"2024-09-11T05:32:55.616706+0000","last_became_peered":"2024-09-11T05:32:55.616706+0000","last_unstale":"2024-09-11T05:33:27.759590+0000","last_undegraded":"2024-09-11T05:33:27.759590+0000","last_fullsized":"2024-09-11T05:33:27.759590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:08:29.403813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069887699999999998,"stat_sum":{"num_bytes":23175684,"num_objects":32,"num_object_clones":9,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":10,"num_read":3259,"num_read_kb":11515,"num_write":605,"num_write_kb":7659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"46'125","reported_seq":2099,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759556+0000","last_change":"2024-09-11T05:32:57.612693+0000","last_active":"2024-09-11T05:33:27.759556+0000","last_peered":"2024-09-11T05:33:27.759556+0000","last_clean":"2024-09-11T05:33:27.759556+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:33:27.759556+0000","last_undegraded":"2024-09-11T05:33:27.759556+0000","last_fullsized":"2024-09-11T05:33:27.759556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:27:50.649372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039696399999999998,"stat_sum":{"num_bytes":29063301,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":14,"num_read":1957,"num_read_kb":12294,"num_write":114,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"46'124","reported_seq":477,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759252+0000","last_change":"2024-09-11T05:32:57.891873+0000","last_active":"2024-09-11T05:33:27.759252+0000","last_peered":"2024-09-11T05:33:27.759252+0000","last_clean":"2024-09-11T05:33:27.759252+0000","last_became_active":"2024-09-11T05:32:55.615674+0000","last_became_peered":"2024-09-11T05:32:55.615674+0000","last_unstale":"2024-09-11T05:33:27.759252+0000","last_undegraded":"2024-09-11T05:33:27.759252+0000","last_fullsized":"2024-09-11T05:33:27.759252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:32.910315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057469400000000005,"stat_sum":{"num_bytes":19352437,"num_objects":34,"num_object_clones":12,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":11,"num_read":321,"num_read_kb":3004,"num_write":119,"num_write_kb":2748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"47'298","reported_seq":2100,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.947861+0000","last_change":"2024-09-11T05:32:57.610640+0000","last_active":"2024-09-11T05:33:27.947861+0000","last_peered":"2024-09-11T05:33:27.947861+0000","last_clean":"2024-09-11T05:33:27.947861+0000","last_became_active":"2024-09-11T05:32:55.611900+0000","last_became_peered":"2024-09-11T05:32:55.611900+0000","last_unstale":"2024-09-11T05:33:27.947861+0000","last_undegraded":"2024-09-11T05:33:27.947861+0000","last_fullsized":"2024-09-11T05:33:27.947861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:37.822046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060489099999999998,"stat_sum":{"num_bytes":53416441,"num_objects":40,"num_object_clones":13,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":13,"num_read":3702,"num_read_kb":24280,"num_write":359,"num_write_kb":14067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"46'339","reported_seq":886,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.747891+0000","last_change":"2024-09-11T05:32:57.607436+0000","last_active":"2024-09-11T05:33:27.747891+0000","last_peered":"2024-09-11T05:33:27.747891+0000","last_clean":"2024-09-11T05:33:27.747891+0000","last_became_active":"2024-09-11T05:32:55.616210+0000","last_became_peered":"2024-09-11T05:32:55.616210+0000","last_unstale":"2024-09-11T05:33:27.747891+0000","last_undegraded":"2024-09-11T05:33:27.747891+0000","last_fullsized":"2024-09-11T05:33:27.747891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:11.555855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061541299999999998,"stat_sum":{"num_bytes":6996582,"num_objects":35,"num_object_clones":11,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":13,"num_read":1610,"num_read_kb":3279,"num_write":499,"num_write_kb":1969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'173","reported_seq":2392,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.958172+0000","last_change":"2024-09-11T05:32:57.611081+0000","last_active":"2024-09-11T05:33:27.958172+0000","last_peered":"2024-09-11T05:33:27.958172+0000","last_clean":"2024-09-11T05:33:27.958172+0000","last_became_active":"2024-09-11T05:32:55.612495+0000","last_became_peered":"2024-09-11T05:32:55.612495+0000","last_unstale":"2024-09-11T05:33:27.958172+0000","last_undegraded":"2024-09-11T05:33:27.958172+0000","last_fullsized":"2024-09-11T05:33:27.958172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:12:13.546356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049061,"stat_sum":{"num_bytes":28412017,"num_objects":48,"num_object_clones":18,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":17,"num_read":3263,"num_read_kb":8979,"num_write":171,"num_write_kb":5101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"47'871","reported_seq":1847,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.885743+0000","last_change":"2024-09-11T05:32:57.610393+0000","last_active":"2024-09-11T05:33:27.885743+0000","last_peered":"2024-09-11T05:33:27.885743+0000","last_clean":"2024-09-11T05:33:27.885743+0000","last_became_active":"2024-09-11T05:32:55.616919+0000","last_became_peered":"2024-09-11T05:32:55.616919+0000","last_unstale":"2024-09-11T05:33:27.885743+0000","last_undegraded":"2024-09-11T05:33:27.885743+0000","last_fullsized":"2024-09-11T05:33:27.885743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:05:00.243846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050971999999999996,"stat_sum":{"num_bytes":9683963,"num_objects":31,"num_object_clones":10,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":9,"num_read":4976,"num_read_kb":7122,"num_write":1464,"num_write_kb":3954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"47'312","reported_seq":1718,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.959899+0000","last_change":"2024-09-11T05:32:57.613299+0000","last_active":"2024-09-11T05:33:27.959899+0000","last_peered":"2024-09-11T05:33:27.959899+0000","last_clean":"2024-09-11T05:33:27.959899+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:33:27.959899+0000","last_undegraded":"2024-09-11T05:33:27.959899+0000","last_fullsized":"2024-09-11T05:33:27.959899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:47:05.393683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084187599999999997,"stat_sum":{"num_bytes":5820459,"num_objects":33,"num_object_clones":9,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":10,"num_read":2432,"num_read_kb":4773,"num_write":446,"num_write_kb":3213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"46'472","reported_seq":1244,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759594+0000","last_change":"2024-09-11T05:32:57.613037+0000","last_active":"2024-09-11T05:33:27.759594+0000","last_peered":"2024-09-11T05:33:27.759594+0000","last_clean":"2024-09-11T05:33:27.759594+0000","last_became_active":"2024-09-11T05:32:55.620957+0000","last_became_peered":"2024-09-11T05:32:55.620957+0000","last_unstale":"2024-09-11T05:33:27.759594+0000","last_undegraded":"2024-09-11T05:33:27.759594+0000","last_fullsized":"2024-09-11T05:33:27.759594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:25.664339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065268399999999995,"stat_sum":{"num_bytes":39405704,"num_objects":33,"num_object_clones":12,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":9,"num_read":2432,"num_read_kb":22527,"num_write":743,"num_write_kb":16347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"46'114","reported_seq":1644,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.763175+0000","last_change":"2024-09-11T05:32:57.891156+0000","last_active":"2024-09-11T05:33:27.763175+0000","last_peered":"2024-09-11T05:33:27.763175+0000","last_clean":"2024-09-11T05:33:27.763175+0000","last_became_active":"2024-09-11T05:32:55.618120+0000","last_became_peered":"2024-09-11T05:32:55.618120+0000","last_unstale":"2024-09-11T05:33:27.763175+0000","last_undegraded":"2024-09-11T05:33:27.763175+0000","last_fullsized":"2024-09-11T05:33:27.763175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:43.189535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057970299999999999,"stat_sum":{"num_bytes":13043372,"num_objects":28,"num_object_clones":8,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":7,"num_read":1503,"num_read_kb":5708,"num_write":107,"num_write_kb":1775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"46'304","reported_seq":1716,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.748071+0000","last_change":"2024-09-11T05:32:57.607444+0000","last_active":"2024-09-11T05:33:27.748071+0000","last_peered":"2024-09-11T05:33:27.748071+0000","last_clean":"2024-09-11T05:33:27.748071+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:33:27.748071+0000","last_undegraded":"2024-09-11T05:33:27.748071+0000","last_fullsized":"2024-09-11T05:33:27.748071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:05.052323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066300199999999999,"stat_sum":{"num_bytes":14563777,"num_objects":44,"num_object_clones":13,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":16,"num_read":2235,"num_read_kb":5584,"num_write":417,"num_write_kb":3854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"46'137","reported_seq":1979,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759241+0000","last_change":"2024-09-11T05:32:57.890899+0000","last_active":"2024-09-11T05:33:27.759241+0000","last_peered":"2024-09-11T05:33:27.759241+0000","last_clean":"2024-09-11T05:33:27.759241+0000","last_became_active":"2024-09-11T05:32:55.617623+0000","last_became_peered":"2024-09-11T05:32:55.617623+0000","last_unstale":"2024-09-11T05:33:27.759241+0000","last_undegraded":"2024-09-11T05:33:27.759241+0000","last_fullsized":"2024-09-11T05:33:27.759241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:37:44.481340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073758600000000004,"stat_sum":{"num_bytes":14416982,"num_objects":44,"num_object_clones":14,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":13,"num_read":1825,"num_read_kb":7911,"num_write":136,"num_write_kb":6331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":71,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759373+0000","last_change":"2024-09-11T05:32:47.598023+0000","last_active":"2024-09-11T05:33:27.759373+0000","last_peered":"2024-09-11T05:33:27.759373+0000","last_clean":"2024-09-11T05:33:27.759373+0000","last_became_active":"2024-09-11T05:32:45.702003+0000","last_became_peered":"2024-09-11T05:32:45.702003+0000","last_unstale":"2024-09-11T05:33:27.759373+0000","last_undegraded":"2024-09-11T05:33:27.759373+0000","last_fullsized":"2024-09-11T05:33:27.759373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:08.654916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"47'124","reported_seq":2139,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.785879+0000","last_change":"2024-09-11T05:32:57.659941+0000","last_active":"2024-09-11T05:33:27.785879+0000","last_peered":"2024-09-11T05:33:27.785879+0000","last_clean":"2024-09-11T05:33:27.785879+0000","last_became_active":"2024-09-11T05:32:55.613342+0000","last_became_peered":"2024-09-11T05:32:55.613342+0000","last_unstale":"2024-09-11T05:33:27.785879+0000","last_undegraded":"2024-09-11T05:33:27.785879+0000","last_fullsized":"2024-09-11T05:33:27.785879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:59.783999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033519099999999998,"stat_sum":{"num_bytes":9619398,"num_objects":37,"num_object_clones":11,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":1971,"num_read_kb":629,"num_write":112,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.747963+0000","last_change":"2024-09-11T05:32:55.614406+0000","last_active":"2024-09-11T05:33:27.747963+0000","last_peered":"2024-09-11T05:33:27.747963+0000","last_clean":"2024-09-11T05:33:27.747963+0000","last_became_active":"2024-09-11T05:32:55.614125+0000","last_became_peered":"2024-09-11T05:32:55.614125+0000","last_unstale":"2024-09-11T05:33:27.747963+0000","last_undegraded":"2024-09-11T05:33:27.747963+0000","last_fullsized":"2024-09-11T05:33:27.747963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:06:59.971006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"46'173","reported_seq":1547,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.951423+0000","last_change":"2024-09-11T05:32:57.618706+0000","last_active":"2024-09-11T05:33:27.951423+0000","last_peered":"2024-09-11T05:33:27.951423+0000","last_clean":"2024-09-11T05:33:27.951423+0000","last_became_active":"2024-09-11T05:32:55.615465+0000","last_became_peered":"2024-09-11T05:32:55.615465+0000","last_unstale":"2024-09-11T05:33:27.951423+0000","last_undegraded":"2024-09-11T05:33:27.951423+0000","last_fullsized":"2024-09-11T05:33:27.951423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:21:14.536036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099597899999999992,"stat_sum":{"num_bytes":18988984,"num_objects":46,"num_object_clones":18,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":20,"num_read":2136,"num_read_kb":4847,"num_write":152,"num_write_kb":4740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759439+0000","last_change":"2024-09-11T05:32:55.611737+0000","last_active":"2024-09-11T05:33:27.759439+0000","last_peered":"2024-09-11T05:33:27.759439+0000","last_clean":"2024-09-11T05:33:27.759439+0000","last_became_active":"2024-09-11T05:32:55.611432+0000","last_became_peered":"2024-09-11T05:32:55.611432+0000","last_unstale":"2024-09-11T05:33:27.759439+0000","last_undegraded":"2024-09-11T05:33:27.759439+0000","last_fullsized":"2024-09-11T05:33:27.759439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:16.067863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"47'354","reported_seq":1697,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.960620+0000","last_change":"2024-09-11T05:32:57.618700+0000","last_active":"2024-09-11T05:33:27.960620+0000","last_peered":"2024-09-11T05:33:27.960620+0000","last_clean":"2024-09-11T05:33:27.960620+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:33:27.960620+0000","last_undegraded":"2024-09-11T05:33:27.960620+0000","last_fullsized":"2024-09-11T05:33:27.960620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:50.176576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010906679999999999,"stat_sum":{"num_bytes":8362623,"num_objects":43,"num_object_clones":13,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":15,"num_read":3366,"num_read_kb":5738,"num_write":423,"num_write_kb":5546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759408+0000","last_change":"2024-09-11T05:33:02.663770+0000","last_active":"2024-09-11T05:33:27.759408+0000","last_peered":"2024-09-11T05:33:27.759408+0000","last_clean":"2024-09-11T05:33:27.759408+0000","last_became_active":"2024-09-11T05:33:02.663542+0000","last_became_peered":"2024-09-11T05:33:02.663542+0000","last_unstale":"2024-09-11T05:33:27.759408+0000","last_undegraded":"2024-09-11T05:33:27.759408+0000","last_fullsized":"2024-09-11T05:33:27.759408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:36.032555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"46'196","reported_seq":1615,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.926976+0000","last_change":"2024-09-11T05:32:57.890326+0000","last_active":"2024-09-11T05:33:27.926976+0000","last_peered":"2024-09-11T05:33:27.926976+0000","last_clean":"2024-09-11T05:33:27.926976+0000","last_became_active":"2024-09-11T05:32:55.611732+0000","last_became_peered":"2024-09-11T05:32:55.611732+0000","last_unstale":"2024-09-11T05:33:27.926976+0000","last_undegraded":"2024-09-11T05:33:27.926976+0000","last_fullsized":"2024-09-11T05:33:27.926976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:10.714409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045416500000000003,"stat_sum":{"num_bytes":17839938,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":15,"num_read":2173,"num_read_kb":7647,"num_write":181,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"46'264","reported_seq":2289,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.914371+0000","last_change":"2024-09-11T05:32:57.607689+0000","last_active":"2024-09-11T05:33:27.914371+0000","last_peered":"2024-09-11T05:33:27.914371+0000","last_clean":"2024-09-11T05:33:27.914371+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:33:27.914371+0000","last_undegraded":"2024-09-11T05:33:27.914371+0000","last_fullsized":"2024-09-11T05:33:27.914371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:02.845888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074095900000000002,"stat_sum":{"num_bytes":21461549,"num_objects":29,"num_object_clones":8,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":8,"num_read":2811,"num_read_kb":7335,"num_write":338,"num_write_kb":3793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":73,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759064+0000","last_change":"2024-09-11T05:32:47.597956+0000","last_active":"2024-09-11T05:33:27.759064+0000","last_peered":"2024-09-11T05:33:27.759064+0000","last_clean":"2024-09-11T05:33:27.759064+0000","last_became_active":"2024-09-11T05:32:45.702439+0000","last_became_peered":"2024-09-11T05:32:45.702439+0000","last_unstale":"2024-09-11T05:33:27.759064+0000","last_undegraded":"2024-09-11T05:33:27.759064+0000","last_fullsized":"2024-09-11T05:33:27.759064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:27:05.110151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195137,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"46'134","reported_seq":1066,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759381+0000","last_change":"2024-09-11T05:32:57.612724+0000","last_active":"2024-09-11T05:33:27.759381+0000","last_peered":"2024-09-11T05:33:27.759381+0000","last_clean":"2024-09-11T05:33:27.759381+0000","last_became_active":"2024-09-11T05:32:55.613283+0000","last_became_peered":"2024-09-11T05:32:55.613283+0000","last_unstale":"2024-09-11T05:33:27.759381+0000","last_undegraded":"2024-09-11T05:33:27.759381+0000","last_fullsized":"2024-09-11T05:33:27.759381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:12:23.882314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041242399999999999,"stat_sum":{"num_bytes":11883443,"num_objects":34,"num_object_clones":10,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":13,"num_read":910,"num_read_kb":4332,"num_write":130,"num_write_kb":1907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":71,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.785750+0000","last_change":"2024-09-11T05:32:47.726973+0000","last_active":"2024-09-11T05:33:27.785750+0000","last_peered":"2024-09-11T05:33:27.785750+0000","last_clean":"2024-09-11T05:33:27.785750+0000","last_became_active":"2024-09-11T05:32:45.585103+0000","last_became_peered":"2024-09-11T05:32:45.585103+0000","last_unstale":"2024-09-11T05:33:27.785750+0000","last_undegraded":"2024-09-11T05:33:27.785750+0000","last_fullsized":"2024-09-11T05:33:27.785750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:07:32.584388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039722200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"46'271","reported_seq":3361,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.920928+0000","last_change":"2024-09-11T05:32:57.617928+0000","last_active":"2024-09-11T05:33:27.920928+0000","last_peered":"2024-09-11T05:33:27.920928+0000","last_clean":"2024-09-11T05:33:27.920928+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:33:27.920928+0000","last_undegraded":"2024-09-11T05:33:27.920928+0000","last_fullsized":"2024-09-11T05:33:27.920928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:19.647873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045617500000000002,"stat_sum":{"num_bytes":26238675,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":10,"num_read":4929,"num_read_kb":12232,"num_write":261,"num_write_kb":2539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":71,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.758814+0000","last_change":"2024-09-11T05:32:47.597556+0000","last_active":"2024-09-11T05:33:27.758814+0000","last_peered":"2024-09-11T05:33:27.758814+0000","last_clean":"2024-09-11T05:33:27.758814+0000","last_became_active":"2024-09-11T05:32:45.585150+0000","last_became_peered":"2024-09-11T05:32:45.585150+0000","last_unstale":"2024-09-11T05:33:27.758814+0000","last_undegraded":"2024-09-11T05:33:27.758814+0000","last_fullsized":"2024-09-11T05:33:27.758814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:57:16.674978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077988099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"46'145","reported_seq":1869,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.938785+0000","last_change":"2024-09-11T05:32:57.890067+0000","last_active":"2024-09-11T05:33:27.938785+0000","last_peered":"2024-09-11T05:33:27.938785+0000","last_clean":"2024-09-11T05:33:27.938785+0000","last_became_active":"2024-09-11T05:32:55.616909+0000","last_became_peered":"2024-09-11T05:32:55.616909+0000","last_unstale":"2024-09-11T05:33:27.938785+0000","last_undegraded":"2024-09-11T05:33:27.938785+0000","last_fullsized":"2024-09-11T05:33:27.938785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:47.139887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054678799999999998,"stat_sum":{"num_bytes":26714752,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":9,"num_read":2762,"num_read_kb":9353,"num_write":161,"num_write_kb":4740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":72,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759521+0000","last_change":"2024-09-11T05:32:47.597195+0000","last_active":"2024-09-11T05:33:27.759521+0000","last_peered":"2024-09-11T05:33:27.759521+0000","last_clean":"2024-09-11T05:33:27.759521+0000","last_became_active":"2024-09-11T05:32:45.582294+0000","last_became_peered":"2024-09-11T05:32:45.582294+0000","last_unstale":"2024-09-11T05:33:27.759521+0000","last_undegraded":"2024-09-11T05:33:27.759521+0000","last_fullsized":"2024-09-11T05:33:27.759521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:49:22.206673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045578900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":222,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.756428+0000","last_change":"2024-09-11T05:32:39.551254+0000","last_active":"2024-09-11T05:33:27.756428+0000","last_peered":"2024-09-11T05:33:27.756428+0000","last_clean":"2024-09-11T05:33:27.756428+0000","last_became_active":"2024-09-11T05:32:39.550968+0000","last_became_peered":"2024-09-11T05:32:39.550968+0000","last_unstale":"2024-09-11T05:33:27.756428+0000","last_undegraded":"2024-09-11T05:33:27.756428+0000","last_fullsized":"2024-09-11T05:33:27.756428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:09.466849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"46'271","reported_seq":2201,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.905637+0000","last_change":"2024-09-11T05:32:57.660171+0000","last_active":"2024-09-11T05:33:27.905637+0000","last_peered":"2024-09-11T05:33:27.905637+0000","last_clean":"2024-09-11T05:33:27.905637+0000","last_became_active":"2024-09-11T05:32:55.611842+0000","last_became_peered":"2024-09-11T05:32:55.611842+0000","last_unstale":"2024-09-11T05:33:27.905637+0000","last_undegraded":"2024-09-11T05:33:27.905637+0000","last_fullsized":"2024-09-11T05:33:27.905637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:07:37.866338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042237200000000001,"stat_sum":{"num_bytes":26698694,"num_objects":40,"num_object_clones":14,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":12,"num_read":3148,"num_read_kb":8393,"num_write":285,"num_write_kb":4985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"46'135","reported_seq":1472,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.758993+0000","last_change":"2024-09-11T05:32:57.890158+0000","last_active":"2024-09-11T05:33:27.758993+0000","last_peered":"2024-09-11T05:33:27.758993+0000","last_clean":"2024-09-11T05:33:27.758993+0000","last_became_active":"2024-09-11T05:32:55.617893+0000","last_became_peered":"2024-09-11T05:32:55.617893+0000","last_unstale":"2024-09-11T05:33:27.758993+0000","last_undegraded":"2024-09-11T05:33:27.758993+0000","last_fullsized":"2024-09-11T05:33:27.758993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:15:38.953208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038649399999999998,"stat_sum":{"num_bytes":17499137,"num_objects":39,"num_object_clones":15,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":11,"num_read":1310,"num_read_kb":8048,"num_write":138,"num_write_kb":7671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"47'152","reported_seq":1611,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.796729+0000","last_change":"2024-09-11T05:32:57.891151+0000","last_active":"2024-09-11T05:33:27.796729+0000","last_peered":"2024-09-11T05:33:27.796729+0000","last_clean":"2024-09-11T05:33:27.796729+0000","last_became_active":"2024-09-11T05:32:55.617635+0000","last_became_peered":"2024-09-11T05:32:55.617635+0000","last_unstale":"2024-09-11T05:33:27.796729+0000","last_undegraded":"2024-09-11T05:33:27.796729+0000","last_fullsized":"2024-09-11T05:33:27.796729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:38.772202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039096600000000002,"stat_sum":{"num_bytes":9225625,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":8,"num_read":1449,"num_read_kb":6843,"num_write":147,"num_write_kb":2592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"46'133","reported_seq":1188,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.785867+0000","last_change":"2024-09-11T05:32:57.659963+0000","last_active":"2024-09-11T05:33:27.785867+0000","last_peered":"2024-09-11T05:33:27.785867+0000","last_clean":"2024-09-11T05:33:27.785867+0000","last_became_active":"2024-09-11T05:32:55.612809+0000","last_became_peered":"2024-09-11T05:32:55.612809+0000","last_unstale":"2024-09-11T05:33:27.785867+0000","last_undegraded":"2024-09-11T05:33:27.785867+0000","last_fullsized":"2024-09-11T05:33:27.785867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:31:00.935945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035048700000000002,"stat_sum":{"num_bytes":23171922,"num_objects":30,"num_object_clones":7,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":8,"num_read":1057,"num_read_kb":21671,"num_write":147,"num_write_kb":15764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"46'135","reported_seq":1439,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.747948+0000","last_change":"2024-09-11T05:32:57.607220+0000","last_active":"2024-09-11T05:33:27.747948+0000","last_peered":"2024-09-11T05:33:27.747948+0000","last_clean":"2024-09-11T05:33:27.747948+0000","last_became_active":"2024-09-11T05:32:55.611273+0000","last_became_peered":"2024-09-11T05:32:55.611273+0000","last_unstale":"2024-09-11T05:33:27.747948+0000","last_undegraded":"2024-09-11T05:33:27.747948+0000","last_fullsized":"2024-09-11T05:33:27.747948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:26.257216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055575600000000002,"stat_sum":{"num_bytes":20980330,"num_objects":45,"num_object_clones":16,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":13,"num_read":1312,"num_read_kb":7725,"num_write":128,"num_write_kb":3190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"46'156","reported_seq":1485,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759447+0000","last_change":"2024-09-11T05:32:57.891891+0000","last_active":"2024-09-11T05:33:27.759447+0000","last_peered":"2024-09-11T05:33:27.759447+0000","last_clean":"2024-09-11T05:33:27.759447+0000","last_became_active":"2024-09-11T05:32:55.614392+0000","last_became_peered":"2024-09-11T05:32:55.614392+0000","last_unstale":"2024-09-11T05:33:27.759447+0000","last_undegraded":"2024-09-11T05:33:27.759447+0000","last_fullsized":"2024-09-11T05:33:27.759447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:40.730590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000425738,"stat_sum":{"num_bytes":23481821,"num_objects":34,"num_object_clones":12,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":6,"num_read":1342,"num_read_kb":9269,"num_write":158,"num_write_kb":8777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"46'172","reported_seq":1725,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.763282+0000","last_change":"2024-09-11T05:32:57.891358+0000","last_active":"2024-09-11T05:33:27.763282+0000","last_peered":"2024-09-11T05:33:27.763282+0000","last_clean":"2024-09-11T05:33:27.763282+0000","last_became_active":"2024-09-11T05:32:55.610903+0000","last_became_peered":"2024-09-11T05:32:55.610903+0000","last_unstale":"2024-09-11T05:33:27.763282+0000","last_undegraded":"2024-09-11T05:33:27.763282+0000","last_fullsized":"2024-09-11T05:33:27.763282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:00:08.320753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060018099999999998,"stat_sum":{"num_bytes":17245889,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":1546,"num_read_kb":8775,"num_write":169,"num_write_kb":2864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"46'347","reported_seq":2765,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.747990+0000","last_change":"2024-09-11T05:32:57.607163+0000","last_active":"2024-09-11T05:33:27.747990+0000","last_peered":"2024-09-11T05:33:27.747990+0000","last_clean":"2024-09-11T05:33:27.747990+0000","last_became_active":"2024-09-11T05:32:55.614915+0000","last_became_peered":"2024-09-11T05:32:55.614915+0000","last_unstale":"2024-09-11T05:33:27.747990+0000","last_undegraded":"2024-09-11T05:33:27.747990+0000","last_fullsized":"2024-09-11T05:33:27.747990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:41:18.601888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050988100000000001,"stat_sum":{"num_bytes":26693486,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":4421,"num_read_kb":8684,"num_write":368,"num_write_kb":4084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"46'117","reported_seq":1233,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.756449+0000","last_change":"2024-09-11T05:32:57.610399+0000","last_active":"2024-09-11T05:33:27.756449+0000","last_peered":"2024-09-11T05:33:27.756449+0000","last_clean":"2024-09-11T05:33:27.756449+0000","last_became_active":"2024-09-11T05:32:55.614295+0000","last_became_peered":"2024-09-11T05:32:55.614295+0000","last_unstale":"2024-09-11T05:33:27.756449+0000","last_undegraded":"2024-09-11T05:33:27.756449+0000","last_fullsized":"2024-09-11T05:33:27.756449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:12.299597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054624999999999997,"stat_sum":{"num_bytes":27560218,"num_objects":40,"num_object_clones":16,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":17,"num_read":1080,"num_read_kb":5901,"num_write":99,"num_write_kb":1838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"47'396","reported_seq":957,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.909263+0000","last_change":"2024-09-11T05:32:57.890065+0000","last_active":"2024-09-11T05:33:27.909263+0000","last_peered":"2024-09-11T05:33:27.909263+0000","last_clean":"2024-09-11T05:33:27.909263+0000","last_became_active":"2024-09-11T05:32:55.617684+0000","last_became_peered":"2024-09-11T05:32:55.617684+0000","last_unstale":"2024-09-11T05:33:27.909263+0000","last_undegraded":"2024-09-11T05:33:27.909263+0000","last_fullsized":"2024-09-11T05:33:27.909263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:42.931363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065996499999999999,"stat_sum":{"num_bytes":7150152,"num_objects":36,"num_object_clones":11,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":14,"num_read":2198,"num_read_kb":2471,"num_write":612,"num_write_kb":3345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"46'166","reported_seq":1174,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.752508+0000","last_change":"2024-09-11T05:32:57.617941+0000","last_active":"2024-09-11T05:33:27.752508+0000","last_peered":"2024-09-11T05:33:27.752508+0000","last_clean":"2024-09-11T05:33:27.752508+0000","last_became_active":"2024-09-11T05:32:55.617445+0000","last_became_peered":"2024-09-11T05:32:55.617445+0000","last_unstale":"2024-09-11T05:33:27.752508+0000","last_undegraded":"2024-09-11T05:33:27.752508+0000","last_fullsized":"2024-09-11T05:33:27.752508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:16.585621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046356899999999999,"stat_sum":{"num_bytes":20608975,"num_objects":28,"num_object_clones":9,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":11,"num_read":986,"num_read_kb":4026,"num_write":162,"num_write_kb":4648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"46'246","reported_seq":3293,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-11T05:33:27.759146+0000","last_change":"2024-09-11T05:32:57.890965+0000","last_active":"2024-09-11T05:33:27.759146+0000","last_peered":"2024-09-11T05:33:27.759146+0000","last_clean":"2024-09-11T05:33:27.759146+0000","last_became_active":"2024-09-11T05:32:55.618294+0000","last_became_peered":"2024-09-11T05:32:55.618294+0000","last_unstale":"2024-09-11T05:33:27.759146+0000","last_undegraded":"2024-09-11T05:33:27.759146+0000","last_fullsized":"2024-09-11T05:33:27.759146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:58:46.429048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049377000000000004,"stat_sum":{"num_bytes":36372001,"num_objects":39,"num_object_clones":14,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":12,"num_read":3713,"num_read_kb":16900,"num_write":326,"num_write_kb":3337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":655148331,"num_objects":1193,"num_object_clones":378,"num_object_copies":2386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1193,"num_whiteouts":379,"num_read":74135,"num_read_kb":277795,"num_write":9677,"num_write_kb":159952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233897984,"data_stored":320324000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7765,"ondisk_log_size":7765,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52480,"kb_used_data":21296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94319360,"statfs":{"total":96636764160,"available":96583024640,"internally_reserved":0,"allocated":21807104,"data_stored":32912052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65300,"kb_used_data":29672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94306540,"statfs":{"total":96636764160,"available":96569896960,"internally_reserved":0,"allocated":30384128,"data_stored":44162455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69584,"kb_used_data":33956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94302256,"statfs":{"total":96636764160,"available":96565510144,"internally_reserved":0,"allocated":34770944,"data_stored":48133057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":0,"seq":60129542156,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81060,"kb_used_data":41552,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94290780,"statfs":{"total":96636764160,"available":96553758720,"internally_reserved":0,"allocated":42549248,"data_stored":56371529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73412,"kb_used_data":33908,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94298428,"statfs":{"total":96636764160,"available":96561590272,"internally_reserved":0,"allocated":34721792,"data_stored":39863467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77036,"kb_used_data":37532,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94294804,"statfs":{"total":96636764160,"available":96557879296,"internally_reserved":0,"allocated":38432768,"data_stored":53509416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73032,"kb_used_data":33520,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94298808,"statfs":{"total":96636764160,"available":96561979392,"internally_reserved":0,"allocated":34324480,"data_stored":46431938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33792000,"data_stored":46200917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37355520,"data_stored":52724480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35000320,"data_stored":40422335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42844160,"data_stored":56941180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33705984,"data_stored":47364850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29908992,"data_stored":43980026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":21291008,"data_stored":32690212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:33:31.522 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T05:33:31.522 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:33:31.522 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T05:33:31.522 INFO:tasks.thrashosds.thrasher:Setting osd 3 primary_affinity to 0.098974 2024-09-11T05:33:31.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 0.09897383729145359 2024-09-11T05:33:31.528 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:31.532 INFO:teuthology.orchestra.run.smithi070.stdout:3288 write 0xdbf998f thru 0xdbfa5dc (0xc4e bytes) 2024-09-11T05:33:31.535 INFO:teuthology.orchestra.run.smithi070.stdout:3290 read 0xb745808 thru 0xb74fc9b (0xa494 bytes) 2024-09-11T05:33:31.535 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.535 INFO:teuthology.orchestra.run.smithi070.stdout:3292 writesame 0x75610b1 thru 0x7561665 data_size 0x1(0x5b5 bytes) 2024-09-11T05:33:31.537 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.543 INFO:teuthology.orchestra.run.smithi070.stdout:3294 writesame 0xeb064b9 thru 0xeb156b1 data_size 0xd(0xf1f9 bytes) 2024-09-11T05:33:31.553 INFO:teuthology.orchestra.run.smithi070.stdout:3296 trunc from 0xeb156b2 to 0x6914220 2024-09-11T05:33:31.573 INFO:teuthology.orchestra.run.smithi070.stdout:3297 trunc from 0x6914220 to 0xccd3e48 2024-09-11T05:33:31.579 INFO:teuthology.orchestra.run.smithi070.stdout:3299 punch from 0x9f4d27c to 0x9f58285, (0xb009 bytes) 2024-09-11T05:33:31.579 INFO:teuthology.orchestra.run.smithi070.stdout:3300 read 0x554e657 thru 0x554f109 (0xab3 bytes) 2024-09-11T05:33:31.580 INFO:teuthology.orchestra.run.smithi070.stdout:3301 write 0x59406ca thru 0x5941fc3 (0x18fa bytes) 2024-09-11T05:33:31.582 INFO:teuthology.orchestra.run.smithi070.stdout:3302 read 0xf000b9 thru 0xf020f8 (0x2040 bytes) 2024-09-11T05:33:31.583 INFO:teuthology.orchestra.run.smithi070.stdout:3303 punch from 0xb31a5ed to 0xb321e89, (0x789c bytes) 2024-09-11T05:33:31.583 INFO:teuthology.orchestra.run.smithi070.stdout:3304 read 0xad50fa4 thru 0xad6074d (0xf7aa bytes) 2024-09-11T05:33:31.583 INFO:teuthology.orchestra.run.smithi070.stdout:3306 write 0x13ff12b thru 0x14064ac (0x7382 bytes) 2024-09-11T05:33:31.585 INFO:teuthology.orchestra.run.smithi070.stdout:3307 writesame 0xa7d81a thru 0xa88b6c data_size 0x1(0xb353 bytes) 2024-09-11T05:33:31.609 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:31.608+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:31.609 INFO:teuthology.orchestra.run.smithi070.stdout:3310 read 0x68bb6f5 thru 0x68cadd0 (0xf6dc bytes) 2024-09-11T05:33:31.611 INFO:teuthology.orchestra.run.smithi070.stdout:3311 write 0x1390d58 thru 0x1394df3 (0x409c bytes) 2024-09-11T05:33:31.612 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:31.612 INFO:teuthology.orchestra.run.smithi070.stdout:3313 writesame 0x74d0716 thru 0x74da73c data_size 0x1(0xa027 bytes) 2024-09-11T05:33:31.640 INFO:teuthology.orchestra.run.smithi070.stdout:3314 clone 22 order 24 su 2097152 sc 5 2024-09-11T05:33:31.649 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:31.649 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:31.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:31.710 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:31.709+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:31.809 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:31.809 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:31.811 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:31.810+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:31.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:31.825 INFO:teuthology.orchestra.run.smithi070.stdout:flattening image image_client.0-clone21 2024-09-11T05:33:31.913 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:31.912+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:31.929 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:31.929 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:31.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:31.972 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-11T05:33:32.015 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:32.015+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:32.094 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:32.094 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:32.103 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:32.114 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:32.113+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:32.215 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:32.214+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:32.251 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:32.251 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:32.251 INFO:teuthology.orchestra.run.smithi070.stdout:3316 read 0xc611dca thru 0xc61e138 (0xc36f bytes) 2024-09-11T05:33:32.252 INFO:teuthology.orchestra.run.smithi070.stdout:3317 read 0x691c41b thru 0x691e30e (0x1ef4 bytes) 2024-09-11T05:33:32.253 INFO:teuthology.orchestra.run.smithi070.stdout:3318 write 0xa031116 thru 0xa03121a (0x105 bytes) 2024-09-11T05:33:32.260 INFO:teuthology.orchestra.run.smithi070.stdout:3319 write 0x1a84381 thru 0x1a8e745 (0xa3c5 bytes) 2024-09-11T05:33:32.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:32.264 INFO:teuthology.orchestra.run.smithi070.stdout:3321 read 0xc9fd343 thru 0xca0099c (0x365a bytes) 2024-09-11T05:33:32.265 INFO:teuthology.orchestra.run.smithi070.stdout:3322 punch from 0x374f1b8 to 0x375ba95, (0xc8dd bytes) 2024-09-11T05:33:32.265 INFO:teuthology.orchestra.run.smithi070.stdout:3323 punch from 0x129449b to 0x12a3f1f, (0xfa84 bytes) 2024-09-11T05:33:32.265 INFO:teuthology.orchestra.run.smithi070.stdout:3324 read 0xb32c2ae thru 0xb3337cf (0x7522 bytes) 2024-09-11T05:33:32.265 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.265 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.266 INFO:teuthology.orchestra.run.smithi070.stdout:3329 trunc from 0xccd3e48 to 0xb46df9b 2024-09-11T05:33:32.278 INFO:teuthology.orchestra.run.smithi070.stdout:3330 read 0x288506b thru 0x28932db (0xe271 bytes) 2024-09-11T05:33:32.278 INFO:teuthology.orchestra.run.smithi070.stdout:3331 write 0x42783b9 thru 0x427c391 (0x3fd9 bytes) 2024-09-11T05:33:32.280 INFO:teuthology.orchestra.run.smithi070.stdout:3333 writesame 0x23b8da7 thru 0x23be3b7 data_size 0x1(0x5611 bytes) 2024-09-11T05:33:32.293 INFO:teuthology.orchestra.run.smithi070.stdout:3335 read 0x30bf518 thru 0x30ca5fe (0xb0e7 bytes) 2024-09-11T05:33:32.294 INFO:teuthology.orchestra.run.smithi070.stdout:3337 read 0x4daaf64 thru 0x4daf6c2 (0x475f bytes) 2024-09-11T05:33:32.302 INFO:teuthology.orchestra.run.smithi070.stdout:3338 write 0xd78e0c3 thru 0xd791735 (0x3673 bytes) 2024-09-11T05:33:32.304 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.304 INFO:teuthology.orchestra.run.smithi070.stdout:3341 read 0xbc5ced3 thru 0xbc6148d (0x45bb bytes) 2024-09-11T05:33:32.305 INFO:teuthology.orchestra.run.smithi070.stdout:3342 trunc from 0xd791736 to 0xcda4510 2024-09-11T05:33:32.313 INFO:teuthology.orchestra.run.smithi070.stdout:3344 write 0x2ef3ce8 thru 0x2f02f8c (0xf2a5 bytes) 2024-09-11T05:33:32.314 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.315 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:32.314+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:32.322 INFO:teuthology.orchestra.run.smithi070.stdout:3346 trunc from 0xcda4510 to 0x69b98d7 2024-09-11T05:33:32.344 INFO:teuthology.orchestra.run.smithi070.stdout:3347 trunc from 0x69b98d7 to 0xae5bc52 2024-09-11T05:33:32.349 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.349 INFO:teuthology.orchestra.run.smithi070.stdout:3349 punch from 0xab84e96 to 0xab8750e, (0x2678 bytes) 2024-09-11T05:33:32.349 INFO:teuthology.orchestra.run.smithi070.stdout:3350 write 0x7a3c1d thru 0x7b1a73 (0xde57 bytes) 2024-09-11T05:33:32.351 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.351 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.351 INFO:teuthology.orchestra.run.smithi070.stdout:3355 write 0x171ee69 thru 0x1721574 (0x270c bytes) 2024-09-11T05:33:32.356 INFO:teuthology.orchestra.run.smithi070.stdout:3357 punch from 0x2ced419 to 0x2cef591, (0x2178 bytes) 2024-09-11T05:33:32.356 INFO:teuthology.orchestra.run.smithi070.stdout:3358 write 0x3691f1a thru 0x3694d9a (0x2e81 bytes) 2024-09-11T05:33:32.357 INFO:teuthology.orchestra.run.smithi070.stdout:3360 read 0x9cc3497 thru 0x9cc8c39 (0x57a3 bytes) 2024-09-11T05:33:32.358 INFO:teuthology.orchestra.run.smithi070.stdout:3361 read 0x870a675 thru 0x8719713 (0xf09f bytes) 2024-09-11T05:33:32.358 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.358 INFO:teuthology.orchestra.run.smithi070.stdout:3363 read 0x72a49a8 thru 0x72b2fa0 (0xe5f9 bytes) 2024-09-11T05:33:32.365 INFO:teuthology.orchestra.run.smithi070.stdout:3364 writesame 0xc2ce89e thru 0xc2da42d data_size 0x8(0xbb90 bytes) 2024-09-11T05:33:32.365 INFO:teuthology.orchestra.run.smithi070.stdout:3365 punch from 0xb5c43a4 to 0xb5d36df, (0xf33b bytes) 2024-09-11T05:33:32.365 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.366 INFO:teuthology.orchestra.run.smithi070.stdout:3368 read 0xb623410 thru 0xb6287cd (0x53be bytes) 2024-09-11T05:33:32.372 INFO:teuthology.orchestra.run.smithi070.stdout:3369 write 0xd5ef097 thru 0xd5fac5e (0xbbc8 bytes) 2024-09-11T05:33:32.375 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.380 INFO:teuthology.orchestra.run.smithi070.stdout:3373 trunc from 0xd5fac5f to 0x9173b02 2024-09-11T05:33:32.387 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:32.387 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:32.391 INFO:teuthology.orchestra.run.smithi070.stdout:3375 read 0x272a536 thru 0x2733e51 (0x991c bytes) 2024-09-11T05:33:32.391 INFO:teuthology.orchestra.run.smithi070.stdout:3377 writesame 0x14ad2bb thru 0x14ba5a2 data_size 0x44(0xd2e8 bytes) 2024-09-11T05:33:32.398 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:32.403 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.404 INFO:teuthology.orchestra.run.smithi070.stdout:3379 writesame 0x8eb20b thru 0x8f61aa data_size 0x50(0xafa0 bytes) 2024-09-11T05:33:32.415 INFO:teuthology.orchestra.run.smithi070.stdout:3380 trunc from 0x9173b02 to 0xe5af02a 2024-09-11T05:33:32.415 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:32.414+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:32.419 INFO:teuthology.orchestra.run.smithi070.stdout:3382 write 0x65b9feb thru 0x65c02e8 (0x62fe bytes) 2024-09-11T05:33:32.420 INFO:teuthology.orchestra.run.smithi070.stdout:3383 write 0x75bc6dd thru 0x75bd263 (0xb87 bytes) 2024-09-11T05:33:32.422 INFO:teuthology.orchestra.run.smithi070.stdout:3384 read 0xe5ff25 thru 0xe6feac (0xff88 bytes) 2024-09-11T05:33:32.423 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.423 INFO:teuthology.orchestra.run.smithi070.stdout:3387 write 0xd176599 thru 0xd178f64 (0x29cc bytes) 2024-09-11T05:33:32.426 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.426 INFO:teuthology.orchestra.run.smithi070.stdout:3391 punch from 0x99e5007 to 0x99ebc77, (0x6c70 bytes) 2024-09-11T05:33:32.426 INFO:teuthology.orchestra.run.smithi070.stdout:3392 punch from 0x3822dfe to 0x3823570, (0x772 bytes) 2024-09-11T05:33:32.426 INFO:teuthology.orchestra.run.smithi070.stdout:3394 write 0x2a6d73e thru 0x2a786d1 (0xaf94 bytes) 2024-09-11T05:33:32.428 INFO:teuthology.orchestra.run.smithi070.stdout:3395 punch from 0x2fedfe0 to 0x2ff2ded, (0x4e0d bytes) 2024-09-11T05:33:32.428 INFO:teuthology.orchestra.run.smithi070.stdout:3396 read 0xe1e581d thru 0xe1f00c4 (0xa8a8 bytes) 2024-09-11T05:33:32.428 INFO:teuthology.orchestra.run.smithi070.stdout:3399 read 0xcd555d8 thru 0xcd5b51a (0x5f43 bytes) 2024-09-11T05:33:32.428 INFO:teuthology.orchestra.run.smithi070.stdout:3400 write 0x40c0cab thru 0x40c4789 (0x3adf bytes) 2024-09-11T05:33:32.429 INFO:teuthology.orchestra.run.smithi070.stdout:3401 write 0xb9fd930 thru 0xba076dc (0x9dad bytes) 2024-09-11T05:33:32.433 INFO:teuthology.orchestra.run.smithi070.stdout:3402 punch from 0xcfcab3f to 0xcfd1a20, (0x6ee1 bytes) 2024-09-11T05:33:32.433 INFO:teuthology.orchestra.run.smithi070.stdout:3403 writesame 0x3410aaf thru 0x3420457 data_size 0x1(0xf9a9 bytes) 2024-09-11T05:33:32.473 INFO:teuthology.orchestra.run.smithi070.stdout:3404 read 0xc647cc9 thru 0xc64ac68 (0x2fa0 bytes) 2024-09-11T05:33:32.475 INFO:teuthology.orchestra.run.smithi070.stdout:3405 write 0x2157307 thru 0x2167051 (0xfd4b bytes) 2024-09-11T05:33:32.477 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.477 INFO:teuthology.orchestra.run.smithi070.stdout:3408 write 0xbb1e90b thru 0xbb21433 (0x2b29 bytes) 2024-09-11T05:33:32.478 INFO:teuthology.orchestra.run.smithi070.stdout:3409 writesame 0x26c0bb9 thru 0x26c5e1c data_size 0x2(0x5264 bytes) 2024-09-11T05:33:32.487 INFO:teuthology.orchestra.run.smithi070.stdout:3410 read 0xa5185af thru 0xa523715 (0xb167 bytes) 2024-09-11T05:33:32.488 INFO:teuthology.orchestra.run.smithi070.stdout:3411 read 0x47314ab thru 0x4734830 (0x3386 bytes) 2024-09-11T05:33:32.488 INFO:teuthology.orchestra.run.smithi070.stdout:3412 writesame 0xdc2cc14 thru 0xdc3ae21 data_size 0x2d(0xe20e bytes) 2024-09-11T05:33:32.508 INFO:teuthology.orchestra.run.smithi070.stdout:3413 trunc from 0xe5af02a to 0xeb0a05 2024-09-11T05:33:32.515 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:32.514+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:32.523 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:32.524 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:32.524 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:32.542 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:3415 writesame 0xb503f74 thru 0xb5093b5 data_size 0xf(0x5442 bytes) 2024-09-11T05:33:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:3417 write 0x8e2f854 thru 0x8e32fba (0x3767 bytes) 2024-09-11T05:33:32.554 INFO:teuthology.orchestra.run.smithi070.stdout:3418 trunc from 0xb5093b6 to 0x22a494c 2024-09-11T05:33:32.579 INFO:teuthology.orchestra.run.smithi070.stdout:3419 write 0xaf35596 thru 0xaf401be (0xac29 bytes) 2024-09-11T05:33:32.589 INFO:teuthology.orchestra.run.smithi070.stdout:3420 writesame 0xd166645 thru 0xd1733a1 data_size 0x1(0xcd5d bytes) 2024-09-11T05:33:32.589 INFO:teuthology.orchestra.run.smithi070.stdout:3422 read 0x26b3a71 thru 0x26c0bf9 (0xd189 bytes) 2024-09-11T05:33:32.590 INFO:teuthology.orchestra.run.smithi070.stdout:3423 punch from 0x5ff5fdb to 0x6000f8e, (0xafb3 bytes) 2024-09-11T05:33:32.590 INFO:teuthology.orchestra.run.smithi070.stdout:3424 write 0xf2f541 thru 0xf357ff (0x62bf bytes) 2024-09-11T05:33:32.591 INFO:teuthology.orchestra.run.smithi070.stdout:3426 write 0x595eab7 thru 0x596668b (0x7bd5 bytes) 2024-09-11T05:33:32.594 INFO:teuthology.orchestra.run.smithi070.stdout:3427 write 0x2ba759b thru 0x2babcfa (0x4760 bytes) 2024-09-11T05:33:32.596 INFO:teuthology.orchestra.run.smithi070.stdout:3429 writesame 0xa86d27c thru 0xa871db9 data_size 0x1(0x4b3e bytes) 2024-09-11T05:33:32.607 INFO:teuthology.orchestra.run.smithi070.stdout:3430 write 0x7ebf98c thru 0x7ec0f95 (0x160a bytes) 2024-09-11T05:33:32.611 INFO:teuthology.orchestra.run.smithi070.stdout:3431 read 0x980d24f thru 0x9810949 (0x36fb bytes) 2024-09-11T05:33:32.611 INFO:teuthology.orchestra.run.smithi070.stdout:3432 read 0x4447c4b thru 0x444a455 (0x280b bytes) 2024-09-11T05:33:32.611 INFO:teuthology.orchestra.run.smithi070.stdout:3433 writesame 0x612d545 thru 0x613ce75 data_size 0x1(0xf931 bytes) 2024-09-11T05:33:32.616 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:32.616+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:32.647 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:32.648 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:32.648 INFO:teuthology.orchestra.run.smithi070.stdout:3434 write 0xc2a173c thru 0xc2aa6bf (0x8f84 bytes) 2024-09-11T05:33:32.651 INFO:teuthology.orchestra.run.smithi070.stdout:3435 read 0x54dbddf thru 0x54e3377 (0x7599 bytes) 2024-09-11T05:33:32.651 INFO:teuthology.orchestra.run.smithi070.stdout:3436 read 0x480f62b thru 0x48108e3 (0x12b9 bytes) 2024-09-11T05:33:32.656 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:32.663 INFO:teuthology.orchestra.run.smithi070.stdout:3437 trunc from 0xd1733a2 to 0x3543dae 2024-09-11T05:33:32.682 INFO:teuthology.orchestra.run.smithi070.stdout:3438 trunc from 0x3543dae to 0x81ba2a6 2024-09-11T05:33:32.687 INFO:teuthology.orchestra.run.smithi070.stdout:3440 read 0x1413781 thru 0x1418265 (0x4ae5 bytes) 2024-09-11T05:33:32.690 INFO:teuthology.orchestra.run.smithi070.stdout:3441 trunc from 0x81ba2a6 to 0xa65f4af 2024-09-11T05:33:32.695 INFO:teuthology.orchestra.run.smithi070.stdout:3442 read 0x6eb7691 thru 0x6ebd1c1 (0x5b31 bytes) 2024-09-11T05:33:32.695 INFO:teuthology.orchestra.run.smithi070.stdout:3443 read 0x5ff067d thru 0x5ffd3d5 (0xcd59 bytes) 2024-09-11T05:33:32.695 INFO:teuthology.orchestra.run.smithi070.stdout:3444 write 0x904feb9 thru 0x905b70a (0xb852 bytes) 2024-09-11T05:33:32.706 INFO:teuthology.orchestra.run.smithi070.stdout:3445 write 0xdf16c1f thru 0xdf19984 (0x2d66 bytes) 2024-09-11T05:33:32.718 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:32.717+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:32.720 INFO:teuthology.orchestra.run.smithi070.stdout:3447 trunc from 0xdf19985 to 0x51a076d 2024-09-11T05:33:32.732 INFO:teuthology.orchestra.run.smithi070.stdout:3448 read 0x1ab05d7 thru 0x1abdd65 (0xd78f bytes) 2024-09-11T05:33:32.733 INFO:teuthology.orchestra.run.smithi070.stdout:3449 read 0xebe9aa thru 0xec203b (0x3692 bytes) 2024-09-11T05:33:32.733 INFO:teuthology.orchestra.run.smithi070.stdout:3451 trunc from 0x51a076d to 0x4bd4ed1 2024-09-11T05:33:32.741 INFO:teuthology.orchestra.run.smithi070.stdout:3453 punch from 0x240065c to 0x240d1dc, (0xcb80 bytes) 2024-09-11T05:33:32.741 INFO:teuthology.orchestra.run.smithi070.stdout:3456 write 0x1cbf31a thru 0x1cc890a (0x95f1 bytes) 2024-09-11T05:33:32.757 INFO:teuthology.orchestra.run.smithi070.stdout:3458 write 0xeb1e75d thru 0xeb2c14f (0xd9f3 bytes) 2024-09-11T05:33:32.761 INFO:teuthology.orchestra.run.smithi070.stdout:3459 trunc from 0xeb2c150 to 0xdaba330 2024-09-11T05:33:32.762 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:32.762 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:32.772 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:32.772 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.3 primary-affinity to 0.0989738 (864862) 2024-09-11T05:33:32.774 INFO:teuthology.orchestra.run.smithi070.stdout:3463 trunc from 0xdaba330 to 0x9572728 2024-09-11T05:33:32.803 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:33:32.803 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:33:32.829 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:32.829+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:32.876 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:32.877 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:32.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:32.930 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:32.929+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:32.952 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:32.952 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:32.969 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:32.970 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:32.988 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:32.988 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:32.988 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:32.989 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:32.997 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:33.004 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:33.004 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:33.021 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:33.037 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:33.037 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:33.039 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:33.038+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:33.054 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:33.054 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:33.070 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:33.070 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:33.121 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:33.120+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:33.141 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:33.142 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:33.142 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:33.142 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:33.142 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:33.154 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:33.222 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:33.221+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:33.258 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:33.259 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:33.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:33.259 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:33.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.259 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45827 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 6897664~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.259 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366795+0000", 2024-09-11T05:33:33.259 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8905664629999999, 2024-09-11T05:33:33.260 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031094567, 2024-09-11T05:33:33.260 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.260 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.260 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.260 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.260 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.260 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.260 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45827 2024-09-11T05:33:33.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.260 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.260 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.260 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366795+0000", 2024-09-11T05:33:33.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.261 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366795+0000", 2024-09-11T05:33:33.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.261 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366795+0000", 2024-09-11T05:33:33.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6499999999999999e-07 2024-09-11T05:33:33.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366797+0000", 2024-09-11T05:33:33.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2340000000000001e-06 2024-09-11T05:33:33.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366803+0000", 2024-09-11T05:33:33.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.631e-06 2024-09-11T05:33:33.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366809+0000", 2024-09-11T05:33:33.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7490000000000004e-06 2024-09-11T05:33:33.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397796+0000", 2024-09-11T05:33:33.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030987737000000001 2024-09-11T05:33:33.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397838+0000", 2024-09-11T05:33:33.264 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1859e-05 2024-09-11T05:33:33.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.264 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.264 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.264 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397889+0000", 2024-09-11T05:33:33.264 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0892e-05 2024-09-11T05:33:33.264 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.264 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.264 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.264 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.264 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45828 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 6946816~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.265 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366815+0000", 2024-09-11T05:33:33.265 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8905463449999997, 2024-09-11T05:33:33.265 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031189219000000001, 2024-09-11T05:33:33.265 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.265 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.265 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.265 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.265 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.265 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.265 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45828 2024-09-11T05:33:33.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.265 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366815+0000", 2024-09-11T05:33:33.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366815+0000", 2024-09-11T05:33:33.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366815+0000", 2024-09-11T05:33:33.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3599999999999999e-07 2024-09-11T05:33:33.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366817+0000", 2024-09-11T05:33:33.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0190000000000001e-06 2024-09-11T05:33:33.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.268 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.268 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366823+0000", 2024-09-11T05:33:33.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7049999999999996e-06 2024-09-11T05:33:33.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.268 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.268 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366829+0000", 2024-09-11T05:33:33.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7490000000000001e-06 2024-09-11T05:33:33.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.269 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.269 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.269 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397914+0000", 2024-09-11T05:33:33.269 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031084157000000001 2024-09-11T05:33:33.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.269 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.269 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.269 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.397955+0000", 2024-09-11T05:33:33.269 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1561999999999999e-05 2024-09-11T05:33:33.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.269 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.269 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.269 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398004+0000", 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8690999999999998e-05 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45829 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 6995968~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8905257740000003, 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031286190999999998, 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.270 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45829 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:33.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.272 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366836+0000", 2024-09-11T05:33:33.272 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4199999999999996e-07 2024-09-11T05:33:33.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.272 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366838+0000", 2024-09-11T05:33:33.272 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9929999999999998e-06 2024-09-11T05:33:33.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.272 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.273 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366844+0000", 2024-09-11T05:33:33.273 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0430000000000004e-06 2024-09-11T05:33:33.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.273 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.273 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.273 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366848+0000", 2024-09-11T05:33:33.273 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6040000000000003e-06 2024-09-11T05:33:33.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.273 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.273 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.273 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398029+0000", 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031180349 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398070+0000", 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1421999999999997e-05 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398121+0000", 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1238e-05 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.274 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.275 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.275 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45830 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7045120~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.275 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:33.275 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8905062030000002, 2024-09-11T05:33:33.275 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031383187999999999, 2024-09-11T05:33:33.275 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.275 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.275 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.275 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.275 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.275 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.275 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45830 2024-09-11T05:33:33.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.276 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.276 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.276 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.276 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:33.276 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.276 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.276 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.276 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:33.276 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.276 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.277 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.277 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:33.277 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.51e-07 2024-09-11T05:33:33.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.277 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.277 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366857+0000", 2024-09-11T05:33:33.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9259999999999999e-06 2024-09-11T05:33:33.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366863+0000", 2024-09-11T05:33:33.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7069999999999997e-06 2024-09-11T05:33:33.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366868+0000", 2024-09-11T05:33:33.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7380000000000002e-06 2024-09-11T05:33:33.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398147+0000", 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031279757999999998 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398189+0000", 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1597999999999997e-05 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398238+0000", 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.901e-05 2024-09-11T05:33:33.279 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45831 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7094272~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8904870760000003, 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031481960000000003, 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.280 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.281 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45831 2024-09-11T05:33:33.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.281 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:33.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:33.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4200000000000002e-07 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366876+0000", 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0020000000000001e-06 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.282 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366882+0000", 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7690000000000002e-06 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366887+0000", 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119999999999999e-06 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398263+0000", 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031376023000000003 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398306+0000", 2024-09-11T05:33:33.284 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3220999999999998e-05 2024-09-11T05:33:33.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.284 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.284 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.284 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398356+0000", 2024-09-11T05:33:33.284 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:33:33.284 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.284 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.284 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.284 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.284 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45832 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7143424~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.285 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:33.285 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8904684559999998, 2024-09-11T05:33:33.285 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031581625000000002, 2024-09-11T05:33:33.285 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.285 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.285 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.285 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.285 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.285 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.285 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45832 2024-09-11T05:33:33.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.285 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.285 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367199+0000", 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00030624 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367205+0000", 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1090000000000003e-06 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367213+0000", 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8979999999999996e-06 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367219+0000", 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.287 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.288 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398380+0000", 2024-09-11T05:33:33.288 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031160931999999999 2024-09-11T05:33:33.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.288 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398425+0000", 2024-09-11T05:33:33.288 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4548000000000001e-05 2024-09-11T05:33:33.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.289 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.289 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398474+0000", 2024-09-11T05:33:33.289 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9298000000000001e-05 2024-09-11T05:33:33.289 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.289 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.289 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.289 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.289 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45833 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7192576~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.289 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:33.289 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8901271709999996, 2024-09-11T05:33:33.289 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031369229999999998, 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45833 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.291 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.291 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.291 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:33.291 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.291 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.291 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.291 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:33.291 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9400000000000005e-07 2024-09-11T05:33:33.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.291 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.291 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.291 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367237+0000", 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4439999999999998e-06 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367243+0000", 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367249+0000", 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2240000000000003e-06 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.292 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398507+0000", 2024-09-11T05:33:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031257994999999997 2024-09-11T05:33:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398551+0000", 2024-09-11T05:33:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4178000000000003e-05 2024-09-11T05:33:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398603+0000", 2024-09-11T05:33:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2178000000000001e-05 2024-09-11T05:33:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45834 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7241728~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8901054400000001, 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031466477, 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.295 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45834 2024-09-11T05:33:33.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.295 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.295 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.295 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.295 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:33.295 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.295 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.295 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.296 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:33.296 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.296 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.296 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.296 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:33.296 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5200000000000002e-07 2024-09-11T05:33:33.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.296 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.296 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.296 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367258+0000", 2024-09-11T05:33:33.297 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1110000000000002e-06 2024-09-11T05:33:33.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.297 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.297 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367264+0000", 2024-09-11T05:33:33.297 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0290000000000002e-06 2024-09-11T05:33:33.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.297 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.297 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367269+0000", 2024-09-11T05:33:33.297 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:33:33.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.298 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.298 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398628+0000", 2024-09-11T05:33:33.298 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031358587 2024-09-11T05:33:33.298 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.298 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.299 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.299 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398671+0000", 2024-09-11T05:33:33.299 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3035999999999999e-05 2024-09-11T05:33:33.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.299 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.299 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.299 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398722+0000", 2024-09-11T05:33:33.299 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1511000000000002e-05 2024-09-11T05:33:33.299 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.299 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.299 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.299 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.300 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45835 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7290880~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.300 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:33.300 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8900858659999997, 2024-09-11T05:33:33.300 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031565589999999998, 2024-09-11T05:33:33.300 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.300 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.300 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.300 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.300 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.300 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.300 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45835 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.301 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367276+0000", 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.96e-07 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367278+0000", 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0279999999999999e-06 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367283+0000", 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8340000000000004e-06 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.302 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367289+0000", 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398747+0000", 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031458211999999999 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398788+0000", 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0998999999999998e-05 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.303 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.304 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.304 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398841+0000", 2024-09-11T05:33:33.304 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2465e-05 2024-09-11T05:33:33.304 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.304 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.304 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.304 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.304 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45836 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7340032~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.304 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:33.304 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8900657899999995, 2024-09-11T05:33:33.304 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031663635000000002, 2024-09-11T05:33:33.304 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.305 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.305 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.305 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.305 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.305 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.305 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45836 2024-09-11T05:33:33.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.305 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.305 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.305 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.305 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:33.305 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368490+0000", 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0011952410000000001 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368494+0000", 2024-09-11T05:33:33.306 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4649999999999999e-06 2024-09-11T05:33:33.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.307 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.307 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.307 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368503+0000", 2024-09-11T05:33:33.307 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0920000000000004e-06 2024-09-11T05:33:33.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.307 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.307 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.307 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368509+0000", 2024-09-11T05:33:33.307 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4130000000000003e-06 2024-09-11T05:33:33.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.307 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.307 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.308 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398865+0000", 2024-09-11T05:33:33.308 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030355473000000001 2024-09-11T05:33:33.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.308 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.308 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.308 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398907+0000", 2024-09-11T05:33:33.308 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1882999999999999e-05 2024-09-11T05:33:33.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.308 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.308 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.308 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398959+0000", 2024-09-11T05:33:33.308 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2067999999999997e-05 2024-09-11T05:33:33.309 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.309 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.309 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.309 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.309 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45842 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7634944~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.310 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368634+0000", 2024-09-11T05:33:33.310 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8887266030000003, 2024-09-11T05:33:33.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031057715999999999, 2024-09-11T05:33:33.310 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.310 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.310 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.310 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.310 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.310 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.310 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45842 2024-09-11T05:33:33.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.310 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368634+0000", 2024-09-11T05:33:33.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368634+0000", 2024-09-11T05:33:33.312 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.312 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.312 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368635+0000", 2024-09-11T05:33:33.312 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:33:33.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.312 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368637+0000", 2024-09-11T05:33:33.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0449999999999999e-06 2024-09-11T05:33:33.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.313 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.313 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.314 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368643+0000", 2024-09-11T05:33:33.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:33:33.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.314 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.314 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368647+0000", 2024-09-11T05:33:33.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7079999999999996e-06 2024-09-11T05:33:33.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.315 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.315 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.315 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399597+0000", 2024-09-11T05:33:33.315 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030949081999999999 2024-09-11T05:33:33.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.315 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.315 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.315 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399640+0000", 2024-09-11T05:33:33.316 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3158000000000003e-05 2024-09-11T05:33:33.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.316 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.316 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.316 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399692+0000", 2024-09-11T05:33:33.316 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2448000000000003e-05 2024-09-11T05:33:33.316 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.317 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.317 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.317 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45843 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7684096~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.317 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368655+0000", 2024-09-11T05:33:33.317 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8887059830000004, 2024-09-11T05:33:33.318 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031152040999999998, 2024-09-11T05:33:33.318 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.318 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.318 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.318 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.318 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.318 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.318 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45843 2024-09-11T05:33:33.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.318 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.318 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.318 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.319 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368655+0000", 2024-09-11T05:33:33.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.319 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.319 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368655+0000", 2024-09-11T05:33:33.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.319 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.320 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368655+0000", 2024-09-11T05:33:33.320 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:33:33.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.320 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.320 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368657+0000", 2024-09-11T05:33:33.320 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.08e-06 2024-09-11T05:33:33.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.320 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.320 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368664+0000", 2024-09-11T05:33:33.321 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0959999999999997e-06 2024-09-11T05:33:33.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.321 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.321 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.321 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368668+0000", 2024-09-11T05:33:33.321 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6829999999999999e-06 2024-09-11T05:33:33.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.321 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.321 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399716+0000", 2024-09-11T05:33:33.322 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031047748 2024-09-11T05:33:33.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399757+0000", 2024-09-11T05:33:33.322 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1056000000000001e-05 2024-09-11T05:33:33.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.323 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399807+0000", 2024-09-11T05:33:33.323 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0046999999999997e-05 2024-09-11T05:33:33.323 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.323 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.323 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.323 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.323 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45844 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7733248~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.323 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:33.323 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8886866470000001, 2024-09-11T05:33:33.323 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031248306, 2024-09-11T05:33:33.323 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.324 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.324 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.324 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.324 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.324 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.324 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45844 2024-09-11T05:33:33.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.324 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.324 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.324 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.324 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:33.324 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:33.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368675+0000", 2024-09-11T05:33:33.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4700000000000001e-07 2024-09-11T05:33:33.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.326 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368680+0000", 2024-09-11T05:33:33.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3750000000000002e-06 2024-09-11T05:33:33.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.326 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.326 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.326 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368687+0000", 2024-09-11T05:33:33.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3080000000000004e-06 2024-09-11T05:33:33.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.326 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.326 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.326 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368692+0000", 2024-09-11T05:33:33.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2329999999999997e-06 2024-09-11T05:33:33.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.327 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.327 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399832+0000", 2024-09-11T05:33:33.327 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031139723000000001 2024-09-11T05:33:33.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.327 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.327 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399872+0000", 2024-09-11T05:33:33.327 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0880000000000002e-05 2024-09-11T05:33:33.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.327 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399923+0000", 2024-09-11T05:33:33.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.024e-05 2024-09-11T05:33:33.328 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.328 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.328 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.328 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45845 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7782400~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.328 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:33.328 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8886628129999998, 2024-09-11T05:33:33.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031339210999999999, 2024-09-11T05:33:33.328 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.329 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.329 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.329 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.329 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.329 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.329 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45845 2024-09-11T05:33:33.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.329 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:33.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:33.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368699+0000", 2024-09-11T05:33:33.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:33:33.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.331 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.331 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368701+0000", 2024-09-11T05:33:33.331 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0389999999999999e-06 2024-09-11T05:33:33.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.331 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.331 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368706+0000", 2024-09-11T05:33:33.331 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5570000000000003e-06 2024-09-11T05:33:33.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.331 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368711+0000", 2024-09-11T05:33:33.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0930000000000002e-06 2024-09-11T05:33:33.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.332 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399947+0000", 2024-09-11T05:33:33.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031235810999999999 2024-09-11T05:33:33.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.332 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399989+0000", 2024-09-11T05:33:33.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1430000000000001e-05 2024-09-11T05:33:33.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.333 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.333 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400037+0000", 2024-09-11T05:33:33.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8838999999999998e-05 2024-09-11T05:33:33.333 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.333 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.333 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.333 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45846 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7831552~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.333 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:33.333 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8886437130000004, 2024-09-11T05:33:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031434484999999998, 2024-09-11T05:33:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45846 2024-09-11T05:33:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:33.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:33.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368718+0000", 2024-09-11T05:33:33.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6600000000000002e-07 2024-09-11T05:33:33.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.336 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368720+0000", 2024-09-11T05:33:33.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0140000000000001e-06 2024-09-11T05:33:33.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.337 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.337 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368726+0000", 2024-09-11T05:33:33.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8719999999999999e-06 2024-09-11T05:33:33.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.337 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.337 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368730+0000", 2024-09-11T05:33:33.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:33:33.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400061+0000", 2024-09-11T05:33:33.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031331141 2024-09-11T05:33:33.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400102+0000", 2024-09-11T05:33:33.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0419e-05 2024-09-11T05:33:33.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400152+0000", 2024-09-11T05:33:33.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9926000000000003e-05 2024-09-11T05:33:33.340 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.340 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.340 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.340 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.340 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45847 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7880704~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.340 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:33.340 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8886246020000002, 2024-09-11T05:33:33.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031531412000000002, 2024-09-11T05:33:33.341 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.341 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.341 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.341 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.341 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.341 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.342 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45847 2024-09-11T05:33:33.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.342 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:33.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:33.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368737+0000", 2024-09-11T05:33:33.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:33:33.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.344 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.344 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.344 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368739+0000", 2024-09-11T05:33:33.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.81e-06 2024-09-11T05:33:33.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.344 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.345 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.345 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368744+0000", 2024-09-11T05:33:33.345 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8919999999999997e-06 2024-09-11T05:33:33.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.345 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.345 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.345 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368749+0000", 2024-09-11T05:33:33.345 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7149999999999997e-06 2024-09-11T05:33:33.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.346 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.346 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400176+0000", 2024-09-11T05:33:33.346 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031426740000000002 2024-09-11T05:33:33.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400218+0000", 2024-09-11T05:33:33.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2338e-05 2024-09-11T05:33:33.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400268+0000", 2024-09-11T05:33:33.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9580000000000003e-05 2024-09-11T05:33:33.348 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.348 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.348 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.348 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.348 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45848 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7929856~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.348 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:33.348 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8886058060000002, 2024-09-11T05:33:33.349 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031629162000000002, 2024-09-11T05:33:33.349 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.349 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.349 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.349 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.349 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.349 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.349 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45848 2024-09-11T05:33:33.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.350 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:33.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:33.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368756+0000", 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368758+0000", 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.951e-06 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368763+0000", 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.801e-06 2024-09-11T05:33:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.352 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.352 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368768+0000", 2024-09-11T05:33:33.352 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1100000000000002e-06 2024-09-11T05:33:33.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.352 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.352 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400292+0000", 2024-09-11T05:33:33.352 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031524033 2024-09-11T05:33:33.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.352 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.352 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400336+0000", 2024-09-11T05:33:33.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3272999999999997e-05 2024-09-11T05:33:33.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.353 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.353 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.353 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400384+0000", 2024-09-11T05:33:33.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8634999999999998e-05 2024-09-11T05:33:33.356 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.356 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.356 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.357 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45849 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7979008~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.357 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:33.357 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8885864139999997, 2024-09-11T05:33:33.357 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031732415, 2024-09-11T05:33:33.357 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.357 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.357 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.357 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.357 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.357 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.357 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45849 2024-09-11T05:33:33.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.358 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0100000000000005e-07 2024-09-11T05:33:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368777+0000", 2024-09-11T05:33:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0260000000000002e-06 2024-09-11T05:33:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368783+0000", 2024-09-11T05:33:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7089999999999999e-06 2024-09-11T05:33:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368788+0000", 2024-09-11T05:33:33.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4029999999999998e-06 2024-09-11T05:33:33.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400409+0000", 2024-09-11T05:33:33.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031620663 2024-09-11T05:33:33.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400453+0000", 2024-09-11T05:33:33.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4376999999999999e-05 2024-09-11T05:33:33.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.361 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.361 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400507+0000", 2024-09-11T05:33:33.361 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3736000000000002e-05 2024-09-11T05:33:33.361 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.361 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.361 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.361 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45850 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8028160~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.361 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:33.361 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8885669519999997, 2024-09-11T05:33:33.362 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031830000999999997, 2024-09-11T05:33:33.362 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.362 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.362 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.362 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.362 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.362 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.362 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45850 2024-09-11T05:33:33.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.362 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.362 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.362 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.362 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:33.363 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.363 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:33.363 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.363 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368795+0000", 2024-09-11T05:33:33.363 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0399999999999996e-07 2024-09-11T05:33:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368796+0000", 2024-09-11T05:33:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.933e-06 2024-09-11T05:33:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368803+0000", 2024-09-11T05:33:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0619999999999997e-06 2024-09-11T05:33:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.365 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368807+0000", 2024-09-11T05:33:33.365 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.685e-06 2024-09-11T05:33:33.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.365 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.365 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.365 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400531+0000", 2024-09-11T05:33:33.365 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031723784999999997 2024-09-11T05:33:33.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.365 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400573+0000", 2024-09-11T05:33:33.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2079999999999997e-05 2024-09-11T05:33:33.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400624+0000", 2024-09-11T05:33:33.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0952000000000003e-05 2024-09-11T05:33:33.366 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45851 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8077312~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 7.8885479590000003, 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031929358999999997, 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.367 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.368 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45851 2024-09-11T05:33:33.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.368 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.368 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:33.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.368 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:33.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370488+0000", 2024-09-11T05:33:33.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.001674743 2024-09-11T05:33:33.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370491+0000", 2024-09-11T05:33:33.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.444e-06 2024-09-11T05:33:33.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.370 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370500+0000", 2024-09-11T05:33:33.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0650000000000005e-06 2024-09-11T05:33:33.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.370 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.370 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.370 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370507+0000", 2024-09-11T05:33:33.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:33:33.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.370 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.370 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.370 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400648+0000", 2024-09-11T05:33:33.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030141889000000002 2024-09-11T05:33:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400691+0000", 2024-09-11T05:33:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2290999999999999e-05 2024-09-11T05:33:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400742+0000", 2024-09-11T05:33:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1717e-05 2024-09-11T05:33:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.372 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.372 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.372 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:33.374 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:33.374 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:33.372+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:33.474 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:33.473+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:33.517 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:33.518 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:33.518 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:33.518 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:33.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:33.575 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:33.575+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:33.669 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:33.669 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:33.669 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:33.669 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:33.669 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:33.676 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:33.675+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:33.677 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:33.777 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:33.776+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:33.781 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T05:33:33.800 INFO:teuthology.orchestra.run.smithi070.stdout:3464 read 0x28bdc7f thru 0x28c4f30 (0x72b2 bytes) 2024-09-11T05:33:33.813 INFO:teuthology.orchestra.run.smithi070.stdout:3465 trunc from 0x9572728 to 0x234a524 2024-09-11T05:33:33.823 INFO:teuthology.orchestra.run.smithi070.stdout:3466 read 0x2146053 thru 0x2148648 (0x25f6 bytes) 2024-09-11T05:33:33.823 INFO:teuthology.orchestra.run.smithi070.stdout:3468 punch from 0x1e6420c to 0x1e67659, (0x344d bytes) 2024-09-11T05:33:33.823 INFO:teuthology.orchestra.run.smithi070.stdout:3469 read 0x18c9f54 thru 0x18d3545 (0x95f2 bytes) 2024-09-11T05:33:33.824 INFO:teuthology.orchestra.run.smithi070.stdout:3470 read 0x17525ce thru 0x175ec4c (0xc67f bytes) 2024-09-11T05:33:33.825 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47407 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2646016~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567880+0000", 2024-09-11T05:33:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2567995449999998, 2024-09-11T05:33:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036075284999999999, 2024-09-11T05:33:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.827 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.827 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.827 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.827 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.827 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.827 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47407 2024-09-11T05:33:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567880+0000", 2024-09-11T05:33:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567880+0000", 2024-09-11T05:33:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567881+0000", 2024-09-11T05:33:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6100000000000002e-07 2024-09-11T05:33:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567882+0000", 2024-09-11T05:33:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0070000000000001e-06 2024-09-11T05:33:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567885+0000", 2024-09-11T05:33:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8899999999999999e-06 2024-09-11T05:33:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567887+0000", 2024-09-11T05:33:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4719999999999998e-06 2024-09-11T05:33:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.603862+0000", 2024-09-11T05:33:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.035975311000000003 2024-09-11T05:33:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.603902+0000", 2024-09-11T05:33:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9855999999999999e-05 2024-09-11T05:33:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.603956+0000", 2024-09-11T05:33:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3488e-05 2024-09-11T05:33:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47408 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2695168~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567890+0000", 2024-09-11T05:33:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2567901609999996, 2024-09-11T05:33:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036177099999999997, 2024-09-11T05:33:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47408 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567890+0000", 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567890+0000", 2024-09-11T05:33:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567890+0000", 2024-09-11T05:33:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.46e-07 2024-09-11T05:33:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567891+0000", 2024-09-11T05:33:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9999999999999996e-07 2024-09-11T05:33:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567894+0000", 2024-09-11T05:33:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8779999999999998e-06 2024-09-11T05:33:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567896+0000", 2024-09-11T05:33:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.486e-06 2024-09-11T05:33:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.603981+0000", 2024-09-11T05:33:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036085035000000001 2024-09-11T05:33:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604019+0000", 2024-09-11T05:33:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7304000000000001e-05 2024-09-11T05:33:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604067+0000", 2024-09-11T05:33:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8151e-05 2024-09-11T05:33:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47409 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2744320~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567899+0000", 2024-09-11T05:33:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2567807379999998, 2024-09-11T05:33:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036285126000000001, 2024-09-11T05:33:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47409 2024-09-11T05:33:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567899+0000", 2024-09-11T05:33:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567899+0000", 2024-09-11T05:33:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567900+0000", 2024-09-11T05:33:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6300000000000001e-07 2024-09-11T05:33:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567900+0000", 2024-09-11T05:33:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2399999999999996e-07 2024-09-11T05:33:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567903+0000", 2024-09-11T05:33:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:33:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567906+0000", 2024-09-11T05:33:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.418e-06 2024-09-11T05:33:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604091+0000", 2024-09-11T05:33:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036185011000000003 2024-09-11T05:33:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604131+0000", 2024-09-11T05:33:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0268999999999997e-05 2024-09-11T05:33:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604184+0000", 2024-09-11T05:33:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3418999999999998e-05 2024-09-11T05:33:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47410 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2793472~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567908+0000", 2024-09-11T05:33:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2567715849999992, 2024-09-11T05:33:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036387492, 2024-09-11T05:33:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47410 2024-09-11T05:33:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567908+0000", 2024-09-11T05:33:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567908+0000", 2024-09-11T05:33:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567909+0000", 2024-09-11T05:33:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3099999999999999e-07 2024-09-11T05:33:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567910+0000", 2024-09-11T05:33:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:33:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567913+0000", 2024-09-11T05:33:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9739999999999998e-06 2024-09-11T05:33:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567916+0000", 2024-09-11T05:33:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5780000000000001e-06 2024-09-11T05:33:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604211+0000", 2024-09-11T05:33:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036294802000000001 2024-09-11T05:33:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604248+0000", 2024-09-11T05:33:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7455e-05 2024-09-11T05:33:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604296+0000", 2024-09-11T05:33:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7896999999999999e-05 2024-09-11T05:33:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47411 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2842624~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567919+0000", 2024-09-11T05:33:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2567614650000003, 2024-09-11T05:33:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036497626999999998, 2024-09-11T05:33:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47411 2024-09-11T05:33:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567919+0000", 2024-09-11T05:33:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567919+0000", 2024-09-11T05:33:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567919+0000", 2024-09-11T05:33:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1e-07 2024-09-11T05:33:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567920+0000", 2024-09-11T05:33:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.3399999999999997e-07 2024-09-11T05:33:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567923+0000", 2024-09-11T05:33:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8720000000000002e-06 2024-09-11T05:33:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567925+0000", 2024-09-11T05:33:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4719999999999998e-06 2024-09-11T05:33:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604320+0000", 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036394911000000002 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604362+0000", 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1918000000000001e-05 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604416+0000", 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.431e-05 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47412 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2891776~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567928+0000", 2024-09-11T05:33:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2567516160000007, 2024-09-11T05:33:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036604599000000002, 2024-09-11T05:33:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47412 2024-09-11T05:33:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567928+0000", 2024-09-11T05:33:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567928+0000", 2024-09-11T05:33:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567929+0000", 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567930+0000", 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9500000000000001e-07 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567933+0000", 2024-09-11T05:33:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0000000000000001e-06 2024-09-11T05:33:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567935+0000", 2024-09-11T05:33:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.542e-06 2024-09-11T05:33:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604442+0000", 2024-09-11T05:33:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036506826999999999 2024-09-11T05:33:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604477+0000", 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5126000000000002e-05 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604533+0000", 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5999999999999999e-05 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47413 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2940928~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567938+0000", 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.256742246, 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036712675, 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47413 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567938+0000", 2024-09-11T05:33:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567938+0000", 2024-09-11T05:33:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567938+0000", 2024-09-11T05:33:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:33:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567941+0000", 2024-09-11T05:33:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.185e-06 2024-09-11T05:33:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567944+0000", 2024-09-11T05:33:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0970000000000002e-06 2024-09-11T05:33:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567947+0000", 2024-09-11T05:33:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4959999999999999e-06 2024-09-11T05:33:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604558+0000", 2024-09-11T05:33:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036611128 2024-09-11T05:33:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604598+0000", 2024-09-11T05:33:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0225999999999997e-05 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604650+0000", 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2333999999999997e-05 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47414 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 2990080~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567950+0000", 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2567296989999992, 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036811337999999999, 2024-09-11T05:33:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.868 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.868 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.868 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.868 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.868 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.868 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47414 2024-09-11T05:33:33.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.868 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.868 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.868 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.868 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567950+0000", 2024-09-11T05:33:33.868 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567950+0000", 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567951+0000", 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.869 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567952+0000", 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.049e-06 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567955+0000", 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2899999999999998e-06 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567958+0000", 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1350000000000001e-06 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.870 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604675+0000", 2024-09-11T05:33:33.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036717340000000001 2024-09-11T05:33:33.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.871 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.871 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604714+0000", 2024-09-11T05:33:33.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8271e-05 2024-09-11T05:33:33.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.871 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.871 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604762+0000", 2024-09-11T05:33:33.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8040000000000001e-05 2024-09-11T05:33:33.871 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.872 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.872 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.872 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.872 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47415 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3039232~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.872 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567961+0000", 2024-09-11T05:33:33.872 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2567185690000002, 2024-09-11T05:33:33.872 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036915079000000003, 2024-09-11T05:33:33.872 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.872 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.872 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.872 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47415 2024-09-11T05:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567961+0000", 2024-09-11T05:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567961+0000", 2024-09-11T05:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567962+0000", 2024-09-11T05:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567963+0000", 2024-09-11T05:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0049999999999999e-06 2024-09-11T05:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.875 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.875 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567966+0000", 2024-09-11T05:33:33.875 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9100000000000001e-06 2024-09-11T05:33:33.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.875 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.875 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567968+0000", 2024-09-11T05:33:33.875 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.762e-06 2024-09-11T05:33:33.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.875 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604785+0000", 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036816509999999997 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604824+0000", 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9248000000000001e-05 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604877+0000", 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2429999999999998e-05 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.876 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.877 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.877 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.877 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47416 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3088384~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.877 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567971+0000", 2024-09-11T05:33:33.877 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2567089179999993, 2024-09-11T05:33:33.877 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037015625000000003, 2024-09-11T05:33:33.877 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.877 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.877 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47416 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567971+0000", 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.878 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567971+0000", 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567971+0000", 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567973+0000", 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.4839999999999999e-06 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.879 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567976+0000", 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.044e-06 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567979+0000", 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8449999999999999e-06 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604904+0000", 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036924962999999998 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604940+0000", 2024-09-11T05:33:33.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6774999999999999e-05 2024-09-11T05:33:33.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.604987+0000", 2024-09-11T05:33:33.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6304999999999998e-05 2024-09-11T05:33:33.881 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.881 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.881 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47417 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3137536~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567982+0000", 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2566984080000001, 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037125624000000003, 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47417 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.883 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.883 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567982+0000", 2024-09-11T05:33:33.883 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.883 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.883 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567982+0000", 2024-09-11T05:33:33.883 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.883 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.883 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567982+0000", 2024-09-11T05:33:33.884 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1199999999999999e-07 2024-09-11T05:33:33.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.884 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.884 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.884 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567983+0000", 2024-09-11T05:33:33.884 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.3500000000000005e-07 2024-09-11T05:33:33.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.884 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.884 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.884 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567986+0000", 2024-09-11T05:33:33.884 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8310000000000001e-06 2024-09-11T05:33:33.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.884 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567988+0000", 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6469999999999998e-06 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605011+0000", 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037022503999999998 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605051+0000", 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9938999999999998e-05 2024-09-11T05:33:33.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605107+0000", 2024-09-11T05:33:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6555999999999999e-05 2024-09-11T05:33:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47418 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3186688~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.567991+0000", 2024-09-11T05:33:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2566889900000007, 2024-09-11T05:33:33.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037227773999999998, 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47418 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567991+0000", 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.567991+0000", 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.568045+0000", 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3993000000000003e-05 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.568047+0000", 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.413e-06 2024-09-11T05:33:33.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.568052+0000", 2024-09-11T05:33:33.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5059999999999997e-06 2024-09-11T05:33:33.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.568056+0000", 2024-09-11T05:33:33.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6569999999999999e-06 2024-09-11T05:33:33.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605133+0000", 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037077150000000003 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605170+0000", 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7741000000000003e-05 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605219+0000", 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8313999999999999e-05 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47419 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3235840~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.568060+0000", 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.256619529, 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037282006999999999, 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47419 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.891 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.568060+0000", 2024-09-11T05:33:33.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.568060+0000", 2024-09-11T05:33:33.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569490+0000", 2024-09-11T05:33:33.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0014297940000000001 2024-09-11T05:33:33.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569494+0000", 2024-09-11T05:33:33.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0339999999999998e-06 2024-09-11T05:33:33.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569502+0000", 2024-09-11T05:33:33.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1040000000000007e-06 2024-09-11T05:33:33.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569507+0000", 2024-09-11T05:33:33.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0910000000000003e-06 2024-09-11T05:33:33.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605242+0000", 2024-09-11T05:33:33.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.035735847000000001 2024-09-11T05:33:33.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605289+0000", 2024-09-11T05:33:33.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6726e-05 2024-09-11T05:33:33.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605342+0000", 2024-09-11T05:33:33.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3411000000000001e-05 2024-09-11T05:33:33.895 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.895 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.895 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.895 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47421 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3334144~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.896 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569532+0000", 2024-09-11T05:33:33.896 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2551481370000008, 2024-09-11T05:33:33.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036049808000000003, 2024-09-11T05:33:33.896 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.896 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.896 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.896 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.896 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.896 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.896 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47421 2024-09-11T05:33:33.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.896 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.897 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569532+0000", 2024-09-11T05:33:33.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.897 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569532+0000", 2024-09-11T05:33:33.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569532+0000", 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8900000000000001e-07 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569534+0000", 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6339999999999999e-06 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569541+0000", 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3300000000000001e-06 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569545+0000", 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.636e-06 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605480+0000", 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.035935421000000002 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605527+0000", 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7203000000000002e-05 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605582+0000", 2024-09-11T05:33:33.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4295000000000001e-05 2024-09-11T05:33:33.900 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.900 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.900 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.900 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47422 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3383296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.900 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569549+0000", 2024-09-11T05:33:33.901 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2551312229999994, 2024-09-11T05:33:33.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036146018000000002, 2024-09-11T05:33:33.901 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.901 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.901 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.901 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.901 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.902 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.902 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47422 2024-09-11T05:33:33.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.902 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569549+0000", 2024-09-11T05:33:33.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569549+0000", 2024-09-11T05:33:33.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569549+0000", 2024-09-11T05:33:33.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:33:33.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569550+0000", 2024-09-11T05:33:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3430000000000001e-06 2024-09-11T05:33:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569554+0000", 2024-09-11T05:33:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.134e-06 2024-09-11T05:33:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569557+0000", 2024-09-11T05:33:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0460000000000001e-06 2024-09-11T05:33:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.905 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.905 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605608+0000", 2024-09-11T05:33:33.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036051894000000001 2024-09-11T05:33:33.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.905 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.905 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605646+0000", 2024-09-11T05:33:33.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7283999999999997e-05 2024-09-11T05:33:33.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.905 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.905 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605695+0000", 2024-09-11T05:33:33.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9052999999999999e-05 2024-09-11T05:33:33.906 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.906 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.906 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.906 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47423 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3432448~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.906 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569560+0000", 2024-09-11T05:33:33.906 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2551204069999997, 2024-09-11T05:33:33.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036258024999999999, 2024-09-11T05:33:33.906 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.906 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.907 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.907 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.907 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.907 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.907 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47423 2024-09-11T05:33:33.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.907 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569560+0000", 2024-09-11T05:33:33.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569560+0000", 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569560+0000", 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9799999999999999e-07 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569561+0000", 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0550000000000001e-06 2024-09-11T05:33:33.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569565+0000", 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1289999999999998e-06 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569568+0000", 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3969999999999998e-06 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605720+0000", 2024-09-11T05:33:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036151533 2024-09-11T05:33:33.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605763+0000", 2024-09-11T05:33:33.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3142999999999997e-05 2024-09-11T05:33:33.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605818+0000", 2024-09-11T05:33:33.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4469999999999999e-05 2024-09-11T05:33:33.910 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.910 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.911 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.911 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47424 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3481600~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.911 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569572+0000", 2024-09-11T05:33:33.911 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2551083980000008, 2024-09-11T05:33:33.911 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036345455999999998, 2024-09-11T05:33:33.911 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.911 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.911 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.912 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.912 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.912 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.912 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47424 2024-09-11T05:33:33.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.912 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.912 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.912 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.912 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569572+0000", 2024-09-11T05:33:33.912 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.912 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569572+0000", 2024-09-11T05:33:33.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569572+0000", 2024-09-11T05:33:33.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.29e-07 2024-09-11T05:33:33.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569573+0000", 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2950000000000001e-06 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569576+0000", 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.021e-06 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569579+0000", 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.604e-06 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605832+0000", 2024-09-11T05:33:33.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036253286000000003 2024-09-11T05:33:33.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605869+0000", 2024-09-11T05:33:33.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7045999999999997e-05 2024-09-11T05:33:33.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605917+0000", 2024-09-11T05:33:33.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7975000000000001e-05 2024-09-11T05:33:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47425 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3530752~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569581+0000", 2024-09-11T05:33:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2550985929999996, 2024-09-11T05:33:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036458552999999998, 2024-09-11T05:33:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.917 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.917 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.917 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47425 2024-09-11T05:33:33.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.917 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.917 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.917 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569581+0000", 2024-09-11T05:33:33.917 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.917 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569581+0000", 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569582+0000", 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.04e-07 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569586+0000", 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5029999999999999e-06 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569589+0000", 2024-09-11T05:33:33.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1879999999999998e-06 2024-09-11T05:33:33.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569592+0000", 2024-09-11T05:33:33.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4040000000000002e-06 2024-09-11T05:33:33.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605942+0000", 2024-09-11T05:33:33.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036350683000000002 2024-09-11T05:33:33.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.920 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.920 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.605986+0000", 2024-09-11T05:33:33.920 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3585999999999999e-05 2024-09-11T05:33:33.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.920 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.920 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606040+0000", 2024-09-11T05:33:33.920 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3984999999999999e-05 2024-09-11T05:33:33.920 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.920 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.920 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.921 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47426 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3579904~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.921 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569595+0000", 2024-09-11T05:33:33.921 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2550852779999992, 2024-09-11T05:33:33.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036554735999999997, 2024-09-11T05:33:33.921 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.921 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.921 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.921 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.921 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.921 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.921 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47426 2024-09-11T05:33:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569595+0000", 2024-09-11T05:33:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569595+0000", 2024-09-11T05:33:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.923 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.923 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569595+0000", 2024-09-11T05:33:33.923 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:33.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.923 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.923 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569596+0000", 2024-09-11T05:33:33.923 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0869999999999999e-06 2024-09-11T05:33:33.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.923 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.923 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569599+0000", 2024-09-11T05:33:33.923 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8439999999999998e-06 2024-09-11T05:33:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569601+0000", 2024-09-11T05:33:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4899999999999999e-06 2024-09-11T05:33:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606066+0000", 2024-09-11T05:33:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036464609000000002 2024-09-11T05:33:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606104+0000", 2024-09-11T05:33:33.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7521000000000002e-05 2024-09-11T05:33:33.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.925 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606149+0000", 2024-09-11T05:33:33.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5972e-05 2024-09-11T05:33:33.925 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.925 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.925 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.926 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.926 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:47427 3.1 3:87e68ab8:::rbd_data.112dcdbd4c7c.0000000000000003:14 [read 3629056~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:33.926 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.569605+0000", 2024-09-11T05:33:33.926 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2550751959999999, 2024-09-11T05:33:33.926 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.036661568999999998, 2024-09-11T05:33:33.926 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:33.926 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:33.926 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:33.926 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:33.926 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:33.926 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:33.927 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 47427 2024-09-11T05:33:33.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.927 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:33.927 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.927 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:33.927 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569605+0000", 2024-09-11T05:33:33.927 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.927 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:33.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.569605+0000", 2024-09-11T05:33:33.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:33.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:33.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.571489+0000", 2024-09-11T05:33:33.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0018838349999999999 2024-09-11T05:33:33.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:33.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.571492+0000", 2024-09-11T05:33:33.929 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7100000000000001e-06 2024-09-11T05:33:33.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:33.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.571500+0000", 2024-09-11T05:33:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8040000000000002e-06 2024-09-11T05:33:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.571505+0000", 2024-09-11T05:33:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4680000000000003e-06 2024-09-11T05:33:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606174+0000", 2024-09-11T05:33:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.034669750999999999 2024-09-11T05:33:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.931 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:33.931 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606215+0000", 2024-09-11T05:33:33.931 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0299000000000002e-05 2024-09-11T05:33:33.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:33.931 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:33.931 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:33.931 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.606266+0000", 2024-09-11T05:33:33.931 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1702000000000001e-05 2024-09-11T05:33:33.932 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.932 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.932 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.932 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:33.932 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:33.932 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:33.936 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:33.937 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:33.933+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:33.941 INFO:teuthology.orchestra.run.smithi070.stdout:3471 writesame 0xddbfaa6 thru 0xddcf766 data_size 0x1(0xfcc1 bytes) 2024-09-11T05:33:33.942 INFO:teuthology.orchestra.run.smithi070.stdout:3475 writesame 0x6084282 thru 0x609073f data_size 0x1(0xc4be bytes) 2024-09-11T05:33:33.942 INFO:teuthology.orchestra.run.smithi070.stdout:3477 writesame 0x9e62967 thru 0x9e6dfe4 data_size 0x5e(0xb67e bytes) 2024-09-11T05:33:33.942 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.942 INFO:teuthology.orchestra.run.smithi070.stdout:3479 read 0x2e85f09 thru 0x2e92574 (0xc66c bytes) 2024-09-11T05:33:33.942 INFO:teuthology.orchestra.run.smithi070.stdout:3480 writesame 0x39ba468 thru 0x39bcea9 data_size 0x2(0x2a42 bytes) 2024-09-11T05:33:33.943 INFO:teuthology.orchestra.run.smithi070.stdout:3481 write 0x2f84655 thru 0x2f908c2 (0xc26e bytes) 2024-09-11T05:33:33.943 INFO:teuthology.orchestra.run.smithi070.stdout:3482 write 0x99fad17 thru 0x99fae24 (0x10e bytes) 2024-09-11T05:33:33.943 INFO:teuthology.orchestra.run.smithi070.stdout:3483 punch from 0x295de9 to 0x29fed3, (0xa0ea bytes) 2024-09-11T05:33:33.943 INFO:teuthology.orchestra.run.smithi070.stdout:3486 read 0xa754f90 thru 0xa764dad (0xfe1e bytes) 2024-09-11T05:33:33.943 INFO:teuthology.orchestra.run.smithi070.stdout:3488 write 0x7dd3007 thru 0x7ddfd65 (0xcd5f bytes) 2024-09-11T05:33:33.943 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.943 INFO:teuthology.orchestra.run.smithi070.stdout:3490 writesame 0xc6156e8 thru 0xc624e28 data_size 0x27(0xf741 bytes) 2024-09-11T05:33:33.944 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.944 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.944 INFO:teuthology.orchestra.run.smithi070.stdout:3493 punch from 0xa206aaa to 0xa215726, (0xec7c bytes) 2024-09-11T05:33:33.944 INFO:teuthology.orchestra.run.smithi070.stdout:3494 punch from 0x599fb28 to 0x59a941a, (0x98f2 bytes) 2024-09-11T05:33:33.944 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.945 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.945 INFO:teuthology.orchestra.run.smithi070.stdout:3497 punch from 0xd384512 to 0xd38f607, (0xb0f5 bytes) 2024-09-11T05:33:33.945 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.945 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.945 INFO:teuthology.orchestra.run.smithi070.stdout:3501 read 0x10705db thru 0x107527a (0x4ca0 bytes) 2024-09-11T05:33:33.946 INFO:teuthology.orchestra.run.smithi070.stdout:3505 read 0xac2389d thru 0xac2d369 (0x9acd bytes) 2024-09-11T05:33:33.946 INFO:teuthology.orchestra.run.smithi070.stdout:3506 punch from 0xc8d77b to 0xc9495b, (0x71e0 bytes) 2024-09-11T05:33:33.946 INFO:teuthology.orchestra.run.smithi070.stdout:3507 read 0x25b0657 thru 0x25b3d6f (0x3719 bytes) 2024-09-11T05:33:33.946 INFO:teuthology.orchestra.run.smithi070.stdout:3508 trunc from 0xddcf767 to 0x692ac4e 2024-09-11T05:33:33.946 INFO:teuthology.orchestra.run.smithi070.stdout:3509 writesame 0x23b4bb6 thru 0x23bb8e9 data_size 0x3a(0x6d34 bytes) 2024-09-11T05:33:33.946 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.947 INFO:teuthology.orchestra.run.smithi070.stdout:3513 write 0x183f05 thru 0x185fc0 (0x20bc bytes) 2024-09-11T05:33:33.947 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.947 INFO:teuthology.orchestra.run.smithi070.stdout:3516 write 0xcf95521 thru 0xcfa0f34 (0xba14 bytes) 2024-09-11T05:33:33.947 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.947 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.948 INFO:teuthology.orchestra.run.smithi070.stdout:3521 read 0x42601a7 thru 0x4266b22 (0x697c bytes) 2024-09-11T05:33:33.948 INFO:teuthology.orchestra.run.smithi070.stdout:3522 read 0x78b1795 thru 0x78bff57 (0xe7c3 bytes) 2024-09-11T05:33:33.948 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.948 INFO:teuthology.orchestra.run.smithi070.stdout:3525 read 0xae573e7 thru 0xae59b7a (0x2794 bytes) 2024-09-11T05:33:33.948 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:33.949 INFO:teuthology.orchestra.run.smithi070.stdout:3527 read 0x8666930 thru 0x8667bb4 (0x1285 bytes) 2024-09-11T05:33:33.949 INFO:teuthology.orchestra.run.smithi070.stdout:3528 read 0x5198c1a thru 0x51a2e45 (0xa22c bytes) 2024-09-11T05:33:33.949 INFO:teuthology.orchestra.run.smithi070.stdout:3529 punch from 0x72b1bbe to 0x72bf852, (0xdc94 bytes) 2024-09-11T05:33:33.949 INFO:teuthology.orchestra.run.smithi070.stdout:3530 read 0x9eb6c9c thru 0x9ebca51 (0x5db6 bytes) 2024-09-11T05:33:33.950 INFO:teuthology.orchestra.run.smithi070.stdout:3531 writesame 0xd821fdf thru 0xd829a44 data_size 0x1(0x7a66 bytes) 2024-09-11T05:33:33.951 INFO:teuthology.orchestra.run.smithi070.stdout:3532 writesame 0x4856e1a thru 0x4859a47 data_size 0x27(0x2c2e bytes) 2024-09-11T05:33:33.951 INFO:teuthology.orchestra.run.smithi070.stdout:3533 read 0xec4d2c thru 0xec69ca (0x1c9f bytes) 2024-09-11T05:33:33.959 INFO:teuthology.orchestra.run.smithi070.stdout:3534 trunc from 0xd829a45 to 0x297e843 2024-09-11T05:33:33.983 INFO:teuthology.orchestra.run.smithi070.stdout:3535 write 0xa3fa39d thru 0xa401d54 (0x79b8 bytes) 2024-09-11T05:33:33.986 INFO:teuthology.orchestra.run.smithi070.stdout:3536 write 0x89cb522 thru 0x89cf3e5 (0x3ec4 bytes) 2024-09-11T05:33:33.993 INFO:teuthology.orchestra.run.smithi070.stdout:3537 trunc from 0xa401d55 to 0x6397cc3 2024-09-11T05:33:34.014 INFO:teuthology.orchestra.run.smithi070.stdout:3538 writesame 0xc2ab5d7 thru 0xc2b0e1e data_size 0x64(0x5848 bytes) 2024-09-11T05:33:34.014 INFO:teuthology.orchestra.run.smithi070.stdout:3540 write 0x84a41f5 thru 0x84afe19 (0xbc25 bytes) 2024-09-11T05:33:34.017 INFO:teuthology.orchestra.run.smithi070.stdout:3541 write 0x1536a0b thru 0x1539c14 (0x320a bytes) 2024-09-11T05:33:34.018 INFO:teuthology.orchestra.run.smithi070.stdout:3544 read 0x4b212c2 thru 0x4b28719 (0x7458 bytes) 2024-09-11T05:33:34.019 INFO:teuthology.orchestra.run.smithi070.stdout:3547 read 0xad97518 thru 0xada269c (0xb185 bytes) 2024-09-11T05:33:34.019 INFO:teuthology.orchestra.run.smithi070.stdout:3549 writesame 0x27f5b1c thru 0x2804198 data_size 0x1(0xe67d bytes) 2024-09-11T05:33:34.034 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:34.034+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:34.060 INFO:teuthology.orchestra.run.smithi070.stdout:3551 trunc from 0xc2b0e1f to 0xb760968 2024-09-11T05:33:34.070 INFO:teuthology.orchestra.run.smithi070.stdout:3552 trunc from 0xb760968 to 0x914f202 2024-09-11T05:33:34.076 INFO:teuthology.orchestra.run.smithi070.stdout:3553 write 0x4887182 thru 0x488b0ac (0x3f2b bytes) 2024-09-11T05:33:34.080 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:34.080 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:34.080 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:34.080 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:34.087 INFO:teuthology.orchestra.run.smithi070.stdout:3556 write 0xcd137c7 thru 0xcd22419 (0xec53 bytes) 2024-09-11T05:33:34.089 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:34.090 INFO:teuthology.orchestra.run.smithi070.stdout:3557 punch from 0x71568c to 0x71689f, (0x1213 bytes) 2024-09-11T05:33:34.090 INFO:teuthology.orchestra.run.smithi070.stdout:3560 read 0x9073dae thru 0x9080782 (0xc9d5 bytes) 2024-09-11T05:33:34.091 INFO:teuthology.orchestra.run.smithi070.stdout:3561 trunc from 0xcd2241a to 0xbeb52b7 2024-09-11T05:33:34.097 INFO:teuthology.orchestra.run.smithi070.stdout:3562 read 0x3df6b7d thru 0x3e04af6 (0xdf7a bytes) 2024-09-11T05:33:34.097 INFO:teuthology.orchestra.run.smithi070.stdout:3563 writesame 0x16e85d5 thru 0x16f590d data_size 0x1(0xd339 bytes) 2024-09-11T05:33:34.131 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.131 INFO:teuthology.orchestra.run.smithi070.stdout:3565 punch from 0x7baefc9 to 0x7bb7855, (0x888c bytes) 2024-09-11T05:33:34.131 INFO:teuthology.orchestra.run.smithi070.stdout:3567 writesame 0x9c78310 thru 0x9c8208c data_size 0x3(0x9d7d bytes) 2024-09-11T05:33:34.135 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:34.135+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:34.153 INFO:teuthology.orchestra.run.smithi070.stdout:3568 trunc from 0xbeb52b7 to 0x60867e 2024-09-11T05:33:34.168 INFO:teuthology.orchestra.run.smithi070.stdout:3569 punch from 0x50fe99 to 0x51c60c, (0xc773 bytes) 2024-09-11T05:33:34.168 INFO:teuthology.orchestra.run.smithi070.stdout:3573 punch from 0x309232 to 0x30d0d5, (0x3ea3 bytes) 2024-09-11T05:33:34.168 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.168 INFO:teuthology.orchestra.run.smithi070.stdout:3575 punch from 0x442d3a to 0x448f0b, (0x61d1 bytes) 2024-09-11T05:33:34.186 INFO:teuthology.orchestra.run.smithi070.stdout:3576 write 0xb827f23 thru 0xb835b4c (0xdc2a bytes) 2024-09-11T05:33:34.189 INFO:teuthology.orchestra.run.smithi070.stdout:3578 write 0x2c85de5 thru 0x2c8ea5c (0x8c78 bytes) 2024-09-11T05:33:34.194 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:34.194 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:34.194 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:34.194 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:34.194 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:34.194 INFO:teuthology.orchestra.run.smithi070.stdout:3579 trunc from 0xb835b4d to 0x87dd5ed 2024-09-11T05:33:34.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:34.212 INFO:teuthology.orchestra.run.smithi070.stdout:3580 write 0xc9a5ee9 thru 0xc9ab877 (0x598f bytes) 2024-09-11T05:33:34.217 INFO:teuthology.orchestra.run.smithi070.stdout:3581 trunc from 0xc9ab878 to 0xb8e7b2b 2024-09-11T05:33:34.223 INFO:teuthology.orchestra.run.smithi070.stdout:3582 read 0xa6ca857 thru 0xa6d30f5 (0x889f bytes) 2024-09-11T05:33:34.223 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.227 INFO:teuthology.orchestra.run.smithi070.stdout:3584 trunc from 0xb8e7b2b to 0x8b54c06 2024-09-11T05:33:34.236 INFO:teuthology.orchestra.run.smithi070.stdout:3585 read 0x865f958 thru 0x8665f17 (0x65c0 bytes) 2024-09-11T05:33:34.236 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.237 INFO:teuthology.orchestra.run.smithi070.stdout:3587 read 0x8ab4873 thru 0x8abd1fe (0x898c bytes) 2024-09-11T05:33:34.237 INFO:teuthology.orchestra.run.smithi070.stdout:3588 read 0x70ca6d6 thru 0x70cee8d (0x47b8 bytes) 2024-09-11T05:33:34.237 INFO:teuthology.orchestra.run.smithi070.stdout:3589 read 0x4f08ba7 thru 0x4f08ebd (0x317 bytes) 2024-09-11T05:33:34.237 INFO:teuthology.orchestra.run.smithi070.stdout:3590 read 0x6d6b885 thru 0x6d789a9 (0xd125 bytes) 2024-09-11T05:33:34.237 INFO:teuthology.orchestra.run.smithi070.stdout:3591 punch from 0xccb7d7 to 0xccde01, (0x262a bytes) 2024-09-11T05:33:34.237 INFO:teuthology.orchestra.run.smithi070.stdout:3592 writesame 0x13ce892 thru 0x13d1211 data_size 0x20(0x2980 bytes) 2024-09-11T05:33:34.240 INFO:teuthology.orchestra.run.smithi070.stdout:3593 punch from 0x45fadfb to 0x46029e6, (0x7beb bytes) 2024-09-11T05:33:34.240 INFO:teuthology.orchestra.run.smithi070.stdout:3594 read 0x3f9f592 thru 0x3fa18a3 (0x2312 bytes) 2024-09-11T05:33:34.240 INFO:teuthology.orchestra.run.smithi070.stdout:3596 read 0x132f5de thru 0x13319db (0x23fe bytes) 2024-09-11T05:33:34.240 INFO:teuthology.orchestra.run.smithi070.stdout:3597 read 0x1c408a5 thru 0x1c4c2c3 (0xba1f bytes) 2024-09-11T05:33:34.241 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.241 INFO:teuthology.orchestra.run.smithi070.stdout:3601 read 0xd26b68 thru 0xd34ae8 (0xdf81 bytes) 2024-09-11T05:33:34.241 INFO:teuthology.orchestra.run.smithi070.stdout:3602 punch from 0x5a7a4d9 to 0x5a7feed, (0x5a14 bytes) 2024-09-11T05:33:34.241 INFO:teuthology.orchestra.run.smithi070.stdout:3604 write 0x835e8f7 thru 0x836a336 (0xba40 bytes) 2024-09-11T05:33:34.247 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:34.246+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:34.254 INFO:teuthology.orchestra.run.smithi070.stdout:3605 write 0xd6bd83f thru 0xd6c91c4 (0xb986 bytes) 2024-09-11T05:33:34.257 INFO:teuthology.orchestra.run.smithi070.stdout:3606 read 0xb64945c thru 0xb650f53 (0x7af8 bytes) 2024-09-11T05:33:34.266 INFO:teuthology.orchestra.run.smithi070.stdout:3607 trunc from 0xd6c91c5 to 0x55f90aa 2024-09-11T05:33:34.276 INFO:teuthology.orchestra.run.smithi070.stdout:3608 read 0x5401791 thru 0x5409fd6 (0x8846 bytes) 2024-09-11T05:33:34.276 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.276 INFO:teuthology.orchestra.run.smithi070.stdout:3610 read 0xc07d47 thru 0xc10bf4 (0x8eae bytes) 2024-09-11T05:33:34.286 INFO:teuthology.orchestra.run.smithi070.stdout:3611 write 0x95efaec thru 0x95f1b1e (0x2033 bytes) 2024-09-11T05:33:34.289 INFO:teuthology.orchestra.run.smithi070.stdout:3612 write 0x5756b12 thru 0x5759e44 (0x3333 bytes) 2024-09-11T05:33:34.291 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.302 INFO:teuthology.orchestra.run.smithi070.stdout:3614 trunc from 0x95f1b1f to 0x1b0bcb 2024-09-11T05:33:34.308 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:34.308 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:34.308 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:34.308 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:34.308 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.308 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.308 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:34.308 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 23.658926775000001, 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:34.309 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:33:34.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:33:34.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:33:34.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:33:34.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:33:34.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:33:34.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:33:34.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46373 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430582+0000", 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8766175529999991, 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022968048000000001, 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.314 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46373 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430582+0000", 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.316 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430582+0000", 2024-09-11T05:33:34.316 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.316 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.316 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.316 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430583+0000", 2024-09-11T05:33:34.316 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.99e-07 2024-09-11T05:33:34.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.316 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.316 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.316 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430585+0000", 2024-09-11T05:33:34.316 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0470000000000001e-06 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430591+0000", 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1550000000000004e-06 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430601+0000", 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0097e-05 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453542+0000", 2024-09-11T05:33:34.317 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022940853000000001 2024-09-11T05:33:34.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.318 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.318 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.318 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453550+0000", 2024-09-11T05:33:34.318 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2970000000000004e-06 2024-09-11T05:33:34.318 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.318 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.318 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.318 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46375 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430626+0000", 2024-09-11T05:33:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8765737439999999, 2024-09-11T05:33:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.02296014, 2024-09-11T05:33:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46375 2024-09-11T05:33:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430626+0000", 2024-09-11T05:33:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430626+0000", 2024-09-11T05:33:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430627+0000", 2024-09-11T05:33:34.321 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.58e-07 2024-09-11T05:33:34.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.321 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.321 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.321 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430628+0000", 2024-09-11T05:33:34.321 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.821e-06 2024-09-11T05:33:34.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.321 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.321 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.321 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430634+0000", 2024-09-11T05:33:34.321 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.519e-06 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430639+0000", 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8520000000000003e-06 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453579+0000", 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022940072999999998 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453586+0000", 2024-09-11T05:33:34.323 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5170000000000002e-06 2024-09-11T05:33:34.323 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.323 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.323 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.323 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.323 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46387 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.323 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430892+0000", 2024-09-11T05:33:34.323 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8763082309999994, 2024-09-11T05:33:34.323 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022967451999999999, 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46387 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430892+0000", 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430892+0000", 2024-09-11T05:33:34.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430892+0000", 2024-09-11T05:33:34.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:33:34.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430894+0000", 2024-09-11T05:33:34.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:33:34.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.326 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.326 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.326 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430899+0000", 2024-09-11T05:33:34.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3630000000000002e-06 2024-09-11T05:33:34.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.326 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.326 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.326 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430904+0000", 2024-09-11T05:33:34.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:33:34.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453851+0000", 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022947116 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453859+0000", 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3820000000000004e-06 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.327 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46389 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430946+0000", 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8762541489999993, 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022968111999999999, 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46389 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430946+0000", 2024-09-11T05:33:34.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430946+0000", 2024-09-11T05:33:34.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430946+0000", 2024-09-11T05:33:34.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:33:34.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430953+0000", 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5169999999999996e-06 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430959+0000", 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8590000000000001e-06 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430963+0000", 2024-09-11T05:33:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5820000000000003e-06 2024-09-11T05:33:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453905+0000", 2024-09-11T05:33:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022941868000000001 2024-09-11T05:33:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453914+0000", 2024-09-11T05:33:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8049999999999996e-06 2024-09-11T05:33:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.332 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46390 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.332 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430969+0000", 2024-09-11T05:33:34.332 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8762305890000004, 2024-09-11T05:33:34.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022962268000000001, 2024-09-11T05:33:34.332 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.332 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.332 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.332 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.332 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.332 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.332 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46390 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430969+0000", 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430969+0000", 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.333 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430970+0000", 2024-09-11T05:33:34.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:33:34.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430972+0000", 2024-09-11T05:33:34.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.968e-06 2024-09-11T05:33:34.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430977+0000", 2024-09-11T05:33:34.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6960000000000002e-06 2024-09-11T05:33:34.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430982+0000", 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3529999999999997e-06 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453927+0000", 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022945139 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453932+0000", 2024-09-11T05:33:34.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7210000000000002e-06 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46391 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430987+0000", 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8762127100000008, 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022979535999999998, 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.336 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46391 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430987+0000", 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430987+0000", 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430988+0000", 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430993+0000", 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2349999999999999e-06 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430999+0000", 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7359999999999998e-06 2024-09-11T05:33:34.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431008+0000", 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2420000000000006e-06 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453958+0000", 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022950310000000002 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453967+0000", 2024-09-11T05:33:34.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46392 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431014+0000", 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8761859120000004, 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022970832, 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.340 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.341 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.341 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46392 2024-09-11T05:33:34.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.341 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.341 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.341 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431014+0000", 2024-09-11T05:33:34.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.341 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.341 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431014+0000", 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431015+0000", 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6700000000000003e-07 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431017+0000", 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1119999999999999e-06 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431023+0000", 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9569999999999999e-06 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431027+0000", 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7530000000000001e-06 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453980+0000", 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022952745 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453985+0000", 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6979999999999997e-06 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46393 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431033+0000", 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8761668230000002, 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.02299064, 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.344 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46393 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431033+0000", 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431033+0000", 2024-09-11T05:33:34.345 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431034+0000", 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5900000000000002e-07 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431043+0000", 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9420000000000007e-06 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.346 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431049+0000", 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9259999999999997e-06 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431054+0000", 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5739999999999997e-06 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454014+0000", 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022960332999999999 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454024+0000", 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4059999999999994e-06 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46394 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431064+0000", 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8761354919999995, 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022975287, 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.348 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46394 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431064+0000", 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431064+0000", 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431065+0000", 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7e-07 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431067+0000", 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431072+0000", 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7640000000000002e-06 2024-09-11T05:33:34.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431077+0000", 2024-09-11T05:33:34.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6319999999999999e-06 2024-09-11T05:33:34.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454036+0000", 2024-09-11T05:33:34.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022958668000000002 2024-09-11T05:33:34.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454040+0000", 2024-09-11T05:33:34.352 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9380000000000002e-06 2024-09-11T05:33:34.352 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.352 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.352 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.352 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46395 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.352 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431096+0000", 2024-09-11T05:33:34.352 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8761042159999999, 2024-09-11T05:33:34.352 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022966864, 2024-09-11T05:33:34.352 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.352 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.352 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46395 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431096+0000", 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431096+0000", 2024-09-11T05:33:34.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431096+0000", 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6000000000000004e-07 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431098+0000", 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1500000000000002e-06 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431105+0000", 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2090000000000002e-06 2024-09-11T05:33:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431114+0000", 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5799999999999998e-06 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454055+0000", 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022940533999999999 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454063+0000", 2024-09-11T05:33:34.355 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8310000000000001e-06 2024-09-11T05:33:34.356 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.356 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.356 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.356 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.356 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46399 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.356 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431176+0000", 2024-09-11T05:33:34.356 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8760243859999992, 2024-09-11T05:33:34.356 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022967634000000001, 2024-09-11T05:33:34.356 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.356 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.357 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.357 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.357 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.357 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.357 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46399 2024-09-11T05:33:34.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.357 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.357 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.357 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431176+0000", 2024-09-11T05:33:34.357 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.358 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.358 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431176+0000", 2024-09-11T05:33:34.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.358 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.358 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431176+0000", 2024-09-11T05:33:34.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6100000000000001e-07 2024-09-11T05:33:34.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.358 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.359 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431178+0000", 2024-09-11T05:33:34.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:33:34.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.359 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.359 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.359 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431184+0000", 2024-09-11T05:33:34.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3239999999999999e-06 2024-09-11T05:33:34.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.359 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.359 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.359 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431189+0000", 2024-09-11T05:33:34.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7049999999999998e-06 2024-09-11T05:33:34.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454135+0000", 2024-09-11T05:33:34.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022945579000000001 2024-09-11T05:33:34.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454143+0000", 2024-09-11T05:33:34.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6179999999999995e-06 2024-09-11T05:33:34.360 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.361 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.361 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.361 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46400 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.361 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431195+0000", 2024-09-11T05:33:34.361 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8760044869999994, 2024-09-11T05:33:34.361 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022966688999999998, 2024-09-11T05:33:34.361 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.361 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.361 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.361 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.362 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.362 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.362 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46400 2024-09-11T05:33:34.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.362 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.362 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.362 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.362 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431195+0000", 2024-09-11T05:33:34.362 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.362 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.362 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431195+0000", 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431196+0000", 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.53e-07 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431199+0000", 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9210000000000001e-06 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431204+0000", 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8100000000000003e-06 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431209+0000", 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6210000000000003e-06 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454156+0000", 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022946785000000001 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.364 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454162+0000", 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1990000000000003e-06 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46401 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431214+0000", 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8759855170000002, 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022973299999999999, 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.365 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.366 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.366 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.366 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46401 2024-09-11T05:33:34.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.366 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431214+0000", 2024-09-11T05:33:34.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431214+0000", 2024-09-11T05:33:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431215+0000", 2024-09-11T05:33:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.03e-07 2024-09-11T05:33:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431217+0000", 2024-09-11T05:33:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.866e-06 2024-09-11T05:33:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.368 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431222+0000", 2024-09-11T05:33:34.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7749999999999998e-06 2024-09-11T05:33:34.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.368 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431227+0000", 2024-09-11T05:33:34.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0039999999999999e-06 2024-09-11T05:33:34.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.368 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454180+0000", 2024-09-11T05:33:34.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022952337 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454188+0000", 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9149999999999996e-06 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46402 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431233+0000", 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8759667190000009, 2024-09-11T05:33:34.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022970022999999999, 2024-09-11T05:33:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46402 2024-09-11T05:33:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431233+0000", 2024-09-11T05:33:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431233+0000", 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431234+0000", 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.371 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431235+0000", 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.813e-06 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431241+0000", 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4399999999999996e-06 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431245+0000", 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.372 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454198+0000", 2024-09-11T05:33:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022952381000000001 2024-09-11T05:33:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454203+0000", 2024-09-11T05:33:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.48e-06 2024-09-11T05:33:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46403 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.374 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431251+0000", 2024-09-11T05:33:34.374 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8759489699999996, 2024-09-11T05:33:34.374 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022983025000000001, 2024-09-11T05:33:34.374 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.374 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.374 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.374 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.374 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.374 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.374 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46403 2024-09-11T05:33:34.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.374 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.374 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431251+0000", 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431251+0000", 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431251+0000", 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:33:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431257+0000", 2024-09-11T05:33:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.643e-06 2024-09-11T05:33:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431264+0000", 2024-09-11T05:33:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2010000000000002e-06 2024-09-11T05:33:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431270+0000", 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454225+0000", 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022955350999999999 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454234+0000", 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7679999999999997e-06 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46404 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431282+0000", 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8759182980000002, 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022967751000000002, 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46404 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.378 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.379 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.379 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.379 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431282+0000", 2024-09-11T05:33:34.379 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.379 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.379 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.379 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431282+0000", 2024-09-11T05:33:34.379 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.379 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.379 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.379 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431282+0000", 2024-09-11T05:33:34.380 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000003e-07 2024-09-11T05:33:34.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.380 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.380 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431284+0000", 2024-09-11T05:33:34.380 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0640000000000001e-06 2024-09-11T05:33:34.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.380 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.380 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431290+0000", 2024-09-11T05:33:34.380 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1149999999999999e-06 2024-09-11T05:33:34.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.381 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.381 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431295+0000", 2024-09-11T05:33:34.381 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.651e-06 2024-09-11T05:33:34.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.381 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.381 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454245+0000", 2024-09-11T05:33:34.381 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.02295003 2024-09-11T05:33:34.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.384 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.384 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.384 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454249+0000", 2024-09-11T05:33:34.384 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3170000000000003e-06 2024-09-11T05:33:34.384 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.384 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.384 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.384 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46447 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431301+0000", 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.875898694, 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022973720999999999, 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46447 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.385 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431301+0000", 2024-09-11T05:33:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431301+0000", 2024-09-11T05:33:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431302+0000", 2024-09-11T05:33:34.386 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6899999999999998e-07 2024-09-11T05:33:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431304+0000", 2024-09-11T05:33:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.99e-06 2024-09-11T05:33:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431309+0000", 2024-09-11T05:33:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7169999999999996e-06 2024-09-11T05:33:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.387 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.388 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431314+0000", 2024-09-11T05:33:34.388 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000003e-06 2024-09-11T05:33:34.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.388 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.388 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.388 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454266+0000", 2024-09-11T05:33:34.388 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022952426000000001 2024-09-11T05:33:34.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.388 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.388 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.388 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454275+0000", 2024-09-11T05:33:34.388 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8189999999999998e-06 2024-09-11T05:33:34.388 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46448 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431319+0000", 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8758808469999995, 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022969360000000001, 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.389 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.390 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46448 2024-09-11T05:33:34.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.390 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.390 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.390 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.390 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431319+0000", 2024-09-11T05:33:34.390 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.390 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.390 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.390 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431319+0000", 2024-09-11T05:33:34.390 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431319+0000", 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431321+0000", 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6810000000000001e-06 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.391 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431327+0000", 2024-09-11T05:33:34.392 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7459999999999997e-06 2024-09-11T05:33:34.392 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.392 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.392 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.392 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431331+0000", 2024-09-11T05:33:34.392 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5210000000000004e-06 2024-09-11T05:33:34.392 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.392 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.392 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.392 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454285+0000", 2024-09-11T05:33:34.392 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022953431 2024-09-11T05:33:34.392 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454288+0000", 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46449 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431337+0000", 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.8758629550000006, 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022974029999999999, 2024-09-11T05:33:34.393 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46449 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431337+0000", 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.394 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431337+0000", 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431337+0000", 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431339+0000", 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.793e-06 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.395 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431345+0000", 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.541e-06 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431349+0000", 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3270000000000002e-06 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454302+0000", 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022953106000000001 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:34.396 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:34.397 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454311+0000", 2024-09-11T05:33:34.397 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9090000000000006e-06 2024-09-11T05:33:34.397 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.397 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.397 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.397 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:34.397 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:34.397 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:34.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:34.401 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.401 INFO:teuthology.orchestra.run.smithi070.stdout:3618 writesame 0x4bada9d thru 0x4bb3084 data_size 0x4(0x55e8 bytes) 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:3621 read 0x3154d1d thru 0x315e010 (0x92f4 bytes) 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:3622 writesame 0x9997be7 thru 0x99a1095 data_size 0x1(0x94af bytes) 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:3623 trunc from 0x99a1096 to 0xd0e0247 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:3624 write 0x512c60f thru 0x512fbd1 (0x35c3 bytes) 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:3625 write 0x6357072 thru 0x635fce9 (0x8c78 bytes) 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:3627 writesame 0x6e9224a thru 0x6e9807c data_size 0x41(0x5e33 bytes) 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:3628 write 0x78663 thru 0x80336 (0x7cd4 bytes) 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:3629 read 0x92f9bb thru 0x9338d3 (0x3f19 bytes) 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:3632 write 0x1939bf thru 0x1a2678 (0xecba bytes) 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:3633 read 0x75be028 thru 0x75bf0d0 (0x10a9 bytes) 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:3634 read 0x5dbedf6 thru 0x5dc5b17 (0x6d22 bytes) 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:3636 read 0x1e34539 thru 0x1e43f51 (0xfa19 bytes) 2024-09-11T05:33:34.402 INFO:teuthology.orchestra.run.smithi070.stdout:3637 writesame 0xdec4369 thru 0xdecd79b data_size 0x1(0x9433 bytes) 2024-09-11T05:33:34.403 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.403 INFO:teuthology.orchestra.run.smithi070.stdout:3640 write 0xe898250 thru 0xe8993a7 (0x1158 bytes) 2024-09-11T05:33:34.403 INFO:teuthology.orchestra.run.smithi070.stdout:3643 write 0x1d616e2 thru 0x1d6c6e2 (0xb001 bytes) 2024-09-11T05:33:34.403 INFO:teuthology.orchestra.run.smithi070.stdout:3646 write 0xb5232ff thru 0xb52e12a (0xae2c bytes) 2024-09-11T05:33:34.403 INFO:teuthology.orchestra.run.smithi070.stdout:3647 read 0x20af07e thru 0x20bc3dc (0xd35f bytes) 2024-09-11T05:33:34.403 INFO:teuthology.orchestra.run.smithi070.stdout:3648 read 0xe2c92d1 thru 0xe2d28c6 (0x95f6 bytes) 2024-09-11T05:33:34.403 INFO:teuthology.orchestra.run.smithi070.stdout:3650 read 0x8acaa10 thru 0x8ad475c (0x9d4d bytes) 2024-09-11T05:33:34.403 INFO:teuthology.orchestra.run.smithi070.stdout:3651 punch from 0x4209a64 to 0x420cc7b, (0x3217 bytes) 2024-09-11T05:33:34.403 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.403 INFO:teuthology.orchestra.run.smithi070.stdout:3654 trunc from 0xe8993a8 to 0xaca5b5d 2024-09-11T05:33:34.403 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.403 INFO:teuthology.orchestra.run.smithi070.stdout:3657 trunc from 0xaca5b5d to 0x66b8b74 2024-09-11T05:33:34.404 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:34.398+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:34.419 INFO:teuthology.orchestra.run.smithi070.stdout:3659 write 0xb7b9446 thru 0xb7c4807 (0xb3c2 bytes) 2024-09-11T05:33:34.422 INFO:teuthology.orchestra.run.smithi070.stdout:3660 read 0x21eb24c thru 0x21f33ba (0x816f bytes) 2024-09-11T05:33:34.422 INFO:teuthology.orchestra.run.smithi070.stdout:3661 writesame 0x768dcff thru 0x7695f8f data_size 0x23(0x8291 bytes) 2024-09-11T05:33:34.424 INFO:teuthology.orchestra.run.smithi070.stdout:3662 write 0x3318eb8 thru 0x331ea3a (0x5b83 bytes) 2024-09-11T05:33:34.425 INFO:teuthology.orchestra.run.smithi070.stdout:3663 read 0x21af258 thru 0x21be064 (0xee0d bytes) 2024-09-11T05:33:34.434 INFO:teuthology.orchestra.run.smithi070.stdout:3664 write 0xdeeb8bb thru 0xdef769e (0xbde4 bytes) 2024-09-11T05:33:34.435 INFO:teuthology.orchestra.run.smithi070.stdout:3666 read 0x225055e thru 0x225e729 (0xe1cc bytes) 2024-09-11T05:33:34.435 INFO:teuthology.orchestra.run.smithi070.stdout:3667 write 0xac64b1d thru 0xac73f7e (0xf462 bytes) 2024-09-11T05:33:34.437 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.437 INFO:teuthology.orchestra.run.smithi070.stdout:3671 read 0x6b5c6c1 thru 0x6b5cd3e (0x67e bytes) 2024-09-11T05:33:34.437 INFO:teuthology.orchestra.run.smithi070.stdout:3672 write 0x973264a thru 0x9737deb (0x57a2 bytes) 2024-09-11T05:33:34.438 INFO:teuthology.orchestra.run.smithi070.stdout:3673 punch from 0x77456e6 to 0x77538c8, (0xe1e2 bytes) 2024-09-11T05:33:34.438 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.438 INFO:teuthology.orchestra.run.smithi070.stdout:3675 write 0x1a5728f thru 0x1a5ef1b (0x7c8d bytes) 2024-09-11T05:33:34.441 INFO:teuthology.orchestra.run.smithi070.stdout:3676 punch from 0x504379c to 0x504bd79, (0x85dd bytes) 2024-09-11T05:33:34.441 INFO:teuthology.orchestra.run.smithi070.stdout:3677 write 0x40ef530 thru 0x40fa1e4 (0xacb5 bytes) 2024-09-11T05:33:34.444 INFO:teuthology.orchestra.run.smithi070.stdout:3679 punch from 0x2259ca7 to 0x22686d9, (0xea32 bytes) 2024-09-11T05:33:34.448 INFO:teuthology.orchestra.run.smithi070.stdout:3680 trunc from 0xdef769f to 0xaad7801 2024-09-11T05:33:34.454 INFO:teuthology.orchestra.run.smithi070.stdout:3681 write 0x1d98fb3 thru 0x1d9df29 (0x4f77 bytes) 2024-09-11T05:33:34.456 INFO:teuthology.orchestra.run.smithi070.stdout:3683 read 0x6b7a659 thru 0x6b7efb1 (0x4959 bytes) 2024-09-11T05:33:34.456 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:34.456 INFO:teuthology.orchestra.run.smithi070.stdout:3685 write 0x3658618 thru 0x3659336 (0xd1f bytes) 2024-09-11T05:33:34.457 INFO:teuthology.orchestra.run.smithi070.stdout:3686 clone 23 order 24 su 262144 sc 7 2024-09-11T05:33:34.499 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:34.498+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:34.523 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:34.600 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:34.599+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:34.666 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:34.667 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:34.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:34.719 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:34.719+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:34.780 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:34.780 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:34.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:34.781 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:34.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.781 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15742 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 483328~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.781 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:34.781 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.530986093999999, 2024-09-11T05:33:34.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022975045999999999, 2024-09-11T05:33:34.781 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.781 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15742 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:34.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:34.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248353+0000", 2024-09-11T05:33:34.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.615e-06 2024-09-11T05:33:34.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248356+0000", 2024-09-11T05:33:34.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.641e-06 2024-09-11T05:33:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248360+0000", 2024-09-11T05:33:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:33:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271209+0000", 2024-09-11T05:33:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022848825999999999 2024-09-11T05:33:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271264+0000", 2024-09-11T05:33:34.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5170999999999997e-05 2024-09-11T05:33:34.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271326+0000", 2024-09-11T05:33:34.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1389000000000005e-05 2024-09-11T05:33:34.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.785 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.786 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15743 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 532480~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.786 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:34.786 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.530970545999999, 2024-09-11T05:33:34.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023116772000000001, 2024-09-11T05:33:34.786 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.786 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15743 2024-09-11T05:33:34.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.786 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248808+0000", 2024-09-11T05:33:34.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044169199999999999 2024-09-11T05:33:34.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248812+0000", 2024-09-11T05:33:34.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6969999999999999e-06 2024-09-11T05:33:34.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248819+0000", 2024-09-11T05:33:34.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6790000000000005e-06 2024-09-11T05:33:34.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248826+0000", 2024-09-11T05:33:34.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5509999999999996e-06 2024-09-11T05:33:34.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271362+0000", 2024-09-11T05:33:34.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022536348000000001 2024-09-11T05:33:34.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271413+0000", 2024-09-11T05:33:34.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0810000000000003e-05 2024-09-11T05:33:34.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271483+0000", 2024-09-11T05:33:34.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9994999999999996e-05 2024-09-11T05:33:34.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.790 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.790 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15746 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 679936~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.790 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.530441227000001, 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022995304000000001, 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15746 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248898+0000", 2024-09-11T05:33:34.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1749999999999999e-06 2024-09-11T05:33:34.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248904+0000", 2024-09-11T05:33:34.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5759999999999996e-06 2024-09-11T05:33:34.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248909+0000", 2024-09-11T05:33:34.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9710000000000003e-06 2024-09-11T05:33:34.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271775+0000", 2024-09-11T05:33:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022866721 2024-09-11T05:33:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271833+0000", 2024-09-11T05:33:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7132000000000001e-05 2024-09-11T05:33:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271891+0000", 2024-09-11T05:33:34.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8303000000000001e-05 2024-09-11T05:33:34.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15747 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 729088~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:34.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.530422687000002, 2024-09-11T05:33:34.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023120391000000001, 2024-09-11T05:33:34.795 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15747 2024-09-11T05:33:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:33:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248916+0000", 2024-09-11T05:33:34.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4270000000000001e-06 2024-09-11T05:33:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248919+0000", 2024-09-11T05:33:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.366e-06 2024-09-11T05:33:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248922+0000", 2024-09-11T05:33:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6790000000000001e-06 2024-09-11T05:33:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271914+0000", 2024-09-11T05:33:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022992584999999999 2024-09-11T05:33:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271965+0000", 2024-09-11T05:33:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1008999999999999e-05 2024-09-11T05:33:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272034+0000", 2024-09-11T05:33:34.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8980999999999996e-05 2024-09-11T05:33:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15748 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 778240~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.530411731000001, 2024-09-11T05:33:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023325197999999998, 2024-09-11T05:33:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.800 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15748 2024-09-11T05:33:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-07 2024-09-11T05:33:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248926+0000", 2024-09-11T05:33:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.077e-06 2024-09-11T05:33:34.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248930+0000", 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5920000000000001e-06 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248933+0000", 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7760000000000002e-06 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272074+0000", 2024-09-11T05:33:34.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023141656 2024-09-11T05:33:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272153+0000", 2024-09-11T05:33:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8566999999999995e-05 2024-09-11T05:33:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272250+0000", 2024-09-11T05:33:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7217000000000001e-05 2024-09-11T05:33:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.804 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16376 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 925696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.485147811000001, 2024-09-11T05:33:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023022233999999999, 2024-09-11T05:33:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16376 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294191+0000", 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1169999999999998e-06 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294198+0000", 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.105e-06 2024-09-11T05:33:34.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294202+0000", 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3490000000000002e-06 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317070+0000", 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022868169000000001 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317141+0000", 2024-09-11T05:33:34.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0947999999999999e-05 2024-09-11T05:33:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317211+0000", 2024-09-11T05:33:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0154999999999995e-05 2024-09-11T05:33:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16377 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 974848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:34.809 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.485129388000001, 2024-09-11T05:33:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023184939000000002, 2024-09-11T05:33:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16377 2024-09-11T05:33:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294208+0000", 2024-09-11T05:33:34.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5600000000000001e-07 2024-09-11T05:33:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294210+0000", 2024-09-11T05:33:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T05:33:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294215+0000", 2024-09-11T05:33:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7989999999999999e-06 2024-09-11T05:33:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294220+0000", 2024-09-11T05:33:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6580000000000001e-06 2024-09-11T05:33:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317241+0000", 2024-09-11T05:33:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023020987999999999 2024-09-11T05:33:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317315+0000", 2024-09-11T05:33:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3496000000000002e-05 2024-09-11T05:33:34.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317392+0000", 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7720999999999997e-05 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16378 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 1024000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.485111443000001, 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023298976999999998, 2024-09-11T05:33:34.814 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16378 2024-09-11T05:33:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294226+0000", 2024-09-11T05:33:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T05:33:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294228+0000", 2024-09-11T05:33:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-06 2024-09-11T05:33:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294234+0000", 2024-09-11T05:33:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1399999999999997e-06 2024-09-11T05:33:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294239+0000", 2024-09-11T05:33:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:33:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317420+0000", 2024-09-11T05:33:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023181499000000001 2024-09-11T05:33:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317478+0000", 2024-09-11T05:33:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7608999999999997e-05 2024-09-11T05:33:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317524+0000", 2024-09-11T05:33:34.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6378999999999998e-05 2024-09-11T05:33:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16400 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 532480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.484990985, 2024-09-11T05:33:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022889597000000001, 2024-09-11T05:33:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.819 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16400 2024-09-11T05:33:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7e-07 2024-09-11T05:33:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294348+0000", 2024-09-11T05:33:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:33:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294354+0000", 2024-09-11T05:33:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9880000000000001e-06 2024-09-11T05:33:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294359+0000", 2024-09-11T05:33:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1580000000000004e-06 2024-09-11T05:33:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317080+0000", 2024-09-11T05:33:34.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022720884 2024-09-11T05:33:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317162+0000", 2024-09-11T05:33:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1432000000000002e-05 2024-09-11T05:33:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317235+0000", 2024-09-11T05:33:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3705e-05 2024-09-11T05:33:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.823 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16401 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.484971353999999, 2024-09-11T05:33:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02302893, 2024-09-11T05:33:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.824 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16401 2024-09-11T05:33:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:34.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294366+0000", 2024-09-11T05:33:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5499999999999998e-07 2024-09-11T05:33:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294368+0000", 2024-09-11T05:33:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:33:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294374+0000", 2024-09-11T05:33:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1720000000000004e-06 2024-09-11T05:33:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294379+0000", 2024-09-11T05:33:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9089999999999999e-06 2024-09-11T05:33:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317261+0000", 2024-09-11T05:33:34.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022882442999999999 2024-09-11T05:33:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317322+0000", 2024-09-11T05:33:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0145000000000001e-05 2024-09-11T05:33:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317394+0000", 2024-09-11T05:33:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2756000000000006e-05 2024-09-11T05:33:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16402 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 630784~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.484951958, 2024-09-11T05:33:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023196998, 2024-09-11T05:33:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16402 2024-09-11T05:33:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0900000000000002e-07 2024-09-11T05:33:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294387+0000", 2024-09-11T05:33:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9139999999999998e-06 2024-09-11T05:33:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294393+0000", 2024-09-11T05:33:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T05:33:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294398+0000", 2024-09-11T05:33:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T05:33:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317424+0000", 2024-09-11T05:33:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023026042 2024-09-11T05:33:34.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317489+0000", 2024-09-11T05:33:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5488999999999996e-05 2024-09-11T05:33:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317582+0000", 2024-09-11T05:33:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2658000000000006e-05 2024-09-11T05:33:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16403 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 679936~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.484932896, 2024-09-11T05:33:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023338022999999999, 2024-09-11T05:33:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16403 2024-09-11T05:33:34.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294406+0000", 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.902e-06 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294413+0000", 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3450000000000002e-06 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294417+0000", 2024-09-11T05:33:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9599999999999999e-06 2024-09-11T05:33:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317608+0000", 2024-09-11T05:33:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023190137 2024-09-11T05:33:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317666+0000", 2024-09-11T05:33:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-11T05:33:34.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317742+0000", 2024-09-11T05:33:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6247000000000004e-05 2024-09-11T05:33:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16404 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 729088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.484913534, 2024-09-11T05:33:34.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023640379, 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16404 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294424+0000", 2024-09-11T05:33:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:33:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294426+0000", 2024-09-11T05:33:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0420000000000001e-06 2024-09-11T05:33:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294432+0000", 2024-09-11T05:33:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8810000000000001e-06 2024-09-11T05:33:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294436+0000", 2024-09-11T05:33:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9529999999999998e-06 2024-09-11T05:33:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317770+0000", 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023333513 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317900+0000", 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013032699999999999 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318064+0000", 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016326900000000001 2024-09-11T05:33:34.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16405 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 778240~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.484894090000001, 2024-09-11T05:33:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023946875999999999, 2024-09-11T05:33:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.843 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16405 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.15e-07 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294445+0000", 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.838e-06 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294451+0000", 2024-09-11T05:33:34.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8279999999999999e-06 2024-09-11T05:33:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294455+0000", 2024-09-11T05:33:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-06 2024-09-11T05:33:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318095+0000", 2024-09-11T05:33:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023639667999999999 2024-09-11T05:33:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318161+0000", 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6305999999999998e-05 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318390+0000", 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000228481 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16406 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 827392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.847 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.484875709000001, 2024-09-11T05:33:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024093394000000001, 2024-09-11T05:33:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16406 2024-09-11T05:33:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:34.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4999999999999998e-07 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294463+0000", 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.108e-06 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294469+0000", 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8359999999999997e-06 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294474+0000", 2024-09-11T05:33:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3150000000000002e-06 2024-09-11T05:33:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318421+0000", 2024-09-11T05:33:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023947231999999999 2024-09-11T05:33:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318492+0000", 2024-09-11T05:33:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1367999999999998e-05 2024-09-11T05:33:34.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318554+0000", 2024-09-11T05:33:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2185000000000002e-05 2024-09-11T05:33:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16407 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.484856867000001, 2024-09-11T05:33:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024230683999999999, 2024-09-11T05:33:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16407 2024-09-11T05:33:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294482+0000", 2024-09-11T05:33:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0959999999999999e-06 2024-09-11T05:33:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294488+0000", 2024-09-11T05:33:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8549999999999998e-06 2024-09-11T05:33:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294492+0000", 2024-09-11T05:33:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2180000000000001e-06 2024-09-11T05:33:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318583+0000", 2024-09-11T05:33:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024090232 2024-09-11T05:33:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318648+0000", 2024-09-11T05:33:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5538999999999997e-05 2024-09-11T05:33:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318711+0000", 2024-09-11T05:33:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2366000000000006e-05 2024-09-11T05:33:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16408 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 925696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.484837879000001, 2024-09-11T05:33:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024377862, 2024-09-11T05:33:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16408 2024-09-11T05:33:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294502+0000", 2024-09-11T05:33:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4420000000000001e-06 2024-09-11T05:33:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294508+0000", 2024-09-11T05:33:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1410000000000002e-06 2024-09-11T05:33:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294512+0000", 2024-09-11T05:33:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.605e-06 2024-09-11T05:33:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318738+0000", 2024-09-11T05:33:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02422535 2024-09-11T05:33:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318816+0000", 2024-09-11T05:33:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7836999999999994e-05 2024-09-11T05:33:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318877+0000", 2024-09-11T05:33:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1058999999999999e-05 2024-09-11T05:33:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16409 3.1b 3.bc4667fb (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.484818819000001, 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575657000000001, 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16409 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T05:33:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294520+0000", 2024-09-11T05:33:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9410000000000001e-06 2024-09-11T05:33:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294526+0000", 2024-09-11T05:33:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9649999999999996e-06 2024-09-11T05:33:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294531+0000", 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5600000000000004e-06 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319081+0000", 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024550249 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319094+0000", 2024-09-11T05:33:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2621e-05 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16410 3.1b 3.bc4667fb (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.484800586999999, 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024587633000000001, 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16410 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.15e-07 2024-09-11T05:33:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294544+0000", 2024-09-11T05:33:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6830000000000008e-06 2024-09-11T05:33:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294550+0000", 2024-09-11T05:33:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:33:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294555+0000", 2024-09-11T05:33:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:33:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319117+0000", 2024-09-11T05:33:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024561862 2024-09-11T05:33:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319124+0000", 2024-09-11T05:33:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8539999999999999e-06 2024-09-11T05:33:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:69653 3.1d 3:b986aa5d:::rbd_header.112d5d3265b9:head [watch ping cookie 140342620774048 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-11T05:33:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:33.706110+0000", 2024-09-11T05:33:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.073226875, 2024-09-11T05:33:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085138077000000006, 2024-09-11T05:33:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 69653 2024-09-11T05:33:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706110+0000", 2024-09-11T05:33:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706110+0000", 2024-09-11T05:33:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706111+0000", 2024-09-11T05:33:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1960000000000001e-06 2024-09-11T05:33:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706119+0000", 2024-09-11T05:33:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6669999999999996e-06 2024-09-11T05:33:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706134+0000", 2024-09-11T05:33:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4769e-05 2024-09-11T05:33:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706152+0000", 2024-09-11T05:33:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.842e-05 2024-09-11T05:33:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706272+0000", 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119907 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706289+0000", 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7025999999999999e-05 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.791061+0000", 2024-09-11T05:33:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084772572000000004 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.791132+0000", 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0322999999999997e-05 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.791248+0000", 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116197 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:34.876 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:34.877 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:34.878 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone22 from 0xaad7801 (overlap 0x1b0bcb) to 0x0 2024-09-11T05:33:34.878 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:34.876+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:34.890 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-11T05:33:34.978 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:34.977+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:35.006 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:35.006 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:35.006 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:35.006 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:35.016 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:35.079 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:35.078+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:35.082 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:33:35.125 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:35.125 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:35.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:35.162 INFO:teuthology.orchestra.run.smithi070.stdout:3687 write 0x1218cdf thru 0x1219626 (0x948 bytes) 2024-09-11T05:33:35.173 INFO:teuthology.orchestra.run.smithi070.stdout:3688 read 0x64d8c70 thru 0x64dce2c (0x41bd bytes) 2024-09-11T05:33:35.174 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:35.174 INFO:teuthology.orchestra.run.smithi070.stdout:3691 writesame 0x3fb5f7f thru 0x3fb92a8 data_size 0x4a(0x332a bytes) 2024-09-11T05:33:35.175 INFO:teuthology.orchestra.run.smithi070.stdout:3693 read 0x2d6d4d4 thru 0x2d7d18d (0xfcba bytes) 2024-09-11T05:33:35.176 INFO:teuthology.orchestra.run.smithi070.stdout:3696 write 0x22d712f thru 0x22e5e99 (0xed6b bytes) 2024-09-11T05:33:35.179 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:35.179+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:35.183 INFO:teuthology.orchestra.run.smithi070.stdout:3698 writesame 0x369cf82 thru 0x369f8af data_size 0x15(0x292e bytes) 2024-09-11T05:33:35.195 INFO:teuthology.orchestra.run.smithi070.stdout:3699 trunc from 0xaad7801 to 0x86f2b45 2024-09-11T05:33:35.215 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:35.215 INFO:teuthology.orchestra.run.smithi070.stdout:3701 writesame 0x1d787ad thru 0x1d7c31c data_size 0x18(0x3b70 bytes) 2024-09-11T05:33:35.219 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:35.219 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:35.224 INFO:teuthology.orchestra.run.smithi070.stdout:3702 read 0x47e2306 thru 0x47e6ded (0x4ae8 bytes) 2024-09-11T05:33:35.233 INFO:teuthology.orchestra.run.smithi070.stdout:3703 trunc from 0x86f2b45 to 0x8609e8 2024-09-11T05:33:35.240 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:35.240 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:35.257 INFO:teuthology.orchestra.run.smithi070.stdout:3705 read 0x2e57d1 thru 0x2efa58 (0xa288 bytes) 2024-09-11T05:33:35.257 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:35.258 INFO:teuthology.orchestra.run.smithi070.stdout:3708 punch from 0x6937e8 to 0x69731e, (0x3b36 bytes) 2024-09-11T05:33:35.265 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:35.265 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:35.273 INFO:teuthology.orchestra.run.smithi070.stdout:3709 write 0x92574cb thru 0x925ec63 (0x7799 bytes) 2024-09-11T05:33:35.281 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:35.280+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:35.283 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:35.283 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:35.287 INFO:teuthology.orchestra.run.smithi070.stdout:3711 write 0xd7efd71 thru 0xd7f6dab (0x703b bytes) 2024-09-11T05:33:35.290 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:35.290 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:35.290 INFO:teuthology.orchestra.run.smithi070.stdout:3712 punch from 0xd3998ed to 0xd3a4f2d, (0xb640 bytes) 2024-09-11T05:33:35.290 INFO:teuthology.orchestra.run.smithi070.stdout:3713 clone 24 order 19 su 2048 sc 12 2024-09-11T05:33:35.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:35.301 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:35.301 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:35.317 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:35.318 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:35.334 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:35.335 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:35.351 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:35.351 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:35.381 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:35.380+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:35.405 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:35.405 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:35.414 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:35.482 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:35.482+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:35.516 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:35.516 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:35.525 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:35.583 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:35.582+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:35.630 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:35.630 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:35.639 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:35.684 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:35.684+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:35.783 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:35.783 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:35.784 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:35.784+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:35.793 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:35.806 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:33:35.853 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone23 from 0xd7f6dac (overlap 0x8609e8) to 0x0 2024-09-11T05:33:35.885 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:35.884+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:35.910 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-11T05:33:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:3714 read 0xa5dc300 thru 0xa5e5801 (0x9502 bytes) 2024-09-11T05:33:35.912 INFO:teuthology.orchestra.run.smithi070.stdout:3715 punch from 0x91741ed to 0x917c2fc, (0x810f bytes) 2024-09-11T05:33:35.915 INFO:teuthology.orchestra.run.smithi070.stdout:3716 read 0xaf0e35f thru 0xaf14347 (0x5fe9 bytes) 2024-09-11T05:33:35.916 INFO:teuthology.orchestra.run.smithi070.stdout:3718 punch from 0x1b041b1 to 0x1b06739, (0x2588 bytes) 2024-09-11T05:33:35.916 INFO:teuthology.orchestra.run.smithi070.stdout:3719 clone 25 order 18 su 8192 sc 10 2024-09-11T05:33:35.953 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:35.953 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:35.963 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:35.987 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:35.986+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:36.068 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:36.069 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:36.077 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:36.121 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:36.120+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:36.181 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:36.182 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:36.188 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:36.188+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:36.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:36.289 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:36.288+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:36.333 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:36.333 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:36.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:36.389 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:36.389+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:36.445 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:36.454 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:36.490 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:36.490+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:36.557 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:36.557 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:36.565 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:36.591 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:36.590+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:36.677 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:36.721 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:36.720+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:36.780 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:36.780 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:36.788 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:36.792 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:36.791+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:36.796 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T05:33:36.865 INFO:teuthology.orchestra.run.smithi070.stdout:flattening image image_client.0-clone24 2024-09-11T05:33:36.892 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:36.891+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:36.964 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:36.965 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:36.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:37.017 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:37.016+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:37.094 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:37.094+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:37.161 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:37.162 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:37.173 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:37.196 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:37.195+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:37.296 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:37.295+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:37.307 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:37.307 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:37.318 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:37.364 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:33:37.408 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:37.407+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:37.499 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:37.498+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:37.501 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:37.501 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:37.512 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:37.545 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:37.546 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:37.581 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:37.581 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:37.599 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:37.598+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:37.612 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:37.613 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:37.642 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:37.642 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:37.668 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:37.669 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:37.688 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:37.688 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:37.695 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:37.695 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:37.698 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:37.723 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:37.723 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:37.739 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:37.738+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:37.752 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:37.753 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:37.789 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:33:37.789 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:33:37.789 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 3, 5, 6, 7] 2024-09-11T05:33:37.790 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-11T05:33:37.807 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:37.807+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:37.878 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:37.878 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:37.878 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:37.878 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:37.878 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.878 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:37.878 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:37.878 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.227591032999999, 2024-09-11T05:33:37.878 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:33:37.878 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.878 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.879 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:33:37.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:33:37.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.883 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46373 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430582+0000", 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.445281810999999, 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022968048000000001, 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46373 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430582+0000", 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430582+0000", 2024-09-11T05:33:37.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430583+0000", 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.99e-07 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430585+0000", 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0470000000000001e-06 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430591+0000", 2024-09-11T05:33:37.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1550000000000004e-06 2024-09-11T05:33:37.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430601+0000", 2024-09-11T05:33:37.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0097e-05 2024-09-11T05:33:37.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453542+0000", 2024-09-11T05:33:37.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022940853000000001 2024-09-11T05:33:37.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.888 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.888 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.888 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453550+0000", 2024-09-11T05:33:37.888 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2970000000000004e-06 2024-09-11T05:33:37.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.888 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.888 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.888 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46375 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.888 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430626+0000", 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.445238002, 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.02296014, 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46375 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430626+0000", 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430626+0000", 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430627+0000", 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.58e-07 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430628+0000", 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.821e-06 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430634+0000", 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.519e-06 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430639+0000", 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8520000000000003e-06 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453579+0000", 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022940072999999998 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453586+0000", 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5170000000000002e-06 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46387 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430892+0000", 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444972489, 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022967451999999999, 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46387 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430892+0000", 2024-09-11T05:33:37.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430892+0000", 2024-09-11T05:33:37.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430892+0000", 2024-09-11T05:33:37.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:33:37.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430894+0000", 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8199999999999999e-06 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430899+0000", 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3630000000000002e-06 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430904+0000", 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453851+0000", 2024-09-11T05:33:37.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022947116 2024-09-11T05:33:37.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.896 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453859+0000", 2024-09-11T05:33:37.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3820000000000004e-06 2024-09-11T05:33:37.896 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.896 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.896 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.896 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46389 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430946+0000", 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444918406999999, 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022968111999999999, 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46389 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430946+0000", 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430946+0000", 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430946+0000", 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430953+0000", 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5169999999999996e-06 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430959+0000", 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8590000000000001e-06 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430963+0000", 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5820000000000003e-06 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453905+0000", 2024-09-11T05:33:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022941868000000001 2024-09-11T05:33:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453914+0000", 2024-09-11T05:33:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8049999999999996e-06 2024-09-11T05:33:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46390 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430969+0000", 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444894847, 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022962268000000001, 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46390 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.901 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430969+0000", 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430969+0000", 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430970+0000", 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430972+0000", 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.968e-06 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430977+0000", 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6960000000000002e-06 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430982+0000", 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3529999999999997e-06 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453927+0000", 2024-09-11T05:33:37.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022945139 2024-09-11T05:33:37.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453932+0000", 2024-09-11T05:33:37.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7210000000000002e-06 2024-09-11T05:33:37.904 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.904 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.904 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.905 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46391 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.905 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.430987+0000", 2024-09-11T05:33:37.905 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444876967999999, 2024-09-11T05:33:37.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022979535999999998, 2024-09-11T05:33:37.905 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.905 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.905 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.905 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.905 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.905 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.905 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46391 2024-09-11T05:33:37.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.905 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430987+0000", 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430987+0000", 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430988+0000", 2024-09-11T05:33:37.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430993+0000", 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2349999999999999e-06 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.430999+0000", 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7359999999999998e-06 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431008+0000", 2024-09-11T05:33:37.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2420000000000006e-06 2024-09-11T05:33:37.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453958+0000", 2024-09-11T05:33:37.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022950310000000002 2024-09-11T05:33:37.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453967+0000", 2024-09-11T05:33:37.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:33:37.908 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.908 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46392 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431014+0000", 2024-09-11T05:33:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.44485017, 2024-09-11T05:33:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022970832, 2024-09-11T05:33:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.910 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46392 2024-09-11T05:33:37.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.910 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431014+0000", 2024-09-11T05:33:37.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431014+0000", 2024-09-11T05:33:37.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.911 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.911 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431015+0000", 2024-09-11T05:33:37.911 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6700000000000003e-07 2024-09-11T05:33:37.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.911 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.911 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431017+0000", 2024-09-11T05:33:37.911 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1119999999999999e-06 2024-09-11T05:33:37.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.911 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.912 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431023+0000", 2024-09-11T05:33:37.912 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9569999999999999e-06 2024-09-11T05:33:37.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.912 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.912 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.912 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431027+0000", 2024-09-11T05:33:37.912 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7530000000000001e-06 2024-09-11T05:33:37.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.912 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.912 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.912 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453980+0000", 2024-09-11T05:33:37.912 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022952745 2024-09-11T05:33:37.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.453985+0000", 2024-09-11T05:33:37.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6979999999999997e-06 2024-09-11T05:33:37.913 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.913 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.913 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.913 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46393 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.913 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431033+0000", 2024-09-11T05:33:37.913 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444831081, 2024-09-11T05:33:37.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.02299064, 2024-09-11T05:33:37.914 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.914 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.914 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.914 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.914 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.914 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.914 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46393 2024-09-11T05:33:37.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.914 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431033+0000", 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431033+0000", 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431034+0000", 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5900000000000002e-07 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431043+0000", 2024-09-11T05:33:37.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9420000000000007e-06 2024-09-11T05:33:37.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.916 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431049+0000", 2024-09-11T05:33:37.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9259999999999997e-06 2024-09-11T05:33:37.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.916 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431054+0000", 2024-09-11T05:33:37.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5739999999999997e-06 2024-09-11T05:33:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454014+0000", 2024-09-11T05:33:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022960332999999999 2024-09-11T05:33:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454024+0000", 2024-09-11T05:33:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4059999999999994e-06 2024-09-11T05:33:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46394 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431064+0000", 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.44479975, 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022975287, 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46394 2024-09-11T05:33:37.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431064+0000", 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431064+0000", 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431065+0000", 2024-09-11T05:33:37.920 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7e-07 2024-09-11T05:33:37.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.920 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.920 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431067+0000", 2024-09-11T05:33:37.920 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9149999999999999e-06 2024-09-11T05:33:37.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.920 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.920 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431072+0000", 2024-09-11T05:33:37.920 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7640000000000002e-06 2024-09-11T05:33:37.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431077+0000", 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6319999999999999e-06 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454036+0000", 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022958668000000002 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454040+0000", 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9380000000000002e-06 2024-09-11T05:33:37.921 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.922 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.922 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.922 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46395 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.922 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431096+0000", 2024-09-11T05:33:37.922 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444768474, 2024-09-11T05:33:37.922 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022966864, 2024-09-11T05:33:37.922 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.922 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.922 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.923 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.923 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.923 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.923 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46395 2024-09-11T05:33:37.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.923 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.923 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.923 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431096+0000", 2024-09-11T05:33:37.923 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.923 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431096+0000", 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431096+0000", 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6000000000000004e-07 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431098+0000", 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1500000000000002e-06 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431105+0000", 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2090000000000002e-06 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431114+0000", 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5799999999999998e-06 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454055+0000", 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022940533999999999 2024-09-11T05:33:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454063+0000", 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8310000000000001e-06 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46399 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431176+0000", 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444688643999999, 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022967634000000001, 2024-09-11T05:33:37.926 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.927 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.927 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.927 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.927 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.927 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.927 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46399 2024-09-11T05:33:37.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.927 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.927 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.927 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.927 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431176+0000", 2024-09-11T05:33:37.927 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431176+0000", 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431176+0000", 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6100000000000001e-07 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431178+0000", 2024-09-11T05:33:37.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431184+0000", 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3239999999999999e-06 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431189+0000", 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7049999999999998e-06 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454135+0000", 2024-09-11T05:33:37.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022945579000000001 2024-09-11T05:33:37.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.930 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.930 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454143+0000", 2024-09-11T05:33:37.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6179999999999995e-06 2024-09-11T05:33:37.930 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.930 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.930 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.930 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46400 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.930 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431195+0000", 2024-09-11T05:33:37.931 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444668745, 2024-09-11T05:33:37.931 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022966688999999998, 2024-09-11T05:33:37.931 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.931 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.931 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.931 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.931 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.931 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.931 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46400 2024-09-11T05:33:37.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.931 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.931 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431195+0000", 2024-09-11T05:33:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431195+0000", 2024-09-11T05:33:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431196+0000", 2024-09-11T05:33:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.53e-07 2024-09-11T05:33:37.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.933 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.933 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.933 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431199+0000", 2024-09-11T05:33:37.933 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9210000000000001e-06 2024-09-11T05:33:37.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.933 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.933 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.933 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431204+0000", 2024-09-11T05:33:37.933 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8100000000000003e-06 2024-09-11T05:33:37.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.933 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.933 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431209+0000", 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6210000000000003e-06 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454156+0000", 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022946785000000001 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454162+0000", 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1990000000000003e-06 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.934 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.935 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.935 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.935 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46401 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.935 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431214+0000", 2024-09-11T05:33:37.935 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444649775, 2024-09-11T05:33:37.935 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022973299999999999, 2024-09-11T05:33:37.935 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.935 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.935 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.935 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.935 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.936 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.936 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46401 2024-09-11T05:33:37.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.936 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.936 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.936 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.936 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431214+0000", 2024-09-11T05:33:37.936 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.936 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.936 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.936 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431214+0000", 2024-09-11T05:33:37.936 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.937 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.937 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.937 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431215+0000", 2024-09-11T05:33:37.937 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.03e-07 2024-09-11T05:33:37.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.937 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.937 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.937 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431217+0000", 2024-09-11T05:33:37.937 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.866e-06 2024-09-11T05:33:37.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.937 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431222+0000", 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7749999999999998e-06 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431227+0000", 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0039999999999999e-06 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454180+0000", 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022952337 2024-09-11T05:33:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454188+0000", 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9149999999999996e-06 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46402 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431233+0000", 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444630976999999, 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022970022999999999, 2024-09-11T05:33:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46402 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431233+0000", 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.941 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.941 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431233+0000", 2024-09-11T05:33:37.941 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.941 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.941 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.941 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431234+0000", 2024-09-11T05:33:37.941 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:33:37.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.941 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.941 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.941 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431235+0000", 2024-09-11T05:33:37.941 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.813e-06 2024-09-11T05:33:37.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.942 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.942 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.942 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431241+0000", 2024-09-11T05:33:37.942 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4399999999999996e-06 2024-09-11T05:33:37.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.942 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.942 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.942 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431245+0000", 2024-09-11T05:33:37.942 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:33:37.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.942 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454198+0000", 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022952381000000001 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454203+0000", 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.48e-06 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46403 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431251+0000", 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444613228, 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022983025000000001, 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46403 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.944 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431251+0000", 2024-09-11T05:33:37.945 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.945 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.945 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431251+0000", 2024-09-11T05:33:37.945 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.945 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.945 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431251+0000", 2024-09-11T05:33:37.945 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:33:37.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.946 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.946 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431257+0000", 2024-09-11T05:33:37.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.643e-06 2024-09-11T05:33:37.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.946 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.946 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.946 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431264+0000", 2024-09-11T05:33:37.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2010000000000002e-06 2024-09-11T05:33:37.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.946 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.946 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.946 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431270+0000", 2024-09-11T05:33:37.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:33:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454225+0000", 2024-09-11T05:33:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022955350999999999 2024-09-11T05:33:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454234+0000", 2024-09-11T05:33:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7679999999999997e-06 2024-09-11T05:33:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.948 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.948 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.948 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46404 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.948 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431282+0000", 2024-09-11T05:33:37.948 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444582556, 2024-09-11T05:33:37.948 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022967751000000002, 2024-09-11T05:33:37.948 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.948 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.948 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.948 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.948 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.948 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.948 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46404 2024-09-11T05:33:37.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.949 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.949 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.949 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.949 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431282+0000", 2024-09-11T05:33:37.949 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.949 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.949 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.949 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431282+0000", 2024-09-11T05:33:37.949 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.949 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.950 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.950 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431282+0000", 2024-09-11T05:33:37.950 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000003e-07 2024-09-11T05:33:37.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.950 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.950 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.950 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431284+0000", 2024-09-11T05:33:37.950 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0640000000000001e-06 2024-09-11T05:33:37.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.950 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.950 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.950 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431290+0000", 2024-09-11T05:33:37.950 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1149999999999999e-06 2024-09-11T05:33:37.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.951 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.951 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.951 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431295+0000", 2024-09-11T05:33:37.951 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.651e-06 2024-09-11T05:33:37.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.951 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.951 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.951 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454245+0000", 2024-09-11T05:33:37.951 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.02295003 2024-09-11T05:33:37.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.951 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.951 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.952 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454249+0000", 2024-09-11T05:33:37.952 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3170000000000003e-06 2024-09-11T05:33:37.952 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.952 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.952 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.952 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.952 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46447 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.952 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431301+0000", 2024-09-11T05:33:37.952 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444562952, 2024-09-11T05:33:37.952 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022973720999999999, 2024-09-11T05:33:37.952 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.953 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.953 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.953 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.953 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.953 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.953 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46447 2024-09-11T05:33:37.953 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.953 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.953 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.953 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.953 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431301+0000", 2024-09-11T05:33:37.953 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.954 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.954 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.954 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431301+0000", 2024-09-11T05:33:37.954 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.954 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.954 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.954 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431302+0000", 2024-09-11T05:33:37.954 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6899999999999998e-07 2024-09-11T05:33:37.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.954 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.954 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431304+0000", 2024-09-11T05:33:37.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.99e-06 2024-09-11T05:33:37.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.955 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.955 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431309+0000", 2024-09-11T05:33:37.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7169999999999996e-06 2024-09-11T05:33:37.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.955 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.955 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431314+0000", 2024-09-11T05:33:37.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000003e-06 2024-09-11T05:33:37.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454266+0000", 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022952426000000001 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454275+0000", 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8189999999999998e-06 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.956 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46448 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431319+0000", 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444545105, 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022969360000000001, 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46448 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.957 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431319+0000", 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431319+0000", 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431319+0000", 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.958 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.959 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431321+0000", 2024-09-11T05:33:37.959 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6810000000000001e-06 2024-09-11T05:33:37.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.959 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.959 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431327+0000", 2024-09-11T05:33:37.959 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7459999999999997e-06 2024-09-11T05:33:37.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.959 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.959 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431331+0000", 2024-09-11T05:33:37.959 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5210000000000004e-06 2024-09-11T05:33:37.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.960 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.960 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.960 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454285+0000", 2024-09-11T05:33:37.960 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022953431 2024-09-11T05:33:37.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.960 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.960 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.960 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454288+0000", 2024-09-11T05:33:37.960 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:33:37.960 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.960 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.960 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.961 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.961 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:46449 3.6 3.9c0a0c6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:37.961 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.431337+0000", 2024-09-11T05:33:37.961 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.444527213000001, 2024-09-11T05:33:37.961 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022974029999999999, 2024-09-11T05:33:37.961 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:37.961 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:37.961 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:33:37.961 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:37.961 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:37.961 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:37.961 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 46449 2024-09-11T05:33:37.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431337+0000", 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431337+0000", 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431337+0000", 2024-09-11T05:33:37.962 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431339+0000", 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.793e-06 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431345+0000", 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.541e-06 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.431349+0000", 2024-09-11T05:33:37.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3270000000000002e-06 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454302+0000", 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.022953106000000001 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.454311+0000", 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9090000000000006e-06 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.964 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:37.965 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:37.965 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:37.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:37.967 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:37.966+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:38.067 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:38.066+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:38.112 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99101 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108261+0000", 2024-09-11T05:33:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00051283500000000001, 2024-09-11T05:33:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054275799999999996, 2024-09-11T05:33:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99101 2024-09-11T05:33:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108261+0000", 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108261+0000", 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108261+0000", 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9299999999999999e-07 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108263+0000", 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8920000000000001e-06 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108269+0000", 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.874e-06 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108274+0000", 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9919999999999998e-06 2024-09-11T05:33:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99102 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108279+0000", 2024-09-11T05:33:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000494518, 2024-09-11T05:33:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000591148, 2024-09-11T05:33:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99102 2024-09-11T05:33:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108279+0000", 2024-09-11T05:33:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108279+0000", 2024-09-11T05:33:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108280+0000", 2024-09-11T05:33:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:33:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108282+0000", 2024-09-11T05:33:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7940000000000001e-06 2024-09-11T05:33:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108287+0000", 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7780000000000004e-06 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108292+0000", 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.899e-06 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99103 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108298+0000", 2024-09-11T05:33:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00047576600000000003, 2024-09-11T05:33:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062870700000000005, 2024-09-11T05:33:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99103 2024-09-11T05:33:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108298+0000", 2024-09-11T05:33:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108298+0000", 2024-09-11T05:33:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108299+0000", 2024-09-11T05:33:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:33:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108301+0000", 2024-09-11T05:33:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0099999999999998e-06 2024-09-11T05:33:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108308+0000", 2024-09-11T05:33:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4150000000000002e-06 2024-09-11T05:33:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108313+0000", 2024-09-11T05:33:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7149999999999997e-06 2024-09-11T05:33:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99104 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108319+0000", 2024-09-11T05:33:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00045446499999999998, 2024-09-11T05:33:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066536899999999996, 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99104 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108319+0000", 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108319+0000", 2024-09-11T05:33:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108320+0000", 2024-09-11T05:33:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T05:33:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108322+0000", 2024-09-11T05:33:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1720000000000001e-06 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108329+0000", 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5169999999999996e-06 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108333+0000", 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7890000000000002e-06 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99105 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108354+0000", 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00042035500000000002, 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00068498099999999998, 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99105 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108354+0000", 2024-09-11T05:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108354+0000", 2024-09-11T05:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108354+0000", 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0100000000000004e-07 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108361+0000", 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1060000000000002e-06 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108371+0000", 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.007e-05 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108379+0000", 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1280000000000002e-06 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99106 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108399+0000", 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00037467499999999999, 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069483999999999995, 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99106 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108399+0000", 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108399+0000", 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108400+0000", 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108402+0000", 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108411+0000", 2024-09-11T05:33:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6389999999999998e-06 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108417+0000", 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5659999999999997e-06 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99107 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108424+0000", 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000349649, 2024-09-11T05:33:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072141299999999996, 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99107 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108424+0000", 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108424+0000", 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108425+0000", 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108427+0000", 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0660000000000002e-06 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108435+0000", 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0870000000000007e-06 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108440+0000", 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99108 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108447+0000", 2024-09-11T05:33:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00032720699999999999, 2024-09-11T05:33:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075286000000000005, 2024-09-11T05:33:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99108 2024-09-11T05:33:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108447+0000", 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108447+0000", 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108447+0000", 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108449+0000", 2024-09-11T05:33:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.294e-06 2024-09-11T05:33:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108457+0000", 2024-09-11T05:33:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6979999999999998e-06 2024-09-11T05:33:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108462+0000", 2024-09-11T05:33:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2490000000000001e-06 2024-09-11T05:33:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99109 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108469+0000", 2024-09-11T05:33:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00030519899999999998, 2024-09-11T05:33:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078726399999999998, 2024-09-11T05:33:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99109 2024-09-11T05:33:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108469+0000", 2024-09-11T05:33:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108469+0000", 2024-09-11T05:33:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108469+0000", 2024-09-11T05:33:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T05:33:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108471+0000", 2024-09-11T05:33:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1110000000000002e-06 2024-09-11T05:33:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108479+0000", 2024-09-11T05:33:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7500000000000003e-06 2024-09-11T05:33:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108484+0000", 2024-09-11T05:33:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0939999999999998e-06 2024-09-11T05:33:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99110 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108490+0000", 2024-09-11T05:33:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00028352299999999999, 2024-09-11T05:33:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000820352, 2024-09-11T05:33:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99110 2024-09-11T05:33:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108490+0000", 2024-09-11T05:33:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108490+0000", 2024-09-11T05:33:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108491+0000", 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1899999999999998e-07 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108493+0000", 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1349999999999999e-06 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108501+0000", 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7510000000000008e-06 2024-09-11T05:33:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108506+0000", 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0239999999999997e-06 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99111 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108512+0000", 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00026175200000000002, 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085204300000000003, 2024-09-11T05:33:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99111 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108512+0000", 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108512+0000", 2024-09-11T05:33:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108513+0000", 2024-09-11T05:33:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:33:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108514+0000", 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.95e-06 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108523+0000", 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1149999999999994e-06 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108528+0000", 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99112 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108534+0000", 2024-09-11T05:33:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000239485, 2024-09-11T05:33:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088431200000000005, 2024-09-11T05:33:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99112 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108534+0000", 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108534+0000", 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108535+0000", 2024-09-11T05:33:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T05:33:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108537+0000", 2024-09-11T05:33:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9759999999999998e-06 2024-09-11T05:33:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108545+0000", 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7950000000000008e-06 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108550+0000", 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9439999999999996e-06 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99113 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108556+0000", 2024-09-11T05:33:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00021774899999999999, 2024-09-11T05:33:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00091538100000000005, 2024-09-11T05:33:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99113 2024-09-11T05:33:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108556+0000", 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108556+0000", 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108557+0000", 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5900000000000002e-07 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108559+0000", 2024-09-11T05:33:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079999999999999e-06 2024-09-11T05:33:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108567+0000", 2024-09-11T05:33:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.208e-06 2024-09-11T05:33:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108573+0000", 2024-09-11T05:33:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:33:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99114 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108587+0000", 2024-09-11T05:33:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000187095, 2024-09-11T05:33:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093738299999999997, 2024-09-11T05:33:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99114 2024-09-11T05:33:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108587+0000", 2024-09-11T05:33:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108587+0000", 2024-09-11T05:33:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108587+0000", 2024-09-11T05:33:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T05:33:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108589+0000", 2024-09-11T05:33:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.215e-06 2024-09-11T05:33:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108597+0000", 2024-09-11T05:33:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9640000000000003e-06 2024-09-11T05:33:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108603+0000", 2024-09-11T05:33:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4859999999999997e-06 2024-09-11T05:33:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99115 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108611+0000", 2024-09-11T05:33:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00016333999999999999, 2024-09-11T05:33:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000966547, 2024-09-11T05:33:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99115 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108611+0000", 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108611+0000", 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108611+0000", 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3599999999999999e-07 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108613+0000", 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3939999999999999e-06 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108621+0000", 2024-09-11T05:33:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9990000000000008e-06 2024-09-11T05:33:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108627+0000", 2024-09-11T05:33:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2190000000000003e-06 2024-09-11T05:33:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99116 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108633+0000", 2024-09-11T05:33:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00014109699999999999, 2024-09-11T05:33:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099739100000000003, 2024-09-11T05:33:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99116 2024-09-11T05:33:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108633+0000", 2024-09-11T05:33:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108633+0000", 2024-09-11T05:33:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108633+0000", 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.32e-07 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108635+0000", 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0789999999999999e-06 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108643+0000", 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9049999999999997e-06 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108648+0000", 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2349999999999999e-06 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99117 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108655+0000", 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000119282, 2024-09-11T05:33:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010281999999999999, 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99117 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108655+0000", 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108655+0000", 2024-09-11T05:33:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108655+0000", 2024-09-11T05:33:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5499999999999999e-07 2024-09-11T05:33:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108661+0000", 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999998e-06 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108669+0000", 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8310000000000001e-06 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108681+0000", 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.218e-05 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99086 3.1d 3:b8039504:::rbd_data.112df73e5671.0000000000000000:1a [read 8259584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.107904+0000", 2024-09-11T05:33:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00087000700000000001, 2024-09-11T05:33:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018441410000000001, 2024-09-11T05:33:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99086 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107904+0000", 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107904+0000", 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107905+0000", 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1299999999999999e-07 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107909+0000", 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2690000000000001e-06 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107918+0000", 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5629999999999998e-06 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107924+0000", 2024-09-11T05:33:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8690000000000001e-06 2024-09-11T05:33:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.109562+0000", 2024-09-11T05:33:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001638146 2024-09-11T05:33:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.109645+0000", 2024-09-11T05:33:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460999999999995e-05 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.109756+0000", 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99118 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108689+0000", 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5184000000000003e-05, 2024-09-11T05:33:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011337789999999999, 2024-09-11T05:33:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99118 2024-09-11T05:33:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108689+0000", 2024-09-11T05:33:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108689+0000", 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108689+0000", 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108691+0000", 2024-09-11T05:33:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2290000000000002e-06 2024-09-11T05:33:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108699+0000", 2024-09-11T05:33:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0260000000000007e-06 2024-09-11T05:33:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108705+0000", 2024-09-11T05:33:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2290000000000002e-06 2024-09-11T05:33:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99087 3.1d 3:b8039504:::rbd_data.112df73e5671.0000000000000000:1a [read 8284160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.107932+0000", 2024-09-11T05:33:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00084167699999999999, 2024-09-11T05:33:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019526439999999999, 2024-09-11T05:33:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99087 2024-09-11T05:33:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107932+0000", 2024-09-11T05:33:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107932+0000", 2024-09-11T05:33:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107933+0000", 2024-09-11T05:33:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-07 2024-09-11T05:33:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107935+0000", 2024-09-11T05:33:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4140000000000001e-06 2024-09-11T05:33:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107942+0000", 2024-09-11T05:33:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0199999999999997e-06 2024-09-11T05:33:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107947+0000", 2024-09-11T05:33:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000002e-06 2024-09-11T05:33:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.109792+0000", 2024-09-11T05:33:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018448399999999999 2024-09-11T05:33:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.109883+0000", 2024-09-11T05:33:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0696e-05 2024-09-11T05:33:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99119 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108711+0000", 2024-09-11T05:33:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.2466999999999997e-05, 2024-09-11T05:33:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001238956, 2024-09-11T05:33:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99119 2024-09-11T05:33:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108711+0000", 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108711+0000", 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108712+0000", 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4799999999999999e-07 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108714+0000", 2024-09-11T05:33:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9939999999999999e-06 2024-09-11T05:33:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108721+0000", 2024-09-11T05:33:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2060000000000001e-06 2024-09-11T05:33:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108726+0000", 2024-09-11T05:33:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9239999999999998e-06 2024-09-11T05:33:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99088 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.107965+0000", 2024-09-11T05:33:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00080887400000000001, 2024-09-11T05:33:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020414000000000001, 2024-09-11T05:33:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99088 2024-09-11T05:33:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107965+0000", 2024-09-11T05:33:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107965+0000", 2024-09-11T05:33:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107966+0000", 2024-09-11T05:33:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9599999999999999e-07 2024-09-11T05:33:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107968+0000", 2024-09-11T05:33:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.424e-06 2024-09-11T05:33:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107975+0000", 2024-09-11T05:33:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2049999999999996e-06 2024-09-11T05:33:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107981+0000", 2024-09-11T05:33:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3639999999999998e-06 2024-09-11T05:33:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.110012+0000", 2024-09-11T05:33:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020317920000000001 2024-09-11T05:33:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99120 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108736+0000", 2024-09-11T05:33:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7715000000000001e-05, 2024-09-11T05:33:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001334067, 2024-09-11T05:33:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99120 2024-09-11T05:33:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108736+0000", 2024-09-11T05:33:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108736+0000", 2024-09-11T05:33:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108737+0000", 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6400000000000003e-07 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108739+0000", 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.294e-06 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108749+0000", 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8120000000000002e-06 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108754+0000", 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.254e-06 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99089 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.107989+0000", 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00078502599999999997, 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002136542, 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99089 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107989+0000", 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107989+0000", 2024-09-11T05:33:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107989+0000", 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4300000000000003e-07 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107992+0000", 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1900000000000002e-06 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.107998+0000", 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4749999999999998e-06 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108003+0000", 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7530000000000001e-06 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99121 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108761+0000", 2024-09-11T05:33:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.3200000000000001e-05, 2024-09-11T05:33:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001419535, 2024-09-11T05:33:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99121 2024-09-11T05:33:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108761+0000", 2024-09-11T05:33:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108761+0000", 2024-09-11T05:33:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108761+0000", 2024-09-11T05:33:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:33:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108763+0000", 2024-09-11T05:33:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8080000000000001e-06 2024-09-11T05:33:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108769+0000", 2024-09-11T05:33:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.365e-06 2024-09-11T05:33:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108774+0000", 2024-09-11T05:33:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9150000000000004e-06 2024-09-11T05:33:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99090 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108009+0000", 2024-09-11T05:33:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00076478799999999997, 2024-09-11T05:33:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022252090000000001, 2024-09-11T05:33:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99090 2024-09-11T05:33:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108009+0000", 2024-09-11T05:33:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108009+0000", 2024-09-11T05:33:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108010+0000", 2024-09-11T05:33:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:33:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108012+0000", 2024-09-11T05:33:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-11T05:33:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108024+0000", 2024-09-11T05:33:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2122e-05 2024-09-11T05:33:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108029+0000", 2024-09-11T05:33:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.49e-06 2024-09-11T05:33:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99122 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108780+0000", 2024-09-11T05:33:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999938, 2024-09-11T05:33:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015103499999999999, 2024-09-11T05:33:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99122 2024-09-11T05:33:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108780+0000", 2024-09-11T05:33:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108780+0000", 2024-09-11T05:33:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108781+0000", 2024-09-11T05:33:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9699999999999996e-07 2024-09-11T05:33:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108783+0000", 2024-09-11T05:33:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0559999999999999e-06 2024-09-11T05:33:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108789+0000", 2024-09-11T05:33:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.302e-06 2024-09-11T05:33:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108794+0000", 2024-09-11T05:33:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1429999999999997e-06 2024-09-11T05:33:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99091 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108036+0000", 2024-09-11T05:33:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00073778500000000002, 2024-09-11T05:33:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023154730000000002, 2024-09-11T05:33:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99091 2024-09-11T05:33:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108036+0000", 2024-09-11T05:33:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108036+0000", 2024-09-11T05:33:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108037+0000", 2024-09-11T05:33:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T05:33:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108039+0000", 2024-09-11T05:33:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2290000000000002e-06 2024-09-11T05:33:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108045+0000", 2024-09-11T05:33:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4520000000000002e-06 2024-09-11T05:33:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108050+0000", 2024-09-11T05:33:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9579999999999998e-06 2024-09-11T05:33:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99123 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108809+0000", 2024-09-11T05:33:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999652, 2024-09-11T05:33:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00160027, 2024-09-11T05:33:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99123 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108809+0000", 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108809+0000", 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108809+0000", 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.75e-07 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108811+0000", 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2639999999999998e-06 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108818+0000", 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8260000000000004e-06 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108824+0000", 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4260000000000002e-06 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99092 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108056+0000", 2024-09-11T05:33:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00071746099999999997, 2024-09-11T05:33:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002410152, 2024-09-11T05:33:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99092 2024-09-11T05:33:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108056+0000", 2024-09-11T05:33:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108056+0000", 2024-09-11T05:33:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108057+0000", 2024-09-11T05:33:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T05:33:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108059+0000", 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.092e-06 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108065+0000", 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3720000000000001e-06 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108070+0000", 2024-09-11T05:33:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9080000000000003e-06 2024-09-11T05:33:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99093 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108078+0000", 2024-09-11T05:33:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00069586699999999997, 2024-09-11T05:33:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024435749999999999, 2024-09-11T05:33:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99093 2024-09-11T05:33:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108078+0000", 2024-09-11T05:33:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108078+0000", 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108078+0000", 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000002e-07 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108098+0000", 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9069999999999999e-05 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108106+0000", 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8969999999999997e-06 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108112+0000", 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3619999999999997e-06 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99094 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108120+0000", 2024-09-11T05:33:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00065415099999999995, 2024-09-11T05:33:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024564890000000001, 2024-09-11T05:33:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99094 2024-09-11T05:33:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108120+0000", 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108120+0000", 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108120+0000", 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6100000000000001e-07 2024-09-11T05:33:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108122+0000", 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2369999999999999e-06 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108130+0000", 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108134+0000", 2024-09-11T05:33:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7010000000000004e-06 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99095 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108140+0000", 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00063393900000000003, 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002496177, 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99095 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108140+0000", 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108140+0000", 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108140+0000", 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6600000000000002e-07 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108142+0000", 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9130000000000001e-06 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108149+0000", 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9859999999999997e-06 2024-09-11T05:33:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108154+0000", 2024-09-11T05:33:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6229999999999996e-06 2024-09-11T05:33:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99096 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108159+0000", 2024-09-11T05:33:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00061456, 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025312170000000001, 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99096 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108159+0000", 2024-09-11T05:33:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108159+0000", 2024-09-11T05:33:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108160+0000", 2024-09-11T05:33:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:33:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108162+0000", 2024-09-11T05:33:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.097e-06 2024-09-11T05:33:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108170+0000", 2024-09-11T05:33:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5269999999999998e-06 2024-09-11T05:33:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108175+0000", 2024-09-11T05:33:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9089999999999999e-06 2024-09-11T05:33:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99097 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108182+0000", 2024-09-11T05:33:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00059192299999999995, 2024-09-11T05:33:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002603855, 2024-09-11T05:33:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99097 2024-09-11T05:33:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108182+0000", 2024-09-11T05:33:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108182+0000", 2024-09-11T05:33:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108182+0000", 2024-09-11T05:33:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:33:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108185+0000", 2024-09-11T05:33:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1270000000000001e-06 2024-09-11T05:33:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108192+0000", 2024-09-11T05:33:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6550000000000004e-06 2024-09-11T05:33:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108197+0000", 2024-09-11T05:33:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8489999999999997e-06 2024-09-11T05:33:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99098 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108203+0000", 2024-09-11T05:33:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00057066400000000002, 2024-09-11T05:33:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026430379999999999, 2024-09-11T05:33:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99098 2024-09-11T05:33:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108203+0000", 2024-09-11T05:33:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108203+0000", 2024-09-11T05:33:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108204+0000", 2024-09-11T05:33:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0400000000000002e-07 2024-09-11T05:33:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108206+0000", 2024-09-11T05:33:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9939999999999999e-06 2024-09-11T05:33:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108213+0000", 2024-09-11T05:33:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6650000000000003e-06 2024-09-11T05:33:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108218+0000", 2024-09-11T05:33:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9350000000000002e-06 2024-09-11T05:33:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99099 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108224+0000", 2024-09-11T05:33:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00054953300000000005, 2024-09-11T05:33:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026810800000000002, 2024-09-11T05:33:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99099 2024-09-11T05:33:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108224+0000", 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108224+0000", 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108225+0000", 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108227+0000", 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9240000000000001e-06 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108233+0000", 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0360000000000003e-06 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108237+0000", 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6929999999999998e-06 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:99100 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-11T05:33:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.108243+0000", 2024-09-11T05:33:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00053130099999999997, 2024-09-11T05:33:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027140739999999999, 2024-09-11T05:33:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99100 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108243+0000", 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108243+0000", 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108243+0000", 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108245+0000", 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.812e-06 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108251+0000", 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9139999999999996e-06 2024-09-11T05:33:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.108256+0000", 2024-09-11T05:33:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0769999999999998e-06 2024-09-11T05:33:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 38 2024-09-11T05:33:38.251 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:38.253 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:38.253 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:38.252+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:38.264 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-11T05:33:38.263+0000 7fc03b8fe640 -1 mon.a@0(leader).osd e56 definitely_dead 0 2024-09-11T05:33:38.353 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:38.353+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:38.414 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:38.414 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:38.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:38.467 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:38.467+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:38.555 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:38.554+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:38.636 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15742 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 483328~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.385774699999999, 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022975045999999999, 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15742 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248351+0000", 2024-09-11T05:33:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248353+0000", 2024-09-11T05:33:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.615e-06 2024-09-11T05:33:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248356+0000", 2024-09-11T05:33:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.641e-06 2024-09-11T05:33:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248360+0000", 2024-09-11T05:33:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:33:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271209+0000", 2024-09-11T05:33:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022848825999999999 2024-09-11T05:33:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271264+0000", 2024-09-11T05:33:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5170999999999997e-05 2024-09-11T05:33:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271326+0000", 2024-09-11T05:33:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1389000000000005e-05 2024-09-11T05:33:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15743 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 532480~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.385759151999999, 2024-09-11T05:33:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023116772000000001, 2024-09-11T05:33:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15743 2024-09-11T05:33:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248366+0000", 2024-09-11T05:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248808+0000", 2024-09-11T05:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044169199999999999 2024-09-11T05:33:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248812+0000", 2024-09-11T05:33:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6969999999999999e-06 2024-09-11T05:33:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248819+0000", 2024-09-11T05:33:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6790000000000005e-06 2024-09-11T05:33:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248826+0000", 2024-09-11T05:33:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5509999999999996e-06 2024-09-11T05:33:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271362+0000", 2024-09-11T05:33:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022536348000000001 2024-09-11T05:33:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271413+0000", 2024-09-11T05:33:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0810000000000003e-05 2024-09-11T05:33:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271483+0000", 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9994999999999996e-05 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15746 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 679936~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.385229833, 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022995304000000001, 2024-09-11T05:33:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15746 2024-09-11T05:33:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248896+0000", 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248898+0000", 2024-09-11T05:33:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1749999999999999e-06 2024-09-11T05:33:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248904+0000", 2024-09-11T05:33:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5759999999999996e-06 2024-09-11T05:33:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248909+0000", 2024-09-11T05:33:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9710000000000003e-06 2024-09-11T05:33:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271775+0000", 2024-09-11T05:33:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022866721 2024-09-11T05:33:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271833+0000", 2024-09-11T05:33:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7132000000000001e-05 2024-09-11T05:33:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271891+0000", 2024-09-11T05:33:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8303000000000001e-05 2024-09-11T05:33:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15747 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 729088~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.385211293000001, 2024-09-11T05:33:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023120391000000001, 2024-09-11T05:33:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15747 2024-09-11T05:33:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248914+0000", 2024-09-11T05:33:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:33:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248916+0000", 2024-09-11T05:33:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4270000000000001e-06 2024-09-11T05:33:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248919+0000", 2024-09-11T05:33:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.366e-06 2024-09-11T05:33:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248922+0000", 2024-09-11T05:33:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6790000000000001e-06 2024-09-11T05:33:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271914+0000", 2024-09-11T05:33:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022992584999999999 2024-09-11T05:33:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.271965+0000", 2024-09-11T05:33:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1008999999999999e-05 2024-09-11T05:33:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272034+0000", 2024-09-11T05:33:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8980999999999996e-05 2024-09-11T05:33:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:15748 3.3 3:c795571a:::rbd_data.112d745a9e91.000000000000002b:a [read 778240~8192] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.385200337000001, 2024-09-11T05:33:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023325197999999998, 2024-09-11T05:33:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15748 2024-09-11T05:33:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248925+0000", 2024-09-11T05:33:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-07 2024-09-11T05:33:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248926+0000", 2024-09-11T05:33:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.077e-06 2024-09-11T05:33:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248930+0000", 2024-09-11T05:33:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5920000000000001e-06 2024-09-11T05:33:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.248933+0000", 2024-09-11T05:33:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7760000000000002e-06 2024-09-11T05:33:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272074+0000", 2024-09-11T05:33:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023141656 2024-09-11T05:33:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272153+0000", 2024-09-11T05:33:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8566999999999995e-05 2024-09-11T05:33:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.272250+0000", 2024-09-11T05:33:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7217000000000001e-05 2024-09-11T05:33:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16376 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 925696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.339936417000001, 2024-09-11T05:33:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023022233999999999, 2024-09-11T05:33:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16376 2024-09-11T05:33:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294189+0000", 2024-09-11T05:33:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:33:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294191+0000", 2024-09-11T05:33:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1169999999999998e-06 2024-09-11T05:33:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294198+0000", 2024-09-11T05:33:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.105e-06 2024-09-11T05:33:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294202+0000", 2024-09-11T05:33:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3490000000000002e-06 2024-09-11T05:33:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317070+0000", 2024-09-11T05:33:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022868169000000001 2024-09-11T05:33:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317141+0000", 2024-09-11T05:33:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0947999999999999e-05 2024-09-11T05:33:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317211+0000", 2024-09-11T05:33:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0154999999999995e-05 2024-09-11T05:33:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16377 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 974848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.339917994, 2024-09-11T05:33:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023184939000000002, 2024-09-11T05:33:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16377 2024-09-11T05:33:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294207+0000", 2024-09-11T05:33:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294208+0000", 2024-09-11T05:33:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5600000000000001e-07 2024-09-11T05:33:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294210+0000", 2024-09-11T05:33:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T05:33:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294215+0000", 2024-09-11T05:33:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7989999999999999e-06 2024-09-11T05:33:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294220+0000", 2024-09-11T05:33:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6580000000000001e-06 2024-09-11T05:33:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317241+0000", 2024-09-11T05:33:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023020987999999999 2024-09-11T05:33:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317315+0000", 2024-09-11T05:33:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3496000000000002e-05 2024-09-11T05:33:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317392+0000", 2024-09-11T05:33:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7720999999999997e-05 2024-09-11T05:33:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16378 3.15 3:a8a0e255:::rbd_data.112d745a9e91.000000000000001f:a [read 1024000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.339900049000001, 2024-09-11T05:33:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023298976999999998, 2024-09-11T05:33:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16378 2024-09-11T05:33:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294225+0000", 2024-09-11T05:33:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294226+0000", 2024-09-11T05:33:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T05:33:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294228+0000", 2024-09-11T05:33:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-06 2024-09-11T05:33:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294234+0000", 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1399999999999997e-06 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294239+0000", 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9289999999999997e-06 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317420+0000", 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023181499000000001 2024-09-11T05:33:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317478+0000", 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7608999999999997e-05 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317524+0000", 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6378999999999998e-05 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16400 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 532480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.339779590999999, 2024-09-11T05:33:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022889597000000001, 2024-09-11T05:33:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16400 2024-09-11T05:33:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294346+0000", 2024-09-11T05:33:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7e-07 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294348+0000", 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294354+0000", 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9880000000000001e-06 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294359+0000", 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1580000000000004e-06 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317080+0000", 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022720884 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317162+0000", 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1432000000000002e-05 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317235+0000", 2024-09-11T05:33:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3705e-05 2024-09-11T05:33:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16401 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 581632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.339759959999999, 2024-09-11T05:33:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02302893, 2024-09-11T05:33:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16401 2024-09-11T05:33:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294365+0000", 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294366+0000", 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5499999999999998e-07 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294368+0000", 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294374+0000", 2024-09-11T05:33:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1720000000000004e-06 2024-09-11T05:33:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294379+0000", 2024-09-11T05:33:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9089999999999999e-06 2024-09-11T05:33:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317261+0000", 2024-09-11T05:33:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022882442999999999 2024-09-11T05:33:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317322+0000", 2024-09-11T05:33:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0145000000000001e-05 2024-09-11T05:33:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317394+0000", 2024-09-11T05:33:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2756000000000006e-05 2024-09-11T05:33:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16402 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 630784~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.339740564, 2024-09-11T05:33:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023196998, 2024-09-11T05:33:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16402 2024-09-11T05:33:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294385+0000", 2024-09-11T05:33:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0900000000000002e-07 2024-09-11T05:33:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294387+0000", 2024-09-11T05:33:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9139999999999998e-06 2024-09-11T05:33:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294393+0000", 2024-09-11T05:33:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T05:33:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294398+0000", 2024-09-11T05:33:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T05:33:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317424+0000", 2024-09-11T05:33:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023026042 2024-09-11T05:33:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317489+0000", 2024-09-11T05:33:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5488999999999996e-05 2024-09-11T05:33:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317582+0000", 2024-09-11T05:33:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2658000000000006e-05 2024-09-11T05:33:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16403 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 679936~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.339721502, 2024-09-11T05:33:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023338022999999999, 2024-09-11T05:33:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16403 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294404+0000", 2024-09-11T05:33:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T05:33:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294406+0000", 2024-09-11T05:33:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.902e-06 2024-09-11T05:33:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294413+0000", 2024-09-11T05:33:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3450000000000002e-06 2024-09-11T05:33:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294417+0000", 2024-09-11T05:33:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9599999999999999e-06 2024-09-11T05:33:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317608+0000", 2024-09-11T05:33:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023190137 2024-09-11T05:33:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317666+0000", 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317742+0000", 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6247000000000004e-05 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16404 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 729088~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.33970214, 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023640379, 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16404 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294423+0000", 2024-09-11T05:33:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294424+0000", 2024-09-11T05:33:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:33:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294426+0000", 2024-09-11T05:33:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0420000000000001e-06 2024-09-11T05:33:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294432+0000", 2024-09-11T05:33:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8810000000000001e-06 2024-09-11T05:33:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294436+0000", 2024-09-11T05:33:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9529999999999998e-06 2024-09-11T05:33:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317770+0000", 2024-09-11T05:33:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023333513 2024-09-11T05:33:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.317900+0000", 2024-09-11T05:33:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013032699999999999 2024-09-11T05:33:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318064+0000", 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016326900000000001 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16405 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 778240~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.339682696000001, 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023946875999999999, 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16405 2024-09-11T05:33:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294443+0000", 2024-09-11T05:33:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.15e-07 2024-09-11T05:33:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294445+0000", 2024-09-11T05:33:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.838e-06 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294451+0000", 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8279999999999999e-06 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294455+0000", 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-06 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318095+0000", 2024-09-11T05:33:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023639667999999999 2024-09-11T05:33:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318161+0000", 2024-09-11T05:33:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6305999999999998e-05 2024-09-11T05:33:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318390+0000", 2024-09-11T05:33:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000228481 2024-09-11T05:33:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16406 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 827392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.339664315, 2024-09-11T05:33:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024093394000000001, 2024-09-11T05:33:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16406 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294461+0000", 2024-09-11T05:33:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4999999999999998e-07 2024-09-11T05:33:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294463+0000", 2024-09-11T05:33:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.108e-06 2024-09-11T05:33:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294469+0000", 2024-09-11T05:33:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8359999999999997e-06 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294474+0000", 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3150000000000002e-06 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318421+0000", 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023947231999999999 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318492+0000", 2024-09-11T05:33:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1367999999999998e-05 2024-09-11T05:33:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318554+0000", 2024-09-11T05:33:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2185000000000002e-05 2024-09-11T05:33:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16407 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 876544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.339645473000001, 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024230683999999999, 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16407 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294480+0000", 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294482+0000", 2024-09-11T05:33:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0959999999999999e-06 2024-09-11T05:33:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294488+0000", 2024-09-11T05:33:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8549999999999998e-06 2024-09-11T05:33:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294492+0000", 2024-09-11T05:33:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2180000000000001e-06 2024-09-11T05:33:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318583+0000", 2024-09-11T05:33:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024090232 2024-09-11T05:33:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318648+0000", 2024-09-11T05:33:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5538999999999997e-05 2024-09-11T05:33:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318711+0000", 2024-09-11T05:33:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2366000000000006e-05 2024-09-11T05:33:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16408 3.1b 3:dfe6623d:::rbd_data.112d745a9e91.0000000000000021:a [read 925696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.339626485, 2024-09-11T05:33:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024377862, 2024-09-11T05:33:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16408 2024-09-11T05:33:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294499+0000", 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294502+0000", 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4420000000000001e-06 2024-09-11T05:33:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294508+0000", 2024-09-11T05:33:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1410000000000002e-06 2024-09-11T05:33:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294512+0000", 2024-09-11T05:33:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.605e-06 2024-09-11T05:33:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318738+0000", 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02422535 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318816+0000", 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7836999999999994e-05 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.318877+0000", 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1058999999999999e-05 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16409 3.1b 3.bc4667fb (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.339607425000001, 2024-09-11T05:33:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575657000000001, 2024-09-11T05:33:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16409 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294518+0000", 2024-09-11T05:33:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T05:33:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294520+0000", 2024-09-11T05:33:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9410000000000001e-06 2024-09-11T05:33:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294526+0000", 2024-09-11T05:33:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9649999999999996e-06 2024-09-11T05:33:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294531+0000", 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5600000000000004e-06 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319081+0000", 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024550249 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319094+0000", 2024-09-11T05:33:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2621e-05 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:16410 3.1b 3.bc4667fb (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.339589192999998, 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024587633000000001, 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16410 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294536+0000", 2024-09-11T05:33:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.15e-07 2024-09-11T05:33:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294544+0000", 2024-09-11T05:33:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6830000000000008e-06 2024-09-11T05:33:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294550+0000", 2024-09-11T05:33:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1489999999999999e-06 2024-09-11T05:33:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.294555+0000", 2024-09-11T05:33:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:33:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319117+0000", 2024-09-11T05:33:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024561862 2024-09-11T05:33:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:10.319124+0000", 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8539999999999999e-06 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:69653 3.1d 3:b986aa5d:::rbd_header.112d5d3265b9:head [watch ping cookie 140342620774048 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:33.706110+0000", 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9280154810000001, 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.085138077000000006, 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 69653 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706110+0000", 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706110+0000", 2024-09-11T05:33:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706111+0000", 2024-09-11T05:33:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1960000000000001e-06 2024-09-11T05:33:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706119+0000", 2024-09-11T05:33:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6669999999999996e-06 2024-09-11T05:33:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706134+0000", 2024-09-11T05:33:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4769e-05 2024-09-11T05:33:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706152+0000", 2024-09-11T05:33:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.842e-05 2024-09-11T05:33:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706272+0000", 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119907 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.706289+0000", 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7025999999999999e-05 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.791061+0000", 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.084772572000000004 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.791132+0000", 2024-09-11T05:33:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0322999999999997e-05 2024-09-11T05:33:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:33.791248+0000", 2024-09-11T05:33:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116197 2024-09-11T05:33:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.736 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:38.737 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:38.738 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:38.735+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:38.808 INFO:teuthology.orchestra.run.smithi070.stderr:marked out osd.3. 2024-09-11T05:33:38.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:33:38.876 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:38.876+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:38.895 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:38.895 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:38.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.895 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117888 3.19 3:9b261b3a:::rbd_data.112df73e5671.0000000000000003:1a [read 13594624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.895 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.892192+0000", 2024-09-11T05:33:38.895 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0010855159999999999, 2024-09-11T05:33:38.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011148690000000001, 2024-09-11T05:33:38.895 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:38.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.896 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117888 2024-09-11T05:33:38.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.896 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892192+0000", 2024-09-11T05:33:38.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892192+0000", 2024-09-11T05:33:38.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892192+0000", 2024-09-11T05:33:38.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000005e-07 2024-09-11T05:33:38.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892195+0000", 2024-09-11T05:33:38.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1339999999999998e-06 2024-09-11T05:33:38.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892200+0000", 2024-09-11T05:33:38.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8610000000000003e-06 2024-09-11T05:33:38.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892204+0000", 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.128e-06 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893259+0000", 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001055081 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893302+0000", 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2876000000000001e-05 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.899 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117889 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.892208+0000", 2024-09-11T05:33:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001069101, 2024-09-11T05:33:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001152962, 2024-09-11T05:33:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117889 2024-09-11T05:33:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892208+0000", 2024-09-11T05:33:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892208+0000", 2024-09-11T05:33:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892209+0000", 2024-09-11T05:33:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-07 2024-09-11T05:33:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892210+0000", 2024-09-11T05:33:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3209999999999999e-06 2024-09-11T05:33:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892218+0000", 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2889999999999998e-06 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892221+0000", 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9849999999999998e-06 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117890 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.904 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.892290+0000", 2024-09-11T05:33:38.904 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0009874739999999999, 2024-09-11T05:33:38.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011129099999999999, 2024-09-11T05:33:38.904 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117890 2024-09-11T05:33:38.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.904 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892290+0000", 2024-09-11T05:33:38.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892290+0000", 2024-09-11T05:33:38.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892291+0000", 2024-09-11T05:33:38.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6000000000000004e-07 2024-09-11T05:33:38.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892294+0000", 2024-09-11T05:33:38.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3210000000000001e-06 2024-09-11T05:33:38.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892303+0000", 2024-09-11T05:33:38.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8529999999999998e-06 2024-09-11T05:33:38.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892308+0000", 2024-09-11T05:33:38.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7250000000000002e-06 2024-09-11T05:33:38.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.907 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.907 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117891 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.907 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.892322+0000", 2024-09-11T05:33:38.907 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00095550400000000003, 2024-09-11T05:33:38.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011229580000000001, 2024-09-11T05:33:38.908 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.908 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117891 2024-09-11T05:33:38.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.908 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892322+0000", 2024-09-11T05:33:38.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892322+0000", 2024-09-11T05:33:38.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892322+0000", 2024-09-11T05:33:38.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T05:33:38.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892324+0000", 2024-09-11T05:33:38.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.795e-06 2024-09-11T05:33:38.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892328+0000", 2024-09-11T05:33:38.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1690000000000002e-06 2024-09-11T05:33:38.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892331+0000", 2024-09-11T05:33:38.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1920000000000001e-06 2024-09-11T05:33:38.911 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.911 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.911 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.911 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117892 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.911 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.892395+0000", 2024-09-11T05:33:38.911 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00088215099999999996, 2024-09-11T05:33:38.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010784740000000001, 2024-09-11T05:33:38.911 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.911 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.912 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.912 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117892 2024-09-11T05:33:38.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.912 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892395+0000", 2024-09-11T05:33:38.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892395+0000", 2024-09-11T05:33:38.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892396+0000", 2024-09-11T05:33:38.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:33:38.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892398+0000", 2024-09-11T05:33:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2409999999999998e-06 2024-09-11T05:33:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892405+0000", 2024-09-11T05:33:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2620000000000001e-06 2024-09-11T05:33:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892409+0000", 2024-09-11T05:33:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4259999999999999e-06 2024-09-11T05:33:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117893 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.892490+0000", 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00078795899999999997, 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010198239999999999, 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117893 2024-09-11T05:33:38.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.916 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892490+0000", 2024-09-11T05:33:38.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892490+0000", 2024-09-11T05:33:38.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892490+0000", 2024-09-11T05:33:38.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1999999999999999e-07 2024-09-11T05:33:38.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892494+0000", 2024-09-11T05:33:38.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4819999999999999e-06 2024-09-11T05:33:38.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892502+0000", 2024-09-11T05:33:38.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6629999999999999e-06 2024-09-11T05:33:38.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892507+0000", 2024-09-11T05:33:38.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0159999999999999e-06 2024-09-11T05:33:38.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.918 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117894 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.918 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.892520+0000", 2024-09-11T05:33:38.919 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00075791400000000005, 2024-09-11T05:33:38.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00104185, 2024-09-11T05:33:38.919 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.919 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117894 2024-09-11T05:33:38.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.919 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892520+0000", 2024-09-11T05:33:38.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892520+0000", 2024-09-11T05:33:38.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892520+0000", 2024-09-11T05:33:38.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2599999999999998e-07 2024-09-11T05:33:38.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892522+0000", 2024-09-11T05:33:38.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1569999999999998e-06 2024-09-11T05:33:38.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892526+0000", 2024-09-11T05:33:38.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0049999999999998e-06 2024-09-11T05:33:38.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892529+0000", 2024-09-11T05:33:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.836e-06 2024-09-11T05:33:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117895 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.892606+0000", 2024-09-11T05:33:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00067161900000000004, 2024-09-11T05:33:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098324400000000009, 2024-09-11T05:33:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117895 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892606+0000", 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892606+0000", 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892607+0000", 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0200000000000001e-07 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892609+0000", 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2230000000000001e-06 2024-09-11T05:33:38.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892615+0000", 2024-09-11T05:33:38.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2040000000000002e-06 2024-09-11T05:33:38.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892618+0000", 2024-09-11T05:33:38.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5099999999999999e-06 2024-09-11T05:33:38.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.925 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.926 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117896 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.926 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.892699+0000", 2024-09-11T05:33:38.926 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000578182, 2024-09-11T05:33:38.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00091761200000000005, 2024-09-11T05:33:38.926 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.926 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117896 2024-09-11T05:33:38.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892699+0000", 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892699+0000", 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892700+0000", 2024-09-11T05:33:38.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-11T05:33:38.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892702+0000", 2024-09-11T05:33:38.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3499999999999999e-06 2024-09-11T05:33:38.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892708+0000", 2024-09-11T05:33:38.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-11T05:33:38.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892711+0000", 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.495e-06 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117897 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.892785+0000", 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00049202800000000004, 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087128900000000003, 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117897 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892785+0000", 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892785+0000", 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892786+0000", 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4900000000000001e-07 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892788+0000", 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2560000000000001e-06 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892793+0000", 2024-09-11T05:33:38.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2190000000000003e-06 2024-09-11T05:33:38.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892797+0000", 2024-09-11T05:33:38.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5300000000000001e-06 2024-09-11T05:33:38.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.932 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.932 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117898 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.932 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.892885+0000", 2024-09-11T05:33:38.932 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00039211900000000002, 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00081156100000000003, 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117898 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892885+0000", 2024-09-11T05:33:38.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892885+0000", 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892886+0000", 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7800000000000001e-07 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892889+0000", 2024-09-11T05:33:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3340000000000002e-06 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892901+0000", 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1337e-05 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892905+0000", 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3109999999999999e-06 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.936 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117899 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.936 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.892918+0000", 2024-09-11T05:33:38.936 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00035993800000000002, 2024-09-11T05:33:38.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080869899999999996, 2024-09-11T05:33:38.936 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.936 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.936 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.936 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117899 2024-09-11T05:33:38.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.937 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892918+0000", 2024-09-11T05:33:38.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892918+0000", 2024-09-11T05:33:38.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892918+0000", 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892920+0000", 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.81e-06 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892924+0000", 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0380000000000001e-06 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.892927+0000", 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8370000000000001e-06 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117900 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.893066+0000", 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00021189099999999999, 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00068700800000000002, 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117900 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893066+0000", 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893066+0000", 2024-09-11T05:33:38.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893066+0000", 2024-09-11T05:33:38.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2399999999999997e-07 2024-09-11T05:33:38.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893069+0000", 2024-09-11T05:33:38.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9330000000000001e-06 2024-09-11T05:33:38.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893078+0000", 2024-09-11T05:33:38.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4330000000000004e-06 2024-09-11T05:33:38.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893083+0000", 2024-09-11T05:33:38.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4870000000000002e-06 2024-09-11T05:33:38.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.942 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117901 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.893112+0000", 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00016518500000000001, 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069943700000000002, 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117901 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893112+0000", 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893112+0000", 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893113+0000", 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3900000000000004e-07 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893117+0000", 2024-09-11T05:33:38.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5810000000000001e-06 2024-09-11T05:33:38.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893125+0000", 2024-09-11T05:33:38.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8799999999999997e-06 2024-09-11T05:33:38.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893131+0000", 2024-09-11T05:33:38.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3329999999999996e-06 2024-09-11T05:33:38.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.946 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.946 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117902 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.946 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.893150+0000", 2024-09-11T05:33:38.946 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000127069, 2024-09-11T05:33:38.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000700324, 2024-09-11T05:33:38.946 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.946 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.946 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.947 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.947 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.947 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117902 2024-09-11T05:33:38.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.947 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893150+0000", 2024-09-11T05:33:38.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893150+0000", 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893151+0000", 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8299999999999997e-07 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893154+0000", 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8320000000000002e-06 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893159+0000", 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0350000000000001e-06 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893162+0000", 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.151e-06 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117903 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.949 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.893324+0000", 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999528, 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058064800000000001, 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117903 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893324+0000", 2024-09-11T05:33:38.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893324+0000", 2024-09-11T05:33:38.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893325+0000", 2024-09-11T05:33:38.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4200000000000004e-07 2024-09-11T05:33:38.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893330+0000", 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8029999999999996e-06 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893340+0000", 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3880000000000006e-06 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893347+0000", 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0840000000000003e-06 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117904 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.893406+0000", 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9998713, 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053408000000000004, 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117904 2024-09-11T05:33:38.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893406+0000", 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893406+0000", 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893407+0000", 2024-09-11T05:33:38.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1999999999999998e-07 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893411+0000", 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-06 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893425+0000", 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3579e-05 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893433+0000", 2024-09-11T05:33:38.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6450000000000005e-06 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117905 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.893448+0000", 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9998293, 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053758500000000004, 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117905 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893448+0000", 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893448+0000", 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893449+0000", 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4199999999999996e-07 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893451+0000", 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.959e-06 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893460+0000", 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.867e-06 2024-09-11T05:33:38.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893466+0000", 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4569999999999996e-06 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117906 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.893547+0000", 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9997306, 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048953099999999997, 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.960 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.960 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117906 2024-09-11T05:33:38.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.960 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893547+0000", 2024-09-11T05:33:38.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893547+0000", 2024-09-11T05:33:38.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893548+0000", 2024-09-11T05:33:38.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0699999999999996e-07 2024-09-11T05:33:38.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893551+0000", 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5650000000000002e-06 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893561+0000", 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3489999999999998e-06 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893569+0000", 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4789999999999996e-06 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117907 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.893589+0000", 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9996881, 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049726499999999999, 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117907 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893589+0000", 2024-09-11T05:33:38.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893589+0000", 2024-09-11T05:33:38.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893590+0000", 2024-09-11T05:33:38.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7999999999999995e-07 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893593+0000", 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1020000000000001e-06 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893602+0000", 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.721e-06 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893608+0000", 2024-09-11T05:33:38.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8830000000000003e-06 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117908 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.893685+0000", 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9995928, 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000450235, 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117908 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893685+0000", 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893685+0000", 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893686+0000", 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7499999999999999e-07 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893689+0000", 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6349999999999999e-06 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893699+0000", 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3999999999999998e-06 2024-09-11T05:33:38.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893706+0000", 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.204e-06 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117909 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.893810+0000", 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9994674, 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036949999999999998, 2024-09-11T05:33:38.969 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.970 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117909 2024-09-11T05:33:38.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.970 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893810+0000", 2024-09-11T05:33:38.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893810+0000", 2024-09-11T05:33:38.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893811+0000", 2024-09-11T05:33:38.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4200000000000005e-07 2024-09-11T05:33:38.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893815+0000", 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7390000000000001e-06 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893825+0000", 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7569999999999999e-06 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893835+0000", 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0679000000000001e-05 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117910 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.893907+0000", 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9993701, 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031567599999999998, 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117910 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.973 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893907+0000", 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893907+0000", 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893908+0000", 2024-09-11T05:33:38.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9599999999999998e-07 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893912+0000", 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6789999999999998e-06 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893921+0000", 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3009999999999995e-06 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893928+0000", 2024-09-11T05:33:38.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2840000000000001e-06 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117911 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.893950+0000", 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9993277, 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030039200000000002, 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117911 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893950+0000", 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893950+0000", 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893951+0000", 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1900000000000002e-07 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893953+0000", 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9519999999999999e-06 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893961+0000", 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.038e-06 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893968+0000", 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3500000000000002e-06 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117912 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.893976+0000", 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9993014, 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031496900000000001, 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.979 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117912 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893976+0000", 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893976+0000", 2024-09-11T05:33:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893977+0000", 2024-09-11T05:33:38.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:33:38.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893979+0000", 2024-09-11T05:33:38.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3010000000000001e-06 2024-09-11T05:33:38.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893986+0000", 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6669999999999999e-06 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.893990+0000", 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6630000000000001e-06 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117913 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.894023+0000", 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9992542, 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031325400000000001, 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117913 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894023+0000", 2024-09-11T05:33:38.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894023+0000", 2024-09-11T05:33:38.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894024+0000", 2024-09-11T05:33:38.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6899999999999997e-07 2024-09-11T05:33:38.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894027+0000", 2024-09-11T05:33:38.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.303e-06 2024-09-11T05:33:38.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894037+0000", 2024-09-11T05:33:38.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0071000000000001e-05 2024-09-11T05:33:38.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894043+0000", 2024-09-11T05:33:38.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8390000000000003e-06 2024-09-11T05:33:38.986 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.986 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.986 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.986 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117914 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.986 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.894067+0000", 2024-09-11T05:33:38.986 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9992104, 2024-09-11T05:33:38.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029704299999999998, 2024-09-11T05:33:38.986 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.987 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.987 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117914 2024-09-11T05:33:38.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.987 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894067+0000", 2024-09-11T05:33:38.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894067+0000", 2024-09-11T05:33:38.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894068+0000", 2024-09-11T05:33:38.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1900000000000002e-07 2024-09-11T05:33:38.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894071+0000", 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8930000000000001e-06 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894078+0000", 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6850000000000001e-06 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894083+0000", 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1340000000000003e-06 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.989 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117915 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.894120+0000", 2024-09-11T05:33:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9991579, 2024-09-11T05:33:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029151699999999998, 2024-09-11T05:33:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117915 2024-09-11T05:33:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894120+0000", 2024-09-11T05:33:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894120+0000", 2024-09-11T05:33:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894120+0000", 2024-09-11T05:33:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3e-07 2024-09-11T05:33:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894123+0000", 2024-09-11T05:33:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2899999999999998e-06 2024-09-11T05:33:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894132+0000", 2024-09-11T05:33:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4600000000000003e-06 2024-09-11T05:33:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894138+0000", 2024-09-11T05:33:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9440000000000002e-06 2024-09-11T05:33:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117916 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.894149+0000", 2024-09-11T05:33:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9991283, 2024-09-11T05:33:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000304777, 2024-09-11T05:33:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117916 2024-09-11T05:33:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894149+0000", 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894149+0000", 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894150+0000", 2024-09-11T05:33:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000003e-07 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894152+0000", 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5600000000000001e-06 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894158+0000", 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894163+0000", 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0159999999999999e-06 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117917 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.894211+0000", 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9990668, 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027597, 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117917 2024-09-11T05:33:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894211+0000", 2024-09-11T05:33:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894211+0000", 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894211+0000", 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.68e-07 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894215+0000", 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894231+0000", 2024-09-11T05:33:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5990000000000001e-05 2024-09-11T05:33:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894237+0000", 2024-09-11T05:33:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1140000000000002e-06 2024-09-11T05:33:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117918 3.19 3.5cd864d9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.894313+0000", 2024-09-11T05:33:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9989643, 2024-09-11T05:33:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218428, 2024-09-11T05:33:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T05:33:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117918 2024-09-11T05:33:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894313+0000", 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894313+0000", 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894314+0000", 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3499999999999995e-07 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894318+0000", 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6729999999999998e-06 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894327+0000", 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9290000000000004e-06 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.894333+0000", 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3520000000000003e-06 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 31 2024-09-11T05:33:39.004 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:39.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:39.006 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:39.004+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:39.106 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:39.105+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:39.150 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:39.150 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:39.150 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:39.150 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:39.150 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:39.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:39.207 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:39.206+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:39.265 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36429 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8585216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182539789, 2024-09-11T05:33:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035281438999999998, 2024-09-11T05:33:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36429 2024-09-11T05:33:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081346+0000", 2024-09-11T05:33:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:33:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081348+0000", 2024-09-11T05:33:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:33:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081355+0000", 2024-09-11T05:33:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2230000000000001e-06 2024-09-11T05:33:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081360+0000", 2024-09-11T05:33:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0499999999999999e-06 2024-09-11T05:33:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116334+0000", 2024-09-11T05:33:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.034973889000000001 2024-09-11T05:33:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116410+0000", 2024-09-11T05:33:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6001000000000006e-05 2024-09-11T05:33:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116627+0000", 2024-09-11T05:33:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000216956 2024-09-11T05:33:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36430 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9437184~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182431726000001, 2024-09-11T05:33:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035492782, 2024-09-11T05:33:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36430 2024-09-11T05:33:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081454+0000", 2024-09-11T05:33:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.99e-07 2024-09-11T05:33:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081458+0000", 2024-09-11T05:33:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7160000000000001e-06 2024-09-11T05:33:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081468+0000", 2024-09-11T05:33:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9629999999999993e-06 2024-09-11T05:33:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081474+0000", 2024-09-11T05:33:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2060000000000004e-06 2024-09-11T05:33:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116658+0000", 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03518454 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116734+0000", 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5703000000000003e-05 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116946+0000", 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211955 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36431 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9895936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182400601000001, 2024-09-11T05:33:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035819799999999999, 2024-09-11T05:33:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36431 2024-09-11T05:33:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081485+0000", 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081493+0000", 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9629999999999998e-06 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081500+0000", 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7070000000000003e-06 2024-09-11T05:33:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081504+0000", 2024-09-11T05:33:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:33:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116993+0000", 2024-09-11T05:33:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035489224 2024-09-11T05:33:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117083+0000", 2024-09-11T05:33:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9560000000000003e-05 2024-09-11T05:33:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117304+0000", 2024-09-11T05:33:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221244 2024-09-11T05:33:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36448 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 327680~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182373899000002, 2024-09-11T05:33:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036143304000000001, 2024-09-11T05:33:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36448 2024-09-11T05:33:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081512+0000", 2024-09-11T05:33:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:33:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081514+0000", 2024-09-11T05:33:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:33:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081520+0000", 2024-09-11T05:33:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4269999999999996e-06 2024-09-11T05:33:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081525+0000", 2024-09-11T05:33:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6140000000000002e-06 2024-09-11T05:33:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117333+0000", 2024-09-11T05:33:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035808385999999998 2024-09-11T05:33:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117446+0000", 2024-09-11T05:33:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113161 2024-09-11T05:33:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117654+0000", 2024-09-11T05:33:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020835800000000001 2024-09-11T05:33:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36449 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1638400~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182354670999999, 2024-09-11T05:33:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036464895999999997, 2024-09-11T05:33:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36449 2024-09-11T05:33:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081531+0000", 2024-09-11T05:33:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:33:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081533+0000", 2024-09-11T05:33:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8649999999999999e-06 2024-09-11T05:33:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081538+0000", 2024-09-11T05:33:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7769999999999999e-06 2024-09-11T05:33:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081543+0000", 2024-09-11T05:33:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4390000000000002e-06 2024-09-11T05:33:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117686+0000", 2024-09-11T05:33:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036142760000000003 2024-09-11T05:33:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117768+0000", 2024-09-11T05:33:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2521000000000005e-05 2024-09-11T05:33:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117995+0000", 2024-09-11T05:33:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022715699999999999 2024-09-11T05:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36450 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182336802999998, 2024-09-11T05:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036798323000000001, 2024-09-11T05:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36450 2024-09-11T05:33:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081549+0000", 2024-09-11T05:33:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1699999999999999e-07 2024-09-11T05:33:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081550+0000", 2024-09-11T05:33:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:33:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081557+0000", 2024-09-11T05:33:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:33:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081561+0000", 2024-09-11T05:33:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2880000000000003e-06 2024-09-11T05:33:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118042+0000", 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036480984000000001 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118142+0000", 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100043 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118347+0000", 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020477399999999999 2024-09-11T05:33:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36451 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4259840~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182318973000001, 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037058173, 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36451 2024-09-11T05:33:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:33:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081568+0000", 2024-09-11T05:33:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:33:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081573+0000", 2024-09-11T05:33:39.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999998e-06 2024-09-11T05:33:39.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081575+0000", 2024-09-11T05:33:39.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.605e-06 2024-09-11T05:33:39.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118377+0000", 2024-09-11T05:33:39.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036801831 2024-09-11T05:33:39.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118459+0000", 2024-09-11T05:33:39.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1983000000000004e-05 2024-09-11T05:33:39.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118624+0000", 2024-09-11T05:33:39.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000165353 2024-09-11T05:33:39.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.301 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.301 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36452 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5570560~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.301 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:39.301 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182306592, 2024-09-11T05:33:39.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037358132000000002, 2024-09-11T05:33:39.301 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36452 2024-09-11T05:33:39.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:39.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:39.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081579+0000", 2024-09-11T05:33:39.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4600000000000001e-07 2024-09-11T05:33:39.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081580+0000", 2024-09-11T05:33:39.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T05:33:39.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081583+0000", 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9119999999999998e-06 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081586+0000", 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.371e-06 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118666+0000", 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037079933000000002 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118725+0000", 2024-09-11T05:33:39.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8600000000000001e-05 2024-09-11T05:33:39.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118937+0000", 2024-09-11T05:33:39.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211931 2024-09-11T05:33:39.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.308 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.308 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36453 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6881280~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.309 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:39.309 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182295942, 2024-09-11T05:33:39.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037649803000000003, 2024-09-11T05:33:39.309 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36453 2024-09-11T05:33:39.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.309 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:39.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:39.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:39.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T05:33:39.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081590+0000", 2024-09-11T05:33:39.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-11T05:33:39.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081593+0000", 2024-09-11T05:33:39.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0110000000000001e-06 2024-09-11T05:33:39.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081596+0000", 2024-09-11T05:33:39.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7609999999999999e-06 2024-09-11T05:33:39.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118965+0000", 2024-09-11T05:33:39.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037368971000000001 2024-09-11T05:33:39.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119037+0000", 2024-09-11T05:33:39.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2300999999999998e-05 2024-09-11T05:33:39.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119239+0000", 2024-09-11T05:33:39.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020146000000000001 2024-09-11T05:33:39.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.313 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36454 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8192000~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182285885999999, 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037930403000000001, 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36454 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:39.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081600+0000", 2024-09-11T05:33:39.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:33:39.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081603+0000", 2024-09-11T05:33:39.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:33:39.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081606+0000", 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4099999999999998e-06 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119274+0000", 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037668407000000001 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119340+0000", 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5685000000000006e-05 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119530+0000", 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000189688 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36455 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9502720~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182275737000001, 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038210565000000002, 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36455 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:39.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081610+0000", 2024-09-11T05:33:39.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:39.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081611+0000", 2024-09-11T05:33:39.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0279999999999999e-06 2024-09-11T05:33:39.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081613+0000", 2024-09-11T05:33:39.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8430000000000001e-06 2024-09-11T05:33:39.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081616+0000", 2024-09-11T05:33:39.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6350000000000002e-06 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119555+0000", 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037939252999999999 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119629+0000", 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3868999999999994e-05 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119820+0000", 2024-09-11T05:33:39.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190724 2024-09-11T05:33:39.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.323 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.323 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36480 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 393216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.323 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:39.323 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182266171999999, 2024-09-11T05:33:39.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039217429999999998, 2024-09-11T05:33:39.323 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36480 2024-09-11T05:33:39.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.324 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:39.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081620+0000", 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4900000000000004e-07 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081624+0000", 2024-09-11T05:33:39.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:33:39.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081627+0000", 2024-09-11T05:33:39.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6520000000000002e-06 2024-09-11T05:33:39.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119851+0000", 2024-09-11T05:33:39.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038224209000000002 2024-09-11T05:33:39.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120518+0000", 2024-09-11T05:33:39.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066708900000000005 2024-09-11T05:33:39.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120836+0000", 2024-09-11T05:33:39.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031833300000000002 2024-09-11T05:33:39.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.328 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.328 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36481 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1703936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.328 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:39.328 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182255285, 2024-09-11T05:33:39.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039545442, 2024-09-11T05:33:39.328 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36481 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:39.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:39.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:39.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081631+0000", 2024-09-11T05:33:39.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0839999999999999e-06 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081635+0000", 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.743e-06 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081637+0000", 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.661e-06 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120887+0000", 2024-09-11T05:33:39.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039249876000000003 2024-09-11T05:33:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120968+0000", 2024-09-11T05:33:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0253999999999994e-05 2024-09-11T05:33:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121175+0000", 2024-09-11T05:33:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020761099999999999 2024-09-11T05:33:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36482 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 3014656~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182244724, 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040344708999999999, 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36482 2024-09-11T05:33:39.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.334 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:39.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:39.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081641+0000", 2024-09-11T05:33:39.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:39.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081647+0000", 2024-09-11T05:33:39.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:33:39.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081651+0000", 2024-09-11T05:33:39.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2080000000000002e-06 2024-09-11T05:33:39.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081654+0000", 2024-09-11T05:33:39.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:33:39.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121203+0000", 2024-09-11T05:33:39.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039549466999999998 2024-09-11T05:33:39.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121267+0000", 2024-09-11T05:33:39.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3713999999999993e-05 2024-09-11T05:33:39.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121985+0000", 2024-09-11T05:33:39.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071827299999999996 2024-09-11T05:33:39.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.337 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.338 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36483 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4325376~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.338 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:39.338 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182228165000001, 2024-09-11T05:33:39.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040925571000000001, 2024-09-11T05:33:39.338 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.338 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.338 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.338 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.338 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.338 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36483 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081661+0000", 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.296e-06 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081665+0000", 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9269999999999998e-06 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081668+0000", 2024-09-11T05:33:39.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.615e-06 2024-09-11T05:33:39.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122019+0000", 2024-09-11T05:33:39.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040350886000000002 2024-09-11T05:33:39.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122108+0000", 2024-09-11T05:33:39.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8671000000000005e-05 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122582+0000", 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047494900000000001 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36484 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5636096~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182213737000001, 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041537567999999997, 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36484 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081672+0000", 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-07 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081673+0000", 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.212e-06 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081676+0000", 2024-09-11T05:33:39.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6940000000000001e-06 2024-09-11T05:33:39.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081679+0000", 2024-09-11T05:33:39.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8260000000000001e-06 2024-09-11T05:33:39.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122615+0000", 2024-09-11T05:33:39.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040935421999999999 2024-09-11T05:33:39.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122892+0000", 2024-09-11T05:33:39.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027731099999999997 2024-09-11T05:33:39.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123209+0000", 2024-09-11T05:33:39.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000316872 2024-09-11T05:33:39.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.347 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.347 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36485 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6946816~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.347 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:39.347 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182201527, 2024-09-11T05:33:39.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041869008999999999, 2024-09-11T05:33:39.347 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36485 2024-09-11T05:33:39.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.348 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:39.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:39.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:39.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:33:39.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081685+0000", 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029e-06 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081689+0000", 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0709999999999996e-06 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081692+0000", 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389999999999999e-06 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123245+0000", 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041553759000000003 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123331+0000", 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5885999999999997e-05 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123553+0000", 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022129499999999999 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.351 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36486 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8257536~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182190509000002, 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042204617999999999, 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36486 2024-09-11T05:33:39.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081698+0000", 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6490000000000001e-06 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081702+0000", 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7249999999999999e-06 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081705+0000", 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7379999999999999e-06 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123583+0000", 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041878604999999999 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123666+0000", 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2027000000000006e-05 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123899+0000", 2024-09-11T05:33:39.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000233663 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36487 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9568256~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.182177334999999, 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043010712999999999, 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36487 2024-09-11T05:33:39.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.357 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:39.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:39.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.16e-07 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081709+0000", 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2100000000000001e-06 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081713+0000", 2024-09-11T05:33:39.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.811e-06 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081716+0000", 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.112e-06 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123961+0000", 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042244482999999999 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124043+0000", 2024-09-11T05:33:39.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2066999999999999e-05 2024-09-11T05:33:39.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124718+0000", 2024-09-11T05:33:39.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067581399999999995 2024-09-11T05:33:39.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.360 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.360 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:43696 3.10 3:0e50cb16:::rbd_data.112dcdbd4c7c.0000000000000007:14 [read 2088960~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:39.360 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:39.360 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.225957119, 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035281203999999997, 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 43696 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:39.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-07 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037930+0000", 2024-09-11T05:33:39.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5540000000000001e-06 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037935+0000", 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0610000000000003e-06 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037939+0000", 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1239999999999998e-06 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073102+0000", 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035163341000000001 2024-09-11T05:33:39.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073159+0000", 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6316000000000001e-05 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073209+0000", 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0512e-05 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.364 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.365 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:39.366 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:39.366 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:39.365+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:39.467 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:39.466+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:39.532 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:39.532 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:39.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.532 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116602 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.532 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814668+0000", 2024-09-11T05:33:39.533 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.696752433, 2024-09-11T05:33:39.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69677020000000001, 2024-09-11T05:33:39.533 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116602 2024-09-11T05:33:39.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.533 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814668+0000", 2024-09-11T05:33:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814668+0000", 2024-09-11T05:33:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814669+0000", 2024-09-11T05:33:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T05:33:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814671+0000", 2024-09-11T05:33:39.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5620000000000002e-06 2024-09-11T05:33:39.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814678+0000", 2024-09-11T05:33:39.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8009999999999998e-06 2024-09-11T05:33:39.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814683+0000", 2024-09-11T05:33:39.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9649999999999999e-06 2024-09-11T05:33:39.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816611+0000", 2024-09-11T05:33:39.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00192793 2024-09-11T05:33:39.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:39.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816616+0000", 2024-09-11T05:33:39.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:33:39.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826340+0000", 2024-09-11T05:33:39.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097242839999999997 2024-09-11T05:33:39.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826352+0000", 2024-09-11T05:33:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1482e-05 2024-09-11T05:33:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116847 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822479+0000", 2024-09-11T05:33:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68894175899999999, 2024-09-11T05:33:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68900672399999996, 2024-09-11T05:33:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116847 2024-09-11T05:33:39.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.539 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822479+0000", 2024-09-11T05:33:39.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822479+0000", 2024-09-11T05:33:39.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822480+0000", 2024-09-11T05:33:39.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T05:33:39.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822482+0000", 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3599999999999999e-06 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822489+0000", 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9519999999999997e-06 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822494+0000", 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-06 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827478+0000", 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049846739999999997 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827485+0000", 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.443e-06 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.542 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116879 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823139+0000", 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68828189399999995, 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68838093, 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116879 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823139+0000", 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823139+0000", 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823139+0000", 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6600000000000002e-07 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823141+0000", 2024-09-11T05:33:39.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T05:33:39.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823147+0000", 2024-09-11T05:33:39.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8850000000000004e-06 2024-09-11T05:33:39.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823152+0000", 2024-09-11T05:33:39.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5109999999999997e-06 2024-09-11T05:33:39.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828643+0000", 2024-09-11T05:33:39.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054914300000000003 2024-09-11T05:33:39.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828651+0000", 2024-09-11T05:33:39.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3119999999999996e-06 2024-09-11T05:33:39.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.547 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.547 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117124 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.547 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833594+0000", 2024-09-11T05:33:39.547 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67782654200000003, 2024-09-11T05:33:39.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.677958587, 2024-09-11T05:33:39.547 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117124 2024-09-11T05:33:39.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.548 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833594+0000", 2024-09-11T05:33:39.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833594+0000", 2024-09-11T05:33:39.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833595+0000", 2024-09-11T05:33:39.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-07 2024-09-11T05:33:39.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833597+0000", 2024-09-11T05:33:39.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-11T05:33:39.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833603+0000", 2024-09-11T05:33:39.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2949999999999999e-06 2024-09-11T05:33:39.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833608+0000", 2024-09-11T05:33:39.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9930000000000003e-06 2024-09-11T05:33:39.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835312+0000", 2024-09-11T05:33:39.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017040180000000001 2024-09-11T05:33:39.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835319+0000", 2024-09-11T05:33:39.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4150000000000004e-06 2024-09-11T05:33:39.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.551 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117348 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.848012+0000", 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.663409154, 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66357394700000005, 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117348 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848012+0000", 2024-09-11T05:33:39.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848012+0000", 2024-09-11T05:33:39.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848012+0000", 2024-09-11T05:33:39.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:33:39.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848015+0000", 2024-09-11T05:33:39.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.525e-06 2024-09-11T05:33:39.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848021+0000", 2024-09-11T05:33:39.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3960000000000003e-06 2024-09-11T05:33:39.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848025+0000", 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4410000000000003e-06 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848108+0000", 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2055e-05 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848115+0000", 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4930000000000001e-06 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117604 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.867894+0000", 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64352707200000003, 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64372463199999996, 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117604 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867894+0000", 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867894+0000", 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867894+0000", 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6600000000000002e-07 2024-09-11T05:33:39.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867897+0000", 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3649999999999998e-06 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867904+0000", 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0620000000000003e-06 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867908+0000", 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6199999999999998e-06 2024-09-11T05:33:39.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867955+0000", 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6693000000000002e-05 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867960+0000", 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6129999999999997e-06 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.559 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116593 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.560 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888890+0000", 2024-09-11T05:33:39.560 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62253055599999996, 2024-09-11T05:33:39.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62276089499999998, 2024-09-11T05:33:39.560 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.560 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116593 2024-09-11T05:33:39.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.560 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888890+0000", 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888890+0000", 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888891+0000", 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9700000000000003e-07 2024-09-11T05:33:39.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888892+0000", 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.843e-06 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888897+0000", 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6600000000000003e-06 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888901+0000", 2024-09-11T05:33:39.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9500000000000003e-06 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889081+0000", 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018003600000000001 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889089+0000", 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000005e-06 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116625 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62182345000000006, 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62208799999999997, 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116625 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.564 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:33:39.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:33:39.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889598+0000", 2024-09-11T05:33:39.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:33:39.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889599+0000", 2024-09-11T05:33:39.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.144e-06 2024-09-11T05:33:39.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889602+0000", 2024-09-11T05:33:39.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:33:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889604+0000", 2024-09-11T05:33:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7640000000000001e-06 2024-09-11T05:33:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890442+0000", 2024-09-11T05:33:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083777099999999996 2024-09-11T05:33:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890452+0000", 2024-09-11T05:33:39.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5559999999999996e-06 2024-09-11T05:33:39.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.568 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.568 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116603 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.568 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814691+0000", 2024-09-11T05:33:39.568 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69673022100000004, 2024-09-11T05:33:39.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69702768000000004, 2024-09-11T05:33:39.568 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116603 2024-09-11T05:33:39.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.569 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814691+0000", 2024-09-11T05:33:39.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814691+0000", 2024-09-11T05:33:39.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814691+0000", 2024-09-11T05:33:39.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:33:39.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814693+0000", 2024-09-11T05:33:39.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.17e-06 2024-09-11T05:33:39.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814699+0000", 2024-09-11T05:33:39.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9619999999999998e-06 2024-09-11T05:33:39.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814704+0000", 2024-09-11T05:33:39.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7729999999999999e-06 2024-09-11T05:33:39.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816643+0000", 2024-09-11T05:33:39.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001939163 2024-09-11T05:33:39.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:39.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816647+0000", 2024-09-11T05:33:39.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3250000000000001e-06 2024-09-11T05:33:39.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826389+0000", 2024-09-11T05:33:39.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097417530000000006 2024-09-11T05:33:39.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826397+0000", 2024-09-11T05:33:39.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3210000000000005e-06 2024-09-11T05:33:39.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.573 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116848 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822500+0000", 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68892046200000001, 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68925635200000002, 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116848 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822500+0000", 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822500+0000", 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822501+0000", 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:33:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822503+0000", 2024-09-11T05:33:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3379999999999999e-06 2024-09-11T05:33:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822509+0000", 2024-09-11T05:33:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5219999999999998e-06 2024-09-11T05:33:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822513+0000", 2024-09-11T05:33:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7389999999999999e-06 2024-09-11T05:33:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827509+0000", 2024-09-11T05:33:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049959260000000004 2024-09-11T05:33:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827516+0000", 2024-09-11T05:33:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8499999999999996e-06 2024-09-11T05:33:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.578 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.578 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116880 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.578 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823158+0000", 2024-09-11T05:33:39.578 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68826302500000003, 2024-09-11T05:33:39.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68863157200000003, 2024-09-11T05:33:39.578 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.578 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.578 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.578 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.578 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116880 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823158+0000", 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823158+0000", 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823158+0000", 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6199999999999999e-07 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823160+0000", 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0190000000000001e-06 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823166+0000", 2024-09-11T05:33:39.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0129999999999999e-06 2024-09-11T05:33:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823171+0000", 2024-09-11T05:33:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6249999999999998e-06 2024-09-11T05:33:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828679+0000", 2024-09-11T05:33:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055077340000000002 2024-09-11T05:33:39.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828686+0000", 2024-09-11T05:33:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T05:33:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117125 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833614+0000", 2024-09-11T05:33:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.677806574, 2024-09-11T05:33:39.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67821439800000005, 2024-09-11T05:33:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117125 2024-09-11T05:33:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833614+0000", 2024-09-11T05:33:39.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833614+0000", 2024-09-11T05:33:39.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833615+0000", 2024-09-11T05:33:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3500000000000002e-07 2024-09-11T05:33:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833617+0000", 2024-09-11T05:33:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0049999999999999e-06 2024-09-11T05:33:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833623+0000", 2024-09-11T05:33:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.392e-06 2024-09-11T05:33:39.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833628+0000", 2024-09-11T05:33:39.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1150000000000002e-06 2024-09-11T05:33:39.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835339+0000", 2024-09-11T05:33:39.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017111450000000001 2024-09-11T05:33:39.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835346+0000", 2024-09-11T05:33:39.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5810000000000002e-06 2024-09-11T05:33:39.587 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.587 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.587 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.587 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117349 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.587 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.848087+0000", 2024-09-11T05:33:39.587 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.663334227, 2024-09-11T05:33:39.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66377497100000005, 2024-09-11T05:33:39.587 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117349 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848087+0000", 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848087+0000", 2024-09-11T05:33:39.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848087+0000", 2024-09-11T05:33:39.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6700000000000003e-07 2024-09-11T05:33:39.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848091+0000", 2024-09-11T05:33:39.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3840000000000001e-06 2024-09-11T05:33:39.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848096+0000", 2024-09-11T05:33:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.75e-06 2024-09-11T05:33:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848100+0000", 2024-09-11T05:33:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5719999999999999e-06 2024-09-11T05:33:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848149+0000", 2024-09-11T05:33:39.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8702000000000002e-05 2024-09-11T05:33:39.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848157+0000", 2024-09-11T05:33:39.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1890000000000007e-06 2024-09-11T05:33:39.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117605 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.867999+0000", 2024-09-11T05:33:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64342209100000003, 2024-09-11T05:33:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.643895196, 2024-09-11T05:33:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.593 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117605 2024-09-11T05:33:39.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.593 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867999+0000", 2024-09-11T05:33:39.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867999+0000", 2024-09-11T05:33:39.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867999+0000", 2024-09-11T05:33:39.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3300000000000003e-07 2024-09-11T05:33:39.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868002+0000", 2024-09-11T05:33:39.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3929999999999998e-06 2024-09-11T05:33:39.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868007+0000", 2024-09-11T05:33:39.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.755e-06 2024-09-11T05:33:39.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868011+0000", 2024-09-11T05:33:39.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8020000000000002e-06 2024-09-11T05:33:39.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868045+0000", 2024-09-11T05:33:39.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3556999999999997e-05 2024-09-11T05:33:39.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868049+0000", 2024-09-11T05:33:39.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2470000000000002e-06 2024-09-11T05:33:39.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.596 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.597 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116594 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.597 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888905+0000", 2024-09-11T05:33:39.597 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62251592899999997, 2024-09-11T05:33:39.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62302501899999996, 2024-09-11T05:33:39.597 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116594 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888905+0000", 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888905+0000", 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888905+0000", 2024-09-11T05:33:39.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:33:39.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888906+0000", 2024-09-11T05:33:39.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1829999999999999e-06 2024-09-11T05:33:39.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888909+0000", 2024-09-11T05:33:39.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.022e-06 2024-09-11T05:33:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888912+0000", 2024-09-11T05:33:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:33:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889121+0000", 2024-09-11T05:33:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000209013 2024-09-11T05:33:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889128+0000", 2024-09-11T05:33:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4490000000000002e-06 2024-09-11T05:33:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116626 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:33:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62181268000000001, 2024-09-11T05:33:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62236190400000002, 2024-09-11T05:33:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116626 2024-09-11T05:33:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:33:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:33:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:33:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:33:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889610+0000", 2024-09-11T05:33:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.186e-06 2024-09-11T05:33:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889613+0000", 2024-09-11T05:33:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T05:33:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889615+0000", 2024-09-11T05:33:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890487+0000", 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087202600000000003 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890492+0000", 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116604 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815588+0000", 2024-09-11T05:33:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69583304400000001, 2024-09-11T05:33:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69641537399999998, 2024-09-11T05:33:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116604 2024-09-11T05:33:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815588+0000", 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815588+0000", 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815589+0000", 2024-09-11T05:33:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4600000000000004e-07 2024-09-11T05:33:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815593+0000", 2024-09-11T05:33:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5220000000000001e-06 2024-09-11T05:33:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815601+0000", 2024-09-11T05:33:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9799999999999998e-06 2024-09-11T05:33:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815607+0000", 2024-09-11T05:33:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4099999999999996e-06 2024-09-11T05:33:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816672+0000", 2024-09-11T05:33:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010645979999999999 2024-09-11T05:33:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816676+0000", 2024-09-11T05:33:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7000000000000002e-06 2024-09-11T05:33:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826429+0000", 2024-09-11T05:33:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097534319999999994 2024-09-11T05:33:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826437+0000", 2024-09-11T05:33:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-06 2024-09-11T05:33:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116849 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822520+0000", 2024-09-11T05:33:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68890063300000004, 2024-09-11T05:33:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68952160200000001, 2024-09-11T05:33:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116849 2024-09-11T05:33:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822520+0000", 2024-09-11T05:33:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822520+0000", 2024-09-11T05:33:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822521+0000", 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822523+0000", 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1509999999999998e-06 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822529+0000", 2024-09-11T05:33:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T05:33:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822533+0000", 2024-09-11T05:33:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6399999999999996e-06 2024-09-11T05:33:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827574+0000", 2024-09-11T05:33:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050403660000000001 2024-09-11T05:33:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827580+0000", 2024-09-11T05:33:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7340000000000002e-06 2024-09-11T05:33:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116881 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823176+0000", 2024-09-11T05:33:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68824469099999996, 2024-09-11T05:33:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68889800199999995, 2024-09-11T05:33:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116881 2024-09-11T05:33:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823176+0000", 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823176+0000", 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823176+0000", 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6899999999999999e-07 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823178+0000", 2024-09-11T05:33:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8980000000000001e-06 2024-09-11T05:33:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823184+0000", 2024-09-11T05:33:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.463e-06 2024-09-11T05:33:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823189+0000", 2024-09-11T05:33:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T05:33:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828712+0000", 2024-09-11T05:33:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055234699999999999 2024-09-11T05:33:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828719+0000", 2024-09-11T05:33:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0419999999999997e-06 2024-09-11T05:33:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117126 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833636+0000", 2024-09-11T05:33:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67778510400000003, 2024-09-11T05:33:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67847100900000001, 2024-09-11T05:33:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117126 2024-09-11T05:33:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833636+0000", 2024-09-11T05:33:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833636+0000", 2024-09-11T05:33:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833636+0000", 2024-09-11T05:33:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9299999999999999e-07 2024-09-11T05:33:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833638+0000", 2024-09-11T05:33:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1830000000000001e-06 2024-09-11T05:33:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833645+0000", 2024-09-11T05:33:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.793e-06 2024-09-11T05:33:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833650+0000", 2024-09-11T05:33:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0329999999999999e-06 2024-09-11T05:33:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835370+0000", 2024-09-11T05:33:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017194420000000001 2024-09-11T05:33:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835376+0000", 2024-09-11T05:33:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5119999999999997e-06 2024-09-11T05:33:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117350 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.848188+0000", 2024-09-11T05:33:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66323258600000001, 2024-09-11T05:33:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66395095199999998, 2024-09-11T05:33:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117350 2024-09-11T05:33:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848188+0000", 2024-09-11T05:33:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848188+0000", 2024-09-11T05:33:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848189+0000", 2024-09-11T05:33:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:33:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848192+0000", 2024-09-11T05:33:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7860000000000001e-06 2024-09-11T05:33:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848199+0000", 2024-09-11T05:33:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7320000000000001e-06 2024-09-11T05:33:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848202+0000", 2024-09-11T05:33:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6480000000000001e-06 2024-09-11T05:33:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848247+0000", 2024-09-11T05:33:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4739e-05 2024-09-11T05:33:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848256+0000", 2024-09-11T05:33:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1919999999999994e-06 2024-09-11T05:33:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117606 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.868103+0000", 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64331764199999997, 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.644068635, 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117606 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868103+0000", 2024-09-11T05:33:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868103+0000", 2024-09-11T05:33:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868104+0000", 2024-09-11T05:33:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T05:33:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868106+0000", 2024-09-11T05:33:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5600000000000001e-06 2024-09-11T05:33:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868111+0000", 2024-09-11T05:33:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1710000000000001e-06 2024-09-11T05:33:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868115+0000", 2024-09-11T05:33:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1370000000000002e-06 2024-09-11T05:33:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868145+0000", 2024-09-11T05:33:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0821000000000002e-05 2024-09-11T05:33:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868150+0000", 2024-09-11T05:33:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1860000000000002e-06 2024-09-11T05:33:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116595 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888915+0000", 2024-09-11T05:33:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62250589499999998, 2024-09-11T05:33:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62330530799999995, 2024-09-11T05:33:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116595 2024-09-11T05:33:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888915+0000", 2024-09-11T05:33:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888915+0000", 2024-09-11T05:33:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888915+0000", 2024-09-11T05:33:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888916+0000", 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.08e-06 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888919+0000", 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.129e-06 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888924+0000", 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-06 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889163+0000", 2024-09-11T05:33:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000238404 2024-09-11T05:33:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889171+0000", 2024-09-11T05:33:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.028e-06 2024-09-11T05:33:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116627 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:33:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62180279500000002, 2024-09-11T05:33:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62263237699999996, 2024-09-11T05:33:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116627 2024-09-11T05:33:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:33:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:33:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:33:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889619+0000", 2024-09-11T05:33:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.093e-06 2024-09-11T05:33:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889622+0000", 2024-09-11T05:33:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T05:33:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889625+0000", 2024-09-11T05:33:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:33:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890528+0000", 2024-09-11T05:33:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000902804 2024-09-11T05:33:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890537+0000", 2024-09-11T05:33:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2029999999999998e-06 2024-09-11T05:33:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116605 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815620+0000", 2024-09-11T05:33:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69580098999999995, 2024-09-11T05:33:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69666090300000005, 2024-09-11T05:33:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116605 2024-09-11T05:33:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815620+0000", 2024-09-11T05:33:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815620+0000", 2024-09-11T05:33:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815620+0000", 2024-09-11T05:33:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:33:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815623+0000", 2024-09-11T05:33:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9440000000000001e-06 2024-09-11T05:33:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815630+0000", 2024-09-11T05:33:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6649999999999997e-06 2024-09-11T05:33:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815636+0000", 2024-09-11T05:33:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5620000000000003e-06 2024-09-11T05:33:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816700+0000", 2024-09-11T05:33:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010645229999999999 2024-09-11T05:33:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816704+0000", 2024-09-11T05:33:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0589999999999996e-06 2024-09-11T05:33:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826466+0000", 2024-09-11T05:33:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097618099999999992 2024-09-11T05:33:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826474+0000", 2024-09-11T05:33:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5820000000000004e-06 2024-09-11T05:33:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116850 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822539+0000", 2024-09-11T05:33:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68888144299999998, 2024-09-11T05:33:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.689777011, 2024-09-11T05:33:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116850 2024-09-11T05:33:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822539+0000", 2024-09-11T05:33:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822539+0000", 2024-09-11T05:33:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822540+0000", 2024-09-11T05:33:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.27e-07 2024-09-11T05:33:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822542+0000", 2024-09-11T05:33:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.029e-06 2024-09-11T05:33:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822548+0000", 2024-09-11T05:33:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-09-11T05:33:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822553+0000", 2024-09-11T05:33:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7249999999999997e-06 2024-09-11T05:33:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827606+0000", 2024-09-11T05:33:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005053274 2024-09-11T05:33:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827613+0000", 2024-09-11T05:33:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8009999999999998e-06 2024-09-11T05:33:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.656 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116882 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.656 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823194+0000", 2024-09-11T05:33:39.656 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68822700199999998, 2024-09-11T05:33:39.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68915293, 2024-09-11T05:33:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116882 2024-09-11T05:33:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823194+0000", 2024-09-11T05:33:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823194+0000", 2024-09-11T05:33:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823194+0000", 2024-09-11T05:33:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:33:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823196+0000", 2024-09-11T05:33:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9319999999999999e-06 2024-09-11T05:33:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823205+0000", 2024-09-11T05:33:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.789e-06 2024-09-11T05:33:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823210+0000", 2024-09-11T05:33:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.989e-06 2024-09-11T05:33:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828746+0000", 2024-09-11T05:33:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055361230000000004 2024-09-11T05:33:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828752+0000", 2024-09-11T05:33:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0809999999999999e-06 2024-09-11T05:33:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117127 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833656+0000", 2024-09-11T05:33:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67776480100000003, 2024-09-11T05:33:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67874698, 2024-09-11T05:33:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117127 2024-09-11T05:33:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833656+0000", 2024-09-11T05:33:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833656+0000", 2024-09-11T05:33:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833656+0000", 2024-09-11T05:33:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:33:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833659+0000", 2024-09-11T05:33:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1280000000000002e-06 2024-09-11T05:33:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833665+0000", 2024-09-11T05:33:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5479999999999998e-06 2024-09-11T05:33:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833670+0000", 2024-09-11T05:33:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2519999999999999e-06 2024-09-11T05:33:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835443+0000", 2024-09-11T05:33:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001772249 2024-09-11T05:33:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835450+0000", 2024-09-11T05:33:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4139999999999997e-06 2024-09-11T05:33:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117351 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.848289+0000", 2024-09-11T05:33:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66313220699999997, 2024-09-11T05:33:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.664145298, 2024-09-11T05:33:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117351 2024-09-11T05:33:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848289+0000", 2024-09-11T05:33:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848289+0000", 2024-09-11T05:33:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848289+0000", 2024-09-11T05:33:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2e-07 2024-09-11T05:33:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848292+0000", 2024-09-11T05:33:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7149999999999998e-06 2024-09-11T05:33:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848298+0000", 2024-09-11T05:33:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5640000000000002e-06 2024-09-11T05:33:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848302+0000", 2024-09-11T05:33:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6689999999999999e-06 2024-09-11T05:33:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848330+0000", 2024-09-11T05:33:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8317e-05 2024-09-11T05:33:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848335+0000", 2024-09-11T05:33:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1239999999999998e-06 2024-09-11T05:33:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117607 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.868204+0000", 2024-09-11T05:33:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64321671700000005, 2024-09-11T05:33:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64426183699999995, 2024-09-11T05:33:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117607 2024-09-11T05:33:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868204+0000", 2024-09-11T05:33:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868204+0000", 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868205+0000", 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868207+0000", 2024-09-11T05:33:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0209999999999998e-06 2024-09-11T05:33:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868212+0000", 2024-09-11T05:33:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4469999999999997e-06 2024-09-11T05:33:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868215+0000", 2024-09-11T05:33:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3009999999999998e-06 2024-09-11T05:33:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868248+0000", 2024-09-11T05:33:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2836999999999997e-05 2024-09-11T05:33:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868252+0000", 2024-09-11T05:33:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2339999999999996e-06 2024-09-11T05:33:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116596 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888941+0000", 2024-09-11T05:33:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62247978100000001, 2024-09-11T05:33:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62355562600000003, 2024-09-11T05:33:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116596 2024-09-11T05:33:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888941+0000", 2024-09-11T05:33:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888941+0000", 2024-09-11T05:33:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888941+0000", 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7e-07 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888943+0000", 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.911e-06 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888949+0000", 2024-09-11T05:33:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8619999999999999e-06 2024-09-11T05:33:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888954+0000", 2024-09-11T05:33:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8210000000000001e-06 2024-09-11T05:33:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889214+0000", 2024-09-11T05:33:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026022900000000001 2024-09-11T05:33:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889222+0000", 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9929999999999995e-06 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116628 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62177879999999996, 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62288656200000003, 2024-09-11T05:33:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116628 2024-09-11T05:33:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:33:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:33:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:33:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:33:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889644+0000", 2024-09-11T05:33:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:33:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889647+0000", 2024-09-11T05:33:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3950000000000001e-06 2024-09-11T05:33:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889650+0000", 2024-09-11T05:33:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:33:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890570+0000", 2024-09-11T05:33:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092007999999999999 2024-09-11T05:33:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890577+0000", 2024-09-11T05:33:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.764e-06 2024-09-11T05:33:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116606 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815644+0000", 2024-09-11T05:33:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69577730400000004, 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69691677699999999, 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116606 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815644+0000", 2024-09-11T05:33:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815644+0000", 2024-09-11T05:33:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815644+0000", 2024-09-11T05:33:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:33:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815646+0000", 2024-09-11T05:33:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3489999999999999e-06 2024-09-11T05:33:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815653+0000", 2024-09-11T05:33:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6789999999999999e-06 2024-09-11T05:33:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815658+0000", 2024-09-11T05:33:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1250000000000001e-06 2024-09-11T05:33:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816728+0000", 2024-09-11T05:33:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010700810000000001 2024-09-11T05:33:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816732+0000", 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8340000000000001e-06 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826502+0000", 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097700349999999998 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826510+0000", 2024-09-11T05:33:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5769999999999996e-06 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116851 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822558+0000", 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68886282799999998, 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69003792500000005, 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116851 2024-09-11T05:33:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822558+0000", 2024-09-11T05:33:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822558+0000", 2024-09-11T05:33:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822558+0000", 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9499999999999998e-07 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822560+0000", 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8870000000000001e-06 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822566+0000", 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7620000000000001e-06 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822571+0000", 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7500000000000003e-06 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827638+0000", 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050670159999999997 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827645+0000", 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.25e-06 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116883 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823216+0000", 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68820505200000004, 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68941183399999995, 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116883 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823216+0000", 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823216+0000", 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823216+0000", 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6600000000000002e-07 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823218+0000", 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1160000000000002e-06 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823226+0000", 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3429999999999998e-06 2024-09-11T05:33:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823231+0000", 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.074e-06 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828777+0000", 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055466999999999999 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828784+0000", 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.533e-06 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117128 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833677+0000", 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67774418199999997, 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67898146000000004, 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117128 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833677+0000", 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833677+0000", 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833677+0000", 2024-09-11T05:33:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:33:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833679+0000", 2024-09-11T05:33:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1260000000000001e-06 2024-09-11T05:33:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833686+0000", 2024-09-11T05:33:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4590000000000003e-06 2024-09-11T05:33:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833690+0000", 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9130000000000002e-06 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835474+0000", 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00178327 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835480+0000", 2024-09-11T05:33:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6869999999999997e-06 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117352 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.848394+0000", 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.663026385, 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66429523999999995, 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117352 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848394+0000", 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848394+0000", 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848395+0000", 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2500000000000005e-07 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848398+0000", 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4770000000000002e-06 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848404+0000", 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4570000000000002e-06 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848408+0000", 2024-09-11T05:33:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000002e-06 2024-09-11T05:33:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848442+0000", 2024-09-11T05:33:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4075000000000002e-05 2024-09-11T05:33:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848455+0000", 2024-09-11T05:33:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2931e-05 2024-09-11T05:33:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117608 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.868305+0000", 2024-09-11T05:33:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64311625100000003, 2024-09-11T05:33:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64441646299999999, 2024-09-11T05:33:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117608 2024-09-11T05:33:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868305+0000", 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868305+0000", 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868305+0000", 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.89e-07 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868308+0000", 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.605e-06 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868313+0000", 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.074e-06 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868316+0000", 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0259999999999999e-06 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868347+0000", 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1192999999999998e-05 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868351+0000", 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1540000000000004e-06 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116597 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888960+0000", 2024-09-11T05:33:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62246042999999995, 2024-09-11T05:33:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62379098099999997, 2024-09-11T05:33:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116597 2024-09-11T05:33:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888960+0000", 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888960+0000", 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888961+0000", 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888963+0000", 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.784e-06 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888976+0000", 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3607e-05 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888980+0000", 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8789999999999996e-06 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889257+0000", 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027668499999999998 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889265+0000", 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.738e-06 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116629 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:33:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62176228899999997, 2024-09-11T05:33:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62314617299999997, 2024-09-11T05:33:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116629 2024-09-11T05:33:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:33:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:33:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:33:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-07 2024-09-11T05:33:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889660+0000", 2024-09-11T05:33:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5650000000000001e-06 2024-09-11T05:33:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889664+0000", 2024-09-11T05:33:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4000000000000001e-06 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889666+0000", 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890614+0000", 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00094762999999999998 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890621+0000", 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.379e-06 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116607 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815666+0000", 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.695755232, 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69717162600000004, 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116607 2024-09-11T05:33:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815666+0000", 2024-09-11T05:33:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815666+0000", 2024-09-11T05:33:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815666+0000", 2024-09-11T05:33:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:33:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815669+0000", 2024-09-11T05:33:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9380000000000001e-06 2024-09-11T05:33:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815675+0000", 2024-09-11T05:33:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2210000000000002e-06 2024-09-11T05:33:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815680+0000", 2024-09-11T05:33:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0710000000000002e-06 2024-09-11T05:33:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816755+0000", 2024-09-11T05:33:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010746810000000001 2024-09-11T05:33:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816759+0000", 2024-09-11T05:33:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0659999999999997e-06 2024-09-11T05:33:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826552+0000", 2024-09-11T05:33:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097932409999999994 2024-09-11T05:33:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826561+0000", 2024-09-11T05:33:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0140000000000004e-06 2024-09-11T05:33:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116852 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822577+0000", 2024-09-11T05:33:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68884430500000005, 2024-09-11T05:33:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69029984, 2024-09-11T05:33:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116852 2024-09-11T05:33:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822577+0000", 2024-09-11T05:33:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822577+0000", 2024-09-11T05:33:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822577+0000", 2024-09-11T05:33:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2300000000000002e-07 2024-09-11T05:33:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822579+0000", 2024-09-11T05:33:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5349999999999999e-06 2024-09-11T05:33:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822585+0000", 2024-09-11T05:33:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8889999999999999e-06 2024-09-11T05:33:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822590+0000", 2024-09-11T05:33:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6450000000000004e-06 2024-09-11T05:33:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827672+0000", 2024-09-11T05:33:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005081665 2024-09-11T05:33:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827678+0000", 2024-09-11T05:33:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4130000000000003e-06 2024-09-11T05:33:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116884 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823237+0000", 2024-09-11T05:33:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68818417300000001, 2024-09-11T05:33:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68967343000000003, 2024-09-11T05:33:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116884 2024-09-11T05:33:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823237+0000", 2024-09-11T05:33:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823237+0000", 2024-09-11T05:33:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823237+0000", 2024-09-11T05:33:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2599999999999998e-07 2024-09-11T05:33:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823239+0000", 2024-09-11T05:33:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2929999999999999e-06 2024-09-11T05:33:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823245+0000", 2024-09-11T05:33:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-11T05:33:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823250+0000", 2024-09-11T05:33:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7430000000000002e-06 2024-09-11T05:33:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828814+0000", 2024-09-11T05:33:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055643990000000003 2024-09-11T05:33:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828821+0000", 2024-09-11T05:33:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8900000000000001e-06 2024-09-11T05:33:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117129 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833698+0000", 2024-09-11T05:33:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67772326299999996, 2024-09-11T05:33:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.679244827, 2024-09-11T05:33:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117129 2024-09-11T05:33:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833698+0000", 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833698+0000", 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833698+0000", 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833701+0000", 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.818e-06 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833708+0000", 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8589999999999999e-06 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833713+0000", 2024-09-11T05:33:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.079e-06 2024-09-11T05:33:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835505+0000", 2024-09-11T05:33:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001791813 2024-09-11T05:33:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835509+0000", 2024-09-11T05:33:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4020000000000004e-06 2024-09-11T05:33:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117353 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.848499+0000", 2024-09-11T05:33:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.662922224, 2024-09-11T05:33:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66447739699999997, 2024-09-11T05:33:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117353 2024-09-11T05:33:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848499+0000", 2024-09-11T05:33:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848499+0000", 2024-09-11T05:33:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848499+0000", 2024-09-11T05:33:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4899999999999995e-07 2024-09-11T05:33:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848502+0000", 2024-09-11T05:33:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0199999999999999e-06 2024-09-11T05:33:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848509+0000", 2024-09-11T05:33:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4489999999999996e-06 2024-09-11T05:33:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848513+0000", 2024-09-11T05:33:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9190000000000001e-06 2024-09-11T05:33:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848546+0000", 2024-09-11T05:33:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3939999999999997e-05 2024-09-11T05:33:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848555+0000", 2024-09-11T05:33:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7639999999999994e-06 2024-09-11T05:33:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117609 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.868408+0000", 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64301266099999999, 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64459971500000002, 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117609 2024-09-11T05:33:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868408+0000", 2024-09-11T05:33:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868408+0000", 2024-09-11T05:33:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868409+0000", 2024-09-11T05:33:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.58e-07 2024-09-11T05:33:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868411+0000", 2024-09-11T05:33:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:33:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868416+0000", 2024-09-11T05:33:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4229999999999996e-06 2024-09-11T05:33:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868420+0000", 2024-09-11T05:33:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2499999999999998e-06 2024-09-11T05:33:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868452+0000", 2024-09-11T05:33:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1924999999999997e-05 2024-09-11T05:33:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868456+0000", 2024-09-11T05:33:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2930000000000002e-06 2024-09-11T05:33:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116598 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888985+0000", 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62243599900000002, 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62405789, 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116598 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888985+0000", 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888985+0000", 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888985+0000", 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8599999999999999e-07 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888989+0000", 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.25e-06 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888993+0000", 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4809999999999998e-06 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888996+0000", 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889298+0000", 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030204500000000003 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889305+0000", 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3669999999999999e-06 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116843 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:33:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62175106700000005, 2024-09-11T05:33:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62340507999999994, 2024-09-11T05:33:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116843 2024-09-11T05:33:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:33:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:33:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:33:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:33:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889671+0000", 2024-09-11T05:33:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-11T05:33:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889674+0000", 2024-09-11T05:33:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.005e-06 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889677+0000", 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890648+0000", 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097103399999999996 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890652+0000", 2024-09-11T05:33:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0790000000000002e-06 2024-09-11T05:33:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116608 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815690+0000", 2024-09-11T05:33:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.695730348, 2024-09-11T05:33:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69741803899999999, 2024-09-11T05:33:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116608 2024-09-11T05:33:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815690+0000", 2024-09-11T05:33:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815690+0000", 2024-09-11T05:33:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815691+0000", 2024-09-11T05:33:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.46e-07 2024-09-11T05:33:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815693+0000", 2024-09-11T05:33:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4760000000000001e-06 2024-09-11T05:33:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815700+0000", 2024-09-11T05:33:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5339999999999996e-06 2024-09-11T05:33:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815704+0000", 2024-09-11T05:33:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T05:33:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816783+0000", 2024-09-11T05:33:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001078435 2024-09-11T05:33:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816787+0000", 2024-09-11T05:33:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1309999999999999e-06 2024-09-11T05:33:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826590+0000", 2024-09-11T05:33:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098030270000000006 2024-09-11T05:33:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826597+0000", 2024-09-11T05:33:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5509999999999996e-06 2024-09-11T05:33:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116853 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822595+0000", 2024-09-11T05:33:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68882554299999998, 2024-09-11T05:33:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69055240299999998, 2024-09-11T05:33:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116853 2024-09-11T05:33:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822595+0000", 2024-09-11T05:33:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822595+0000", 2024-09-11T05:33:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822596+0000", 2024-09-11T05:33:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.27e-07 2024-09-11T05:33:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822598+0000", 2024-09-11T05:33:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0209999999999998e-06 2024-09-11T05:33:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822603+0000", 2024-09-11T05:33:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2970000000000003e-06 2024-09-11T05:33:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822608+0000", 2024-09-11T05:33:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7620000000000003e-06 2024-09-11T05:33:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827702+0000", 2024-09-11T05:33:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050946409999999996 2024-09-11T05:33:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827709+0000", 2024-09-11T05:33:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9e-06 2024-09-11T05:33:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116885 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823255+0000", 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68816582299999995, 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68992458300000004, 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116885 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823255+0000", 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823255+0000", 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823255+0000", 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823258+0000", 2024-09-11T05:33:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.114e-06 2024-09-11T05:33:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823264+0000", 2024-09-11T05:33:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9090000000000003e-06 2024-09-11T05:33:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823269+0000", 2024-09-11T05:33:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8600000000000001e-06 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.829040+0000", 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057705270000000001 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.829048+0000", 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9580000000000007e-06 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117130 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833719+0000", 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67770182599999995, 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67949411500000001, 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117130 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833719+0000", 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833719+0000", 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833719+0000", 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3599999999999999e-07 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833721+0000", 2024-09-11T05:33:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.934e-06 2024-09-11T05:33:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833728+0000", 2024-09-11T05:33:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8709999999999999e-06 2024-09-11T05:33:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833734+0000", 2024-09-11T05:33:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4380000000000003e-06 2024-09-11T05:33:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835534+0000", 2024-09-11T05:33:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001800325 2024-09-11T05:33:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835538+0000", 2024-09-11T05:33:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8179999999999997e-06 2024-09-11T05:33:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117354 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.848627+0000", 2024-09-11T05:33:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66279384900000005, 2024-09-11T05:33:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66461839499999997, 2024-09-11T05:33:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117354 2024-09-11T05:33:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848627+0000", 2024-09-11T05:33:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848627+0000", 2024-09-11T05:33:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848628+0000", 2024-09-11T05:33:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-11T05:33:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848631+0000", 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.689e-06 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848638+0000", 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8329999999999994e-06 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848644+0000", 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1499999999999998e-06 2024-09-11T05:33:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848685+0000", 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1112999999999998e-05 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848694+0000", 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0359999999999995e-06 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117610 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.868520+0000", 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64290132300000002, 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64475923499999999, 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117610 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868520+0000", 2024-09-11T05:33:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868520+0000", 2024-09-11T05:33:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868520+0000", 2024-09-11T05:33:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7399999999999998e-07 2024-09-11T05:33:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868523+0000", 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5210000000000001e-06 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868528+0000", 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868532+0000", 2024-09-11T05:33:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1540000000000002e-06 2024-09-11T05:33:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868563+0000", 2024-09-11T05:33:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1940000000000003e-05 2024-09-11T05:33:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868568+0000", 2024-09-11T05:33:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1749999999999998e-06 2024-09-11T05:33:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116599 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888999+0000", 2024-09-11T05:33:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62242193999999995, 2024-09-11T05:33:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62436201099999999, 2024-09-11T05:33:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116599 2024-09-11T05:33:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888999+0000", 2024-09-11T05:33:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888999+0000", 2024-09-11T05:33:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888999+0000", 2024-09-11T05:33:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:33:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889000+0000", 2024-09-11T05:33:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.144e-06 2024-09-11T05:33:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889003+0000", 2024-09-11T05:33:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.038e-06 2024-09-11T05:33:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889007+0000", 2024-09-11T05:33:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5030000000000002e-06 2024-09-11T05:33:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889344+0000", 2024-09-11T05:33:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00033764899999999998 2024-09-11T05:33:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889351+0000", 2024-09-11T05:33:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2090000000000002e-06 2024-09-11T05:33:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116844 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:33:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62174087600000005, 2024-09-11T05:33:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62371422499999996, 2024-09-11T05:33:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116844 2024-09-11T05:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:33:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:33:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889681+0000", 2024-09-11T05:33:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.229e-06 2024-09-11T05:33:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889684+0000", 2024-09-11T05:33:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0130000000000002e-06 2024-09-11T05:33:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889687+0000", 2024-09-11T05:33:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7259999999999998e-06 2024-09-11T05:33:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890685+0000", 2024-09-11T05:33:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099783399999999996 2024-09-11T05:33:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890695+0000", 2024-09-11T05:33:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-09-11T05:33:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116609 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815711+0000", 2024-09-11T05:33:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69570999600000005, 2024-09-11T05:33:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69771749400000005, 2024-09-11T05:33:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116609 2024-09-11T05:33:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815711+0000", 2024-09-11T05:33:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815711+0000", 2024-09-11T05:33:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815711+0000", 2024-09-11T05:33:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T05:33:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815713+0000", 2024-09-11T05:33:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.221e-06 2024-09-11T05:33:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815719+0000", 2024-09-11T05:33:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5709999999999997e-06 2024-09-11T05:33:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815724+0000", 2024-09-11T05:33:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.967e-06 2024-09-11T05:33:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816817+0000", 2024-09-11T05:33:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001093012 2024-09-11T05:33:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816821+0000", 2024-09-11T05:33:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8689999999999997e-06 2024-09-11T05:33:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826620+0000", 2024-09-11T05:33:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097993079999999996 2024-09-11T05:33:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826626+0000", 2024-09-11T05:33:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1589999999999998e-06 2024-09-11T05:33:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116854 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822613+0000", 2024-09-11T05:33:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.688807697, 2024-09-11T05:33:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69085324299999995, 2024-09-11T05:33:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116854 2024-09-11T05:33:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822613+0000", 2024-09-11T05:33:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822613+0000", 2024-09-11T05:33:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822613+0000", 2024-09-11T05:33:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:33:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822620+0000", 2024-09-11T05:33:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T05:33:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822626+0000", 2024-09-11T05:33:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.105e-06 2024-09-11T05:33:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822630+0000", 2024-09-11T05:33:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:33:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827734+0000", 2024-09-11T05:33:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051038840000000004 2024-09-11T05:33:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827741+0000", 2024-09-11T05:33:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6139999999999997e-06 2024-09-11T05:33:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117099 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.831587+0000", 2024-09-11T05:33:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67983377, 2024-09-11T05:33:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68191255900000003, 2024-09-11T05:33:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117099 2024-09-11T05:33:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831587+0000", 2024-09-11T05:33:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831587+0000", 2024-09-11T05:33:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831588+0000", 2024-09-11T05:33:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4249999999999999e-06 2024-09-11T05:33:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831594+0000", 2024-09-11T05:33:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6699999999999999e-06 2024-09-11T05:33:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831604+0000", 2024-09-11T05:33:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6520000000000001e-06 2024-09-11T05:33:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831611+0000", 2024-09-11T05:33:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6260000000000003e-06 2024-09-11T05:33:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832373+0000", 2024-09-11T05:33:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076163499999999998 2024-09-11T05:33:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832383+0000", 2024-09-11T05:33:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9490000000000008e-06 2024-09-11T05:33:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117131 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833740+0000", 2024-09-11T05:33:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67768123999999996, 2024-09-11T05:33:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67979327000000001, 2024-09-11T05:33:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117131 2024-09-11T05:33:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833740+0000", 2024-09-11T05:33:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833740+0000", 2024-09-11T05:33:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833740+0000", 2024-09-11T05:33:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5499999999999998e-07 2024-09-11T05:33:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833742+0000", 2024-09-11T05:33:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0219999999999999e-06 2024-09-11T05:33:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833749+0000", 2024-09-11T05:33:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4189999999999999e-06 2024-09-11T05:33:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833754+0000", 2024-09-11T05:33:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2989999999999996e-06 2024-09-11T05:33:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835561+0000", 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018068559999999999 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835564+0000", 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6959999999999998e-06 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117355 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.848739+0000", 2024-09-11T05:33:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66268134999999995, 2024-09-11T05:33:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66482556500000001, 2024-09-11T05:33:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117355 2024-09-11T05:33:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848739+0000", 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848739+0000", 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848740+0000", 2024-09-11T05:33:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9999999999999997e-07 2024-09-11T05:33:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848744+0000", 2024-09-11T05:33:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.529e-06 2024-09-11T05:33:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848753+0000", 2024-09-11T05:33:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6819999999999998e-06 2024-09-11T05:33:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848759+0000", 2024-09-11T05:33:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7259999999999999e-06 2024-09-11T05:33:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848795+0000", 2024-09-11T05:33:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6316000000000003e-05 2024-09-11T05:33:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848809+0000", 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3383e-05 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117611 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.868629+0000", 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64279195099999997, 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64496935899999996, 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117611 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868629+0000", 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868629+0000", 2024-09-11T05:33:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868629+0000", 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868631+0000", 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0509999999999999e-06 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868637+0000", 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5049999999999998e-06 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868641+0000", 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7699999999999999e-06 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868676+0000", 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4999000000000002e-05 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868680+0000", 2024-09-11T05:33:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2819999999999998e-06 2024-09-11T05:33:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116600 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889027+0000", 2024-09-11T05:33:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.622393792, 2024-09-11T05:33:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62460355899999997, 2024-09-11T05:33:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116600 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889027+0000", 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889027+0000", 2024-09-11T05:33:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889027+0000", 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1399999999999997e-07 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889030+0000", 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2699999999999999e-06 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889036+0000", 2024-09-11T05:33:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.857e-06 2024-09-11T05:33:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889041+0000", 2024-09-11T05:33:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0730000000000004e-06 2024-09-11T05:33:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889386+0000", 2024-09-11T05:33:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034511500000000001 2024-09-11T05:33:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889394+0000", 2024-09-11T05:33:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2390000000000002e-06 2024-09-11T05:33:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116845 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:33:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62173064300000003, 2024-09-11T05:33:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62397371899999998, 2024-09-11T05:33:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116845 2024-09-11T05:33:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:33:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:33:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:33:39.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:33:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889692+0000", 2024-09-11T05:33:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2330000000000001e-06 2024-09-11T05:33:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889695+0000", 2024-09-11T05:33:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9249999999999999e-06 2024-09-11T05:33:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889697+0000", 2024-09-11T05:33:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:33:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890719+0000", 2024-09-11T05:33:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010218429999999999 2024-09-11T05:33:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890723+0000", 2024-09-11T05:33:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:33:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116610 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815730+0000", 2024-09-11T05:33:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69569100900000003, 2024-09-11T05:33:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69796603800000001, 2024-09-11T05:33:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116610 2024-09-11T05:33:39.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815730+0000", 2024-09-11T05:33:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815730+0000", 2024-09-11T05:33:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815730+0000", 2024-09-11T05:33:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T05:33:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815736+0000", 2024-09-11T05:33:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2179999999999996e-06 2024-09-11T05:33:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815742+0000", 2024-09-11T05:33:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T05:33:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815747+0000", 2024-09-11T05:33:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7369999999999997e-06 2024-09-11T05:33:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816844+0000", 2024-09-11T05:33:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010972779999999999 2024-09-11T05:33:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816848+0000", 2024-09-11T05:33:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6830000000000001e-06 2024-09-11T05:33:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826649+0000", 2024-09-11T05:33:39.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098019119999999994 2024-09-11T05:33:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826657+0000", 2024-09-11T05:33:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1269999999999997e-06 2024-09-11T05:33:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.848 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116855 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822636+0000", 2024-09-11T05:33:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68878457800000004, 2024-09-11T05:33:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69109865199999998, 2024-09-11T05:33:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116855 2024-09-11T05:33:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.849 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822636+0000", 2024-09-11T05:33:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822636+0000", 2024-09-11T05:33:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822637+0000", 2024-09-11T05:33:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3300000000000003e-07 2024-09-11T05:33:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822639+0000", 2024-09-11T05:33:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1710000000000001e-06 2024-09-11T05:33:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822645+0000", 2024-09-11T05:33:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8159999999999999e-06 2024-09-11T05:33:39.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822650+0000", 2024-09-11T05:33:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0379999999999999e-06 2024-09-11T05:33:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827766+0000", 2024-09-11T05:33:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051163759999999997 2024-09-11T05:33:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827772+0000", 2024-09-11T05:33:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2709999999999998e-06 2024-09-11T05:33:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117100 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.831633+0000", 2024-09-11T05:33:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67978780599999999, 2024-09-11T05:33:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68213544299999995, 2024-09-11T05:33:39.853 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117100 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831633+0000", 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831633+0000", 2024-09-11T05:33:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831633+0000", 2024-09-11T05:33:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7e-07 2024-09-11T05:33:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831636+0000", 2024-09-11T05:33:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6900000000000001e-06 2024-09-11T05:33:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831642+0000", 2024-09-11T05:33:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T05:33:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831648+0000", 2024-09-11T05:33:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.147e-06 2024-09-11T05:33:39.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832711+0000", 2024-09-11T05:33:39.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001063636 2024-09-11T05:33:39.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832719+0000", 2024-09-11T05:33:39.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1680000000000004e-06 2024-09-11T05:33:39.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.857 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117132 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833761+0000", 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67766032099999995, 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.680042488, 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117132 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833761+0000", 2024-09-11T05:33:39.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833761+0000", 2024-09-11T05:33:39.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833761+0000", 2024-09-11T05:33:39.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8599999999999999e-07 2024-09-11T05:33:39.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833763+0000", 2024-09-11T05:33:39.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1390000000000002e-06 2024-09-11T05:33:39.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833770+0000", 2024-09-11T05:33:39.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8020000000000003e-06 2024-09-11T05:33:39.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833775+0000", 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9819999999999999e-06 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835587+0000", 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018119430000000001 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835591+0000", 2024-09-11T05:33:39.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8290000000000001e-06 2024-09-11T05:33:39.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.862 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.862 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117356 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.862 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.848900+0000", 2024-09-11T05:33:39.862 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66252059500000005, 2024-09-11T05:33:39.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66493800599999997, 2024-09-11T05:33:39.862 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.862 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117356 2024-09-11T05:33:39.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.863 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848900+0000", 2024-09-11T05:33:39.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848900+0000", 2024-09-11T05:33:39.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848901+0000", 2024-09-11T05:33:39.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7999999999999995e-07 2024-09-11T05:33:39.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848904+0000", 2024-09-11T05:33:39.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2380000000000002e-06 2024-09-11T05:33:39.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848912+0000", 2024-09-11T05:33:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7389999999999999e-06 2024-09-11T05:33:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848916+0000", 2024-09-11T05:33:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0679999999999998e-06 2024-09-11T05:33:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848970+0000", 2024-09-11T05:33:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3902e-05 2024-09-11T05:33:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848978+0000", 2024-09-11T05:33:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0989999999999999e-06 2024-09-11T05:33:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117612 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.866 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.868727+0000", 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64269351500000005, 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64514292500000003, 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117612 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868727+0000", 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868727+0000", 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868728+0000", 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868730+0000", 2024-09-11T05:33:39.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3929999999999998e-06 2024-09-11T05:33:39.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868735+0000", 2024-09-11T05:33:39.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1170000000000003e-06 2024-09-11T05:33:39.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868739+0000", 2024-09-11T05:33:39.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.557e-06 2024-09-11T05:33:39.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868770+0000", 2024-09-11T05:33:39.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0873000000000001e-05 2024-09-11T05:33:39.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868774+0000", 2024-09-11T05:33:39.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-09-11T05:33:39.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.870 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.871 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116601 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.871 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889047+0000", 2024-09-11T05:33:39.871 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.622374078, 2024-09-11T05:33:39.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62485700300000002, 2024-09-11T05:33:39.871 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.871 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.871 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.872 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116601 2024-09-11T05:33:39.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.872 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889047+0000", 2024-09-11T05:33:39.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889047+0000", 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889047+0000", 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9999999999999999e-07 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889049+0000", 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9829999999999999e-06 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889055+0000", 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6330000000000001e-06 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889059+0000", 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4290000000000003e-06 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889450+0000", 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039093400000000001 2024-09-11T05:33:39.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889460+0000", 2024-09-11T05:33:39.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9920000000000002e-06 2024-09-11T05:33:39.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.875 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.875 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116846 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.875 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:33:39.875 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62170771800000002, 2024-09-11T05:33:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62422398499999998, 2024-09-11T05:33:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116846 2024-09-11T05:33:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:33:39.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:33:39.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:33:39.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-07 2024-09-11T05:33:39.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889715+0000", 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.482e-06 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889718+0000", 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889721+0000", 2024-09-11T05:33:39.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-11T05:33:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890762+0000", 2024-09-11T05:33:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010413659999999999 2024-09-11T05:33:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890772+0000", 2024-09-11T05:33:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5750000000000007e-06 2024-09-11T05:33:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116611 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815752+0000", 2024-09-11T05:33:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69566865899999997, 2024-09-11T05:33:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69821733200000002, 2024-09-11T05:33:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116611 2024-09-11T05:33:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815752+0000", 2024-09-11T05:33:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815752+0000", 2024-09-11T05:33:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815753+0000", 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5600000000000001e-07 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815755+0000", 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.029e-06 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815759+0000", 2024-09-11T05:33:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8810000000000004e-06 2024-09-11T05:33:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815763+0000", 2024-09-11T05:33:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.89e-06 2024-09-11T05:33:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816871+0000", 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001107668 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816875+0000", 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1150000000000004e-06 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826681+0000", 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098054849999999992 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826687+0000", 2024-09-11T05:33:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4200000000000004e-06 2024-09-11T05:33:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116856 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822655+0000", 2024-09-11T05:33:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68876535999999999, 2024-09-11T05:33:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69135303199999998, 2024-09-11T05:33:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116856 2024-09-11T05:33:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822655+0000", 2024-09-11T05:33:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822655+0000", 2024-09-11T05:33:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822656+0000", 2024-09-11T05:33:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:33:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822658+0000", 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0640000000000001e-06 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822663+0000", 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3279999999999996e-06 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822668+0000", 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5299999999999998e-06 2024-09-11T05:33:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827796+0000", 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005127983 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827808+0000", 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2333e-05 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117101 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.831655+0000", 2024-09-11T05:33:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67976534600000005, 2024-09-11T05:33:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68238516000000005, 2024-09-11T05:33:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117101 2024-09-11T05:33:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831655+0000", 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831655+0000", 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831656+0000", 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:33:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831658+0000", 2024-09-11T05:33:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3439999999999999e-06 2024-09-11T05:33:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831665+0000", 2024-09-11T05:33:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.657e-06 2024-09-11T05:33:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831670+0000", 2024-09-11T05:33:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6789999999999996e-06 2024-09-11T05:33:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832745+0000", 2024-09-11T05:33:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00107592 2024-09-11T05:33:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832752+0000", 2024-09-11T05:33:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0219999999999999e-06 2024-09-11T05:33:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.894 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.894 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117133 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.894 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833781+0000", 2024-09-11T05:33:39.894 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67763991599999995, 2024-09-11T05:33:39.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68029299600000004, 2024-09-11T05:33:39.894 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.894 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.895 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.895 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117133 2024-09-11T05:33:39.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.895 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833781+0000", 2024-09-11T05:33:39.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833781+0000", 2024-09-11T05:33:39.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833781+0000", 2024-09-11T05:33:39.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3299999999999998e-07 2024-09-11T05:33:39.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833783+0000", 2024-09-11T05:33:39.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.058e-06 2024-09-11T05:33:39.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833790+0000", 2024-09-11T05:33:39.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3890000000000002e-06 2024-09-11T05:33:39.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833795+0000", 2024-09-11T05:33:39.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8269999999999997e-06 2024-09-11T05:33:39.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835614+0000", 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018195830000000001 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835618+0000", 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6519999999999999e-06 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.899 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117357 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.899 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.849017+0000", 2024-09-11T05:33:39.899 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66240392800000003, 2024-09-11T05:33:39.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66510572000000001, 2024-09-11T05:33:39.899 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.899 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117357 2024-09-11T05:33:39.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.900 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849017+0000", 2024-09-11T05:33:39.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849017+0000", 2024-09-11T05:33:39.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849017+0000", 2024-09-11T05:33:39.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:33:39.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849020+0000", 2024-09-11T05:33:39.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.277e-06 2024-09-11T05:33:39.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849026+0000", 2024-09-11T05:33:39.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-11T05:33:39.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849029+0000", 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.501e-06 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849058+0000", 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8608000000000001e-05 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849062+0000", 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4739999999999999e-06 2024-09-11T05:33:39.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117613 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.868839+0000", 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64258158700000001, 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.645313629, 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117613 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868839+0000", 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868839+0000", 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868840+0000", 2024-09-11T05:33:39.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9500000000000003e-07 2024-09-11T05:33:39.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868842+0000", 2024-09-11T05:33:39.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1069999999999999e-06 2024-09-11T05:33:39.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868848+0000", 2024-09-11T05:33:39.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8200000000000002e-06 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868852+0000", 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2880000000000003e-06 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868885+0000", 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3104e-05 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868889+0000", 2024-09-11T05:33:39.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-06 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116602 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889075+0000", 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62234543899999994, 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62510914699999998, 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.907 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.908 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116602 2024-09-11T05:33:39.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.908 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889075+0000", 2024-09-11T05:33:39.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889075+0000", 2024-09-11T05:33:39.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889076+0000", 2024-09-11T05:33:39.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6300000000000001e-07 2024-09-11T05:33:39.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889077+0000", 2024-09-11T05:33:39.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.581e-06 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889082+0000", 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0830000000000003e-06 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889085+0000", 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8289999999999999e-06 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889502+0000", 2024-09-11T05:33:39.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041658899999999998 2024-09-11T05:33:39.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889507+0000", 2024-09-11T05:33:39.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8230000000000002e-06 2024-09-11T05:33:39.911 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.911 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.911 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.911 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116847 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.911 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:33:39.912 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62167802999999999, 2024-09-11T05:33:39.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62447235099999998, 2024-09-11T05:33:39.912 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.912 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.912 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.912 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116847 2024-09-11T05:33:39.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.912 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:33:39.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:33:39.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:33:39.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T05:33:39.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889747+0000", 2024-09-11T05:33:39.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.501e-06 2024-09-11T05:33:39.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889753+0000", 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1360000000000002e-06 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889756+0000", 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3110000000000001e-06 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890808+0000", 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010523240000000001 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890813+0000", 2024-09-11T05:33:39.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5650000000000003e-06 2024-09-11T05:33:39.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.916 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.916 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116612 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.916 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815768+0000", 2024-09-11T05:33:39.916 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69565254099999996, 2024-09-11T05:33:39.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69847847900000004, 2024-09-11T05:33:39.916 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.917 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.917 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.917 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116612 2024-09-11T05:33:39.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.917 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815768+0000", 2024-09-11T05:33:39.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815768+0000", 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815769+0000", 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815771+0000", 2024-09-11T05:33:39.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815776+0000", 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2889999999999997e-06 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815780+0000", 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.126e-06 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816898+0000", 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001118181 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816902+0000", 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.681e-06 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826710+0000", 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098080700000000003 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826716+0000", 2024-09-11T05:33:39.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3470000000000004e-06 2024-09-11T05:33:39.921 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.921 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.921 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.921 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116857 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.921 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822673+0000", 2024-09-11T05:33:39.921 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68874786499999996, 2024-09-11T05:33:39.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.691610693, 2024-09-11T05:33:39.921 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116857 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822673+0000", 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822673+0000", 2024-09-11T05:33:39.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822673+0000", 2024-09-11T05:33:39.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:33:39.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822675+0000", 2024-09-11T05:33:39.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.142e-06 2024-09-11T05:33:39.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822681+0000", 2024-09-11T05:33:39.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6339999999999998e-06 2024-09-11T05:33:39.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822686+0000", 2024-09-11T05:33:39.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5909999999999998e-06 2024-09-11T05:33:39.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827832+0000", 2024-09-11T05:33:39.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051467830000000003 2024-09-11T05:33:39.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827839+0000", 2024-09-11T05:33:39.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0430000000000004e-06 2024-09-11T05:33:39.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.925 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.926 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117102 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.926 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.831676+0000", 2024-09-11T05:33:39.926 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67974469400000004, 2024-09-11T05:33:39.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68263772599999994, 2024-09-11T05:33:39.926 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117102 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831676+0000", 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831676+0000", 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831677+0000", 2024-09-11T05:33:39.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.96e-07 2024-09-11T05:33:39.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831679+0000", 2024-09-11T05:33:39.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-11T05:33:39.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831685+0000", 2024-09-11T05:33:39.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9089999999999997e-06 2024-09-11T05:33:39.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831689+0000", 2024-09-11T05:33:39.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5369999999999999e-06 2024-09-11T05:33:39.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832775+0000", 2024-09-11T05:33:39.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010859579999999999 2024-09-11T05:33:39.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832782+0000", 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3339999999999998e-06 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117134 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833809+0000", 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67761188400000005, 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68053645200000001, 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.931 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117134 2024-09-11T05:33:39.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.931 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833809+0000", 2024-09-11T05:33:39.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833809+0000", 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833809+0000", 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833827+0000", 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8036000000000001e-05 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833835+0000", 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0409999999999998e-06 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833841+0000", 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.959e-06 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835641+0000", 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799344 2024-09-11T05:33:39.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835644+0000", 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.658e-06 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117358 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.849180+0000", 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.662240791, 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66519556499999999, 2024-09-11T05:33:39.934 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117358 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849180+0000", 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849180+0000", 2024-09-11T05:33:39.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849181+0000", 2024-09-11T05:33:39.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5300000000000003e-07 2024-09-11T05:33:39.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849185+0000", 2024-09-11T05:33:39.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.743e-06 2024-09-11T05:33:39.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849194+0000", 2024-09-11T05:33:39.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6409999999999997e-06 2024-09-11T05:33:39.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849199+0000", 2024-09-11T05:33:39.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3880000000000002e-06 2024-09-11T05:33:39.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849237+0000", 2024-09-11T05:33:39.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8318999999999997e-05 2024-09-11T05:33:39.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849245+0000", 2024-09-11T05:33:39.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8380000000000002e-06 2024-09-11T05:33:39.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.939 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.939 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117614 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.939 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.868934+0000", 2024-09-11T05:33:39.939 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64248706700000002, 2024-09-11T05:33:39.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64547328999999998, 2024-09-11T05:33:39.939 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.939 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.939 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117614 2024-09-11T05:33:39.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.940 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868934+0000", 2024-09-11T05:33:39.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868934+0000", 2024-09-11T05:33:39.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868934+0000", 2024-09-11T05:33:39.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.58e-07 2024-09-11T05:33:39.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868937+0000", 2024-09-11T05:33:39.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5339999999999998e-06 2024-09-11T05:33:39.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868942+0000", 2024-09-11T05:33:39.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2560000000000002e-06 2024-09-11T05:33:39.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868945+0000", 2024-09-11T05:33:39.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2430000000000001e-06 2024-09-11T05:33:39.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868977+0000", 2024-09-11T05:33:39.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1257000000000002e-05 2024-09-11T05:33:39.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.868981+0000", 2024-09-11T05:33:39.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2699999999999998e-06 2024-09-11T05:33:39.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.943 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.944 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116603 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.944 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889089+0000", 2024-09-11T05:33:39.944 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62233174899999999, 2024-09-11T05:33:39.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62534804799999999, 2024-09-11T05:33:39.944 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.945 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116603 2024-09-11T05:33:39.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.945 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889089+0000", 2024-09-11T05:33:39.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889089+0000", 2024-09-11T05:33:39.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889089+0000", 2024-09-11T05:33:39.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7399999999999999e-07 2024-09-11T05:33:39.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889091+0000", 2024-09-11T05:33:39.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.784e-06 2024-09-11T05:33:39.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889097+0000", 2024-09-11T05:33:39.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5570000000000003e-06 2024-09-11T05:33:39.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889101+0000", 2024-09-11T05:33:39.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.313e-06 2024-09-11T05:33:39.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889542+0000", 2024-09-11T05:33:39.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044089900000000002 2024-09-11T05:33:39.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889550+0000", 2024-09-11T05:33:39.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7489999999999998e-06 2024-09-11T05:33:39.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.949 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.949 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116848 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.949 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:33:39.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62166134500000003, 2024-09-11T05:33:39.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62470920600000002, 2024-09-11T05:33:39.949 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.949 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.949 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116848 2024-09-11T05:33:39.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.950 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:33:39.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:33:39.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889760+0000", 2024-09-11T05:33:39.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:33:39.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889761+0000", 2024-09-11T05:33:39.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.189e-06 2024-09-11T05:33:39.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889764+0000", 2024-09-11T05:33:39.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:33:39.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889766+0000", 2024-09-11T05:33:39.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:33:39.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890850+0000", 2024-09-11T05:33:39.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010835479999999999 2024-09-11T05:33:39.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890857+0000", 2024-09-11T05:33:39.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6299999999999998e-06 2024-09-11T05:33:39.953 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.953 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.953 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.953 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116613 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.954 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815785+0000", 2024-09-11T05:33:39.954 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69563552200000001, 2024-09-11T05:33:39.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.698715172, 2024-09-11T05:33:39.954 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.954 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.954 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.954 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.954 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.954 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.954 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116613 2024-09-11T05:33:39.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.954 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815785+0000", 2024-09-11T05:33:39.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815785+0000", 2024-09-11T05:33:39.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815786+0000", 2024-09-11T05:33:39.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T05:33:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815788+0000", 2024-09-11T05:33:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967e-06 2024-09-11T05:33:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815793+0000", 2024-09-11T05:33:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7320000000000003e-06 2024-09-11T05:33:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815798+0000", 2024-09-11T05:33:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T05:33:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816925+0000", 2024-09-11T05:33:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001127177 2024-09-11T05:33:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816929+0000", 2024-09-11T05:33:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6890000000000002e-06 2024-09-11T05:33:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826741+0000", 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098124730000000004 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826748+0000", 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5649999999999998e-06 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.959 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116858 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.959 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822692+0000", 2024-09-11T05:33:39.959 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68872926599999995, 2024-09-11T05:33:39.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69184440599999997, 2024-09-11T05:33:39.959 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116858 2024-09-11T05:33:39.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.959 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822692+0000", 2024-09-11T05:33:39.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822692+0000", 2024-09-11T05:33:39.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822692+0000", 2024-09-11T05:33:39.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2599999999999998e-07 2024-09-11T05:33:39.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822694+0000", 2024-09-11T05:33:39.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7689999999999999e-06 2024-09-11T05:33:39.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822701+0000", 2024-09-11T05:33:39.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.905e-06 2024-09-11T05:33:39.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822705+0000", 2024-09-11T05:33:39.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.809e-06 2024-09-11T05:33:39.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827862+0000", 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051571070000000002 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827869+0000", 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5640000000000002e-06 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117103 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.831695+0000", 2024-09-11T05:33:39.963 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.679725405, 2024-09-11T05:33:39.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.682872009, 2024-09-11T05:33:39.964 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.964 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117103 2024-09-11T05:33:39.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.964 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831695+0000", 2024-09-11T05:33:39.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831695+0000", 2024-09-11T05:33:39.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831696+0000", 2024-09-11T05:33:39.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T05:33:39.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831698+0000", 2024-09-11T05:33:39.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0209999999999998e-06 2024-09-11T05:33:39.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831704+0000", 2024-09-11T05:33:39.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9100000000000002e-06 2024-09-11T05:33:39.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831708+0000", 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5229999999999997e-06 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832934+0000", 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001226015 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832943+0000", 2024-09-11T05:33:39.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7749999999999998e-06 2024-09-11T05:33:39.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.968 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.968 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117135 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.968 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833850+0000", 2024-09-11T05:33:39.968 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67757091599999997, 2024-09-11T05:33:39.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68074791599999995, 2024-09-11T05:33:39.968 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.968 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.969 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117135 2024-09-11T05:33:39.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.969 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833850+0000", 2024-09-11T05:33:39.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833850+0000", 2024-09-11T05:33:39.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833850+0000", 2024-09-11T05:33:39.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6699999999999999e-07 2024-09-11T05:33:39.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833853+0000", 2024-09-11T05:33:39.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.181e-06 2024-09-11T05:33:39.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833859+0000", 2024-09-11T05:33:39.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8719999999999996e-06 2024-09-11T05:33:39.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833864+0000", 2024-09-11T05:33:39.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:33:39.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835664+0000", 2024-09-11T05:33:39.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001799173 2024-09-11T05:33:39.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835667+0000", 2024-09-11T05:33:39.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T05:33:39.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.972 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.973 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117359 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.973 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.849280+0000", 2024-09-11T05:33:39.973 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66214056700000001, 2024-09-11T05:33:39.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66534928299999996, 2024-09-11T05:33:39.973 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.973 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.973 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.973 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.974 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117359 2024-09-11T05:33:39.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.974 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849280+0000", 2024-09-11T05:33:39.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849280+0000", 2024-09-11T05:33:39.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849281+0000", 2024-09-11T05:33:39.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7299999999999996e-07 2024-09-11T05:33:39.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849283+0000", 2024-09-11T05:33:39.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5730000000000002e-06 2024-09-11T05:33:39.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849290+0000", 2024-09-11T05:33:39.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4230000000000002e-06 2024-09-11T05:33:39.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849295+0000", 2024-09-11T05:33:39.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.702e-06 2024-09-11T05:33:39.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849323+0000", 2024-09-11T05:33:39.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8311e-05 2024-09-11T05:33:39.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849328+0000", 2024-09-11T05:33:39.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8289999999999998e-06 2024-09-11T05:33:39.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.977 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.978 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117615 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.978 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.869034+0000", 2024-09-11T05:33:39.978 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64238697700000003, 2024-09-11T05:33:39.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64562814499999999, 2024-09-11T05:33:39.978 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.978 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.978 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117615 2024-09-11T05:33:39.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.979 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869034+0000", 2024-09-11T05:33:39.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869034+0000", 2024-09-11T05:33:39.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869034+0000", 2024-09-11T05:33:39.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T05:33:39.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869036+0000", 2024-09-11T05:33:39.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.12e-06 2024-09-11T05:33:39.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869042+0000", 2024-09-11T05:33:39.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4149999999999998e-06 2024-09-11T05:33:39.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869045+0000", 2024-09-11T05:33:39.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4539999999999999e-06 2024-09-11T05:33:39.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869078+0000", 2024-09-11T05:33:39.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2459000000000002e-05 2024-09-11T05:33:39.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869082+0000", 2024-09-11T05:33:39.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3159999999999998e-06 2024-09-11T05:33:39.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.982 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.982 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116604 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.982 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889115+0000", 2024-09-11T05:33:39.982 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62230620999999997, 2024-09-11T05:33:39.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.625577567, 2024-09-11T05:33:39.982 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.983 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116604 2024-09-11T05:33:39.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.983 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889115+0000", 2024-09-11T05:33:39.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889115+0000", 2024-09-11T05:33:39.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889115+0000", 2024-09-11T05:33:39.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6899999999999998e-07 2024-09-11T05:33:39.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889118+0000", 2024-09-11T05:33:39.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4250000000000001e-06 2024-09-11T05:33:39.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889125+0000", 2024-09-11T05:33:39.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0119999999999999e-06 2024-09-11T05:33:39.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889130+0000", 2024-09-11T05:33:39.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0730000000000004e-06 2024-09-11T05:33:39.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889575+0000", 2024-09-11T05:33:39.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044531200000000001 2024-09-11T05:33:39.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889579+0000", 2024-09-11T05:33:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7160000000000001e-06 2024-09-11T05:33:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116849 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:33:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62165155900000002, 2024-09-11T05:33:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62495435799999999, 2024-09-11T05:33:39.988 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.988 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116849 2024-09-11T05:33:39.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.988 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:33:39.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:33:39.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:33:39.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:33:39.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889771+0000", 2024-09-11T05:33:39.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:33:39.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889774+0000", 2024-09-11T05:33:39.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:33:39.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889776+0000", 2024-09-11T05:33:39.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.638e-06 2024-09-11T05:33:39.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890886+0000", 2024-09-11T05:33:39.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011102519999999999 2024-09-11T05:33:39.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890891+0000", 2024-09-11T05:33:39.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2200000000000003e-06 2024-09-11T05:33:39.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.991 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.992 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116614 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.992 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815810+0000", 2024-09-11T05:33:39.992 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69561121000000004, 2024-09-11T05:33:39.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69894433, 2024-09-11T05:33:39.992 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.992 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.992 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116614 2024-09-11T05:33:39.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.993 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815810+0000", 2024-09-11T05:33:39.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815810+0000", 2024-09-11T05:33:39.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815810+0000", 2024-09-11T05:33:39.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:33:39.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:39.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815812+0000", 2024-09-11T05:33:39.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1440000000000001e-06 2024-09-11T05:33:39.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:39.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815818+0000", 2024-09-11T05:33:39.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3489999999999997e-06 2024-09-11T05:33:39.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:39.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815823+0000", 2024-09-11T05:33:39.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0010000000000001e-06 2024-09-11T05:33:39.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816954+0000", 2024-09-11T05:33:39.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011301410000000001 2024-09-11T05:33:39.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:39.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816958+0000", 2024-09-11T05:33:39.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0040000000000001e-06 2024-09-11T05:33:39.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:39.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826773+0000", 2024-09-11T05:33:39.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098151160000000005 2024-09-11T05:33:39.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:39.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826779+0000", 2024-09-11T05:33:39.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6329999999999999e-06 2024-09-11T05:33:39.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.997 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:39.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:39.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.997 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116859 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:39.997 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822711+0000", 2024-09-11T05:33:39.997 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68870981200000003, 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69207958400000003, 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116859 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822711+0000", 2024-09-11T05:33:39.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:39.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822711+0000", 2024-09-11T05:33:39.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:39.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:39.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822711+0000", 2024-09-11T05:33:39.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:33:39.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:39.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:39.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822713+0000", 2024-09-11T05:33:40.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:33:40.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822720+0000", 2024-09-11T05:33:40.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3080000000000004e-06 2024-09-11T05:33:40.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822725+0000", 2024-09-11T05:33:40.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1590000000000001e-06 2024-09-11T05:33:40.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827898+0000", 2024-09-11T05:33:40.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051732870000000004 2024-09-11T05:33:40.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827906+0000", 2024-09-11T05:33:40.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6480000000000003e-06 2024-09-11T05:33:40.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.001 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.002 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117104 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.002 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.831714+0000", 2024-09-11T05:33:40.002 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67970702400000005, 2024-09-11T05:33:40.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68313015300000002, 2024-09-11T05:33:40.002 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117104 2024-09-11T05:33:40.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.003 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831714+0000", 2024-09-11T05:33:40.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831714+0000", 2024-09-11T05:33:40.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831714+0000", 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831716+0000", 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1950000000000002e-06 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831722+0000", 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4960000000000004e-06 2024-09-11T05:33:40.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831727+0000", 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.305e-06 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833140+0000", 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014128999999999999 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833150+0000", 2024-09-11T05:33:40.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7540000000000001e-06 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117136 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833872+0000", 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.677549281, 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68100500200000003, 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.006 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.007 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117136 2024-09-11T05:33:40.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.007 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833872+0000", 2024-09-11T05:33:40.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833872+0000", 2024-09-11T05:33:40.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833872+0000", 2024-09-11T05:33:40.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:33:40.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833874+0000", 2024-09-11T05:33:40.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.204e-06 2024-09-11T05:33:40.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833881+0000", 2024-09-11T05:33:40.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T05:33:40.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833887+0000", 2024-09-11T05:33:40.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8780000000000003e-06 2024-09-11T05:33:40.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835687+0000", 2024-09-11T05:33:40.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00180043 2024-09-11T05:33:40.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835691+0000", 2024-09-11T05:33:40.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5650000000000002e-06 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117360 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.849453+0000", 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66196768100000003, 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66545711500000004, 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.012 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.012 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117360 2024-09-11T05:33:40.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.012 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849453+0000", 2024-09-11T05:33:40.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849453+0000", 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849454+0000", 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849456+0000", 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1969999999999999e-06 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849461+0000", 2024-09-11T05:33:40.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8149999999999996e-06 2024-09-11T05:33:40.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849464+0000", 2024-09-11T05:33:40.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6009999999999999e-06 2024-09-11T05:33:40.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849492+0000", 2024-09-11T05:33:40.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7385999999999998e-05 2024-09-11T05:33:40.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849496+0000", 2024-09-11T05:33:40.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3200000000000001e-06 2024-09-11T05:33:40.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.015 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.016 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117616 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.016 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.869134+0000", 2024-09-11T05:33:40.016 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64228640299999995, 2024-09-11T05:33:40.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64580815700000005, 2024-09-11T05:33:40.016 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.016 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.016 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117616 2024-09-11T05:33:40.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.017 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869134+0000", 2024-09-11T05:33:40.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869134+0000", 2024-09-11T05:33:40.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869135+0000", 2024-09-11T05:33:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6100000000000001e-07 2024-09-11T05:33:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869137+0000", 2024-09-11T05:33:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5900000000000002e-06 2024-09-11T05:33:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869143+0000", 2024-09-11T05:33:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2020000000000003e-06 2024-09-11T05:33:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869146+0000", 2024-09-11T05:33:40.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2729999999999998e-06 2024-09-11T05:33:40.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869177+0000", 2024-09-11T05:33:40.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1281000000000001e-05 2024-09-11T05:33:40.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869181+0000", 2024-09-11T05:33:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.211e-06 2024-09-11T05:33:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116605 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889153+0000", 2024-09-11T05:33:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62226821200000004, 2024-09-11T05:33:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62582371800000003, 2024-09-11T05:33:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116605 2024-09-11T05:33:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889153+0000", 2024-09-11T05:33:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889153+0000", 2024-09-11T05:33:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889153+0000", 2024-09-11T05:33:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.46e-07 2024-09-11T05:33:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889155+0000", 2024-09-11T05:33:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2529999999999999e-06 2024-09-11T05:33:40.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889161+0000", 2024-09-11T05:33:40.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9020000000000004e-06 2024-09-11T05:33:40.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889166+0000", 2024-09-11T05:33:40.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T05:33:40.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889611+0000", 2024-09-11T05:33:40.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044488900000000002 2024-09-11T05:33:40.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889620+0000", 2024-09-11T05:33:40.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5839999999999995e-06 2024-09-11T05:33:40.024 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.024 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.025 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116850 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.025 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:33:40.025 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62163053300000004, 2024-09-11T05:33:40.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62521961000000004, 2024-09-11T05:33:40.025 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.025 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116850 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889791+0000", 2024-09-11T05:33:40.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:33:40.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889792+0000", 2024-09-11T05:33:40.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4899999999999999e-06 2024-09-11T05:33:40.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889795+0000", 2024-09-11T05:33:40.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:33:40.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889798+0000", 2024-09-11T05:33:40.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7089999999999998e-06 2024-09-11T05:33:40.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890924+0000", 2024-09-11T05:33:40.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001125685 2024-09-11T05:33:40.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890933+0000", 2024-09-11T05:33:40.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3340000000000008e-06 2024-09-11T05:33:40.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.029 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.029 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116615 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.029 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815829+0000", 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69559179999999998, 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.699213376, 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116615 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815829+0000", 2024-09-11T05:33:40.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815829+0000", 2024-09-11T05:33:40.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815829+0000", 2024-09-11T05:33:40.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:33:40.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815831+0000", 2024-09-11T05:33:40.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.767e-06 2024-09-11T05:33:40.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815836+0000", 2024-09-11T05:33:40.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3199999999999999e-06 2024-09-11T05:33:40.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815841+0000", 2024-09-11T05:33:40.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1309999999999999e-06 2024-09-11T05:33:40.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816983+0000", 2024-09-11T05:33:40.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001142344 2024-09-11T05:33:40.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816987+0000", 2024-09-11T05:33:40.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8750000000000002e-06 2024-09-11T05:33:40.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826826+0000", 2024-09-11T05:33:40.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098394559999999999 2024-09-11T05:33:40.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826833+0000", 2024-09-11T05:33:40.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.674e-06 2024-09-11T05:33:40.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.034 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.035 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116860 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.035 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822730+0000", 2024-09-11T05:33:40.035 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68869036100000003, 2024-09-11T05:33:40.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69235117199999996, 2024-09-11T05:33:40.035 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.035 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116860 2024-09-11T05:33:40.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.036 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822730+0000", 2024-09-11T05:33:40.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822730+0000", 2024-09-11T05:33:40.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822731+0000", 2024-09-11T05:33:40.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T05:33:40.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822733+0000", 2024-09-11T05:33:40.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.854e-06 2024-09-11T05:33:40.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822739+0000", 2024-09-11T05:33:40.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:33:40.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822743+0000", 2024-09-11T05:33:40.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6840000000000004e-06 2024-09-11T05:33:40.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827933+0000", 2024-09-11T05:33:40.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051898609999999996 2024-09-11T05:33:40.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827940+0000", 2024-09-11T05:33:40.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9870000000000002e-06 2024-09-11T05:33:40.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.039 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.040 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117105 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.040 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.831734+0000", 2024-09-11T05:33:40.040 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67968719799999999, 2024-09-11T05:33:40.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.683380247, 2024-09-11T05:33:40.040 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.040 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.040 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.040 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117105 2024-09-11T05:33:40.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.041 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831734+0000", 2024-09-11T05:33:40.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831734+0000", 2024-09-11T05:33:40.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831734+0000", 2024-09-11T05:33:40.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.53e-07 2024-09-11T05:33:40.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831736+0000", 2024-09-11T05:33:40.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-11T05:33:40.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831742+0000", 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831747+0000", 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833184+0000", 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014369910000000001 2024-09-11T05:33:40.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833191+0000", 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6599999999999995e-06 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117137 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833893+0000", 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67752747000000002, 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68125412100000005, 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.044 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.045 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.045 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117137 2024-09-11T05:33:40.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.045 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833893+0000", 2024-09-11T05:33:40.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833893+0000", 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833894+0000", 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2199999999999999e-07 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833896+0000", 2024-09-11T05:33:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0109999999999999e-06 2024-09-11T05:33:40.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833902+0000", 2024-09-11T05:33:40.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4180000000000002e-06 2024-09-11T05:33:40.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833908+0000", 2024-09-11T05:33:40.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3569999999999997e-06 2024-09-11T05:33:40.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835710+0000", 2024-09-11T05:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001802122 2024-09-11T05:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835713+0000", 2024-09-11T05:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.811e-06 2024-09-11T05:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117361 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.849851+0000", 2024-09-11T05:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66156988999999999, 2024-09-11T05:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66552255599999999, 2024-09-11T05:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117361 2024-09-11T05:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849851+0000", 2024-09-11T05:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849851+0000", 2024-09-11T05:33:40.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849852+0000", 2024-09-11T05:33:40.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8299999999999996e-07 2024-09-11T05:33:40.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849855+0000", 2024-09-11T05:33:40.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3349999999999998e-06 2024-09-11T05:33:40.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849865+0000", 2024-09-11T05:33:40.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7380000000000006e-06 2024-09-11T05:33:40.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849870+0000", 2024-09-11T05:33:40.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1989999999999997e-06 2024-09-11T05:33:40.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849922+0000", 2024-09-11T05:33:40.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2247000000000003e-05 2024-09-11T05:33:40.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849932+0000", 2024-09-11T05:33:40.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8230000000000006e-06 2024-09-11T05:33:40.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.053 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117617 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.869236+0000", 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64218467899999998, 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64617232400000002, 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117617 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869236+0000", 2024-09-11T05:33:40.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869236+0000", 2024-09-11T05:33:40.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869237+0000", 2024-09-11T05:33:40.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T05:33:40.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869239+0000", 2024-09-11T05:33:40.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1110000000000002e-06 2024-09-11T05:33:40.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869244+0000", 2024-09-11T05:33:40.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5459999999999999e-06 2024-09-11T05:33:40.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869247+0000", 2024-09-11T05:33:40.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.162e-06 2024-09-11T05:33:40.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869280+0000", 2024-09-11T05:33:40.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2509000000000003e-05 2024-09-11T05:33:40.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869284+0000", 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2610000000000004e-06 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116606 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889173+0000", 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62224821299999999, 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62627068900000005, 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116606 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889173+0000", 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889173+0000", 2024-09-11T05:33:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889173+0000", 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3599999999999999e-07 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889175+0000", 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.945e-06 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889181+0000", 2024-09-11T05:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889185+0000", 2024-09-11T05:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3800000000000004e-06 2024-09-11T05:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889644+0000", 2024-09-11T05:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000459025 2024-09-11T05:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889648+0000", 2024-09-11T05:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6519999999999999e-06 2024-09-11T05:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116851 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62159066299999999, 2024-09-11T05:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62564591599999997, 2024-09-11T05:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116851 2024-09-11T05:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889832+0000", 2024-09-11T05:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6819999999999999e-06 2024-09-11T05:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889838+0000", 2024-09-11T05:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889841+0000", 2024-09-11T05:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890957+0000", 2024-09-11T05:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001115956 2024-09-11T05:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890961+0000", 2024-09-11T05:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7050000000000001e-06 2024-09-11T05:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116616 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815846+0000", 2024-09-11T05:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69557500400000005, 2024-09-11T05:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69966534300000005, 2024-09-11T05:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116616 2024-09-11T05:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815846+0000", 2024-09-11T05:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815846+0000", 2024-09-11T05:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815846+0000", 2024-09-11T05:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815848+0000", 2024-09-11T05:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9230000000000001e-06 2024-09-11T05:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815853+0000", 2024-09-11T05:33:40.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2079999999999999e-06 2024-09-11T05:33:40.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815858+0000", 2024-09-11T05:33:40.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4129999999999999e-06 2024-09-11T05:33:40.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817013+0000", 2024-09-11T05:33:40.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00115504 2024-09-11T05:33:40.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817017+0000", 2024-09-11T05:33:40.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0820000000000001e-06 2024-09-11T05:33:40.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826857+0000", 2024-09-11T05:33:40.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00983997 2024-09-11T05:33:40.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826863+0000", 2024-09-11T05:33:40.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T05:33:40.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.072 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.072 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116861 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.072 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822750+0000", 2024-09-11T05:33:40.072 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68867115099999998, 2024-09-11T05:33:40.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69280135200000004, 2024-09-11T05:33:40.073 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.073 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.073 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.073 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.073 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.073 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.073 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116861 2024-09-11T05:33:40.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.073 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822750+0000", 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822750+0000", 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822750+0000", 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822752+0000", 2024-09-11T05:33:40.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1009999999999999e-06 2024-09-11T05:33:40.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822758+0000", 2024-09-11T05:33:40.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8799999999999996e-06 2024-09-11T05:33:40.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822763+0000", 2024-09-11T05:33:40.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7210000000000002e-06 2024-09-11T05:33:40.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827973+0000", 2024-09-11T05:33:40.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052098889999999997 2024-09-11T05:33:40.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827980+0000", 2024-09-11T05:33:40.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1940000000000001e-06 2024-09-11T05:33:40.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.077 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.077 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117106 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.077 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.831752+0000", 2024-09-11T05:33:40.077 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67966873900000002, 2024-09-11T05:33:40.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68383150500000001, 2024-09-11T05:33:40.077 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.077 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.077 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117106 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831752+0000", 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831752+0000", 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831752+0000", 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831754+0000", 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.906e-06 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.831760+0000", 2024-09-11T05:33:40.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2680000000000002e-06 2024-09-11T05:33:40.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832429+0000", 2024-09-11T05:33:40.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066919600000000005 2024-09-11T05:33:40.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833215+0000", 2024-09-11T05:33:40.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078629899999999996 2024-09-11T05:33:40.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833222+0000", 2024-09-11T05:33:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1359999999999999e-06 2024-09-11T05:33:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117138 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833914+0000", 2024-09-11T05:33:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67750695500000002, 2024-09-11T05:33:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68170324599999998, 2024-09-11T05:33:40.081 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117138 2024-09-11T05:33:40.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.082 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833914+0000", 2024-09-11T05:33:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833914+0000", 2024-09-11T05:33:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833914+0000", 2024-09-11T05:33:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5999999999999999e-07 2024-09-11T05:33:40.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833916+0000", 2024-09-11T05:33:40.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T05:33:40.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833923+0000", 2024-09-11T05:33:40.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7209999999999997e-06 2024-09-11T05:33:40.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833928+0000", 2024-09-11T05:33:40.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3129999999999998e-06 2024-09-11T05:33:40.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835735+0000", 2024-09-11T05:33:40.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018067199999999999 2024-09-11T05:33:40.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835739+0000", 2024-09-11T05:33:40.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.58e-06 2024-09-11T05:33:40.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.086 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.086 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117362 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.086 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.849891+0000", 2024-09-11T05:33:40.087 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66152960100000002, 2024-09-11T05:33:40.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66575813800000005, 2024-09-11T05:33:40.087 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.087 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.087 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117362 2024-09-11T05:33:40.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.088 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849891+0000", 2024-09-11T05:33:40.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849891+0000", 2024-09-11T05:33:40.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849892+0000", 2024-09-11T05:33:40.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7000000000000005e-07 2024-09-11T05:33:40.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849895+0000", 2024-09-11T05:33:40.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7939999999999998e-06 2024-09-11T05:33:40.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849902+0000", 2024-09-11T05:33:40.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8630000000000008e-06 2024-09-11T05:33:40.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849908+0000", 2024-09-11T05:33:40.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3299999999999998e-06 2024-09-11T05:33:40.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849962+0000", 2024-09-11T05:33:40.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.427e-05 2024-09-11T05:33:40.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849970+0000", 2024-09-11T05:33:40.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5639999999999999e-06 2024-09-11T05:33:40.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.091 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.091 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117618 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.091 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.869336+0000", 2024-09-11T05:33:40.091 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64208456700000005, 2024-09-11T05:33:40.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64634664200000003, 2024-09-11T05:33:40.091 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117618 2024-09-11T05:33:40.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.092 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869336+0000", 2024-09-11T05:33:40.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869336+0000", 2024-09-11T05:33:40.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869337+0000", 2024-09-11T05:33:40.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0900000000000002e-07 2024-09-11T05:33:40.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869339+0000", 2024-09-11T05:33:40.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4889999999999998e-06 2024-09-11T05:33:40.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869344+0000", 2024-09-11T05:33:40.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000003e-06 2024-09-11T05:33:40.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869347+0000", 2024-09-11T05:33:40.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.05e-06 2024-09-11T05:33:40.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869378+0000", 2024-09-11T05:33:40.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0719999999999997e-05 2024-09-11T05:33:40.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869382+0000", 2024-09-11T05:33:40.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2969999999999997e-06 2024-09-11T05:33:40.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.095 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.096 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116607 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.096 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889199+0000", 2024-09-11T05:33:40.096 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.622222202, 2024-09-11T05:33:40.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62651636700000002, 2024-09-11T05:33:40.096 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.096 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.096 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116607 2024-09-11T05:33:40.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.097 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889199+0000", 2024-09-11T05:33:40.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889199+0000", 2024-09-11T05:33:40.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889199+0000", 2024-09-11T05:33:40.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1399999999999998e-07 2024-09-11T05:33:40.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889201+0000", 2024-09-11T05:33:40.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6449999999999999e-06 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889206+0000", 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5140000000000001e-06 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889209+0000", 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8229999999999999e-06 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889682+0000", 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047344800000000001 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889691+0000", 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4670000000000004e-06 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116852 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:33:40.100 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62157605199999999, 2024-09-11T05:33:40.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62590405500000001, 2024-09-11T05:33:40.101 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.101 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.101 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116852 2024-09-11T05:33:40.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.101 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:33:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:33:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:33:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:33:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889846+0000", 2024-09-11T05:33:40.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.204e-06 2024-09-11T05:33:40.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889849+0000", 2024-09-11T05:33:40.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.931e-06 2024-09-11T05:33:40.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889852+0000", 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890993+0000", 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001141176 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891001+0000", 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5259999999999996e-06 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.104 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.105 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116617 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.105 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815862+0000", 2024-09-11T05:33:40.105 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69555839399999997, 2024-09-11T05:33:40.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69992046500000005, 2024-09-11T05:33:40.105 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.105 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.105 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.105 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.105 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116617 2024-09-11T05:33:40.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.106 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815862+0000", 2024-09-11T05:33:40.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815862+0000", 2024-09-11T05:33:40.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815863+0000", 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9700000000000003e-07 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815864+0000", 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.685e-06 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815870+0000", 2024-09-11T05:33:40.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1050000000000003e-06 2024-09-11T05:33:40.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815884+0000", 2024-09-11T05:33:40.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4046000000000001e-05 2024-09-11T05:33:40.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817042+0000", 2024-09-11T05:33:40.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011587920000000001 2024-09-11T05:33:40.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817046+0000", 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.765e-06 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826887+0000", 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098409250000000004 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826893+0000", 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9220000000000002e-06 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.109 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.110 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116862 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.110 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822768+0000", 2024-09-11T05:33:40.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68865249399999995, 2024-09-11T05:33:40.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69305915500000004, 2024-09-11T05:33:40.110 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.110 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116862 2024-09-11T05:33:40.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.111 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822768+0000", 2024-09-11T05:33:40.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822768+0000", 2024-09-11T05:33:40.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822769+0000", 2024-09-11T05:33:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T05:33:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822771+0000", 2024-09-11T05:33:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.934e-06 2024-09-11T05:33:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822777+0000", 2024-09-11T05:33:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-11T05:33:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822781+0000", 2024-09-11T05:33:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4599999999999996e-06 2024-09-11T05:33:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828009+0000", 2024-09-11T05:33:40.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052280820000000002 2024-09-11T05:33:40.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828016+0000", 2024-09-11T05:33:40.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4989999999999999e-06 2024-09-11T05:33:40.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.115 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117107 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.832927+0000", 2024-09-11T05:33:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67849378400000004, 2024-09-11T05:33:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68293463399999998, 2024-09-11T05:33:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117107 2024-09-11T05:33:40.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.117 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832927+0000", 2024-09-11T05:33:40.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832927+0000", 2024-09-11T05:33:40.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832928+0000", 2024-09-11T05:33:40.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1399999999999996e-07 2024-09-11T05:33:40.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832932+0000", 2024-09-11T05:33:40.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-11T05:33:40.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832942+0000", 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8330000000000006e-06 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.832949+0000", 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3540000000000002e-06 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833862+0000", 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00091281700000000001 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833987+0000", 2024-09-11T05:33:40.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012487199999999999 2024-09-11T05:33:40.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.120 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.120 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117139 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833935+0000", 2024-09-11T05:33:40.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67748612200000002, 2024-09-11T05:33:40.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.681959439, 2024-09-11T05:33:40.120 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117139 2024-09-11T05:33:40.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.121 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833935+0000", 2024-09-11T05:33:40.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833935+0000", 2024-09-11T05:33:40.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833935+0000", 2024-09-11T05:33:40.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:33:40.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833937+0000", 2024-09-11T05:33:40.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0509999999999999e-06 2024-09-11T05:33:40.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833944+0000", 2024-09-11T05:33:40.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4679999999999997e-06 2024-09-11T05:33:40.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833949+0000", 2024-09-11T05:33:40.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0080000000000002e-06 2024-09-11T05:33:40.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835760+0000", 2024-09-11T05:33:40.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018118100000000001 2024-09-11T05:33:40.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835764+0000", 2024-09-11T05:33:40.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5559999999999999e-06 2024-09-11T05:33:40.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.130 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.130 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117363 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.130 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.849916+0000", 2024-09-11T05:33:40.130 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66150446299999999, 2024-09-11T05:33:40.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66601228199999996, 2024-09-11T05:33:40.130 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117363 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849916+0000", 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849916+0000", 2024-09-11T05:33:40.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849917+0000", 2024-09-11T05:33:40.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:33:40.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849919+0000", 2024-09-11T05:33:40.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3700000000000002e-06 2024-09-11T05:33:40.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849925+0000", 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849932+0000", 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1519999999999997e-06 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849995+0000", 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3737000000000003e-05 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.850003+0000", 2024-09-11T05:33:40.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2520000000000002e-06 2024-09-11T05:33:40.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.134 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.134 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117619 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.134 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.869441+0000", 2024-09-11T05:33:40.134 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64197942299999999, 2024-09-11T05:33:40.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64652094299999996, 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117619 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869441+0000", 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869441+0000", 2024-09-11T05:33:40.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869442+0000", 2024-09-11T05:33:40.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T05:33:40.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869444+0000", 2024-09-11T05:33:40.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0470000000000001e-06 2024-09-11T05:33:40.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869449+0000", 2024-09-11T05:33:40.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4809999999999997e-06 2024-09-11T05:33:40.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869453+0000", 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.196e-06 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869485+0000", 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2094000000000001e-05 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869489+0000", 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.139 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116608 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.139 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889213+0000", 2024-09-11T05:33:40.139 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62220832400000003, 2024-09-11T05:33:40.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62678236099999995, 2024-09-11T05:33:40.139 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116608 2024-09-11T05:33:40.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.140 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889213+0000", 2024-09-11T05:33:40.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889213+0000", 2024-09-11T05:33:40.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889213+0000", 2024-09-11T05:33:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T05:33:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889214+0000", 2024-09-11T05:33:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.235e-06 2024-09-11T05:33:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889217+0000", 2024-09-11T05:33:40.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9529999999999999e-06 2024-09-11T05:33:40.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889220+0000", 2024-09-11T05:33:40.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6510000000000001e-06 2024-09-11T05:33:40.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889716+0000", 2024-09-11T05:33:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049622800000000003 2024-09-11T05:33:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889719+0000", 2024-09-11T05:33:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7069999999999998e-06 2024-09-11T05:33:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116853 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:33:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62156533400000002, 2024-09-11T05:33:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62617367800000001, 2024-09-11T05:33:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116853 2024-09-11T05:33:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:33:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:33:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889856+0000", 2024-09-11T05:33:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:33:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889857+0000", 2024-09-11T05:33:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.435e-06 2024-09-11T05:33:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889860+0000", 2024-09-11T05:33:40.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9620000000000002e-06 2024-09-11T05:33:40.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889863+0000", 2024-09-11T05:33:40.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T05:33:40.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891036+0000", 2024-09-11T05:33:40.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011734580000000001 2024-09-11T05:33:40.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891042+0000", 2024-09-11T05:33:40.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3290000000000001e-06 2024-09-11T05:33:40.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.148 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.149 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116618 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.149 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815889+0000", 2024-09-11T05:33:40.149 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69553142400000001, 2024-09-11T05:33:40.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70017236800000004, 2024-09-11T05:33:40.149 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.149 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116618 2024-09-11T05:33:40.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.150 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815889+0000", 2024-09-11T05:33:40.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815889+0000", 2024-09-11T05:33:40.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815890+0000", 2024-09-11T05:33:40.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4999999999999998e-07 2024-09-11T05:33:40.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815892+0000", 2024-09-11T05:33:40.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0880000000000002e-06 2024-09-11T05:33:40.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815897+0000", 2024-09-11T05:33:40.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0130000000000001e-06 2024-09-11T05:33:40.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815901+0000", 2024-09-11T05:33:40.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.279e-06 2024-09-11T05:33:40.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817070+0000", 2024-09-11T05:33:40.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001168868 2024-09-11T05:33:40.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817074+0000", 2024-09-11T05:33:40.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8580000000000002e-06 2024-09-11T05:33:40.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826917+0000", 2024-09-11T05:33:40.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098432899999999993 2024-09-11T05:33:40.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826924+0000", 2024-09-11T05:33:40.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7880000000000001e-06 2024-09-11T05:33:40.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116863 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822787+0000", 2024-09-11T05:33:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68863425099999998, 2024-09-11T05:33:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69332998999999995, 2024-09-11T05:33:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116863 2024-09-11T05:33:40.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.155 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822787+0000", 2024-09-11T05:33:40.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822787+0000", 2024-09-11T05:33:40.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822787+0000", 2024-09-11T05:33:40.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T05:33:40.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822789+0000", 2024-09-11T05:33:40.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.097e-06 2024-09-11T05:33:40.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822794+0000", 2024-09-11T05:33:40.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4550000000000003e-06 2024-09-11T05:33:40.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822828+0000", 2024-09-11T05:33:40.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3534000000000001e-05 2024-09-11T05:33:40.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828041+0000", 2024-09-11T05:33:40.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052134629999999998 2024-09-11T05:33:40.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828048+0000", 2024-09-11T05:33:40.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8510000000000001e-06 2024-09-11T05:33:40.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.158 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.158 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117108 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.158 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833236+0000", 2024-09-11T05:33:40.158 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.678184601, 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68291211799999996, 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117108 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833236+0000", 2024-09-11T05:33:40.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833236+0000", 2024-09-11T05:33:40.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833237+0000", 2024-09-11T05:33:40.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7100000000000001e-07 2024-09-11T05:33:40.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833241+0000", 2024-09-11T05:33:40.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0589999999999996e-06 2024-09-11T05:33:40.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833249+0000", 2024-09-11T05:33:40.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5739999999999998e-06 2024-09-11T05:33:40.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833255+0000", 2024-09-11T05:33:40.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2559999999999999e-06 2024-09-11T05:33:40.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.834851+0000", 2024-09-11T05:33:40.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015966140000000001 2024-09-11T05:33:40.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.834865+0000", 2024-09-11T05:33:40.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3567000000000001e-05 2024-09-11T05:33:40.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.162 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117140 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833955+0000", 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67746619299999999, 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68222368499999997, 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117140 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833955+0000", 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833955+0000", 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833955+0000", 2024-09-11T05:33:40.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4999999999999998e-07 2024-09-11T05:33:40.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833957+0000", 2024-09-11T05:33:40.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9889999999999999e-06 2024-09-11T05:33:40.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833964+0000", 2024-09-11T05:33:40.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4930000000000003e-06 2024-09-11T05:33:40.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833968+0000", 2024-09-11T05:33:40.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6079999999999998e-06 2024-09-11T05:33:40.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835786+0000", 2024-09-11T05:33:40.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001817613 2024-09-11T05:33:40.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835789+0000", 2024-09-11T05:33:40.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:33:40.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.167 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.167 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117364 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.167 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.849996+0000", 2024-09-11T05:33:40.167 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66142473599999996, 2024-09-11T05:33:40.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66621369900000005, 2024-09-11T05:33:40.167 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117364 2024-09-11T05:33:40.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.168 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849996+0000", 2024-09-11T05:33:40.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849996+0000", 2024-09-11T05:33:40.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849997+0000", 2024-09-11T05:33:40.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.39e-07 2024-09-11T05:33:40.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.849999+0000", 2024-09-11T05:33:40.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8559999999999998e-06 2024-09-11T05:33:40.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.850006+0000", 2024-09-11T05:33:40.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7610000000000002e-06 2024-09-11T05:33:40.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.850010+0000", 2024-09-11T05:33:40.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1629999999999998e-06 2024-09-11T05:33:40.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.850044+0000", 2024-09-11T05:33:40.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3834999999999997e-05 2024-09-11T05:33:40.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.850051+0000", 2024-09-11T05:33:40.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4629999999999998e-06 2024-09-11T05:33:40.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.172 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.172 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117620 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.172 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.869548+0000", 2024-09-11T05:33:40.172 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64187304599999995, 2024-09-11T05:33:40.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64669232700000001, 2024-09-11T05:33:40.172 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117620 2024-09-11T05:33:40.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.173 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869548+0000", 2024-09-11T05:33:40.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869548+0000", 2024-09-11T05:33:40.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869548+0000", 2024-09-11T05:33:40.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6199999999999998e-07 2024-09-11T05:33:40.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869551+0000", 2024-09-11T05:33:40.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.57e-06 2024-09-11T05:33:40.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869556+0000", 2024-09-11T05:33:40.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0019999999999997e-06 2024-09-11T05:33:40.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869559+0000", 2024-09-11T05:33:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0139999999999999e-06 2024-09-11T05:33:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869591+0000", 2024-09-11T05:33:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2518000000000003e-05 2024-09-11T05:33:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869596+0000", 2024-09-11T05:33:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2529999999999998e-06 2024-09-11T05:33:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116609 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889222+0000", 2024-09-11T05:33:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62219848600000005, 2024-09-11T05:33:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62704924699999998, 2024-09-11T05:33:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116609 2024-09-11T05:33:40.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.178 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889222+0000", 2024-09-11T05:33:40.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889222+0000", 2024-09-11T05:33:40.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889223+0000", 2024-09-11T05:33:40.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2100000000000001e-07 2024-09-11T05:33:40.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889224+0000", 2024-09-11T05:33:40.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.161e-06 2024-09-11T05:33:40.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889227+0000", 2024-09-11T05:33:40.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.738e-06 2024-09-11T05:33:40.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889232+0000", 2024-09-11T05:33:40.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1309999999999999e-06 2024-09-11T05:33:40.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:33:40.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00052702499999999998 2024-09-11T05:33:40.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889768+0000", 2024-09-11T05:33:40.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0780000000000002e-06 2024-09-11T05:33:40.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.181 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.181 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116854 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.182 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:33:40.182 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62155514300000003, 2024-09-11T05:33:40.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62643627999999996, 2024-09-11T05:33:40.182 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116854 2024-09-11T05:33:40.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.182 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:33:40.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889867+0000", 2024-09-11T05:33:40.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.155e-06 2024-09-11T05:33:40.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889871+0000", 2024-09-11T05:33:40.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9260000000000002e-06 2024-09-11T05:33:40.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889875+0000", 2024-09-11T05:33:40.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.262e-06 2024-09-11T05:33:40.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891070+0000", 2024-09-11T05:33:40.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011945160000000001 2024-09-11T05:33:40.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891079+0000", 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3759999999999997e-06 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116587 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814258+0000", 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.697162477, 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70207532399999995, 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116587 2024-09-11T05:33:40.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.187 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814258+0000", 2024-09-11T05:33:40.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814258+0000", 2024-09-11T05:33:40.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814260+0000", 2024-09-11T05:33:40.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3289999999999999e-06 2024-09-11T05:33:40.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814267+0000", 2024-09-11T05:33:40.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.289e-06 2024-09-11T05:33:40.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814279+0000", 2024-09-11T05:33:40.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2367e-05 2024-09-11T05:33:40.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814288+0000", 2024-09-11T05:33:40.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4349999999999997e-06 2024-09-11T05:33:40.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815072+0000", 2024-09-11T05:33:40.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000784566 2024-09-11T05:33:40.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T05:33:40.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815078+0000", 2024-09-11T05:33:40.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.417e-06 2024-09-11T05:33:40.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825074+0000", 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099966010000000008 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825180+0000", 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010568099999999999 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.191 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116619 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.192 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815906+0000", 2024-09-11T05:33:40.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.695514878, 2024-09-11T05:33:40.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70046561600000001, 2024-09-11T05:33:40.192 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116619 2024-09-11T05:33:40.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.192 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815906+0000", 2024-09-11T05:33:40.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815906+0000", 2024-09-11T05:33:40.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815906+0000", 2024-09-11T05:33:40.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8200000000000001e-07 2024-09-11T05:33:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815908+0000", 2024-09-11T05:33:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8729999999999999e-06 2024-09-11T05:33:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815913+0000", 2024-09-11T05:33:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3739999999999997e-06 2024-09-11T05:33:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815918+0000", 2024-09-11T05:33:40.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4750000000000004e-06 2024-09-11T05:33:40.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817098+0000", 2024-09-11T05:33:40.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001180256 2024-09-11T05:33:40.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817102+0000", 2024-09-11T05:33:40.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7299999999999999e-06 2024-09-11T05:33:40.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826949+0000", 2024-09-11T05:33:40.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098466539999999998 2024-09-11T05:33:40.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826955+0000", 2024-09-11T05:33:40.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:33:40.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.197 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.197 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116864 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.197 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822836+0000", 2024-09-11T05:33:40.197 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68858475200000002, 2024-09-11T05:33:40.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.6935713, 2024-09-11T05:33:40.197 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116864 2024-09-11T05:33:40.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.198 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822836+0000", 2024-09-11T05:33:40.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822836+0000", 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822837+0000", 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822839+0000", 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5280000000000002e-06 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822846+0000", 2024-09-11T05:33:40.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5939999999999999e-06 2024-09-11T05:33:40.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822851+0000", 2024-09-11T05:33:40.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1270000000000002e-06 2024-09-11T05:33:40.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828074+0000", 2024-09-11T05:33:40.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052235739999999999 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828081+0000", 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117109 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833266+0000", 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67815530300000004, 2024-09-11T05:33:40.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68317352899999995, 2024-09-11T05:33:40.202 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117109 2024-09-11T05:33:40.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.202 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833266+0000", 2024-09-11T05:33:40.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833266+0000", 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833266+0000", 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5400000000000002e-07 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833269+0000", 2024-09-11T05:33:40.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7669999999999999e-06 2024-09-11T05:33:40.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833275+0000", 2024-09-11T05:33:40.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5039999999999999e-06 2024-09-11T05:33:40.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833280+0000", 2024-09-11T05:33:40.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1309999999999997e-06 2024-09-11T05:33:40.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.834896+0000", 2024-09-11T05:33:40.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001615422 2024-09-11T05:33:40.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.834903+0000", 2024-09-11T05:33:40.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0310000000000001e-06 2024-09-11T05:33:40.206 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.206 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.206 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.206 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117141 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.206 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833977+0000", 2024-09-11T05:33:40.206 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67744426199999996, 2024-09-11T05:33:40.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68249405399999996, 2024-09-11T05:33:40.206 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117141 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833977+0000", 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833977+0000", 2024-09-11T05:33:40.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833977+0000", 2024-09-11T05:33:40.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-07 2024-09-11T05:33:40.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833979+0000", 2024-09-11T05:33:40.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0849999999999999e-06 2024-09-11T05:33:40.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833985+0000", 2024-09-11T05:33:40.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.511e-06 2024-09-11T05:33:40.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833991+0000", 2024-09-11T05:33:40.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3190000000000002e-06 2024-09-11T05:33:40.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835809+0000", 2024-09-11T05:33:40.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001818634 2024-09-11T05:33:40.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835813+0000", 2024-09-11T05:33:40.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.647e-06 2024-09-11T05:33:40.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.210 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.210 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117365 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.210 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.850080+0000", 2024-09-11T05:33:40.211 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66134101300000003, 2024-09-11T05:33:40.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.66642115899999999, 2024-09-11T05:33:40.211 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.211 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117365 2024-09-11T05:33:40.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.211 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.850080+0000", 2024-09-11T05:33:40.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.850080+0000", 2024-09-11T05:33:40.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.850080+0000", 2024-09-11T05:33:40.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0999999999999998e-07 2024-09-11T05:33:40.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.850084+0000", 2024-09-11T05:33:40.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2949999999999998e-06 2024-09-11T05:33:40.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.850092+0000", 2024-09-11T05:33:40.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0199999999999994e-06 2024-09-11T05:33:40.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.850095+0000", 2024-09-11T05:33:40.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7290000000000002e-06 2024-09-11T05:33:40.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.850130+0000", 2024-09-11T05:33:40.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4969999999999999e-05 2024-09-11T05:33:40.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.850135+0000", 2024-09-11T05:33:40.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0010000000000001e-06 2024-09-11T05:33:40.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.215 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.215 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117621 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.215 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.869817+0000", 2024-09-11T05:33:40.215 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64160401600000005, 2024-09-11T05:33:40.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.64671568700000004, 2024-09-11T05:33:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117621 2024-09-11T05:33:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869817+0000", 2024-09-11T05:33:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869817+0000", 2024-09-11T05:33:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869817+0000", 2024-09-11T05:33:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:33:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869819+0000", 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2529999999999999e-06 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869826+0000", 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1179999999999997e-06 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869829+0000", 2024-09-11T05:33:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4630000000000001e-06 2024-09-11T05:33:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869864+0000", 2024-09-11T05:33:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4879000000000003e-05 2024-09-11T05:33:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.869868+0000", 2024-09-11T05:33:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2989999999999998e-06 2024-09-11T05:33:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116610 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889236+0000", 2024-09-11T05:33:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62218529899999997, 2024-09-11T05:33:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.627327305, 2024-09-11T05:33:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116610 2024-09-11T05:33:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889236+0000", 2024-09-11T05:33:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889236+0000", 2024-09-11T05:33:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889236+0000", 2024-09-11T05:33:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.03e-07 2024-09-11T05:33:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889241+0000", 2024-09-11T05:33:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4269999999999999e-06 2024-09-11T05:33:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889254+0000", 2024-09-11T05:33:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.291e-05 2024-09-11T05:33:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889259+0000", 2024-09-11T05:33:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6999999999999999e-06 2024-09-11T05:33:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889793+0000", 2024-09-11T05:33:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053400799999999999 2024-09-11T05:33:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889796+0000", 2024-09-11T05:33:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5980000000000001e-06 2024-09-11T05:33:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116588 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814304+0000", 2024-09-11T05:33:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69711675100000003, 2024-09-11T05:33:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70229014999999995, 2024-09-11T05:33:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116588 2024-09-11T05:33:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814304+0000", 2024-09-11T05:33:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814304+0000", 2024-09-11T05:33:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814304+0000", 2024-09-11T05:33:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:33:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814307+0000", 2024-09-11T05:33:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8959999999999999e-06 2024-09-11T05:33:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814314+0000", 2024-09-11T05:33:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7669999999999998e-06 2024-09-11T05:33:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814319+0000", 2024-09-11T05:33:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.135e-06 2024-09-11T05:33:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815127+0000", 2024-09-11T05:33:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080804900000000003 2024-09-11T05:33:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815132+0000", 2024-09-11T05:33:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-11T05:33:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825247+0000", 2024-09-11T05:33:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010115002999999999 2024-09-11T05:33:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825255+0000", 2024-09-11T05:33:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5350000000000004e-06 2024-09-11T05:33:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116620 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815923+0000", 2024-09-11T05:33:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69549799599999995, 2024-09-11T05:33:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70070870299999999, 2024-09-11T05:33:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116620 2024-09-11T05:33:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815923+0000", 2024-09-11T05:33:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815923+0000", 2024-09-11T05:33:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815923+0000", 2024-09-11T05:33:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0699999999999998e-07 2024-09-11T05:33:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815925+0000", 2024-09-11T05:33:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8619999999999999e-06 2024-09-11T05:33:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815930+0000", 2024-09-11T05:33:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3489999999999999e-06 2024-09-11T05:33:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815935+0000", 2024-09-11T05:33:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2429999999999999e-06 2024-09-11T05:33:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817131+0000", 2024-09-11T05:33:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011963259999999999 2024-09-11T05:33:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817135+0000", 2024-09-11T05:33:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1579999999999998e-06 2024-09-11T05:33:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826978+0000", 2024-09-11T05:33:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098427500000000008 2024-09-11T05:33:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.826984+0000", 2024-09-11T05:33:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4479999999999999e-06 2024-09-11T05:33:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116865 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822857+0000", 2024-09-11T05:33:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68856360400000005, 2024-09-11T05:33:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69380982700000005, 2024-09-11T05:33:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116865 2024-09-11T05:33:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822857+0000", 2024-09-11T05:33:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822857+0000", 2024-09-11T05:33:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822858+0000", 2024-09-11T05:33:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:33:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822860+0000", 2024-09-11T05:33:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1399999999999998e-06 2024-09-11T05:33:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822865+0000", 2024-09-11T05:33:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5130000000000004e-06 2024-09-11T05:33:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822871+0000", 2024-09-11T05:33:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:33:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828108+0000", 2024-09-11T05:33:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052369499999999998 2024-09-11T05:33:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828115+0000", 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0190000000000001e-06 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117110 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833288+0000", 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67813322399999998, 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68341105899999999, 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117110 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833288+0000", 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833288+0000", 2024-09-11T05:33:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833288+0000", 2024-09-11T05:33:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:33:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833298+0000", 2024-09-11T05:33:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4839999999999993e-06 2024-09-11T05:33:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833304+0000", 2024-09-11T05:33:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6370000000000002e-06 2024-09-11T05:33:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833309+0000", 2024-09-11T05:33:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0139999999999998e-06 2024-09-11T05:33:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.834931+0000", 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00162144 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.834937+0000", 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7390000000000002e-06 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117334 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.846200+0000", 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66522045100000005, 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67052851199999997, 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117334 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846200+0000", 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846200+0000", 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846202+0000", 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.218e-06 2024-09-11T05:33:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846207+0000", 2024-09-11T05:33:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9629999999999997e-06 2024-09-11T05:33:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846215+0000", 2024-09-11T05:33:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6289999999999999e-06 2024-09-11T05:33:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846221+0000", 2024-09-11T05:33:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8900000000000004e-06 2024-09-11T05:33:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846274+0000", 2024-09-11T05:33:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3180000000000002e-05 2024-09-11T05:33:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846281+0000", 2024-09-11T05:33:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7719999999999997e-06 2024-09-11T05:33:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117590 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.866441+0000", 2024-09-11T05:33:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64498023699999996, 2024-09-11T05:33:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65031966399999996, 2024-09-11T05:33:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117590 2024-09-11T05:33:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866441+0000", 2024-09-11T05:33:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866441+0000", 2024-09-11T05:33:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866442+0000", 2024-09-11T05:33:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1289999999999999e-06 2024-09-11T05:33:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866446+0000", 2024-09-11T05:33:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1320000000000004e-06 2024-09-11T05:33:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866454+0000", 2024-09-11T05:33:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.746e-06 2024-09-11T05:33:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866459+0000", 2024-09-11T05:33:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0350000000000001e-06 2024-09-11T05:33:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866513+0000", 2024-09-11T05:33:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3937999999999998e-05 2024-09-11T05:33:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866518+0000", 2024-09-11T05:33:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8259999999999998e-06 2024-09-11T05:33:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117846 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.887341+0000", 2024-09-11T05:33:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.624080156, 2024-09-11T05:33:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62945098200000005, 2024-09-11T05:33:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117846 2024-09-11T05:33:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887341+0000", 2024-09-11T05:33:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887341+0000", 2024-09-11T05:33:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887342+0000", 2024-09-11T05:33:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T05:33:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887346+0000", 2024-09-11T05:33:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3379999999999998e-06 2024-09-11T05:33:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887356+0000", 2024-09-11T05:33:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0003999999999999e-05 2024-09-11T05:33:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887361+0000", 2024-09-11T05:33:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2630000000000003e-06 2024-09-11T05:33:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887417+0000", 2024-09-11T05:33:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5617e-05 2024-09-11T05:33:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887423+0000", 2024-09-11T05:33:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5320000000000003e-06 2024-09-11T05:33:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116611 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889267+0000", 2024-09-11T05:33:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62215427499999998, 2024-09-11T05:33:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62757672600000003, 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116611 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889267+0000", 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889267+0000", 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889267+0000", 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3700000000000001e-07 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889269+0000", 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1639999999999999e-06 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889274+0000", 2024-09-11T05:33:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3340000000000001e-06 2024-09-11T05:33:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889279+0000", 2024-09-11T05:33:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6530000000000002e-06 2024-09-11T05:33:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889844+0000", 2024-09-11T05:33:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056473000000000005 2024-09-11T05:33:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889853+0000", 2024-09-11T05:33:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4520000000000003e-06 2024-09-11T05:33:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116589 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814326+0000", 2024-09-11T05:33:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.697094769, 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70255103799999996, 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116589 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814326+0000", 2024-09-11T05:33:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814326+0000", 2024-09-11T05:33:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814326+0000", 2024-09-11T05:33:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:33:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814329+0000", 2024-09-11T05:33:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3190000000000002e-06 2024-09-11T05:33:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814335+0000", 2024-09-11T05:33:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8640000000000001e-06 2024-09-11T05:33:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814339+0000", 2024-09-11T05:33:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6689999999999997e-06 2024-09-11T05:33:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815161+0000", 2024-09-11T05:33:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082124599999999998 2024-09-11T05:33:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815166+0000", 2024-09-11T05:33:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4589999999999997e-06 2024-09-11T05:33:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825279+0000", 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010113459999999999 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825286+0000", 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9879999999999998e-06 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116621 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815939+0000", 2024-09-11T05:33:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69548170899999995, 2024-09-11T05:33:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70097596100000004, 2024-09-11T05:33:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116621 2024-09-11T05:33:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815939+0000", 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815939+0000", 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815939+0000", 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0400000000000002e-07 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815941+0000", 2024-09-11T05:33:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.736e-06 2024-09-11T05:33:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815947+0000", 2024-09-11T05:33:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5310000000000001e-06 2024-09-11T05:33:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815951+0000", 2024-09-11T05:33:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2629999999999997e-06 2024-09-11T05:33:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817163+0000", 2024-09-11T05:33:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012116500000000001 2024-09-11T05:33:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817167+0000", 2024-09-11T05:33:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1819999999999999e-06 2024-09-11T05:33:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827007+0000", 2024-09-11T05:33:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098402149999999994 2024-09-11T05:33:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827013+0000", 2024-09-11T05:33:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3570000000000003e-06 2024-09-11T05:33:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116866 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822877+0000", 2024-09-11T05:33:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68854365699999998, 2024-09-11T05:33:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69407724900000001, 2024-09-11T05:33:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116866 2024-09-11T05:33:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822877+0000", 2024-09-11T05:33:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822877+0000", 2024-09-11T05:33:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822878+0000", 2024-09-11T05:33:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:33:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822883+0000", 2024-09-11T05:33:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5650000000000001e-06 2024-09-11T05:33:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822889+0000", 2024-09-11T05:33:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8470000000000001e-06 2024-09-11T05:33:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822894+0000", 2024-09-11T05:33:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7299999999999996e-06 2024-09-11T05:33:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828142+0000", 2024-09-11T05:33:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052483709999999999 2024-09-11T05:33:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828149+0000", 2024-09-11T05:33:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5019999999999998e-06 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117111 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833317+0000", 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67810381399999997, 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68367058199999997, 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117111 2024-09-11T05:33:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833317+0000", 2024-09-11T05:33:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833317+0000", 2024-09-11T05:33:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833317+0000", 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3099999999999998e-07 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833320+0000", 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.294e-06 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833326+0000", 2024-09-11T05:33:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7960000000000001e-06 2024-09-11T05:33:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833331+0000", 2024-09-11T05:33:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.169e-06 2024-09-11T05:33:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.834958+0000", 2024-09-11T05:33:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016275689999999999 2024-09-11T05:33:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.834965+0000", 2024-09-11T05:33:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:33:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117335 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.846294+0000", 2024-09-11T05:33:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66512711400000002, 2024-09-11T05:33:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67072588399999999, 2024-09-11T05:33:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117335 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846294+0000", 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846294+0000", 2024-09-11T05:33:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846294+0000", 2024-09-11T05:33:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0299999999999998e-07 2024-09-11T05:33:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846298+0000", 2024-09-11T05:33:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3900000000000002e-06 2024-09-11T05:33:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846304+0000", 2024-09-11T05:33:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4810000000000003e-06 2024-09-11T05:33:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846308+0000", 2024-09-11T05:33:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6780000000000002e-06 2024-09-11T05:33:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846345+0000", 2024-09-11T05:33:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6738e-05 2024-09-11T05:33:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846349+0000", 2024-09-11T05:33:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5199999999999999e-06 2024-09-11T05:33:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117591 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.866550+0000", 2024-09-11T05:33:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64487126299999997, 2024-09-11T05:33:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65050312899999996, 2024-09-11T05:33:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117591 2024-09-11T05:33:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866550+0000", 2024-09-11T05:33:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866550+0000", 2024-09-11T05:33:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866550+0000", 2024-09-11T05:33:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9200000000000001e-07 2024-09-11T05:33:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866553+0000", 2024-09-11T05:33:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6680000000000001e-06 2024-09-11T05:33:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866559+0000", 2024-09-11T05:33:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3550000000000001e-06 2024-09-11T05:33:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866563+0000", 2024-09-11T05:33:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8160000000000004e-06 2024-09-11T05:33:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866600+0000", 2024-09-11T05:33:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6622999999999998e-05 2024-09-11T05:33:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866604+0000", 2024-09-11T05:33:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:33:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117847 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.887457+0000", 2024-09-11T05:33:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62396339300000003, 2024-09-11T05:33:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62962708599999995, 2024-09-11T05:33:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117847 2024-09-11T05:33:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887457+0000", 2024-09-11T05:33:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887457+0000", 2024-09-11T05:33:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887458+0000", 2024-09-11T05:33:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2399999999999997e-07 2024-09-11T05:33:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887462+0000", 2024-09-11T05:33:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7840000000000001e-06 2024-09-11T05:33:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887469+0000", 2024-09-11T05:33:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6560000000000003e-06 2024-09-11T05:33:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887473+0000", 2024-09-11T05:33:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2649999999999998e-06 2024-09-11T05:33:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887509+0000", 2024-09-11T05:33:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6579999999999999e-05 2024-09-11T05:33:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887515+0000", 2024-09-11T05:33:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2050000000000001e-06 2024-09-11T05:33:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116612 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889290+0000", 2024-09-11T05:33:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.622130725, 2024-09-11T05:33:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62782757099999997, 2024-09-11T05:33:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116612 2024-09-11T05:33:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889290+0000", 2024-09-11T05:33:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889290+0000", 2024-09-11T05:33:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889291+0000", 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5699999999999998e-07 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889293+0000", 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.119e-06 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889298+0000", 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7209999999999999e-06 2024-09-11T05:33:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889303+0000", 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.809e-06 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057690599999999997 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889887+0000", 2024-09-11T05:33:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8070000000000002e-06 2024-09-11T05:33:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116590 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814345+0000", 2024-09-11T05:33:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69707629900000001, 2024-09-11T05:33:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70280640900000002, 2024-09-11T05:33:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116590 2024-09-11T05:33:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814345+0000", 2024-09-11T05:33:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814345+0000", 2024-09-11T05:33:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814345+0000", 2024-09-11T05:33:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6199999999999999e-07 2024-09-11T05:33:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814347+0000", 2024-09-11T05:33:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4899999999999999e-06 2024-09-11T05:33:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814353+0000", 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8889999999999999e-06 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814358+0000", 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6190000000000002e-06 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815192+0000", 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083421099999999996 2024-09-11T05:33:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815196+0000", 2024-09-11T05:33:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0799999999999999e-06 2024-09-11T05:33:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825308+0000", 2024-09-11T05:33:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010111996 2024-09-11T05:33:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825315+0000", 2024-09-11T05:33:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.64e-06 2024-09-11T05:33:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116622 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815956+0000", 2024-09-11T05:33:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69546518700000004, 2024-09-11T05:33:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70123297299999998, 2024-09-11T05:33:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116622 2024-09-11T05:33:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815956+0000", 2024-09-11T05:33:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815956+0000", 2024-09-11T05:33:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815956+0000", 2024-09-11T05:33:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.39e-07 2024-09-11T05:33:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815963+0000", 2024-09-11T05:33:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8310000000000003e-06 2024-09-11T05:33:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815969+0000", 2024-09-11T05:33:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7679999999999997e-06 2024-09-11T05:33:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815973+0000", 2024-09-11T05:33:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7049999999999998e-06 2024-09-11T05:33:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817193+0000", 2024-09-11T05:33:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001220079 2024-09-11T05:33:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817197+0000", 2024-09-11T05:33:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4759999999999998e-06 2024-09-11T05:33:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827037+0000", 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098405760000000002 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827044+0000", 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.421e-06 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116867 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822900+0000", 2024-09-11T05:33:40.314 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68852103600000003, 2024-09-11T05:33:40.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69432891600000002, 2024-09-11T05:33:40.315 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116867 2024-09-11T05:33:40.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.315 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822900+0000", 2024-09-11T05:33:40.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822900+0000", 2024-09-11T05:33:40.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822900+0000", 2024-09-11T05:33:40.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1399999999999998e-07 2024-09-11T05:33:40.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822902+0000", 2024-09-11T05:33:40.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9970000000000001e-06 2024-09-11T05:33:40.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822908+0000", 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9490000000000001e-06 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822913+0000", 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5739999999999997e-06 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828174+0000", 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052617799999999998 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828181+0000", 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0339999999999999e-06 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117112 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833338+0000", 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67808291899999995, 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68392441299999995, 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117112 2024-09-11T05:33:40.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.320 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833338+0000", 2024-09-11T05:33:40.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833338+0000", 2024-09-11T05:33:40.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833338+0000", 2024-09-11T05:33:40.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0400000000000002e-07 2024-09-11T05:33:40.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833340+0000", 2024-09-11T05:33:40.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1119999999999999e-06 2024-09-11T05:33:40.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833347+0000", 2024-09-11T05:33:40.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:33:40.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833352+0000", 2024-09-11T05:33:40.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3059999999999997e-06 2024-09-11T05:33:40.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.834986+0000", 2024-09-11T05:33:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016334170000000001 2024-09-11T05:33:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.834993+0000", 2024-09-11T05:33:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8390000000000001e-06 2024-09-11T05:33:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.324 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117336 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.324 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.846393+0000", 2024-09-11T05:33:40.324 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66502811699999997, 2024-09-11T05:33:40.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67090168699999997, 2024-09-11T05:33:40.324 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117336 2024-09-11T05:33:40.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.325 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846393+0000", 2024-09-11T05:33:40.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846393+0000", 2024-09-11T05:33:40.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846393+0000", 2024-09-11T05:33:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7000000000000005e-07 2024-09-11T05:33:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846396+0000", 2024-09-11T05:33:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:33:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846402+0000", 2024-09-11T05:33:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5049999999999998e-06 2024-09-11T05:33:40.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846405+0000", 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3979999999999999e-06 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846437+0000", 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2116999999999998e-05 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846442+0000", 2024-09-11T05:33:40.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.369e-06 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117592 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.866653+0000", 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64476745199999996, 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65067417000000005, 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117592 2024-09-11T05:33:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866653+0000", 2024-09-11T05:33:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866653+0000", 2024-09-11T05:33:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866654+0000", 2024-09-11T05:33:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9200000000000001e-07 2024-09-11T05:33:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866657+0000", 2024-09-11T05:33:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6989999999999999e-06 2024-09-11T05:33:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866662+0000", 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4620000000000004e-06 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866665+0000", 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3280000000000002e-06 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866701+0000", 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5960000000000001e-05 2024-09-11T05:33:40.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866706+0000", 2024-09-11T05:33:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3780000000000003e-06 2024-09-11T05:33:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117848 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.887618+0000", 2024-09-11T05:33:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62380293799999997, 2024-09-11T05:33:40.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62974155799999998, 2024-09-11T05:33:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117848 2024-09-11T05:33:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887618+0000", 2024-09-11T05:33:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887618+0000", 2024-09-11T05:33:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887618+0000", 2024-09-11T05:33:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9999999999999997e-07 2024-09-11T05:33:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887621+0000", 2024-09-11T05:33:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7360000000000001e-06 2024-09-11T05:33:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887627+0000", 2024-09-11T05:33:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1630000000000001e-06 2024-09-11T05:33:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887631+0000", 2024-09-11T05:33:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.698e-06 2024-09-11T05:33:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887666+0000", 2024-09-11T05:33:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4748e-05 2024-09-11T05:33:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887671+0000", 2024-09-11T05:33:40.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-06 2024-09-11T05:33:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116613 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889309+0000", 2024-09-11T05:33:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62211175699999999, 2024-09-11T05:33:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62808334300000002, 2024-09-11T05:33:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116613 2024-09-11T05:33:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889309+0000", 2024-09-11T05:33:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889309+0000", 2024-09-11T05:33:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889309+0000", 2024-09-11T05:33:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0499999999999999e-07 2024-09-11T05:33:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889311+0000", 2024-09-11T05:33:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T05:33:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889317+0000", 2024-09-11T05:33:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6699999999999999e-06 2024-09-11T05:33:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889321+0000", 2024-09-11T05:33:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9049999999999999e-06 2024-09-11T05:33:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889924+0000", 2024-09-11T05:33:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060313100000000002 2024-09-11T05:33:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889933+0000", 2024-09-11T05:33:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0680000000000003e-06 2024-09-11T05:33:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116591 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814363+0000", 2024-09-11T05:33:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69705782500000002, 2024-09-11T05:33:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70306187799999997, 2024-09-11T05:33:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116591 2024-09-11T05:33:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814363+0000", 2024-09-11T05:33:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814363+0000", 2024-09-11T05:33:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814363+0000", 2024-09-11T05:33:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T05:33:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814365+0000", 2024-09-11T05:33:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-06 2024-09-11T05:33:40.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814371+0000", 2024-09-11T05:33:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5570000000000003e-06 2024-09-11T05:33:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814376+0000", 2024-09-11T05:33:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7180000000000004e-06 2024-09-11T05:33:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815225+0000", 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084973100000000005 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815230+0000", 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8690000000000003e-06 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825337+0000", 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010106819 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825344+0000", 2024-09-11T05:33:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6540000000000002e-06 2024-09-11T05:33:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116623 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815979+0000", 2024-09-11T05:33:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69544228500000005, 2024-09-11T05:33:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70148578800000005, 2024-09-11T05:33:40.347 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116623 2024-09-11T05:33:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815979+0000", 2024-09-11T05:33:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815979+0000", 2024-09-11T05:33:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815979+0000", 2024-09-11T05:33:40.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-07 2024-09-11T05:33:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815981+0000", 2024-09-11T05:33:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.857e-06 2024-09-11T05:33:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815986+0000", 2024-09-11T05:33:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4179999999999996e-06 2024-09-11T05:33:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815990+0000", 2024-09-11T05:33:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.233e-06 2024-09-11T05:33:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817220+0000", 2024-09-11T05:33:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012292939999999999 2024-09-11T05:33:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817224+0000", 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1099999999999996e-06 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827068+0000", 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098437390000000007 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827074+0000", 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3230000000000003e-06 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116868 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822919+0000", 2024-09-11T05:33:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68850207799999996, 2024-09-11T05:33:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69458457299999998, 2024-09-11T05:33:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116868 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822919+0000", 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822919+0000", 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822919+0000", 2024-09-11T05:33:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1399999999999998e-07 2024-09-11T05:33:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822921+0000", 2024-09-11T05:33:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:33:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822931+0000", 2024-09-11T05:33:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0047000000000001e-05 2024-09-11T05:33:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822936+0000", 2024-09-11T05:33:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0300000000000001e-06 2024-09-11T05:33:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828207+0000", 2024-09-11T05:33:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052708110000000002 2024-09-11T05:33:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828214+0000", 2024-09-11T05:33:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7379999999999997e-06 2024-09-11T05:33:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117113 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833359+0000", 2024-09-11T05:33:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67806195599999997, 2024-09-11T05:33:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68417654100000003, 2024-09-11T05:33:40.357 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117113 2024-09-11T05:33:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833359+0000", 2024-09-11T05:33:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833359+0000", 2024-09-11T05:33:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833359+0000", 2024-09-11T05:33:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:33:40.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833362+0000", 2024-09-11T05:33:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3350000000000001e-06 2024-09-11T05:33:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833368+0000", 2024-09-11T05:33:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9009999999999997e-06 2024-09-11T05:33:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833374+0000", 2024-09-11T05:33:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1159999999999998e-06 2024-09-11T05:33:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835015+0000", 2024-09-11T05:33:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016414439999999999 2024-09-11T05:33:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835022+0000", 2024-09-11T05:33:40.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9779999999999999e-06 2024-09-11T05:33:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117337 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.846500+0000", 2024-09-11T05:33:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66492087099999997, 2024-09-11T05:33:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67106860499999998, 2024-09-11T05:33:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117337 2024-09-11T05:33:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846500+0000", 2024-09-11T05:33:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846500+0000", 2024-09-11T05:33:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846500+0000", 2024-09-11T05:33:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T05:33:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846503+0000", 2024-09-11T05:33:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5069999999999999e-06 2024-09-11T05:33:40.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846509+0000", 2024-09-11T05:33:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6590000000000004e-06 2024-09-11T05:33:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846512+0000", 2024-09-11T05:33:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3780000000000001e-06 2024-09-11T05:33:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846545+0000", 2024-09-11T05:33:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3064000000000001e-05 2024-09-11T05:33:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846549+0000", 2024-09-11T05:33:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3640000000000001e-06 2024-09-11T05:33:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117593 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.366 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.866755+0000", 2024-09-11T05:33:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64466618799999997, 2024-09-11T05:33:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65084700699999998, 2024-09-11T05:33:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117593 2024-09-11T05:33:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866755+0000", 2024-09-11T05:33:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866755+0000", 2024-09-11T05:33:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866755+0000", 2024-09-11T05:33:40.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:33:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866757+0000", 2024-09-11T05:33:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.277e-06 2024-09-11T05:33:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866763+0000", 2024-09-11T05:33:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8000000000000004e-06 2024-09-11T05:33:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866767+0000", 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4709999999999999e-06 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866805+0000", 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8787e-05 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866810+0000", 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6829999999999999e-06 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117849 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.887729+0000", 2024-09-11T05:33:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62369192600000001, 2024-09-11T05:33:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62990448499999996, 2024-09-11T05:33:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117849 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887729+0000", 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887729+0000", 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887730+0000", 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0100000000000005e-07 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887733+0000", 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0489999999999999e-06 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887739+0000", 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8739999999999997e-06 2024-09-11T05:33:40.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887743+0000", 2024-09-11T05:33:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-06 2024-09-11T05:33:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887773+0000", 2024-09-11T05:33:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9473999999999999e-05 2024-09-11T05:33:40.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887777+0000", 2024-09-11T05:33:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7720000000000002e-06 2024-09-11T05:33:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116614 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889334+0000", 2024-09-11T05:33:40.375 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62208687600000001, 2024-09-11T05:33:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62833271499999999, 2024-09-11T05:33:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116614 2024-09-11T05:33:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889334+0000", 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889334+0000", 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889334+0000", 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7599999999999998e-07 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889336+0000", 2024-09-11T05:33:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.632e-06 2024-09-11T05:33:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889340+0000", 2024-09-11T05:33:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:33:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889343+0000", 2024-09-11T05:33:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0750000000000002e-06 2024-09-11T05:33:40.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889989+0000", 2024-09-11T05:33:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064545 2024-09-11T05:33:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889994+0000", 2024-09-11T05:33:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4779999999999999e-06 2024-09-11T05:33:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116592 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814391+0000", 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69702943100000003, 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70330749699999995, 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116592 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814391+0000", 2024-09-11T05:33:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814391+0000", 2024-09-11T05:33:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814392+0000", 2024-09-11T05:33:40.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7800000000000002e-07 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814395+0000", 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6910000000000002e-06 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814401+0000", 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6120000000000004e-06 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814406+0000", 2024-09-11T05:33:40.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7489999999999998e-06 2024-09-11T05:33:40.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815258+0000", 2024-09-11T05:33:40.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085165100000000004 2024-09-11T05:33:40.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815262+0000", 2024-09-11T05:33:40.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3159999999999998e-06 2024-09-11T05:33:40.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825365+0000", 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010103199 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825376+0000", 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0986e-05 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116624 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.815995+0000", 2024-09-11T05:33:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69542557900000002, 2024-09-11T05:33:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70174250900000001, 2024-09-11T05:33:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116624 2024-09-11T05:33:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815995+0000", 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815995+0000", 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815996+0000", 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T05:33:40.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815998+0000", 2024-09-11T05:33:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:33:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816003+0000", 2024-09-11T05:33:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4160000000000003e-06 2024-09-11T05:33:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816008+0000", 2024-09-11T05:33:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.493e-06 2024-09-11T05:33:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817249+0000", 2024-09-11T05:33:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012413229999999999 2024-09-11T05:33:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817253+0000", 2024-09-11T05:33:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9790000000000004e-06 2024-09-11T05:33:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827097+0000", 2024-09-11T05:33:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098442089999999996 2024-09-11T05:33:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827103+0000", 2024-09-11T05:33:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3829999999999997e-06 2024-09-11T05:33:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116869 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822943+0000", 2024-09-11T05:33:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68847783299999998, 2024-09-11T05:33:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69483425099999996, 2024-09-11T05:33:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116869 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822943+0000", 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822943+0000", 2024-09-11T05:33:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822943+0000", 2024-09-11T05:33:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:33:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822946+0000", 2024-09-11T05:33:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.345e-06 2024-09-11T05:33:40.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822953+0000", 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9280000000000004e-06 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822957+0000", 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7210000000000002e-06 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828243+0000", 2024-09-11T05:33:40.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052852130000000004 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828249+0000", 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5289999999999997e-06 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117114 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833380+0000", 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.678041012, 2024-09-11T05:33:40.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.684431664, 2024-09-11T05:33:40.395 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.395 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.395 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117114 2024-09-11T05:33:40.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.395 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833380+0000", 2024-09-11T05:33:40.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833380+0000", 2024-09-11T05:33:40.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833380+0000", 2024-09-11T05:33:40.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:33:40.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833383+0000", 2024-09-11T05:33:40.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4150000000000002e-06 2024-09-11T05:33:40.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833390+0000", 2024-09-11T05:33:40.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.401e-06 2024-09-11T05:33:40.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833395+0000", 2024-09-11T05:33:40.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9189999999999998e-06 2024-09-11T05:33:40.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835044+0000", 2024-09-11T05:33:40.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016490529999999999 2024-09-11T05:33:40.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835051+0000", 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7599999999999997e-06 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117338 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.846625+0000", 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66479535499999998, 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67121972100000005, 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117338 2024-09-11T05:33:40.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.400 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846625+0000", 2024-09-11T05:33:40.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846625+0000", 2024-09-11T05:33:40.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846626+0000", 2024-09-11T05:33:40.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.82e-07 2024-09-11T05:33:40.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846629+0000", 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0649999999999999e-06 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846634+0000", 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2000000000000002e-06 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846637+0000", 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1540000000000002e-06 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846672+0000", 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4168999999999998e-05 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846676+0000", 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2429999999999999e-06 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117594 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.866864+0000", 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64455715099999999, 2024-09-11T05:33:40.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65101325600000004, 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117594 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866864+0000", 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866864+0000", 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866864+0000", 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866867+0000", 2024-09-11T05:33:40.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8779999999999998e-06 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866872+0000", 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3600000000000004e-06 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866876+0000", 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2909999999999999e-06 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866907+0000", 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1551999999999999e-05 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866912+0000", 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2409999999999997e-06 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117850 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.887833+0000", 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62358743999999999, 2024-09-11T05:33:40.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63007670500000001, 2024-09-11T05:33:40.408 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117850 2024-09-11T05:33:40.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887833+0000", 2024-09-11T05:33:40.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887833+0000", 2024-09-11T05:33:40.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887834+0000", 2024-09-11T05:33:40.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5700000000000002e-07 2024-09-11T05:33:40.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887837+0000", 2024-09-11T05:33:40.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0639999999999998e-06 2024-09-11T05:33:40.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887843+0000", 2024-09-11T05:33:40.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.409e-06 2024-09-11T05:33:40.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887847+0000", 2024-09-11T05:33:40.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7950000000000001e-06 2024-09-11T05:33:40.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887876+0000", 2024-09-11T05:33:40.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9119e-05 2024-09-11T05:33:40.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887881+0000", 2024-09-11T05:33:40.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:33:40.411 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.411 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.411 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.412 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116615 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.412 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889353+0000", 2024-09-11T05:33:40.412 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62206824900000002, 2024-09-11T05:33:40.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62859093799999999, 2024-09-11T05:33:40.412 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116615 2024-09-11T05:33:40.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.413 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889353+0000", 2024-09-11T05:33:40.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889353+0000", 2024-09-11T05:33:40.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889353+0000", 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3999999999999998e-07 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889355+0000", 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0619999999999999e-06 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889360+0000", 2024-09-11T05:33:40.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4269999999999999e-06 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889363+0000", 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0070000000000002e-06 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890032+0000", 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000669124 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890042+0000", 2024-09-11T05:33:40.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1190000000000003e-06 2024-09-11T05:33:40.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.416 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.416 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116593 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.416 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814412+0000", 2024-09-11T05:33:40.416 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69700930100000003, 2024-09-11T05:33:40.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70356415800000005, 2024-09-11T05:33:40.416 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116593 2024-09-11T05:33:40.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.417 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814412+0000", 2024-09-11T05:33:40.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814412+0000", 2024-09-11T05:33:40.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814412+0000", 2024-09-11T05:33:40.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:33:40.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814414+0000", 2024-09-11T05:33:40.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0880000000000002e-06 2024-09-11T05:33:40.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814420+0000", 2024-09-11T05:33:40.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5940000000000001e-06 2024-09-11T05:33:40.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814424+0000", 2024-09-11T05:33:40.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T05:33:40.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815291+0000", 2024-09-11T05:33:40.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00086728100000000002 2024-09-11T05:33:40.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815296+0000", 2024-09-11T05:33:40.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2950000000000004e-06 2024-09-11T05:33:40.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825397+0000", 2024-09-11T05:33:40.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010101603000000001 2024-09-11T05:33:40.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825404+0000", 2024-09-11T05:33:40.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:33:40.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.421 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.422 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116625 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.422 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.816013+0000", 2024-09-11T05:33:40.422 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69540808899999995, 2024-09-11T05:33:40.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70200178800000002, 2024-09-11T05:33:40.422 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116625 2024-09-11T05:33:40.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.423 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816013+0000", 2024-09-11T05:33:40.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816013+0000", 2024-09-11T05:33:40.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816013+0000", 2024-09-11T05:33:40.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8000000000000002e-07 2024-09-11T05:33:40.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816015+0000", 2024-09-11T05:33:40.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7e-06 2024-09-11T05:33:40.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816020+0000", 2024-09-11T05:33:40.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3600000000000004e-06 2024-09-11T05:33:40.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816024+0000", 2024-09-11T05:33:40.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.194e-06 2024-09-11T05:33:40.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817279+0000", 2024-09-11T05:33:40.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012550619999999999 2024-09-11T05:33:40.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817283+0000", 2024-09-11T05:33:40.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0790000000000002e-06 2024-09-11T05:33:40.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827132+0000", 2024-09-11T05:33:40.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098482650000000001 2024-09-11T05:33:40.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827140+0000", 2024-09-11T05:33:40.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2970000000000004e-06 2024-09-11T05:33:40.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.427 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.427 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116870 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.427 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822963+0000", 2024-09-11T05:33:40.427 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68845799399999996, 2024-09-11T05:33:40.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69509178500000002, 2024-09-11T05:33:40.427 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116870 2024-09-11T05:33:40.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.428 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822963+0000", 2024-09-11T05:33:40.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822963+0000", 2024-09-11T05:33:40.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822963+0000", 2024-09-11T05:33:40.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.41e-07 2024-09-11T05:33:40.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822965+0000", 2024-09-11T05:33:40.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.978e-06 2024-09-11T05:33:40.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822971+0000", 2024-09-11T05:33:40.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6879999999999996e-06 2024-09-11T05:33:40.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822976+0000", 2024-09-11T05:33:40.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7840000000000003e-06 2024-09-11T05:33:40.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828274+0000", 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005298507 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828281+0000", 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3890000000000002e-06 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.431 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117115 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.432 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833401+0000", 2024-09-11T05:33:40.432 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.678019547, 2024-09-11T05:33:40.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68468540099999997, 2024-09-11T05:33:40.432 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117115 2024-09-11T05:33:40.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.432 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833401+0000", 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833401+0000", 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833402+0000", 2024-09-11T05:33:40.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833404+0000", 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.097e-06 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833411+0000", 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7700000000000004e-06 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833416+0000", 2024-09-11T05:33:40.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1660000000000002e-06 2024-09-11T05:33:40.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835072+0000", 2024-09-11T05:33:40.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001656313 2024-09-11T05:33:40.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835078+0000", 2024-09-11T05:33:40.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4289999999999998e-06 2024-09-11T05:33:40.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.435 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.436 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117339 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.436 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.846723+0000", 2024-09-11T05:33:40.436 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66469796699999995, 2024-09-11T05:33:40.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67141404800000004, 2024-09-11T05:33:40.436 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117339 2024-09-11T05:33:40.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.437 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846723+0000", 2024-09-11T05:33:40.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846723+0000", 2024-09-11T05:33:40.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846723+0000", 2024-09-11T05:33:40.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0400000000000002e-07 2024-09-11T05:33:40.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846726+0000", 2024-09-11T05:33:40.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.419e-06 2024-09-11T05:33:40.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846731+0000", 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846735+0000", 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3349999999999998e-06 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846772+0000", 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7024999999999999e-05 2024-09-11T05:33:40.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846781+0000", 2024-09-11T05:33:40.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7309999999999999e-06 2024-09-11T05:33:40.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.440 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.440 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117595 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.440 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.866967+0000", 2024-09-11T05:33:40.441 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.644453422, 2024-09-11T05:33:40.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65119938499999996, 2024-09-11T05:33:40.441 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117595 2024-09-11T05:33:40.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.441 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866967+0000", 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866967+0000", 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866968+0000", 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T05:33:40.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866970+0000", 2024-09-11T05:33:40.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2879999999999999e-06 2024-09-11T05:33:40.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866976+0000", 2024-09-11T05:33:40.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6579999999999999e-06 2024-09-11T05:33:40.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.866979+0000", 2024-09-11T05:33:40.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2729999999999998e-06 2024-09-11T05:33:40.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867012+0000", 2024-09-11T05:33:40.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2756999999999998e-05 2024-09-11T05:33:40.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867016+0000", 2024-09-11T05:33:40.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2989999999999998e-06 2024-09-11T05:33:40.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.445 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.445 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117851 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.445 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.887936+0000", 2024-09-11T05:33:40.445 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62348434600000002, 2024-09-11T05:33:40.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63026168400000004, 2024-09-11T05:33:40.445 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117851 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887936+0000", 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887936+0000", 2024-09-11T05:33:40.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887937+0000", 2024-09-11T05:33:40.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5999999999999999e-07 2024-09-11T05:33:40.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887939+0000", 2024-09-11T05:33:40.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4729999999999999e-06 2024-09-11T05:33:40.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887946+0000", 2024-09-11T05:33:40.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.37e-06 2024-09-11T05:33:40.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887950+0000", 2024-09-11T05:33:40.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0119999999999999e-06 2024-09-11T05:33:40.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887978+0000", 2024-09-11T05:33:40.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8323999999999999e-05 2024-09-11T05:33:40.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.887982+0000", 2024-09-11T05:33:40.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:33:40.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.449 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.450 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116616 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.450 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889438+0000", 2024-09-11T05:33:40.450 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62198332099999998, 2024-09-11T05:33:40.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62879106699999998, 2024-09-11T05:33:40.450 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116616 2024-09-11T05:33:40.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.451 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889438+0000", 2024-09-11T05:33:40.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889438+0000", 2024-09-11T05:33:40.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889438+0000", 2024-09-11T05:33:40.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9800000000000003e-07 2024-09-11T05:33:40.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889441+0000", 2024-09-11T05:33:40.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0410000000000002e-06 2024-09-11T05:33:40.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889447+0000", 2024-09-11T05:33:40.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4759999999999997e-06 2024-09-11T05:33:40.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889451+0000", 2024-09-11T05:33:40.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000001e-06 2024-09-11T05:33:40.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890078+0000", 2024-09-11T05:33:40.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062747900000000001 2024-09-11T05:33:40.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890083+0000", 2024-09-11T05:33:40.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.775e-06 2024-09-11T05:33:40.454 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.454 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.454 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.454 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116594 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.454 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814429+0000", 2024-09-11T05:33:40.455 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69699171100000001, 2024-09-11T05:33:40.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70383108900000002, 2024-09-11T05:33:40.455 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116594 2024-09-11T05:33:40.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.455 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814429+0000", 2024-09-11T05:33:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814429+0000", 2024-09-11T05:33:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814429+0000", 2024-09-11T05:33:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-07 2024-09-11T05:33:40.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814431+0000", 2024-09-11T05:33:40.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.764e-06 2024-09-11T05:33:40.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814437+0000", 2024-09-11T05:33:40.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6640000000000003e-06 2024-09-11T05:33:40.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814442+0000", 2024-09-11T05:33:40.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1819999999999997e-06 2024-09-11T05:33:40.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815318+0000", 2024-09-11T05:33:40.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087632599999999997 2024-09-11T05:33:40.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815323+0000", 2024-09-11T05:33:40.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1439999999999996e-06 2024-09-11T05:33:40.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825429+0000", 2024-09-11T05:33:40.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010106616000000001 2024-09-11T05:33:40.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825436+0000", 2024-09-11T05:33:40.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7900000000000002e-06 2024-09-11T05:33:40.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.459 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.460 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116626 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.460 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.816029+0000", 2024-09-11T05:33:40.460 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.695391659, 2024-09-11T05:33:40.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.702267957, 2024-09-11T05:33:40.460 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.460 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116626 2024-09-11T05:33:40.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.461 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816029+0000", 2024-09-11T05:33:40.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816029+0000", 2024-09-11T05:33:40.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816030+0000", 2024-09-11T05:33:40.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T05:33:40.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816031+0000", 2024-09-11T05:33:40.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.781e-06 2024-09-11T05:33:40.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816037+0000", 2024-09-11T05:33:40.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.609e-06 2024-09-11T05:33:40.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816041+0000", 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3329999999999998e-06 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817306+0000", 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012643820000000001 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817309+0000", 2024-09-11T05:33:40.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.58e-06 2024-09-11T05:33:40.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827172+0000", 2024-09-11T05:33:40.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098624799999999999 2024-09-11T05:33:40.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827179+0000", 2024-09-11T05:33:40.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7219999999999999e-06 2024-09-11T05:33:40.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.464 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116871 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822981+0000", 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.688439888, 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69535183899999997, 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116871 2024-09-11T05:33:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.466 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822981+0000", 2024-09-11T05:33:40.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822981+0000", 2024-09-11T05:33:40.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822981+0000", 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822983+0000", 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.945e-06 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822989+0000", 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9479999999999996e-06 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822994+0000", 2024-09-11T05:33:40.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3199999999999999e-06 2024-09-11T05:33:40.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828305+0000", 2024-09-11T05:33:40.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053101110000000002 2024-09-11T05:33:40.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828311+0000", 2024-09-11T05:33:40.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3080000000000004e-06 2024-09-11T05:33:40.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.469 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.469 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117116 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.469 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833422+0000", 2024-09-11T05:33:40.469 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67799922800000001, 2024-09-11T05:33:40.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68494297599999998, 2024-09-11T05:33:40.469 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117116 2024-09-11T05:33:40.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.470 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833422+0000", 2024-09-11T05:33:40.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833422+0000", 2024-09-11T05:33:40.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833422+0000", 2024-09-11T05:33:40.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8699999999999995e-07 2024-09-11T05:33:40.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833424+0000", 2024-09-11T05:33:40.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.119e-06 2024-09-11T05:33:40.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833430+0000", 2024-09-11T05:33:40.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1279999999999996e-06 2024-09-11T05:33:40.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833435+0000", 2024-09-11T05:33:40.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0819999999999998e-06 2024-09-11T05:33:40.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835098+0000", 2024-09-11T05:33:40.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001662579 2024-09-11T05:33:40.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835104+0000", 2024-09-11T05:33:40.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1199999999999999e-06 2024-09-11T05:33:40.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.473 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.474 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117340 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.474 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.846892+0000", 2024-09-11T05:33:40.474 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66452844799999999, 2024-09-11T05:33:40.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67150388400000005, 2024-09-11T05:33:40.474 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.474 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.474 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.474 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117340 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846892+0000", 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846892+0000", 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846893+0000", 2024-09-11T05:33:40.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8899999999999999e-07 2024-09-11T05:33:40.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846896+0000", 2024-09-11T05:33:40.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3699999999999999e-06 2024-09-11T05:33:40.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846903+0000", 2024-09-11T05:33:40.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8070000000000002e-06 2024-09-11T05:33:40.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846907+0000", 2024-09-11T05:33:40.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9530000000000001e-06 2024-09-11T05:33:40.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846950+0000", 2024-09-11T05:33:40.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3174999999999999e-05 2024-09-11T05:33:40.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846957+0000", 2024-09-11T05:33:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T05:33:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117596 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.867065+0000", 2024-09-11T05:33:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64435535399999999, 2024-09-11T05:33:40.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65136124100000004, 2024-09-11T05:33:40.479 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.479 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117596 2024-09-11T05:33:40.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.479 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867065+0000", 2024-09-11T05:33:40.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867065+0000", 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867066+0000", 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7599999999999997e-07 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867068+0000", 2024-09-11T05:33:40.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5119999999999998e-06 2024-09-11T05:33:40.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867074+0000", 2024-09-11T05:33:40.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1490000000000002e-06 2024-09-11T05:33:40.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867077+0000", 2024-09-11T05:33:40.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-06 2024-09-11T05:33:40.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867108+0000", 2024-09-11T05:33:40.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0822999999999999e-05 2024-09-11T05:33:40.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867112+0000", 2024-09-11T05:33:40.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2350000000000001e-06 2024-09-11T05:33:40.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.482 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.483 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117852 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.483 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888038+0000", 2024-09-11T05:33:40.483 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62338249999999995, 2024-09-11T05:33:40.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63041973600000001, 2024-09-11T05:33:40.483 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117852 2024-09-11T05:33:40.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.484 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888038+0000", 2024-09-11T05:33:40.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888038+0000", 2024-09-11T05:33:40.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888039+0000", 2024-09-11T05:33:40.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:33:40.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888042+0000", 2024-09-11T05:33:40.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.734e-06 2024-09-11T05:33:40.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888048+0000", 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1210000000000003e-06 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888051+0000", 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3830000000000001e-06 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888082+0000", 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0380999999999999e-05 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888086+0000", 2024-09-11T05:33:40.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.369e-06 2024-09-11T05:33:40.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.487 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.487 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116617 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.487 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889457+0000", 2024-09-11T05:33:40.488 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.621963461, 2024-09-11T05:33:40.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62903051799999998, 2024-09-11T05:33:40.488 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.488 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.488 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.488 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.488 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116617 2024-09-11T05:33:40.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.489 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889457+0000", 2024-09-11T05:33:40.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889457+0000", 2024-09-11T05:33:40.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889458+0000", 2024-09-11T05:33:40.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.48e-07 2024-09-11T05:33:40.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889459+0000", 2024-09-11T05:33:40.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.372e-06 2024-09-11T05:33:40.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889464+0000", 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7389999999999999e-06 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889467+0000", 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.897e-06 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890118+0000", 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065102599999999997 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890128+0000", 2024-09-11T05:33:40.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9089999999999995e-06 2024-09-11T05:33:40.492 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.492 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.492 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.492 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116595 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.492 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814447+0000", 2024-09-11T05:33:40.492 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69697340500000005, 2024-09-11T05:33:40.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70407197200000005, 2024-09-11T05:33:40.492 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.493 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116595 2024-09-11T05:33:40.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.493 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814447+0000", 2024-09-11T05:33:40.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814447+0000", 2024-09-11T05:33:40.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814448+0000", 2024-09-11T05:33:40.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.41e-07 2024-09-11T05:33:40.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814450+0000", 2024-09-11T05:33:40.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2220000000000001e-06 2024-09-11T05:33:40.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814456+0000", 2024-09-11T05:33:40.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9399999999999999e-06 2024-09-11T05:33:40.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814461+0000", 2024-09-11T05:33:40.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.724e-06 2024-09-11T05:33:40.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815367+0000", 2024-09-11T05:33:40.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000906777 2024-09-11T05:33:40.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815372+0000", 2024-09-11T05:33:40.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6489999999999999e-06 2024-09-11T05:33:40.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825457+0000", 2024-09-11T05:33:40.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010085168 2024-09-11T05:33:40.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825464+0000", 2024-09-11T05:33:40.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5470000000000002e-06 2024-09-11T05:33:40.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.500 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.500 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116627 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.501 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.816046+0000", 2024-09-11T05:33:40.501 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69537467600000002, 2024-09-11T05:33:40.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70251020900000005, 2024-09-11T05:33:40.501 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116627 2024-09-11T05:33:40.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.502 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816046+0000", 2024-09-11T05:33:40.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816046+0000", 2024-09-11T05:33:40.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816047+0000", 2024-09-11T05:33:40.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5600000000000001e-07 2024-09-11T05:33:40.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816048+0000", 2024-09-11T05:33:40.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8989999999999999e-06 2024-09-11T05:33:40.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816054+0000", 2024-09-11T05:33:40.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6030000000000004e-06 2024-09-11T05:33:40.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816058+0000", 2024-09-11T05:33:40.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.33e-06 2024-09-11T05:33:40.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817331+0000", 2024-09-11T05:33:40.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012729939999999999 2024-09-11T05:33:40.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817335+0000", 2024-09-11T05:33:40.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T05:33:40.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827207+0000", 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009872044 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827215+0000", 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5469999999999999e-06 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116872 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823000+0000", 2024-09-11T05:33:40.506 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68842054500000005, 2024-09-11T05:33:40.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69559167899999996, 2024-09-11T05:33:40.507 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116872 2024-09-11T05:33:40.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.507 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823000+0000", 2024-09-11T05:33:40.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823000+0000", 2024-09-11T05:33:40.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823001+0000", 2024-09-11T05:33:40.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:33:40.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823003+0000", 2024-09-11T05:33:40.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:33:40.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823008+0000", 2024-09-11T05:33:40.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.66e-06 2024-09-11T05:33:40.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823014+0000", 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1989999999999997e-06 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828337+0000", 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053232979999999997 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828344+0000", 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117117 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833442+0000", 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67797899500000003, 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68518161899999996, 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117117 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833442+0000", 2024-09-11T05:33:40.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833442+0000", 2024-09-11T05:33:40.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833442+0000", 2024-09-11T05:33:40.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T05:33:40.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833444+0000", 2024-09-11T05:33:40.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0789999999999999e-06 2024-09-11T05:33:40.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833451+0000", 2024-09-11T05:33:40.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T05:33:40.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833456+0000", 2024-09-11T05:33:40.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0189999999999997e-06 2024-09-11T05:33:40.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835124+0000", 2024-09-11T05:33:40.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016678870000000001 2024-09-11T05:33:40.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835130+0000", 2024-09-11T05:33:40.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.02e-06 2024-09-11T05:33:40.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.515 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.515 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117341 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.515 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.846999+0000", 2024-09-11T05:33:40.515 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66442226900000001, 2024-09-11T05:33:40.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67165515099999995, 2024-09-11T05:33:40.515 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.516 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117341 2024-09-11T05:33:40.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.516 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846999+0000", 2024-09-11T05:33:40.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846999+0000", 2024-09-11T05:33:40.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.846999+0000", 2024-09-11T05:33:40.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4499999999999997e-07 2024-09-11T05:33:40.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847002+0000", 2024-09-11T05:33:40.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6840000000000001e-06 2024-09-11T05:33:40.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847009+0000", 2024-09-11T05:33:40.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8839999999999997e-06 2024-09-11T05:33:40.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847013+0000", 2024-09-11T05:33:40.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1860000000000002e-06 2024-09-11T05:33:40.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847037+0000", 2024-09-11T05:33:40.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4573999999999999e-05 2024-09-11T05:33:40.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847042+0000", 2024-09-11T05:33:40.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.126e-06 2024-09-11T05:33:40.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.520 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.520 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117597 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.520 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.867166+0000", 2024-09-11T05:33:40.520 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64425527900000001, 2024-09-11T05:33:40.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65151952199999996, 2024-09-11T05:33:40.520 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117597 2024-09-11T05:33:40.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.521 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867166+0000", 2024-09-11T05:33:40.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867166+0000", 2024-09-11T05:33:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867166+0000", 2024-09-11T05:33:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8099999999999998e-07 2024-09-11T05:33:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867168+0000", 2024-09-11T05:33:40.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.261e-06 2024-09-11T05:33:40.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867174+0000", 2024-09-11T05:33:40.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4110000000000004e-06 2024-09-11T05:33:40.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867178+0000", 2024-09-11T05:33:40.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4800000000000003e-06 2024-09-11T05:33:40.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867212+0000", 2024-09-11T05:33:40.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3538000000000003e-05 2024-09-11T05:33:40.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867216+0000", 2024-09-11T05:33:40.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2980000000000002e-06 2024-09-11T05:33:40.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.525 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117853 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.525 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888158+0000", 2024-09-11T05:33:40.525 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62326299399999996, 2024-09-11T05:33:40.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63055868199999998, 2024-09-11T05:33:40.525 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.525 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117853 2024-09-11T05:33:40.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.525 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888158+0000", 2024-09-11T05:33:40.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888158+0000", 2024-09-11T05:33:40.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888158+0000", 2024-09-11T05:33:40.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8699999999999995e-07 2024-09-11T05:33:40.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888161+0000", 2024-09-11T05:33:40.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0240000000000002e-06 2024-09-11T05:33:40.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888167+0000", 2024-09-11T05:33:40.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4600000000000002e-06 2024-09-11T05:33:40.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888170+0000", 2024-09-11T05:33:40.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5279999999999999e-06 2024-09-11T05:33:40.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888213+0000", 2024-09-11T05:33:40.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3035999999999999e-05 2024-09-11T05:33:40.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888224+0000", 2024-09-11T05:33:40.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0411000000000001e-05 2024-09-11T05:33:40.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.529 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.529 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116618 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.529 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889495+0000", 2024-09-11T05:33:40.529 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62192603400000002, 2024-09-11T05:33:40.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62925209500000001, 2024-09-11T05:33:40.529 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116618 2024-09-11T05:33:40.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.530 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889495+0000", 2024-09-11T05:33:40.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889495+0000", 2024-09-11T05:33:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889495+0000", 2024-09-11T05:33:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4600000000000001e-07 2024-09-11T05:33:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889497+0000", 2024-09-11T05:33:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6029999999999999e-06 2024-09-11T05:33:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889500+0000", 2024-09-11T05:33:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5489999999999998e-06 2024-09-11T05:33:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889503+0000", 2024-09-11T05:33:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6680000000000001e-06 2024-09-11T05:33:40.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890160+0000", 2024-09-11T05:33:40.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065706499999999997 2024-09-11T05:33:40.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890169+0000", 2024-09-11T05:33:40.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8529999999999998e-06 2024-09-11T05:33:40.533 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.533 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.533 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.534 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116596 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.534 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814466+0000", 2024-09-11T05:33:40.534 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69695466399999995, 2024-09-11T05:33:40.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70431233299999996, 2024-09-11T05:33:40.534 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.534 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116596 2024-09-11T05:33:40.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.535 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814466+0000", 2024-09-11T05:33:40.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814466+0000", 2024-09-11T05:33:40.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814467+0000", 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814468+0000", 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8300000000000001e-06 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814474+0000", 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0499999999999997e-06 2024-09-11T05:33:40.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814480+0000", 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1499999999999998e-06 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815400+0000", 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092041200000000001 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815404+0000", 2024-09-11T05:33:40.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4309999999999996e-06 2024-09-11T05:33:40.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825487+0000", 2024-09-11T05:33:40.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010083089999999999 2024-09-11T05:33:40.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825495+0000", 2024-09-11T05:33:40.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.661e-06 2024-09-11T05:33:40.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.539 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116628 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.539 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.816063+0000", 2024-09-11T05:33:40.539 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69535742300000003, 2024-09-11T05:33:40.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.702772116, 2024-09-11T05:33:40.539 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116628 2024-09-11T05:33:40.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.540 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816063+0000", 2024-09-11T05:33:40.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816063+0000", 2024-09-11T05:33:40.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816064+0000", 2024-09-11T05:33:40.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T05:33:40.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816066+0000", 2024-09-11T05:33:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7400000000000001e-06 2024-09-11T05:33:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816071+0000", 2024-09-11T05:33:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1800000000000004e-06 2024-09-11T05:33:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816075+0000", 2024-09-11T05:33:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.656e-06 2024-09-11T05:33:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817359+0000", 2024-09-11T05:33:40.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012838190000000001 2024-09-11T05:33:40.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817363+0000", 2024-09-11T05:33:40.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8990000000000003e-06 2024-09-11T05:33:40.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827242+0000", 2024-09-11T05:33:40.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098790590000000008 2024-09-11T05:33:40.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827250+0000", 2024-09-11T05:33:40.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1489999999999994e-06 2024-09-11T05:33:40.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.544 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.545 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116873 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.545 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823019+0000", 2024-09-11T05:33:40.545 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68840135700000005, 2024-09-11T05:33:40.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69585542499999997, 2024-09-11T05:33:40.545 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116873 2024-09-11T05:33:40.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.546 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823019+0000", 2024-09-11T05:33:40.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823019+0000", 2024-09-11T05:33:40.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823020+0000", 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.41e-07 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823022+0000", 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.995e-06 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823028+0000", 2024-09-11T05:33:40.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7230000000000001e-06 2024-09-11T05:33:40.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823032+0000", 2024-09-11T05:33:40.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8779999999999997e-06 2024-09-11T05:33:40.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828374+0000", 2024-09-11T05:33:40.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053412299999999998 2024-09-11T05:33:40.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828382+0000", 2024-09-11T05:33:40.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0579999999999998e-06 2024-09-11T05:33:40.549 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.549 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.549 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.550 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117118 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.550 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833462+0000", 2024-09-11T05:33:40.550 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67795878899999995, 2024-09-11T05:33:40.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68544712900000004, 2024-09-11T05:33:40.550 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.550 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.550 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.550 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.551 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.551 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117118 2024-09-11T05:33:40.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.551 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833462+0000", 2024-09-11T05:33:40.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833462+0000", 2024-09-11T05:33:40.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833462+0000", 2024-09-11T05:33:40.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5199999999999998e-07 2024-09-11T05:33:40.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833464+0000", 2024-09-11T05:33:40.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0770000000000002e-06 2024-09-11T05:33:40.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833471+0000", 2024-09-11T05:33:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9949999999999999e-06 2024-09-11T05:33:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833477+0000", 2024-09-11T05:33:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7379999999999999e-06 2024-09-11T05:33:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835148+0000", 2024-09-11T05:33:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001670569 2024-09-11T05:33:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835154+0000", 2024-09-11T05:33:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:33:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117342 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.847169+0000", 2024-09-11T05:33:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66425220900000004, 2024-09-11T05:33:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67177199200000004, 2024-09-11T05:33:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117342 2024-09-11T05:33:40.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847169+0000", 2024-09-11T05:33:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847169+0000", 2024-09-11T05:33:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847169+0000", 2024-09-11T05:33:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7899999999999997e-07 2024-09-11T05:33:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847172+0000", 2024-09-11T05:33:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6220000000000001e-06 2024-09-11T05:33:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847179+0000", 2024-09-11T05:33:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5139999999999998e-06 2024-09-11T05:33:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847183+0000", 2024-09-11T05:33:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0069999999999999e-06 2024-09-11T05:33:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847215+0000", 2024-09-11T05:33:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2258000000000002e-05 2024-09-11T05:33:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847220+0000", 2024-09-11T05:33:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1270000000000002e-06 2024-09-11T05:33:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117598 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.867266+0000", 2024-09-11T05:33:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64415433799999999, 2024-09-11T05:33:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65170693999999996, 2024-09-11T05:33:40.559 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117598 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867266+0000", 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867266+0000", 2024-09-11T05:33:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867267+0000", 2024-09-11T05:33:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:33:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867270+0000", 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867275+0000", 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2660000000000001e-06 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867279+0000", 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4179999999999999e-06 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867312+0000", 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2635000000000002e-05 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867316+0000", 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2660000000000003e-06 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116587 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888731+0000", 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62268967500000005, 2024-09-11T05:33:40.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63027406900000005, 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116587 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888731+0000", 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888731+0000", 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888732+0000", 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6300000000000005e-07 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888735+0000", 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3529999999999999e-06 2024-09-11T05:33:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888743+0000", 2024-09-11T05:33:40.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9349999999999994e-06 2024-09-11T05:33:40.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888749+0000", 2024-09-11T05:33:40.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7100000000000004e-06 2024-09-11T05:33:40.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888794+0000", 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4885999999999997e-05 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888807+0000", 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3413e-05 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116619 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889506+0000", 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.621914576, 2024-09-11T05:33:40.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.62975081300000002, 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116619 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889506+0000", 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889506+0000", 2024-09-11T05:33:40.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889506+0000", 2024-09-11T05:33:40.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:33:40.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889508+0000", 2024-09-11T05:33:40.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.282e-06 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889511+0000", 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0290000000000001e-06 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889514+0000", 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7549999999999999e-06 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890207+0000", 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069335999999999996 2024-09-11T05:33:40.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890216+0000", 2024-09-11T05:33:40.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1940000000000004e-06 2024-09-11T05:33:40.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.571 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.571 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116597 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.571 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814485+0000", 2024-09-11T05:33:40.571 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.696935788, 2024-09-11T05:33:40.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70480639099999998, 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116597 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814485+0000", 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814485+0000", 2024-09-11T05:33:40.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814485+0000", 2024-09-11T05:33:40.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:33:40.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814488+0000", 2024-09-11T05:33:40.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.26e-06 2024-09-11T05:33:40.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814552+0000", 2024-09-11T05:33:40.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3847e-05 2024-09-11T05:33:40.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814557+0000", 2024-09-11T05:33:40.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5249999999999996e-06 2024-09-11T05:33:40.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815432+0000", 2024-09-11T05:33:40.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087463500000000002 2024-09-11T05:33:40.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815436+0000", 2024-09-11T05:33:40.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2690000000000001e-06 2024-09-11T05:33:40.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825519+0000", 2024-09-11T05:33:40.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010083313 2024-09-11T05:33:40.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825527+0000", 2024-09-11T05:33:40.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3000000000000004e-06 2024-09-11T05:33:40.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.576 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.576 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116629 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.577 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.816081+0000", 2024-09-11T05:33:40.577 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69534013800000005, 2024-09-11T05:33:40.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70324845999999996, 2024-09-11T05:33:40.577 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116629 2024-09-11T05:33:40.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.577 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816081+0000", 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816081+0000", 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816081+0000", 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T05:33:40.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816083+0000", 2024-09-11T05:33:40.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.781e-06 2024-09-11T05:33:40.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816088+0000", 2024-09-11T05:33:40.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.378e-06 2024-09-11T05:33:40.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.816093+0000", 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.532e-06 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817434+0000", 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013416680000000001 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.817440+0000", 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6180000000000003e-06 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827280+0000", 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098396339999999999 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827287+0000", 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116874 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.581 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823039+0000", 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.688381927, 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69632930999999998, 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116874 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823039+0000", 2024-09-11T05:33:40.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823039+0000", 2024-09-11T05:33:40.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823039+0000", 2024-09-11T05:33:40.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1800000000000002e-07 2024-09-11T05:33:40.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823041+0000", 2024-09-11T05:33:40.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0090000000000002e-06 2024-09-11T05:33:40.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823047+0000", 2024-09-11T05:33:40.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8490000000000002e-06 2024-09-11T05:33:40.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823052+0000", 2024-09-11T05:33:40.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.775e-06 2024-09-11T05:33:40.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828445+0000", 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053933109999999996 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828454+0000", 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3799999999999994e-06 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.586 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117119 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.586 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833484+0000", 2024-09-11T05:33:40.586 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.677937189, 2024-09-11T05:33:40.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68591785999999999, 2024-09-11T05:33:40.586 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117119 2024-09-11T05:33:40.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.586 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833484+0000", 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833484+0000", 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833484+0000", 2024-09-11T05:33:40.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:33:40.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833486+0000", 2024-09-11T05:33:40.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.108e-06 2024-09-11T05:33:40.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833493+0000", 2024-09-11T05:33:40.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7390000000000002e-06 2024-09-11T05:33:40.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833497+0000", 2024-09-11T05:33:40.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5909999999999998e-06 2024-09-11T05:33:40.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835173+0000", 2024-09-11T05:33:40.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001675267 2024-09-11T05:33:40.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835179+0000", 2024-09-11T05:33:40.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5379999999999999e-06 2024-09-11T05:33:40.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.590 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.590 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117343 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.590 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.847277+0000", 2024-09-11T05:33:40.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66414375199999998, 2024-09-11T05:33:40.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67215650900000001, 2024-09-11T05:33:40.590 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117343 2024-09-11T05:33:40.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.591 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847277+0000", 2024-09-11T05:33:40.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847277+0000", 2024-09-11T05:33:40.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847278+0000", 2024-09-11T05:33:40.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5799999999999999e-07 2024-09-11T05:33:40.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847281+0000", 2024-09-11T05:33:40.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9059999999999998e-06 2024-09-11T05:33:40.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847288+0000", 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0639999999999996e-06 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847291+0000", 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6370000000000001e-06 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847325+0000", 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3762e-05 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847331+0000", 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6230000000000002e-06 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117599 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.867369+0000", 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.644051331, 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65209718900000002, 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117599 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867369+0000", 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867369+0000", 2024-09-11T05:33:40.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867370+0000", 2024-09-11T05:33:40.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:33:40.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867372+0000", 2024-09-11T05:33:40.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3590000000000002e-06 2024-09-11T05:33:40.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867378+0000", 2024-09-11T05:33:40.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-06 2024-09-11T05:33:40.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867381+0000", 2024-09-11T05:33:40.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3550000000000001e-06 2024-09-11T05:33:40.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867416+0000", 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4474000000000002e-05 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867420+0000", 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2189999999999998e-06 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116588 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.598 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888759+0000", 2024-09-11T05:33:40.599 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62266165100000004, 2024-09-11T05:33:40.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63073986699999995, 2024-09-11T05:33:40.599 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.599 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116588 2024-09-11T05:33:40.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.599 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888759+0000", 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888759+0000", 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888760+0000", 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2399999999999999e-07 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888762+0000", 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.125e-06 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888768+0000", 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3759999999999996e-06 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888773+0000", 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1290000000000004e-06 2024-09-11T05:33:40.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888851+0000", 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7373000000000006e-05 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888858+0000", 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.678e-06 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.602 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116620 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889517+0000", 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62190358300000004, 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63001602999999995, 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116620 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889517+0000", 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889517+0000", 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889517+0000", 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889519+0000", 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.178e-06 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889522+0000", 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0280000000000001e-06 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889524+0000", 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6699999999999998e-06 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890248+0000", 2024-09-11T05:33:40.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072352099999999997 2024-09-11T05:33:40.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890252+0000", 2024-09-11T05:33:40.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3290000000000004e-06 2024-09-11T05:33:40.606 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.606 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.606 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.606 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116598 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814566+0000", 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69685451799999998, 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70499903399999997, 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116598 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814566+0000", 2024-09-11T05:33:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814566+0000", 2024-09-11T05:33:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814567+0000", 2024-09-11T05:33:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1799999999999995e-07 2024-09-11T05:33:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814573+0000", 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2600000000000002e-06 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814580+0000", 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3720000000000001e-06 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814585+0000", 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9409999999999998e-06 2024-09-11T05:33:40.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815464+0000", 2024-09-11T05:33:40.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087924400000000005 2024-09-11T05:33:40.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815468+0000", 2024-09-11T05:33:40.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4490000000000001e-06 2024-09-11T05:33:40.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825548+0000", 2024-09-11T05:33:40.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010080044999999999 2024-09-11T05:33:40.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825555+0000", 2024-09-11T05:33:40.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3810000000000004e-06 2024-09-11T05:33:40.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.611 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.611 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116843 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.612 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822291+0000", 2024-09-11T05:33:40.612 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68913031999999996, 2024-09-11T05:33:40.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69731360499999995, 2024-09-11T05:33:40.612 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116843 2024-09-11T05:33:40.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.612 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822291+0000", 2024-09-11T05:33:40.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822291+0000", 2024-09-11T05:33:40.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822292+0000", 2024-09-11T05:33:40.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3060000000000001e-06 2024-09-11T05:33:40.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822296+0000", 2024-09-11T05:33:40.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5940000000000004e-06 2024-09-11T05:33:40.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822307+0000", 2024-09-11T05:33:40.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0229e-05 2024-09-11T05:33:40.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822315+0000", 2024-09-11T05:33:40.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9699999999999999e-06 2024-09-11T05:33:40.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827316+0000", 2024-09-11T05:33:40.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050009090000000004 2024-09-11T05:33:40.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827349+0000", 2024-09-11T05:33:40.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3930999999999998e-05 2024-09-11T05:33:40.615 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116875 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823058+0000", 2024-09-11T05:33:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68836321300000003, 2024-09-11T05:33:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69657955900000001, 2024-09-11T05:33:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116875 2024-09-11T05:33:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823058+0000", 2024-09-11T05:33:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823058+0000", 2024-09-11T05:33:40.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823058+0000", 2024-09-11T05:33:40.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:33:40.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823060+0000", 2024-09-11T05:33:40.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-11T05:33:40.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823067+0000", 2024-09-11T05:33:40.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9879999999999998e-06 2024-09-11T05:33:40.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823072+0000", 2024-09-11T05:33:40.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6480000000000002e-06 2024-09-11T05:33:40.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828485+0000", 2024-09-11T05:33:40.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054136649999999998 2024-09-11T05:33:40.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828494+0000", 2024-09-11T05:33:40.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0219999999999993e-06 2024-09-11T05:33:40.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.620 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.620 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117120 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.621 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833504+0000", 2024-09-11T05:33:40.621 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67791681699999995, 2024-09-11T05:33:40.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68616525799999994, 2024-09-11T05:33:40.621 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117120 2024-09-11T05:33:40.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.621 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833504+0000", 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833504+0000", 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833504+0000", 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:33:40.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833507+0000", 2024-09-11T05:33:40.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3980000000000002e-06 2024-09-11T05:33:40.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833513+0000", 2024-09-11T05:33:40.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4799999999999998e-06 2024-09-11T05:33:40.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833519+0000", 2024-09-11T05:33:40.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:33:40.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835202+0000", 2024-09-11T05:33:40.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016837620000000001 2024-09-11T05:33:40.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835209+0000", 2024-09-11T05:33:40.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2990000000000002e-06 2024-09-11T05:33:40.625 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.625 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.625 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.625 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117344 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.625 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.847453+0000", 2024-09-11T05:33:40.625 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66396765899999999, 2024-09-11T05:33:40.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67224925300000005, 2024-09-11T05:33:40.625 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117344 2024-09-11T05:33:40.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.626 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847453+0000", 2024-09-11T05:33:40.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847453+0000", 2024-09-11T05:33:40.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847454+0000", 2024-09-11T05:33:40.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4099999999999998e-07 2024-09-11T05:33:40.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847457+0000", 2024-09-11T05:33:40.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9720000000000001e-06 2024-09-11T05:33:40.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847464+0000", 2024-09-11T05:33:40.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.861e-06 2024-09-11T05:33:40.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847468+0000", 2024-09-11T05:33:40.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0300000000000004e-06 2024-09-11T05:33:40.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847503+0000", 2024-09-11T05:33:40.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5252000000000001e-05 2024-09-11T05:33:40.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847507+0000", 2024-09-11T05:33:40.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5589999999999999e-06 2024-09-11T05:33:40.630 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.630 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.630 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.631 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117600 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.631 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.867470+0000", 2024-09-11T05:33:40.631 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64395050899999995, 2024-09-11T05:33:40.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65226420699999998, 2024-09-11T05:33:40.631 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.631 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.631 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.631 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.631 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117600 2024-09-11T05:33:40.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.632 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867470+0000", 2024-09-11T05:33:40.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867470+0000", 2024-09-11T05:33:40.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867471+0000", 2024-09-11T05:33:40.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1600000000000001e-07 2024-09-11T05:33:40.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867473+0000", 2024-09-11T05:33:40.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4990000000000001e-06 2024-09-11T05:33:40.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867478+0000", 2024-09-11T05:33:40.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0810000000000001e-06 2024-09-11T05:33:40.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867482+0000", 2024-09-11T05:33:40.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0579999999999999e-06 2024-09-11T05:33:40.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867513+0000", 2024-09-11T05:33:40.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0508999999999999e-05 2024-09-11T05:33:40.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867517+0000", 2024-09-11T05:33:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2400000000000001e-06 2024-09-11T05:33:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116589 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888780+0000", 2024-09-11T05:33:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62264041000000003, 2024-09-11T05:33:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63098721099999999, 2024-09-11T05:33:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.636 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.636 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116589 2024-09-11T05:33:40.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.636 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888780+0000", 2024-09-11T05:33:40.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888780+0000", 2024-09-11T05:33:40.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888781+0000", 2024-09-11T05:33:40.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8599999999999999e-07 2024-09-11T05:33:40.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888783+0000", 2024-09-11T05:33:40.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0099999999999998e-06 2024-09-11T05:33:40.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888788+0000", 2024-09-11T05:33:40.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5380000000000002e-06 2024-09-11T05:33:40.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888808+0000", 2024-09-11T05:33:40.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9973999999999999e-05 2024-09-11T05:33:40.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888905+0000", 2024-09-11T05:33:40.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6562000000000001e-05 2024-09-11T05:33:40.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888915+0000", 2024-09-11T05:33:40.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0329999999999999e-05 2024-09-11T05:33:40.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.639 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.640 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116621 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.640 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889533+0000", 2024-09-11T05:33:40.640 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62188774300000005, 2024-09-11T05:33:40.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63027128399999999, 2024-09-11T05:33:40.640 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116621 2024-09-11T05:33:40.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.640 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889533+0000", 2024-09-11T05:33:40.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889533+0000", 2024-09-11T05:33:40.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889533+0000", 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889535+0000", 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.575e-06 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889539+0000", 2024-09-11T05:33:40.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6239999999999999e-06 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889541+0000", 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6029999999999999e-06 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890290+0000", 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074930299999999999 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890300+0000", 2024-09-11T05:33:40.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5040000000000008e-06 2024-09-11T05:33:40.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.644 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.644 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116599 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.644 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814591+0000", 2024-09-11T05:33:40.644 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69683031799999995, 2024-09-11T05:33:40.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70524614699999999, 2024-09-11T05:33:40.644 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116599 2024-09-11T05:33:40.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.645 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814591+0000", 2024-09-11T05:33:40.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814591+0000", 2024-09-11T05:33:40.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814591+0000", 2024-09-11T05:33:40.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4200000000000002e-07 2024-09-11T05:33:40.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814593+0000", 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.906e-06 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814599+0000", 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0229999999999998e-06 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814604+0000", 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9710000000000003e-06 2024-09-11T05:33:40.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815496+0000", 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089177500000000003 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815500+0000", 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.177e-06 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825577+0000", 2024-09-11T05:33:40.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010077259 2024-09-11T05:33:40.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825583+0000", 2024-09-11T05:33:40.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.477e-06 2024-09-11T05:33:40.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.649 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.650 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116844 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.650 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822329+0000", 2024-09-11T05:33:40.650 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68909203699999999, 2024-09-11T05:33:40.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69754648200000002, 2024-09-11T05:33:40.650 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116844 2024-09-11T05:33:40.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.651 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822329+0000", 2024-09-11T05:33:40.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822329+0000", 2024-09-11T05:33:40.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822329+0000", 2024-09-11T05:33:40.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9800000000000004e-07 2024-09-11T05:33:40.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822332+0000", 2024-09-11T05:33:40.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6309999999999999e-06 2024-09-11T05:33:40.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822339+0000", 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7229999999999998e-06 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822344+0000", 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6149999999999996e-06 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827379+0000", 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050349740000000002 2024-09-11T05:33:40.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827387+0000", 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.174e-06 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116876 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823078+0000", 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68834302599999997, 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69682962800000003, 2024-09-11T05:33:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116876 2024-09-11T05:33:40.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.655 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823078+0000", 2024-09-11T05:33:40.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823078+0000", 2024-09-11T05:33:40.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823078+0000", 2024-09-11T05:33:40.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:40.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823080+0000", 2024-09-11T05:33:40.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0209999999999998e-06 2024-09-11T05:33:40.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823086+0000", 2024-09-11T05:33:40.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.789e-06 2024-09-11T05:33:40.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823090+0000", 2024-09-11T05:33:40.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:33:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828539+0000", 2024-09-11T05:33:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005448334 2024-09-11T05:33:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828547+0000", 2024-09-11T05:33:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6549999999999993e-06 2024-09-11T05:33:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117121 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833525+0000", 2024-09-11T05:33:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67789574399999997, 2024-09-11T05:33:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68641585100000002, 2024-09-11T05:33:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.659 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117121 2024-09-11T05:33:40.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.660 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833525+0000", 2024-09-11T05:33:40.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833525+0000", 2024-09-11T05:33:40.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833525+0000", 2024-09-11T05:33:40.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T05:33:40.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833528+0000", 2024-09-11T05:33:40.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.086e-06 2024-09-11T05:33:40.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833535+0000", 2024-09-11T05:33:40.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:33:40.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833540+0000", 2024-09-11T05:33:40.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3480000000000003e-06 2024-09-11T05:33:40.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835229+0000", 2024-09-11T05:33:40.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016883619999999999 2024-09-11T05:33:40.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835235+0000", 2024-09-11T05:33:40.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5259999999999999e-06 2024-09-11T05:33:40.663 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.663 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.663 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.663 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117345 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.663 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.847913+0000", 2024-09-11T05:33:40.663 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66350783999999996, 2024-09-11T05:33:40.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67206133700000004, 2024-09-11T05:33:40.663 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.664 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.664 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.664 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.664 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.664 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117345 2024-09-11T05:33:40.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.664 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847913+0000", 2024-09-11T05:33:40.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847913+0000", 2024-09-11T05:33:40.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847914+0000", 2024-09-11T05:33:40.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2799999999999995e-07 2024-09-11T05:33:40.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847918+0000", 2024-09-11T05:33:40.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8449999999999996e-06 2024-09-11T05:33:40.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847925+0000", 2024-09-11T05:33:40.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9370000000000004e-06 2024-09-11T05:33:40.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847929+0000", 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.941e-06 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847981+0000", 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1455000000000001e-05 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847990+0000", 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4150000000000005e-06 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.668 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117601 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.668 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.867814+0000", 2024-09-11T05:33:40.668 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64360694799999996, 2024-09-11T05:33:40.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65219259699999999, 2024-09-11T05:33:40.668 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.669 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.669 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117601 2024-09-11T05:33:40.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.669 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867814+0000", 2024-09-11T05:33:40.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867814+0000", 2024-09-11T05:33:40.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867814+0000", 2024-09-11T05:33:40.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9299999999999998e-07 2024-09-11T05:33:40.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867817+0000", 2024-09-11T05:33:40.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.277e-06 2024-09-11T05:33:40.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867823+0000", 2024-09-11T05:33:40.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6819999999999997e-06 2024-09-11T05:33:40.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867827+0000", 2024-09-11T05:33:40.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4410000000000002e-06 2024-09-11T05:33:40.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867861+0000", 2024-09-11T05:33:40.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3946999999999999e-05 2024-09-11T05:33:40.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867868+0000", 2024-09-11T05:33:40.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2629999999999997e-06 2024-09-11T05:33:40.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.672 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.673 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.673 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116590 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.673 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888821+0000", 2024-09-11T05:33:40.673 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62260001200000004, 2024-09-11T05:33:40.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63121909499999995, 2024-09-11T05:33:40.673 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.674 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116590 2024-09-11T05:33:40.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.674 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888821+0000", 2024-09-11T05:33:40.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888821+0000", 2024-09-11T05:33:40.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888821+0000", 2024-09-11T05:33:40.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6800000000000001e-07 2024-09-11T05:33:40.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888824+0000", 2024-09-11T05:33:40.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5289999999999998e-06 2024-09-11T05:33:40.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888830+0000", 2024-09-11T05:33:40.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.55e-06 2024-09-11T05:33:40.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888836+0000", 2024-09-11T05:33:40.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3279999999999996e-06 2024-09-11T05:33:40.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888950+0000", 2024-09-11T05:33:40.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011396999999999999 2024-09-11T05:33:40.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888957+0000", 2024-09-11T05:33:40.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7260000000000002e-06 2024-09-11T05:33:40.677 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.677 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.677 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.677 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116622 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.678 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889544+0000", 2024-09-11T05:33:40.678 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62187638199999995, 2024-09-11T05:33:40.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63052740399999996, 2024-09-11T05:33:40.678 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.678 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.678 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.678 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.678 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.678 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116622 2024-09-11T05:33:40.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.678 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889544+0000", 2024-09-11T05:33:40.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889544+0000", 2024-09-11T05:33:40.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889545+0000", 2024-09-11T05:33:40.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:40.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889549+0000", 2024-09-11T05:33:40.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1969999999999998e-06 2024-09-11T05:33:40.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889552+0000", 2024-09-11T05:33:40.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.377e-06 2024-09-11T05:33:40.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889555+0000", 2024-09-11T05:33:40.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4930000000000001e-06 2024-09-11T05:33:40.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890328+0000", 2024-09-11T05:33:40.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00077351299999999998 2024-09-11T05:33:40.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890332+0000", 2024-09-11T05:33:40.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2409999999999997e-06 2024-09-11T05:33:40.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.682 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.682 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116600 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.682 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814611+0000", 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.696810237, 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70551032400000002, 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116600 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814611+0000", 2024-09-11T05:33:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814611+0000", 2024-09-11T05:33:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814611+0000", 2024-09-11T05:33:40.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:33:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814613+0000", 2024-09-11T05:33:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1440000000000001e-06 2024-09-11T05:33:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814619+0000", 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1859999999999997e-06 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814624+0000", 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5499999999999996e-06 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815534+0000", 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00090973200000000001 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815538+0000", 2024-09-11T05:33:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2699999999999998e-06 2024-09-11T05:33:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825605+0000", 2024-09-11T05:33:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010067265000000001 2024-09-11T05:33:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825613+0000", 2024-09-11T05:33:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8520000000000004e-06 2024-09-11T05:33:40.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116845 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822351+0000", 2024-09-11T05:33:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68906990099999998, 2024-09-11T05:33:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.697807171, 2024-09-11T05:33:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.688 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116845 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822351+0000", 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822351+0000", 2024-09-11T05:33:40.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822351+0000", 2024-09-11T05:33:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8299999999999998e-07 2024-09-11T05:33:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822353+0000", 2024-09-11T05:33:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.029e-06 2024-09-11T05:33:40.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822359+0000", 2024-09-11T05:33:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3890000000000004e-06 2024-09-11T05:33:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822363+0000", 2024-09-11T05:33:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6110000000000004e-06 2024-09-11T05:33:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827413+0000", 2024-09-11T05:33:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050500320000000003 2024-09-11T05:33:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827420+0000", 2024-09-11T05:33:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1169999999999998e-06 2024-09-11T05:33:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116877 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.692 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823096+0000", 2024-09-11T05:33:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68832484299999996, 2024-09-11T05:33:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69709249299999998, 2024-09-11T05:33:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116877 2024-09-11T05:33:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823096+0000", 2024-09-11T05:33:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823096+0000", 2024-09-11T05:33:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823096+0000", 2024-09-11T05:33:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:33:40.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823098+0000", 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0279999999999999e-06 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823105+0000", 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4679999999999997e-06 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823110+0000", 2024-09-11T05:33:40.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T05:33:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828575+0000", 2024-09-11T05:33:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054657760000000003 2024-09-11T05:33:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828583+0000", 2024-09-11T05:33:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0859999999999996e-06 2024-09-11T05:33:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.696 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117122 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833547+0000", 2024-09-11T05:33:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67787425599999995, 2024-09-11T05:33:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68667343999999997, 2024-09-11T05:33:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117122 2024-09-11T05:33:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833547+0000", 2024-09-11T05:33:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833547+0000", 2024-09-11T05:33:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833547+0000", 2024-09-11T05:33:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:33:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833553+0000", 2024-09-11T05:33:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T05:33:40.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833561+0000", 2024-09-11T05:33:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8210000000000002e-06 2024-09-11T05:33:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833567+0000", 2024-09-11T05:33:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.648e-06 2024-09-11T05:33:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835256+0000", 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016888910000000001 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835262+0000", 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4860000000000002e-06 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117346 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.847944+0000", 2024-09-11T05:33:40.701 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66347666100000002, 2024-09-11T05:33:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.67230596099999995, 2024-09-11T05:33:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117346 2024-09-11T05:33:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847944+0000", 2024-09-11T05:33:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847944+0000", 2024-09-11T05:33:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847945+0000", 2024-09-11T05:33:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4000000000000002e-07 2024-09-11T05:33:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847947+0000", 2024-09-11T05:33:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.599e-06 2024-09-11T05:33:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847954+0000", 2024-09-11T05:33:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1740000000000003e-06 2024-09-11T05:33:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847960+0000", 2024-09-11T05:33:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1819999999999997e-06 2024-09-11T05:33:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848019+0000", 2024-09-11T05:33:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9206000000000002e-05 2024-09-11T05:33:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848033+0000", 2024-09-11T05:33:40.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4369000000000001e-05 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117602 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.867842+0000", 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64357917799999997, 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65244006600000004, 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117602 2024-09-11T05:33:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867842+0000", 2024-09-11T05:33:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867842+0000", 2024-09-11T05:33:40.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867842+0000", 2024-09-11T05:33:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2499999999999995e-07 2024-09-11T05:33:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867845+0000", 2024-09-11T05:33:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-11T05:33:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867851+0000", 2024-09-11T05:33:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5069999999999997e-06 2024-09-11T05:33:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867856+0000", 2024-09-11T05:33:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5970000000000002e-06 2024-09-11T05:33:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867895+0000", 2024-09-11T05:33:40.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9671e-05 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867903+0000", 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9379999999999992e-06 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116591 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888843+0000", 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62257792599999995, 2024-09-11T05:33:40.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63146899999999995, 2024-09-11T05:33:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116591 2024-09-11T05:33:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.711 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888843+0000", 2024-09-11T05:33:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888843+0000", 2024-09-11T05:33:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888843+0000", 2024-09-11T05:33:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:33:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888845+0000", 2024-09-11T05:33:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0959999999999999e-06 2024-09-11T05:33:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888851+0000", 2024-09-11T05:33:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:33:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888856+0000", 2024-09-11T05:33:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0889999999999999e-06 2024-09-11T05:33:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888993+0000", 2024-09-11T05:33:40.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013711300000000001 2024-09-11T05:33:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889001+0000", 2024-09-11T05:33:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8650000000000001e-06 2024-09-11T05:33:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116623 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:33:40.715 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62184851600000002, 2024-09-11T05:33:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63077147899999997, 2024-09-11T05:33:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116623 2024-09-11T05:33:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:33:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:33:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889573+0000", 2024-09-11T05:33:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:33:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889574+0000", 2024-09-11T05:33:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4810000000000001e-06 2024-09-11T05:33:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889578+0000", 2024-09-11T05:33:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T05:33:40.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889581+0000", 2024-09-11T05:33:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2380000000000002e-06 2024-09-11T05:33:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890367+0000", 2024-09-11T05:33:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078646599999999999 2024-09-11T05:33:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890377+0000", 2024-09-11T05:33:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5789999999999993e-06 2024-09-11T05:33:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116601 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.814631+0000", 2024-09-11T05:33:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69679028899999995, 2024-09-11T05:33:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.70574624900000005, 2024-09-11T05:33:40.720 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116601 2024-09-11T05:33:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814631+0000", 2024-09-11T05:33:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814631+0000", 2024-09-11T05:33:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814631+0000", 2024-09-11T05:33:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:33:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814633+0000", 2024-09-11T05:33:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3020000000000002e-06 2024-09-11T05:33:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814640+0000", 2024-09-11T05:33:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2729999999999999e-06 2024-09-11T05:33:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814644+0000", 2024-09-11T05:33:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6480000000000002e-06 2024-09-11T05:33:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815568+0000", 2024-09-11T05:33:40.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092337400000000003 2024-09-11T05:33:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815572+0000", 2024-09-11T05:33:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1679999999999997e-06 2024-09-11T05:33:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825637+0000", 2024-09-11T05:33:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010065628 2024-09-11T05:33:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.825644+0000", 2024-09-11T05:33:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.827e-06 2024-09-11T05:33:40.727 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116846 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.822369+0000", 2024-09-11T05:33:40.728 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68905150599999998, 2024-09-11T05:33:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69804331500000005, 2024-09-11T05:33:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116846 2024-09-11T05:33:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822369+0000", 2024-09-11T05:33:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822369+0000", 2024-09-11T05:33:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822370+0000", 2024-09-11T05:33:40.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822456+0000", 2024-09-11T05:33:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6341000000000006e-05 2024-09-11T05:33:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822464+0000", 2024-09-11T05:33:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.588e-06 2024-09-11T05:33:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.822469+0000", 2024-09-11T05:33:40.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5999999999999997e-06 2024-09-11T05:33:40.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827448+0000", 2024-09-11T05:33:40.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049785710000000002 2024-09-11T05:33:40.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.827455+0000", 2024-09-11T05:33:40.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:33:40.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.735 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.736 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116878 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.736 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.823115+0000", 2024-09-11T05:33:40.736 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.688305783, 2024-09-11T05:33:40.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.69732936199999995, 2024-09-11T05:33:40.736 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116878 2024-09-11T05:33:40.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.740 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823115+0000", 2024-09-11T05:33:40.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823115+0000", 2024-09-11T05:33:40.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823115+0000", 2024-09-11T05:33:40.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000002e-07 2024-09-11T05:33:40.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823121+0000", 2024-09-11T05:33:40.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9739999999999999e-06 2024-09-11T05:33:40.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823127+0000", 2024-09-11T05:33:40.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0549999999999996e-06 2024-09-11T05:33:40.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.823133+0000", 2024-09-11T05:33:40.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3879999999999999e-06 2024-09-11T05:33:40.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828609+0000", 2024-09-11T05:33:40.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005476051 2024-09-11T05:33:40.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.828615+0000", 2024-09-11T05:33:40.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5259999999999999e-06 2024-09-11T05:33:40.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.744 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.745 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117123 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.745 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.833574+0000", 2024-09-11T05:33:40.745 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.67784691100000005, 2024-09-11T05:33:40.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.68690096899999997, 2024-09-11T05:33:40.745 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117123 2024-09-11T05:33:40.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.746 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833574+0000", 2024-09-11T05:33:40.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833574+0000", 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833574+0000", 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833576+0000", 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1330000000000002e-06 2024-09-11T05:33:40.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833583+0000", 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7549999999999997e-06 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.833588+0000", 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0350000000000001e-06 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835284+0000", 2024-09-11T05:33:40.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001695579 2024-09-11T05:33:40.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.835290+0000", 2024-09-11T05:33:40.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6719999999999998e-06 2024-09-11T05:33:40.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.749 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.749 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117347 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.749 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.847976+0000", 2024-09-11T05:33:40.749 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66344451999999998, 2024-09-11T05:33:40.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.672530238, 2024-09-11T05:33:40.750 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.750 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.750 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.750 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117347 2024-09-11T05:33:40.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.750 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847976+0000", 2024-09-11T05:33:40.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847976+0000", 2024-09-11T05:33:40.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847977+0000", 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2300000000000001e-07 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847980+0000", 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000001e-06 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847987+0000", 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.216e-06 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.847992+0000", 2024-09-11T05:33:40.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8879999999999996e-06 2024-09-11T05:33:40.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848069+0000", 2024-09-11T05:33:40.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6363000000000001e-05 2024-09-11T05:33:40.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.848077+0000", 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4679999999999992e-06 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:117603 3.14 3.fafa41f4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.867863+0000", 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.64355758100000005, 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.65267505800000003, 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117603 2024-09-11T05:33:40.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867863+0000", 2024-09-11T05:33:40.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867863+0000", 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867864+0000", 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5499999999999999e-07 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867866+0000", 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1069999999999999e-06 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867871+0000", 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.631e-06 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867876+0000", 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6600000000000003e-06 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867928+0000", 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1771000000000003e-05 2024-09-11T05:33:40.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.867935+0000", 2024-09-11T05:33:40.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9500000000000004e-06 2024-09-11T05:33:40.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.758 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.758 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116592 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.758 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.888862+0000", 2024-09-11T05:33:40.758 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.622558575, 2024-09-11T05:33:40.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63170699100000005, 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116592 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888862+0000", 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888862+0000", 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888863+0000", 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3799999999999998e-07 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888865+0000", 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0020000000000001e-06 2024-09-11T05:33:40.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888870+0000", 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.888875+0000", 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4880000000000001e-06 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889035+0000", 2024-09-11T05:33:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016009499999999999 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889042+0000", 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5920000000000003e-06 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116624 3.14 3.fafa41f4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62183466899999995, 2024-09-11T05:33:40.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.63101454300000004, 2024-09-11T05:33:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T05:33:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116624 2024-09-11T05:33:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:40.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:33:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:33:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889587+0000", 2024-09-11T05:33:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:33:40.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889588+0000", 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889592+0000", 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.472e-06 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889594+0000", 2024-09-11T05:33:40.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T05:33:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890405+0000", 2024-09-11T05:33:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00081088199999999997 2024-09-11T05:33:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890410+0000", 2024-09-11T05:33:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999996e-06 2024-09-11T05:33:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:40.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:40.767 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 256 2024-09-11T05:33:40.767 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:40.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:33:40.768 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:40.767+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:40.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:40.770 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T05:33:40.869 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:40.868+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:40.970 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:40.969+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:40.993 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:40.993 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:40.994 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:40.994 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:40.994 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:41.008 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:41.045 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:41.046 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:41.071 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:41.070+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:41.086 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:41.087 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:41.130 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:41.130 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:41.164 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:41.164 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:41.171 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:41.170+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:41.200 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:41.200 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:41.232 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:41.233 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:41.233 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:41.233 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:41.247 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:41.264 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:41.264 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:41.272 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:41.271+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:41.295 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:41.295 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:41.373 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:41.373+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:41.444 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:41.444 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:41.457 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:41.498 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:41.498+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:41.574 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:41.574+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:41.662 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:41.662 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:41.674 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:41.675 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:41.674+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:41.776 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:41.775+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:41.866 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:41.866 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:41.876 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:41.877 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:41.875+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:41.977 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:41.977+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:41.979 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:41.980 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:41.988 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:42.078 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:42.077+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:42.090 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:42.090 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:42.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:42.180 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:42.179+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:42.242 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:42.242 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:42.250 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:42.281 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:42.280+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:42.353 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:42.353 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:42.362 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:42.406 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:42.405+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:42.466 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:42.466 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:42.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:42.482 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:42.482+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:42.583 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:42.582+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:42.619 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:42.619 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:42.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:42.684 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:42.684+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:42.770 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:42.770 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:42.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:33:42.779 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:42.816 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:42.816+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:42.885 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:42.885 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:42.886 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:42.886+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:42.893 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:42.989 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:42.988+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:42.996 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:42.997 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:43.005 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:43.090 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:43.089+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:43.148 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:43.149 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:43.157 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:43.191 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:43.190+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:43.292 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:43.291+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:43.299 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:43.299 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:43.308 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:43.317 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:33:43.392 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:43.392+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:43.410 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:43.410 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:43.419 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:43.441 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:43.442 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:43.458 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:43.459 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:43.474 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:43.474 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:43.492 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:43.493 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:43.493 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:43.492+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:43.517 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:43.518 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:43.539 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:43.540 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:43.541 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:43.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:43.556 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:43.556 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:43.573 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:43.573 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:43.593 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:43.592+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:43.661 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:43.661 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:43.669 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:43.713 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:43.713+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:43.795 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:43.794+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:43.801 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116524 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:33:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9878438339999995, 2024-09-11T05:33:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344630100000001, 2024-09-11T05:33:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116524 2024-09-11T05:33:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:33:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:33:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811270+0000", 2024-09-11T05:33:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:33:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811272+0000", 2024-09-11T05:33:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:33:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811278+0000", 2024-09-11T05:33:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1970000000000001e-06 2024-09-11T05:33:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811283+0000", 2024-09-11T05:33:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-09-11T05:33:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813113+0000", 2024-09-11T05:33:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001830302 2024-09-11T05:33:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813117+0000", 2024-09-11T05:33:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0810000000000004e-06 2024-09-11T05:33:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814661+0000", 2024-09-11T05:33:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015436969999999999 2024-09-11T05:33:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814667+0000", 2024-09-11T05:33:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6370000000000002e-06 2024-09-11T05:33:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826115+0000", 2024-09-11T05:33:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114479059999999 2024-09-11T05:33:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826123+0000", 2024-09-11T05:33:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000004e-06 2024-09-11T05:33:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845722+0000", 2024-09-11T05:33:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195993000000001 2024-09-11T05:33:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845732+0000", 2024-09-11T05:33:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T05:33:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116525 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:33:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9878239520000003, 2024-09-11T05:33:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344747700000001, 2024-09-11T05:33:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116525 2024-09-11T05:33:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:33:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:33:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811290+0000", 2024-09-11T05:33:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:33:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811295+0000", 2024-09-11T05:33:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8969999999999999e-06 2024-09-11T05:33:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811301+0000", 2024-09-11T05:33:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4919999999999998e-06 2024-09-11T05:33:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811306+0000", 2024-09-11T05:33:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999998e-06 2024-09-11T05:33:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813138+0000", 2024-09-11T05:33:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001832078 2024-09-11T05:33:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813142+0000", 2024-09-11T05:33:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0380000000000001e-06 2024-09-11T05:33:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814689+0000", 2024-09-11T05:33:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546799 2024-09-11T05:33:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814695+0000", 2024-09-11T05:33:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8739999999999997e-06 2024-09-11T05:33:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826148+0000", 2024-09-11T05:33:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114527259999999 2024-09-11T05:33:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826166+0000", 2024-09-11T05:33:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7484999999999999e-05 2024-09-11T05:33:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845756+0000", 2024-09-11T05:33:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019590609 2024-09-11T05:33:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845764+0000", 2024-09-11T05:33:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7020000000000001e-06 2024-09-11T05:33:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116526 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:33:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9878011539999996, 2024-09-11T05:33:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344863210000002, 2024-09-11T05:33:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116526 2024-09-11T05:33:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:33:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:33:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:33:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:33:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811315+0000", 2024-09-11T05:33:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079999999999999e-06 2024-09-11T05:33:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811320+0000", 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8619999999999999e-06 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811325+0000", 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814736+0000", 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034115780000000002 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814744+0000", 2024-09-11T05:33:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5340000000000002e-06 2024-09-11T05:33:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826212+0000", 2024-09-11T05:33:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114682749999999 2024-09-11T05:33:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826225+0000", 2024-09-11T05:33:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:33:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845789+0000", 2024-09-11T05:33:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195649200000001 2024-09-11T05:33:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845798+0000", 2024-09-11T05:33:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9269999999999994e-06 2024-09-11T05:33:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116527 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:33:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9877822219999999, 2024-09-11T05:33:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345095849999999, 2024-09-11T05:33:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116527 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:33:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:33:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811334+0000", 2024-09-11T05:33:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:33:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811340+0000", 2024-09-11T05:33:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.691e-06 2024-09-11T05:33:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811345+0000", 2024-09-11T05:33:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5480000000000003e-06 2024-09-11T05:33:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814767+0000", 2024-09-11T05:33:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034223190000000001 2024-09-11T05:33:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814774+0000", 2024-09-11T05:33:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:33:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826265+0000", 2024-09-11T05:33:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114912460000001 2024-09-11T05:33:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826274+0000", 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3909999999999998e-06 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845831+0000", 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195574080000001 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845841+0000", 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3610000000000007e-06 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116528 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:33:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.987762783, 2024-09-11T05:33:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345287679999999, 2024-09-11T05:33:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116528 2024-09-11T05:33:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:33:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:33:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811351+0000", 2024-09-11T05:33:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T05:33:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811353+0000", 2024-09-11T05:33:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:33:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811359+0000", 2024-09-11T05:33:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811364+0000", 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000001e-06 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814795+0000", 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034316569999999998 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814826+0000", 2024-09-11T05:33:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0587999999999999e-05 2024-09-11T05:33:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826309+0000", 2024-09-11T05:33:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011483444 2024-09-11T05:33:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826319+0000", 2024-09-11T05:33:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6849999999999996e-06 2024-09-11T05:33:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845868+0000", 2024-09-11T05:33:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195487110000001 2024-09-11T05:33:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845879+0000", 2024-09-11T05:33:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1428e-05 2024-09-11T05:33:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116529 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9877441490000001, 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034542531, 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116529 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:33:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:33:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:33:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811371+0000", 2024-09-11T05:33:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T05:33:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811377+0000", 2024-09-11T05:33:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1580000000000002e-06 2024-09-11T05:33:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811383+0000", 2024-09-11T05:33:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.135e-06 2024-09-11T05:33:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814851+0000", 2024-09-11T05:33:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034684690000000001 2024-09-11T05:33:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814858+0000", 2024-09-11T05:33:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6969999999999996e-06 2024-09-11T05:33:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826354+0000", 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114962359999999 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826364+0000", 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0047999999999999e-05 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845903+0000", 2024-09-11T05:33:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195393610000001 2024-09-11T05:33:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845912+0000", 2024-09-11T05:33:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2269999999999993e-06 2024-09-11T05:33:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116530 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:33:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9877252370000003, 2024-09-11T05:33:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345557429999999, 2024-09-11T05:33:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116530 2024-09-11T05:33:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:33:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:33:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:33:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:33:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811390+0000", 2024-09-11T05:33:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:33:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811396+0000", 2024-09-11T05:33:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:33:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811402+0000", 2024-09-11T05:33:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:33:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814879+0000", 2024-09-11T05:33:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034769290000000001 2024-09-11T05:33:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814885+0000", 2024-09-11T05:33:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.156e-06 2024-09-11T05:33:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826389+0000", 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115041140000001 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826397+0000", 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845935+0000", 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195381370000001 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845944+0000", 2024-09-11T05:33:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4540000000000007e-06 2024-09-11T05:33:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116531 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:33:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9877051779999997, 2024-09-11T05:33:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345764630000001, 2024-09-11T05:33:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116531 2024-09-11T05:33:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:33:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811411+0000", 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:33:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811417+0000", 2024-09-11T05:33:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:33:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811422+0000", 2024-09-11T05:33:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3229999999999997e-06 2024-09-11T05:33:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814906+0000", 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034835389999999999 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814913+0000", 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309999999999996e-06 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826423+0000", 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115109019999999 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826431+0000", 2024-09-11T05:33:43.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9410000000000007e-06 2024-09-11T05:33:43.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845975+0000", 2024-09-11T05:33:43.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019543767 2024-09-11T05:33:43.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845984+0000", 2024-09-11T05:33:43.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3530000000000001e-06 2024-09-11T05:33:43.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.862 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.862 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116532 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.862 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:33:43.862 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.98768498, 2024-09-11T05:33:43.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034588131, 2024-09-11T05:33:43.862 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.862 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116532 2024-09-11T05:33:43.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.863 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:33:43.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:33:43.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811429+0000", 2024-09-11T05:33:43.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:33:43.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811431+0000", 2024-09-11T05:33:43.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9910000000000001e-06 2024-09-11T05:33:43.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811437+0000", 2024-09-11T05:33:43.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.049e-06 2024-09-11T05:33:43.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811441+0000", 2024-09-11T05:33:43.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8289999999999998e-06 2024-09-11T05:33:43.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814934+0000", 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034927220000000002 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814941+0000", 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.844e-06 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826480+0000", 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115393260000001 2024-09-11T05:33:43.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826496+0000", 2024-09-11T05:33:43.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5406000000000001e-05 2024-09-11T05:33:43.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846008+0000", 2024-09-11T05:33:43.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.01951214 2024-09-11T05:33:43.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846016+0000", 2024-09-11T05:33:43.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4440000000000008e-06 2024-09-11T05:33:43.868 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.868 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.868 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.868 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116533 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.868 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:33:43.868 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9876654259999995, 2024-09-11T05:33:43.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345994049999998, 2024-09-11T05:33:43.868 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.868 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.868 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.869 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.869 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.869 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.869 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116533 2024-09-11T05:33:43.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.869 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:33:43.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811450+0000", 2024-09-11T05:33:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0940000000000002e-06 2024-09-11T05:33:43.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811457+0000", 2024-09-11T05:33:43.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2729999999999999e-06 2024-09-11T05:33:43.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811461+0000", 2024-09-11T05:33:43.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.673e-06 2024-09-11T05:33:43.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814962+0000", 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035012530000000002 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814970+0000", 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0539999999999997e-06 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826536+0000", 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011566049 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826542+0000", 2024-09-11T05:33:43.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1709999999999999e-06 2024-09-11T05:33:43.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846039+0000", 2024-09-11T05:33:43.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019497168 2024-09-11T05:33:43.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846047+0000", 2024-09-11T05:33:43.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-11T05:33:43.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.874 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.874 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116534 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.874 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:33:43.874 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9876465190000001, 2024-09-11T05:33:43.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034610979, 2024-09-11T05:33:43.874 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.874 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.874 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116534 2024-09-11T05:33:43.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.875 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:33:43.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811469+0000", 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.871e-06 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811475+0000", 2024-09-11T05:33:43.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1689999999999997e-06 2024-09-11T05:33:43.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811480+0000", 2024-09-11T05:33:43.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5990000000000004e-06 2024-09-11T05:33:43.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814990+0000", 2024-09-11T05:33:43.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003510876 2024-09-11T05:33:43.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814997+0000", 2024-09-11T05:33:43.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T05:33:43.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826571+0000", 2024-09-11T05:33:43.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115740230000001 2024-09-11T05:33:43.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826576+0000", 2024-09-11T05:33:43.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-11T05:33:43.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846070+0000", 2024-09-11T05:33:43.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194937660000001 2024-09-11T05:33:43.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846078+0000", 2024-09-11T05:33:43.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.038e-06 2024-09-11T05:33:43.880 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.880 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.880 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.880 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116535 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.880 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:33:43.880 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9876273600000003, 2024-09-11T05:33:43.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346218060000001, 2024-09-11T05:33:43.880 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116535 2024-09-11T05:33:43.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.881 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:33:43.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811488+0000", 2024-09-11T05:33:43.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:33:43.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811495+0000", 2024-09-11T05:33:43.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3960000000000003e-06 2024-09-11T05:33:43.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811500+0000", 2024-09-11T05:33:43.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9910000000000002e-06 2024-09-11T05:33:43.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815019+0000", 2024-09-11T05:33:43.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035190479999999999 2024-09-11T05:33:43.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815025+0000", 2024-09-11T05:33:43.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2550000000000003e-06 2024-09-11T05:33:43.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826604+0000", 2024-09-11T05:33:43.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115789959999999 2024-09-11T05:33:43.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826611+0000", 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846100+0000", 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194890569999999 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846108+0000", 2024-09-11T05:33:43.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4089999999999997e-06 2024-09-11T05:33:43.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.886 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.886 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116536 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.886 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:33:43.886 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9876078389999998, 2024-09-11T05:33:43.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034634724, 2024-09-11T05:33:43.886 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.886 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.886 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116536 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:33:43.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811506+0000", 2024-09-11T05:33:43.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:33:43.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811508+0000", 2024-09-11T05:33:43.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T05:33:43.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811514+0000", 2024-09-11T05:33:43.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0610000000000001e-06 2024-09-11T05:33:43.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811519+0000", 2024-09-11T05:33:43.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0340000000000004e-06 2024-09-11T05:33:43.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815049+0000", 2024-09-11T05:33:43.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035296440000000002 2024-09-11T05:33:43.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815055+0000", 2024-09-11T05:33:43.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:33:43.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826642+0000", 2024-09-11T05:33:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011586375 2024-09-11T05:33:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826649+0000", 2024-09-11T05:33:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-09-11T05:33:43.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846131+0000", 2024-09-11T05:33:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194814569999999 2024-09-11T05:33:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846140+0000", 2024-09-11T05:33:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2240000000000001e-06 2024-09-11T05:33:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116537 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:33:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9875882699999998, 2024-09-11T05:33:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346492180000002, 2024-09-11T05:33:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.896 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116537 2024-09-11T05:33:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:33:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:33:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:33:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:33:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811532+0000", 2024-09-11T05:33:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:33:43.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811538+0000", 2024-09-11T05:33:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7259999999999996e-06 2024-09-11T05:33:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811543+0000", 2024-09-11T05:33:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.164e-06 2024-09-11T05:33:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815078+0000", 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003534428 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815086+0000", 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8210000000000002e-06 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826736+0000", 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116503429999999 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826751+0000", 2024-09-11T05:33:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4895999999999999e-05 2024-09-11T05:33:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846165+0000", 2024-09-11T05:33:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019413854 2024-09-11T05:33:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846174+0000", 2024-09-11T05:33:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3149999999999998e-06 2024-09-11T05:33:43.901 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116538 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:33:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9875635809999999, 2024-09-11T05:33:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346557729999999, 2024-09-11T05:33:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116538 2024-09-11T05:33:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:33:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:33:43.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:33:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:33:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811552+0000", 2024-09-11T05:33:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2869999999999999e-06 2024-09-11T05:33:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811559+0000", 2024-09-11T05:33:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3820000000000001e-06 2024-09-11T05:33:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811564+0000", 2024-09-11T05:33:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:33:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815109+0000", 2024-09-11T05:33:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035450989999999999 2024-09-11T05:33:43.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815115+0000", 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826780+0000", 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116645799999999 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826787+0000", 2024-09-11T05:33:43.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3880000000000002e-06 2024-09-11T05:33:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846196+0000", 2024-09-11T05:33:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194094069999999 2024-09-11T05:33:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846205+0000", 2024-09-11T05:33:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.884e-06 2024-09-11T05:33:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.908 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116539 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.908 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:33:43.908 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9875435350000004, 2024-09-11T05:33:43.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346668399999999, 2024-09-11T05:33:43.909 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116539 2024-09-11T05:33:43.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.909 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:33:43.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:33:43.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:33:43.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:33:43.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811572+0000", 2024-09-11T05:33:43.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:33:43.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811578+0000", 2024-09-11T05:33:43.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T05:33:43.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811583+0000", 2024-09-11T05:33:43.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:33:43.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815137+0000", 2024-09-11T05:33:43.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035540210000000001 2024-09-11T05:33:43.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815144+0000", 2024-09-11T05:33:43.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5969999999999997e-06 2024-09-11T05:33:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826851+0000", 2024-09-11T05:33:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117072149999999 2024-09-11T05:33:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826860+0000", 2024-09-11T05:33:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4200000000000007e-06 2024-09-11T05:33:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846228+0000", 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019368287 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846236+0000", 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.541e-06 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116540 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:33:43.915 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9875241109999999, 2024-09-11T05:33:43.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346767830000001, 2024-09-11T05:33:43.915 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116540 2024-09-11T05:33:43.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.915 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:33:43.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:33:43.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:33:43.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:33:43.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811591+0000", 2024-09-11T05:33:43.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:33:43.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811598+0000", 2024-09-11T05:33:43.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T05:33:43.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811603+0000", 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9470000000000002e-06 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815168+0000", 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035651810000000002 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815174+0000", 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826883+0000", 2024-09-11T05:33:43.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117088830000001 2024-09-11T05:33:43.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826891+0000", 2024-09-11T05:33:43.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7179999999999996e-06 2024-09-11T05:33:43.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846258+0000", 2024-09-11T05:33:43.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019367328 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846266+0000", 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4880000000000001e-06 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116541 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9875048169999996, 2024-09-11T05:33:43.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346837, 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116541 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811609+0000", 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811611+0000", 2024-09-11T05:33:43.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8679999999999999e-06 2024-09-11T05:33:43.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811617+0000", 2024-09-11T05:33:43.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:33:43.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811622+0000", 2024-09-11T05:33:43.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9370000000000003e-06 2024-09-11T05:33:43.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815201+0000", 2024-09-11T05:33:43.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035788679999999998 2024-09-11T05:33:43.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815207+0000", 2024-09-11T05:33:43.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7530000000000004e-06 2024-09-11T05:33:43.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826988+0000", 2024-09-11T05:33:43.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117802300000001 2024-09-11T05:33:43.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826996+0000", 2024-09-11T05:33:43.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.259e-06 2024-09-11T05:33:43.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846285+0000", 2024-09-11T05:33:43.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192892090000001 2024-09-11T05:33:43.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846292+0000", 2024-09-11T05:33:43.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9399999999999996e-06 2024-09-11T05:33:43.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.926 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.926 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116542 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.926 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:33:43.926 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9874859069999999, 2024-09-11T05:33:43.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034697618, 2024-09-11T05:33:43.926 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116542 2024-09-11T05:33:43.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.927 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:33:43.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:33:43.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811628+0000", 2024-09-11T05:33:43.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:33:43.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811629+0000", 2024-09-11T05:33:43.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8059999999999999e-06 2024-09-11T05:33:43.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811636+0000", 2024-09-11T05:33:43.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0990000000000004e-06 2024-09-11T05:33:43.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811640+0000", 2024-09-11T05:33:43.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6630000000000001e-06 2024-09-11T05:33:43.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815230+0000", 2024-09-11T05:33:43.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035897009999999998 2024-09-11T05:33:43.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815237+0000", 2024-09-11T05:33:43.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6590000000000001e-06 2024-09-11T05:33:43.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827019+0000", 2024-09-11T05:33:43.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011782261 2024-09-11T05:33:43.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827026+0000", 2024-09-11T05:33:43.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.605e-06 2024-09-11T05:33:43.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846317+0000", 2024-09-11T05:33:43.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192904270000001 2024-09-11T05:33:43.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846325+0000", 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0530000000000007e-06 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116543 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9874672330000003, 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0347097559999998, 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116543 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:43.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811648+0000", 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811654+0000", 2024-09-11T05:33:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T05:33:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811659+0000", 2024-09-11T05:33:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9409999999999998e-06 2024-09-11T05:33:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815259+0000", 2024-09-11T05:33:43.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035993980000000002 2024-09-11T05:33:43.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815265+0000", 2024-09-11T05:33:43.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-11T05:33:43.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827049+0000", 2024-09-11T05:33:43.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117836019999999 2024-09-11T05:33:43.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:43.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827056+0000", 2024-09-11T05:33:43.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3919999999999997e-06 2024-09-11T05:33:43.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:43.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846348+0000", 2024-09-11T05:33:43.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192919039999999 2024-09-11T05:33:43.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:43.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:43.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:43.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846356+0000", 2024-09-11T05:33:43.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7449999999999995e-06 2024-09-11T05:33:43.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.940 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:43.940 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:43.940 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:43.940 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 5, 6, 7] out_osds: [4, 3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:33:43.940 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:33:43.941 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T05:33:43.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T05:33:43.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T05:33:43.944 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:43.941+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:44.044 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:44.042+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:44.144 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:44.144+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:44.147 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:44.147 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:44.147 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:44.160 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:44.245 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:44.245+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:44.346 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:44.345+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:44.371 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:44.371 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:44.382 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:44.447 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:44.446+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:33:44.477 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 62, 2024-09-11T05:33:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "eb5ff116-0384-4170-94d3-d3ddcb9c254f", 2024-09-11T05:33:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T05:32:25.817911+0000", 2024-09-11T05:33:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T05:33:43.824731+0000", 2024-09-11T05:33:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T05:32:37.539498+0000", 2024-09-11T05:33:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T05:33:38.795439+0000", 2024-09-11T05:33:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T05:33:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5801984, 2024-09-11T05:33:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T05:33:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "noscrub", 2024-09-11T05:33:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T05:33:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T05:33:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T05:33:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T05:33:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 5, 2024-09-11T05:33:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T05:33:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T05:33:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T05:33:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T05:33:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:37.977484+0000", 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:33:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:33:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:33:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:33:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:33:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:33:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:33:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:33:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:33:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:33:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "17", 2024-09-11T05:33:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:33:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:33:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:33:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:33:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:33:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T05:33:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T05:33:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:33:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:33:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:33:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:33:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:33:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:33:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:33:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:33:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:33:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:33:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:33:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:33:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:33:44.484 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:33:44.485 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:33:44.485 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:33:44.485 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:33:44.485 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:33:44.485 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T05:33:44.485 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T05:33:44.485 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T05:33:44.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.485 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:33:44.485 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T05:33:44.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.485 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:33:44.486 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:33:44.486 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-11T05:33:44.486 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-11T05:33:44.486 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-11T05:33:44.486 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T05:33:44.486 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T05:33:44.486 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.88737106323242188, 2024-09-11T05:33:44.486 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-11T05:33:44.486 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-11T05:33:44.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.486 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T05:33:44.487 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T05:33:44.487 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:43.780723+0000", 2024-09-11T05:33:44.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T05:33:44.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:33:44.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:33:44.487 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:33:44.487 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:33:44.487 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:33:44.487 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:33:44.487 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:33:44.487 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:33:44.487 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:33:44.487 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:33:44.488 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:33:44.488 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:33:44.488 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T05:33:44.488 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T05:33:44.488 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T05:33:44.488 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T05:33:44.488 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T05:33:44.488 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:33:44.488 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:33:44.488 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:33:44.488 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:33:44.488 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:33:44.488 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:33:44.489 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:33:44.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.489 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "21", 2024-09-11T05:33:44.489 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:33:44.489 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:33:44.489 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:33:44.489 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:33:44.489 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:33:44.489 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T05:33:44.489 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 21, 2024-09-11T05:33:44.489 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:33:44.490 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:33:44.490 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:33:44.490 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:33:44.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:33:44.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:33:44.491 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:33:44.491 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:33:44.491 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:33:44.491 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:33:44.491 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:33:44.491 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:33:44.491 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:33:44.491 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:33:44.491 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:33:44.491 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:33:44.492 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:33:44.492 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:33:44.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:33:44.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.492 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:33:44.492 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:33:44.492 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:33:44.492 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:33:44.492 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:33:44.492 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:33:44.492 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:33:44.493 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:33:44.493 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:33:44.493 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:33:44.493 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:33:44.493 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T05:33:44.493 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:33:44.493 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T05:33:44.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.494 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:33:44.494 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:33:44.494 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 2, 2024-09-11T05:33:44.494 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 2, 2024-09-11T05:33:44.494 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.75, 2024-09-11T05:33:44.494 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.5, 2024-09-11T05:33:44.494 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.5, 2024-09-11T05:33:44.494 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.88737106323242188, 2024-09-11T05:33:44.494 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-11T05:33:44.494 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-11T05:33:44.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.495 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T05:33:44.495 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T05:33:44.495 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:53.728195+0000", 2024-09-11T05:33:44.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T05:33:44.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:33:44.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:33:44.495 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:33:44.495 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:33:44.495 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:33:44.495 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:33:44.495 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:33:44.496 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:33:44.496 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:33:44.496 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:33:44.496 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:33:44.496 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:33:44.496 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T05:33:44.496 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T05:33:44.496 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T05:33:44.496 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T05:33:44.496 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T05:33:44.496 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:33:44.496 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:33:44.496 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:33:44.497 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:33:44.497 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:33:44.497 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:33:44.497 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:33:44.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.497 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "56", 2024-09-11T05:33:44.497 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:33:44.497 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:33:44.497 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:33:44.497 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:33:44.497 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:33:44.497 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 27, 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 56, 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:33:44.498 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:33:44.499 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:33:44.499 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:33:44.499 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:33:44.499 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:33:44.499 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:33:44.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:33:44.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.499 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:33:44.499 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:33:44.499 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:33:44.499 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:33:44.499 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:33:44.499 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:33:44.500 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:33:44.500 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:33:44.500 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:33:44.500 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:33:44.500 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:33:44.500 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T05:33:44.500 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:33:44.500 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T05:33:44.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.500 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:33:44.500 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.75, 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.75, 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.75, 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.309999942779541, 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.309999942779541, 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.88737106323242188, 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.501 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T05:33:44.502 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "6ef7487b-9326-4062-8fe4-ef39030252bd", 2024-09-11T05:33:44.502 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:44.502 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:44.502 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:44.502 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:44.502 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:44.502 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:44.502 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:44.502 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 60, 2024-09-11T05:33:44.502 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:44.502 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:44.503 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:44.503 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.503 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T05:33:44.503 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:44.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.503 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T05:33:44.503 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:44.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.504 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.504 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:44.504 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.504 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T05:33:44.504 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:44.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.505 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T05:33:44.505 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:44.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.505 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.505 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:44.505 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.505 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T05:33:44.505 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:44.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.506 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T05:33:44.506 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:44.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.506 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.506 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:44.507 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.507 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T05:33:44.507 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:44.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.508 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T05:33:44.508 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:33:44.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.508 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.509 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6819/4108497907", 2024-09-11T05:33:44.509 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6821/4108497907", 2024-09-11T05:33:44.509 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6825/4108497907", 2024-09-11T05:33:44.509 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6823/4108497907", 2024-09-11T05:33:44.509 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:44.509 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:44.510 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:44.510 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.510 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T05:33:44.510 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "3e0d8348-6e1b-4d63-b0f1-c20d90d73760", 2024-09-11T05:33:44.510 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:44.511 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:44.511 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:44.511 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:44.511 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:44.511 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:44.511 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:44.511 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 60, 2024-09-11T05:33:44.512 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:44.512 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:44.512 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:44.512 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.513 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T05:33:44.513 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:44.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.514 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T05:33:44.514 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:44.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.514 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.514 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:44.514 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.515 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T05:33:44.515 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:44.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.515 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T05:33:44.515 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:44.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.515 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.515 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:44.515 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.516 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T05:33:44.516 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:44.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.516 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T05:33:44.516 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:44.516 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.516 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.516 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:44.517 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.517 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T05:33:44.517 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:44.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.517 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T05:33:44.517 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:33:44.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.517 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/3979396531", 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/3979396531", 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/3979396531", 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/3979396531", 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "38bbb42f-85e2-4064-8f55-e0385aff07d4", 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:44.518 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 61, 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:44.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.520 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T05:33:44.520 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:44.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.520 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.520 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:44.520 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.520 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T05:33:44.520 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:44.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.521 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T05:33:44.521 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:44.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.521 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.521 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:44.521 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.522 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T05:33:44.522 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:44.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.522 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T05:33:44.522 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:44.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.522 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.522 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:44.522 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.523 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T05:33:44.523 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:44.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.523 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T05:33:44.523 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:33:44.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.523 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.523 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6811/4053894977", 2024-09-11T05:33:44.523 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6813/4053894977", 2024-09-11T05:33:44.524 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6817/4053894977", 2024-09-11T05:33:44.524 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6815/4053894977", 2024-09-11T05:33:44.524 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:44.524 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:44.524 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:44.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.524 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T05:33:44.524 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "e96ca529-f3b3-4f7e-bd59-1e9872a5efab", 2024-09-11T05:33:44.524 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:44.524 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 0, 2024-09-11T05:33:44.524 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0, 2024-09-11T05:33:44.525 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.098968505859375, 2024-09-11T05:33:44.525 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:44.525 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:44.525 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:44.525 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:44.525 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:44.525 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:44.525 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:44.525 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.525 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T05:33:44.526 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:44.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.526 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T05:33:44.526 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:44.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.526 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.526 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:44.526 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.527 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T05:33:44.527 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:44.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.527 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T05:33:44.527 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:44.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.527 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.527 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:44.527 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.528 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6832", 2024-09-11T05:33:44.528 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:44.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.528 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6833", 2024-09-11T05:33:44.528 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:44.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.528 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.528 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:44.529 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.529 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T05:33:44.529 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:44.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.529 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T05:33:44.529 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:33:44.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.529 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.530 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6827/2067624829", 2024-09-11T05:33:44.530 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6829/2067624829", 2024-09-11T05:33:44.530 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6833/2067624829", 2024-09-11T05:33:44.530 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6831/2067624829", 2024-09-11T05:33:44.530 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:44.530 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:44.530 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:44.530 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.530 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T05:33:44.530 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dbbde660-d90e-4e02-9a01-16b0f76aa2b8", 2024-09-11T05:33:44.531 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:44.531 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 0, 2024-09-11T05:33:44.531 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0, 2024-09-11T05:33:44.531 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:44.531 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:44.531 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:44.531 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:44.531 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 18, 2024-09-11T05:33:44.531 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:44.531 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:44.531 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:44.531 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.532 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6816", 2024-09-11T05:33:44.532 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:44.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.532 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6817", 2024-09-11T05:33:44.532 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:44.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.532 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.532 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:44.533 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.533 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6818", 2024-09-11T05:33:44.533 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:44.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.533 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6819", 2024-09-11T05:33:44.533 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:44.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.534 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.534 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:44.534 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.534 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6822", 2024-09-11T05:33:44.534 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:44.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.535 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6823", 2024-09-11T05:33:44.535 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:44.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.535 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:44.535 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.535 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6820", 2024-09-11T05:33:44.535 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:44.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.536 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6821", 2024-09-11T05:33:44.536 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:33:44.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.536 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.536 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6817/1743986256", 2024-09-11T05:33:44.536 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6819/1743986256", 2024-09-11T05:33:44.536 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6823/1743986256", 2024-09-11T05:33:44.536 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6821/1743986256", 2024-09-11T05:33:44.536 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:44.536 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:44.536 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:44.537 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.537 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T05:33:44.537 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "2dc1a002-3ec0-4b4d-b84d-e684fa8a9131", 2024-09-11T05:33:44.537 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:44.537 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:44.537 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:44.537 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:44.537 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:44.537 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:44.537 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:44.537 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 60, 2024-09-11T05:33:44.538 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:44.538 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:44.538 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:44.538 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.538 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6824", 2024-09-11T05:33:44.538 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:44.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.539 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6825", 2024-09-11T05:33:44.539 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:44.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.539 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.539 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:44.539 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.539 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6826", 2024-09-11T05:33:44.540 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:44.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.540 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6827", 2024-09-11T05:33:44.540 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:44.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.540 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.540 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:44.540 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.541 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6830", 2024-09-11T05:33:44.541 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:44.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.541 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6831", 2024-09-11T05:33:44.541 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:44.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.541 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.541 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6828", 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6829", 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.542 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6825/2732588656", 2024-09-11T05:33:44.543 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6827/2732588656", 2024-09-11T05:33:44.543 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6831/2732588656", 2024-09-11T05:33:44.543 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6829/2732588656", 2024-09-11T05:33:44.543 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:44.543 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:44.543 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:44.543 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.543 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T05:33:44.543 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a", 2024-09-11T05:33:44.543 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:44.543 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:44.544 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:44.544 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:44.544 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:44.544 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:44.544 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:44.544 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 60, 2024-09-11T05:33:44.544 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:44.544 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:44.544 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:44.544 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6800", 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6801", 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.546 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6802", 2024-09-11T05:33:44.546 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:44.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.546 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6803", 2024-09-11T05:33:44.546 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:44.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.546 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6806", 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6807", 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.547 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.548 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:44.548 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.548 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6804", 2024-09-11T05:33:44.548 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:44.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.548 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6805", 2024-09-11T05:33:44.548 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:33:44.549 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.549 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.549 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6801/372011645", 2024-09-11T05:33:44.549 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6803/372011645", 2024-09-11T05:33:44.549 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6807/372011645", 2024-09-11T05:33:44.549 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6805/372011645", 2024-09-11T05:33:44.549 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:44.549 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:44.549 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:44.549 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "5fef4450-317c-4e1f-b05b-80740b9538f1", 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:33:44.550 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6808", 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6809", 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:33:44.551 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.552 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6810", 2024-09-11T05:33:44.552 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:44.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.552 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6811", 2024-09-11T05:33:44.552 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:44.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.552 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.552 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:33:44.553 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.553 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6814", 2024-09-11T05:33:44.553 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:44.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.553 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6815", 2024-09-11T05:33:44.553 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:44.553 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.553 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.554 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:33:44.554 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:33:44.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:33:44.554 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6812", 2024-09-11T05:33:44.554 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:44.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6813", 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6809/583221652", 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6811/583221652", 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6815/583221652", 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6813/583221652", 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.556 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:44.556 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T05:33:44.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.556 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T05:33:44.556 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:44.556 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:44.556 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:44.556 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:44.556 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:44.556 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.130019+0000", 2024-09-11T05:33:44.556 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:44.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.557 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T05:33:44.557 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:44.557 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:44.557 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:44.557 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:44.557 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:44.557 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.339373+0000", 2024-09-11T05:33:44.557 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:44.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.558 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T05:33:44.558 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:44.558 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:44.558 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:44.558 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:44.558 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:44.558 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.204705+0000", 2024-09-11T05:33:44.558 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:44.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.558 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 65536, 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.075490+0000", 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:44.559 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:44.560 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 65536, 2024-09-11T05:33:44.560 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.279790+0000", 2024-09-11T05:33:44.560 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:44.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.560 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T05:33:44.560 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:44.560 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:44.560 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:44.560 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:44.560 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:44.560 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.287168+0000", 2024-09-11T05:33:44.561 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:44.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.561 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T05:33:44.561 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:44.561 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:44.561 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:44.561 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:44.561 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:44.561 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:34.320448+0000", 2024-09-11T05:33:44.561 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:44.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.562 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T05:33:44.562 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:33:44.562 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:33:44.562 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:33:44.562 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:33:44.562 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:33:44.562 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:34.838001+0000", 2024-09-11T05:33:44.562 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:33:44.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.562 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:44.562 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [], 2024-09-11T05:33:44.562 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [ 2024-09-11T05:33:44.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "2.4", 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 6, 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 1 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T05:33:44.563 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T05:33:44.564 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T05:33:44.564 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T05:33:44.564 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T05:33:44.564 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T05:33:44.564 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T05:33:44.564 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T05:33:44.564 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T05:33:44.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.564 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [], 2024-09-11T05:33:44.565 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-11T05:33:44.565 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-11T05:33:44.565 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T05:33:44.565 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T05:33:44.565 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T05:33:44.565 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T05:33:44.565 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T05:33:44.565 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T05:33:44.565 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T05:33:44.565 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T05:33:44.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.566 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:44.568 INFO:tasks.thrashosds.thrasher:j is {'epoch': 62, 'fsid': 'eb5ff116-0384-4170-94d3-d3ddcb9c254f', 'created': '2024-09-11T05:32:25.817911+0000', 'modified': '2024-09-11T05:33:43.824731+0000', 'last_up_change': '2024-09-11T05:32:37.539498+0000', 'last_in_change': '2024-09-11T05:33:38.795439+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T05:32:37.977484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8873710632324219, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T05:32:43.780723+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.75, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8873710632324219, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T05:32:53.728195+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 27, 'snap_epoch': 56, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 0.75, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 0.8873710632324219, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}], 'osds': [{'osd': 0, 'uuid': '6ef7487b-9326-4062-8fe4-ef39030252bd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 4108497907}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 4108497907}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 4108497907}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 4108497907}]}, 'public_addr': '172.21.15.70:6819/4108497907', 'cluster_addr': '172.21.15.70:6821/4108497907', 'heartbeat_back_addr': '172.21.15.70:6825/4108497907', 'heartbeat_front_addr': '172.21.15.70:6823/4108497907', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3e0d8348-6e1b-4d63-b0f1-c20d90d73760', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 3979396531}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 3979396531}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 3979396531}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 3979396531}]}, 'public_addr': '172.21.15.70:6801/3979396531', 'cluster_addr': '172.21.15.70:6803/3979396531', 'heartbeat_back_addr': '172.21.15.70:6807/3979396531', 'heartbeat_front_addr': '172.21.15.70:6805/3979396531', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '38bbb42f-85e2-4064-8f55-e0385aff07d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 61, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 4053894977}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 4053894977}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 4053894977}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 4053894977}]}, 'public_addr': '172.21.15.70:6811/4053894977', 'cluster_addr': '172.21.15.70:6813/4053894977', 'heartbeat_back_addr': '172.21.15.70:6817/4053894977', 'heartbeat_front_addr': '172.21.15.70:6815/4053894977', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e96ca529-f3b3-4f7e-bd59-1e9872a5efab', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0.098968505859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2067624829}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2067624829}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6832', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6833', 'nonce': 2067624829}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2067624829}]}, 'public_addr': '172.21.15.70:6827/2067624829', 'cluster_addr': '172.21.15.70:6829/2067624829', 'heartbeat_back_addr': '172.21.15.70:6833/2067624829', 'heartbeat_front_addr': '172.21.15.70:6831/2067624829', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'dbbde660-d90e-4e02-9a01-16b0f76aa2b8', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6816', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6817', 'nonce': 1743986256}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6818', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6819', 'nonce': 1743986256}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6822', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6823', 'nonce': 1743986256}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6820', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6821', 'nonce': 1743986256}]}, 'public_addr': '172.21.15.84:6817/1743986256', 'cluster_addr': '172.21.15.84:6819/1743986256', 'heartbeat_back_addr': '172.21.15.84:6823/1743986256', 'heartbeat_front_addr': '172.21.15.84:6821/1743986256', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2dc1a002-3ec0-4b4d-b84d-e684fa8a9131', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6824', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6825', 'nonce': 2732588656}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6826', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6827', 'nonce': 2732588656}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6830', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6831', 'nonce': 2732588656}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6828', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6829', 'nonce': 2732588656}]}, 'public_addr': '172.21.15.84:6825/2732588656', 'cluster_addr': '172.21.15.84:6827/2732588656', 'heartbeat_back_addr': '172.21.15.84:6831/2732588656', 'heartbeat_front_addr': '172.21.15.84:6829/2732588656', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6800', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6801', 'nonce': 372011645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6802', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6803', 'nonce': 372011645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6806', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6807', 'nonce': 372011645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6804', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6805', 'nonce': 372011645}]}, 'public_addr': '172.21.15.84:6801/372011645', 'cluster_addr': '172.21.15.84:6803/372011645', 'heartbeat_back_addr': '172.21.15.84:6807/372011645', 'heartbeat_front_addr': '172.21.15.84:6805/372011645', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '5fef4450-317c-4e1f-b05b-80740b9538f1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6808', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6809', 'nonce': 583221652}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6810', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6811', 'nonce': 583221652}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6814', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6815', 'nonce': 583221652}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6812', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6813', 'nonce': 583221652}]}, 'public_addr': '172.21.15.84:6809/583221652', 'cluster_addr': '172.21.15.84:6811/583221652', 'heartbeat_back_addr': '172.21.15.84:6815/583221652', 'heartbeat_front_addr': '172.21.15.84:6813/583221652', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.130019+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.339373+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.204705+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.075490+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.279790+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.287168+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:34.320448+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:34.838001+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.4', 'mappings': [{'from': 6, 'to': 1}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T05:33:44.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:33:44.569 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:44.569 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:44.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:44.570 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:44.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.570 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36429 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8585216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.570 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:44.570 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.455289419, 2024-09-11T05:33:44.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035281438999999998, 2024-09-11T05:33:44.570 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.570 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36429 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081346+0000", 2024-09-11T05:33:44.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:33:44.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081348+0000", 2024-09-11T05:33:44.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:33:44.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081355+0000", 2024-09-11T05:33:44.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2230000000000001e-06 2024-09-11T05:33:44.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081360+0000", 2024-09-11T05:33:44.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0499999999999999e-06 2024-09-11T05:33:44.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116334+0000", 2024-09-11T05:33:44.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.034973889000000001 2024-09-11T05:33:44.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116410+0000", 2024-09-11T05:33:44.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6001000000000006e-05 2024-09-11T05:33:44.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116627+0000", 2024-09-11T05:33:44.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000216956 2024-09-11T05:33:44.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.574 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.575 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36430 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9437184~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.575 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:44.575 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.455181356000001, 2024-09-11T05:33:44.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035492782, 2024-09-11T05:33:44.575 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.575 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36430 2024-09-11T05:33:44.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.576 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:44.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:44.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081454+0000", 2024-09-11T05:33:44.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.99e-07 2024-09-11T05:33:44.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081458+0000", 2024-09-11T05:33:44.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7160000000000001e-06 2024-09-11T05:33:44.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081468+0000", 2024-09-11T05:33:44.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9629999999999993e-06 2024-09-11T05:33:44.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081474+0000", 2024-09-11T05:33:44.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2060000000000004e-06 2024-09-11T05:33:44.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116658+0000", 2024-09-11T05:33:44.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03518454 2024-09-11T05:33:44.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116734+0000", 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5703000000000003e-05 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116946+0000", 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211955 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.580 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36431 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9895936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.580 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:44.580 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.455150231000001, 2024-09-11T05:33:44.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035819799999999999, 2024-09-11T05:33:44.580 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36431 2024-09-11T05:33:44.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.580 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:44.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:44.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081485+0000", 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081493+0000", 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9629999999999998e-06 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081500+0000", 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7070000000000003e-06 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081504+0000", 2024-09-11T05:33:44.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:33:44.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116993+0000", 2024-09-11T05:33:44.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035489224 2024-09-11T05:33:44.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117083+0000", 2024-09-11T05:33:44.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9560000000000003e-05 2024-09-11T05:33:44.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117304+0000", 2024-09-11T05:33:44.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221244 2024-09-11T05:33:44.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.584 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.584 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36448 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 327680~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.584 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:44.584 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.455123529000002, 2024-09-11T05:33:44.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036143304000000001, 2024-09-11T05:33:44.585 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.585 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.585 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.585 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.585 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.585 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.585 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36448 2024-09-11T05:33:44.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.585 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081512+0000", 2024-09-11T05:33:44.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081514+0000", 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081520+0000", 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4269999999999996e-06 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081525+0000", 2024-09-11T05:33:44.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6140000000000002e-06 2024-09-11T05:33:44.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117333+0000", 2024-09-11T05:33:44.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035808385999999998 2024-09-11T05:33:44.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117446+0000", 2024-09-11T05:33:44.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113161 2024-09-11T05:33:44.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117654+0000", 2024-09-11T05:33:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020835800000000001 2024-09-11T05:33:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36449 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1638400~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.455104300999999, 2024-09-11T05:33:44.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036464895999999997, 2024-09-11T05:33:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36449 2024-09-11T05:33:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:44.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081531+0000", 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081533+0000", 2024-09-11T05:33:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8649999999999999e-06 2024-09-11T05:33:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081538+0000", 2024-09-11T05:33:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7769999999999999e-06 2024-09-11T05:33:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081543+0000", 2024-09-11T05:33:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4390000000000002e-06 2024-09-11T05:33:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117686+0000", 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036142760000000003 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117768+0000", 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2521000000000005e-05 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117995+0000", 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022715699999999999 2024-09-11T05:33:44.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36450 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.455086433000002, 2024-09-11T05:33:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036798323000000001, 2024-09-11T05:33:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36450 2024-09-11T05:33:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081549+0000", 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1699999999999999e-07 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081550+0000", 2024-09-11T05:33:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:33:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081557+0000", 2024-09-11T05:33:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:33:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081561+0000", 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2880000000000003e-06 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118042+0000", 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036480984000000001 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118142+0000", 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100043 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118347+0000", 2024-09-11T05:33:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020477399999999999 2024-09-11T05:33:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36451 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4259840~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.455068603000001, 2024-09-11T05:33:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037058173, 2024-09-11T05:33:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36451 2024-09-11T05:33:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:33:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081568+0000", 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081573+0000", 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999998e-06 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081575+0000", 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.605e-06 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118377+0000", 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036801831 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118459+0000", 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1983000000000004e-05 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118624+0000", 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000165353 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36452 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5570560~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.455056222, 2024-09-11T05:33:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037358132000000002, 2024-09-11T05:33:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.604 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36452 2024-09-11T05:33:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081579+0000", 2024-09-11T05:33:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4600000000000001e-07 2024-09-11T05:33:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081580+0000", 2024-09-11T05:33:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T05:33:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081583+0000", 2024-09-11T05:33:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9119999999999998e-06 2024-09-11T05:33:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081586+0000", 2024-09-11T05:33:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.371e-06 2024-09-11T05:33:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118666+0000", 2024-09-11T05:33:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037079933000000002 2024-09-11T05:33:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118725+0000", 2024-09-11T05:33:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8600000000000001e-05 2024-09-11T05:33:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118937+0000", 2024-09-11T05:33:44.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211931 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36453 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6881280~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.455045572, 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037649803000000003, 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36453 2024-09-11T05:33:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:44.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T05:33:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081590+0000", 2024-09-11T05:33:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-11T05:33:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081593+0000", 2024-09-11T05:33:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0110000000000001e-06 2024-09-11T05:33:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081596+0000", 2024-09-11T05:33:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7609999999999999e-06 2024-09-11T05:33:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118965+0000", 2024-09-11T05:33:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037368971000000001 2024-09-11T05:33:44.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119037+0000", 2024-09-11T05:33:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2300999999999998e-05 2024-09-11T05:33:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119239+0000", 2024-09-11T05:33:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020146000000000001 2024-09-11T05:33:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36454 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8192000~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.455035515999999, 2024-09-11T05:33:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037930403000000001, 2024-09-11T05:33:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36454 2024-09-11T05:33:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081600+0000", 2024-09-11T05:33:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:33:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081603+0000", 2024-09-11T05:33:44.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:33:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081606+0000", 2024-09-11T05:33:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4099999999999998e-06 2024-09-11T05:33:44.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119274+0000", 2024-09-11T05:33:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037668407000000001 2024-09-11T05:33:44.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119340+0000", 2024-09-11T05:33:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5685000000000006e-05 2024-09-11T05:33:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119530+0000", 2024-09-11T05:33:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000189688 2024-09-11T05:33:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36455 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9502720~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:44.624 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.455025367000001, 2024-09-11T05:33:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038210565000000002, 2024-09-11T05:33:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36455 2024-09-11T05:33:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081610+0000", 2024-09-11T05:33:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081611+0000", 2024-09-11T05:33:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0279999999999999e-06 2024-09-11T05:33:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081613+0000", 2024-09-11T05:33:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8430000000000001e-06 2024-09-11T05:33:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081616+0000", 2024-09-11T05:33:44.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6350000000000002e-06 2024-09-11T05:33:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119555+0000", 2024-09-11T05:33:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037939252999999999 2024-09-11T05:33:44.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119629+0000", 2024-09-11T05:33:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3868999999999994e-05 2024-09-11T05:33:44.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119820+0000", 2024-09-11T05:33:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190724 2024-09-11T05:33:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.634 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36480 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 393216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:44.635 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.455015801999998, 2024-09-11T05:33:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039217429999999998, 2024-09-11T05:33:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36480 2024-09-11T05:33:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081620+0000", 2024-09-11T05:33:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4900000000000004e-07 2024-09-11T05:33:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081624+0000", 2024-09-11T05:33:44.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:33:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081627+0000", 2024-09-11T05:33:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6520000000000002e-06 2024-09-11T05:33:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119851+0000", 2024-09-11T05:33:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038224209000000002 2024-09-11T05:33:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120518+0000", 2024-09-11T05:33:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066708900000000005 2024-09-11T05:33:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120836+0000", 2024-09-11T05:33:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031833300000000002 2024-09-11T05:33:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36481 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1703936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.455004915, 2024-09-11T05:33:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039545442, 2024-09-11T05:33:44.644 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36481 2024-09-11T05:33:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081631+0000", 2024-09-11T05:33:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0839999999999999e-06 2024-09-11T05:33:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081635+0000", 2024-09-11T05:33:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.743e-06 2024-09-11T05:33:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081637+0000", 2024-09-11T05:33:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.661e-06 2024-09-11T05:33:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120887+0000", 2024-09-11T05:33:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039249876000000003 2024-09-11T05:33:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120968+0000", 2024-09-11T05:33:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0253999999999994e-05 2024-09-11T05:33:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121175+0000", 2024-09-11T05:33:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020761099999999999 2024-09-11T05:33:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36482 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 3014656~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.454994354, 2024-09-11T05:33:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040344708999999999, 2024-09-11T05:33:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36482 2024-09-11T05:33:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081641+0000", 2024-09-11T05:33:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081647+0000", 2024-09-11T05:33:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:33:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081651+0000", 2024-09-11T05:33:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2080000000000002e-06 2024-09-11T05:33:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081654+0000", 2024-09-11T05:33:44.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:33:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121203+0000", 2024-09-11T05:33:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039549466999999998 2024-09-11T05:33:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121267+0000", 2024-09-11T05:33:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3713999999999993e-05 2024-09-11T05:33:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121985+0000", 2024-09-11T05:33:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071827299999999996 2024-09-11T05:33:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36483 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4325376~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.454977795000001, 2024-09-11T05:33:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040925571000000001, 2024-09-11T05:33:44.654 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36483 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:33:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081661+0000", 2024-09-11T05:33:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.296e-06 2024-09-11T05:33:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081665+0000", 2024-09-11T05:33:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9269999999999998e-06 2024-09-11T05:33:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081668+0000", 2024-09-11T05:33:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.615e-06 2024-09-11T05:33:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122019+0000", 2024-09-11T05:33:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040350886000000002 2024-09-11T05:33:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122108+0000", 2024-09-11T05:33:44.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8671000000000005e-05 2024-09-11T05:33:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122582+0000", 2024-09-11T05:33:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047494900000000001 2024-09-11T05:33:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36484 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5636096~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.659 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.454963367000001, 2024-09-11T05:33:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041537567999999997, 2024-09-11T05:33:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36484 2024-09-11T05:33:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081672+0000", 2024-09-11T05:33:44.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-07 2024-09-11T05:33:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081673+0000", 2024-09-11T05:33:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.212e-06 2024-09-11T05:33:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081676+0000", 2024-09-11T05:33:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6940000000000001e-06 2024-09-11T05:33:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081679+0000", 2024-09-11T05:33:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8260000000000001e-06 2024-09-11T05:33:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122615+0000", 2024-09-11T05:33:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040935421999999999 2024-09-11T05:33:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122892+0000", 2024-09-11T05:33:44.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027731099999999997 2024-09-11T05:33:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123209+0000", 2024-09-11T05:33:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000316872 2024-09-11T05:33:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36485 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6946816~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:44.664 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.454951157, 2024-09-11T05:33:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041869008999999999, 2024-09-11T05:33:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36485 2024-09-11T05:33:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081685+0000", 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029e-06 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081689+0000", 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0709999999999996e-06 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081692+0000", 2024-09-11T05:33:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389999999999999e-06 2024-09-11T05:33:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123245+0000", 2024-09-11T05:33:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041553759000000003 2024-09-11T05:33:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123331+0000", 2024-09-11T05:33:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5885999999999997e-05 2024-09-11T05:33:44.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123553+0000", 2024-09-11T05:33:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022129499999999999 2024-09-11T05:33:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36486 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8257536~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.454940139000001, 2024-09-11T05:33:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042204617999999999, 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36486 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081698+0000", 2024-09-11T05:33:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6490000000000001e-06 2024-09-11T05:33:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081702+0000", 2024-09-11T05:33:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7249999999999999e-06 2024-09-11T05:33:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081705+0000", 2024-09-11T05:33:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7379999999999999e-06 2024-09-11T05:33:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123583+0000", 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041878604999999999 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123666+0000", 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2027000000000006e-05 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123899+0000", 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000233663 2024-09-11T05:33:44.673 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36487 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9568256~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.454926964999999, 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043010712999999999, 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.674 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36487 2024-09-11T05:33:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.16e-07 2024-09-11T05:33:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081709+0000", 2024-09-11T05:33:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2100000000000001e-06 2024-09-11T05:33:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081713+0000", 2024-09-11T05:33:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.811e-06 2024-09-11T05:33:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081716+0000", 2024-09-11T05:33:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.112e-06 2024-09-11T05:33:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123961+0000", 2024-09-11T05:33:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042244482999999999 2024-09-11T05:33:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124043+0000", 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2066999999999999e-05 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124718+0000", 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067581399999999995 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.678 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:43696 3.10 3:0e50cb16:::rbd_data.112dcdbd4c7c.0000000000000007:14 [read 2088960~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.498706749, 2024-09-11T05:33:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035281203999999997, 2024-09-11T05:33:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 43696 2024-09-11T05:33:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:44.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-07 2024-09-11T05:33:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037930+0000", 2024-09-11T05:33:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5540000000000001e-06 2024-09-11T05:33:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037935+0000", 2024-09-11T05:33:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0610000000000003e-06 2024-09-11T05:33:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037939+0000", 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1239999999999998e-06 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073102+0000", 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035163341000000001 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073159+0000", 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6316000000000001e-05 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073209+0000", 2024-09-11T05:33:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0512e-05 2024-09-11T05:33:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.683 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.683 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:44.684 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:44.684 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:44.566+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:44.685 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-11T05:33:44.686 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:44.684+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:44.686 INFO:teuthology.orchestra.run.smithi070.stdout:3720 read 0x6a37644 thru 0x6a3f733 (0x80f0 bytes) 2024-09-11T05:33:44.687 INFO:teuthology.orchestra.run.smithi070.stdout:3721 read 0xcc0eb27 thru 0xcc10c47 (0x2121 bytes) 2024-09-11T05:33:44.687 INFO:teuthology.orchestra.run.smithi070.stdout:3722 writesame 0x7dbaa04 thru 0x7dbd425 data_size 0x1(0x2a22 bytes) 2024-09-11T05:33:44.701 INFO:teuthology.orchestra.run.smithi070.stdout:3723 read 0x74db6c9 thru 0x74e62ed (0xac25 bytes) 2024-09-11T05:33:44.701 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:44.701 INFO:teuthology.orchestra.run.smithi070.stdout:3727 read 0xc8da267 thru 0xc8e7361 (0xd0fb bytes) 2024-09-11T05:33:44.701 INFO:teuthology.orchestra.run.smithi070.stdout:3729 write 0xac36ab8 thru 0xac43523 (0xca6c bytes) 2024-09-11T05:33:44.716 INFO:teuthology.orchestra.run.smithi070.stdout:3730 read 0x83c6419 thru 0x83cfd47 (0x992f bytes) 2024-09-11T05:33:44.716 INFO:teuthology.orchestra.run.smithi070.stdout:3731 write 0xb6265bd thru 0xb63626b (0xfcaf bytes) 2024-09-11T05:33:44.730 INFO:teuthology.orchestra.run.smithi070.stdout:3732 writesame 0xb93b4b2 thru 0xb946f1a data_size 0x1(0xba69 bytes) 2024-09-11T05:33:44.761 INFO:teuthology.orchestra.run.smithi070.stdout:3733 write 0x8b04868 thru 0x8b0b240 (0x69d9 bytes) 2024-09-11T05:33:44.780 INFO:teuthology.orchestra.run.smithi070.stdout:3734 trunc from 0xd7f6dac to 0x2855345 2024-09-11T05:33:44.786 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:44.785+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:44.807 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:44.807 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:44.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.808 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4397.0:143952 3.1e e62/22 3:7c7e9cbe:::rbd_data.112d55d87bfc.00000000000000a8:head v 62'145, mlcod=53'143)", 2024-09-11T05:33:44.808 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:44.806872+0000", 2024-09-11T05:33:44.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00072130800000000004, 2024-09-11T05:33:44.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074191299999999997, 2024-09-11T05:33:44.808 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:44.808 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.806872+0000", 2024-09-11T05:33:44.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.806872+0000", 2024-09-11T05:33:44.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.806873+0000", 2024-09-11T05:33:44.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4200000000000004e-07 2024-09-11T05:33:44.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.806881+0000", 2024-09-11T05:33:44.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2980000000000003e-06 2024-09-11T05:33:44.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.806896+0000", 2024-09-11T05:33:44.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.505e-05 2024-09-11T05:33:44.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.806904+0000", 2024-09-11T05:33:44.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-11T05:33:44.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.806958+0000", 2024-09-11T05:33:44.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4045999999999997e-05 2024-09-11T05:33:44.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.806979+0000", 2024-09-11T05:33:44.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0891e-05 2024-09-11T05:33:44.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:33:44.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.807581+0000", 2024-09-11T05:33:44.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060161199999999996 2024-09-11T05:33:44.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.812 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.812 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4397.0:143953 3.3 e62/22 3:c4cce6b4:::rbd_data.112d55d87bfc.00000000000000a9:head v 62'307, mlcod=62'305)", 2024-09-11T05:33:44.812 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:44.807028+0000", 2024-09-11T05:33:44.812 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00056526299999999999, 2024-09-11T05:33:44.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000637373, 2024-09-11T05:33:44.812 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:44.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:44.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:44.813 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:44.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:44.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.807028+0000", 2024-09-11T05:33:44.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:44.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.807028+0000", 2024-09-11T05:33:44.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:44.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.807029+0000", 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3900000000000004e-07 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.807035+0000", 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.852e-06 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.807046+0000", 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1060000000000001e-05 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:44.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.807053+0000", 2024-09-11T05:33:44.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9619999999999996e-06 2024-09-11T05:33:44.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:44.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.807091+0000", 2024-09-11T05:33:44.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7687e-05 2024-09-11T05:33:44.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:44.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:44.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:44.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:44.807106+0000", 2024-09-11T05:33:44.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5048999999999999e-05 2024-09-11T05:33:44.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.816 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:44.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:44.816 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:33:44.816 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 2 2024-09-11T05:33:44.816 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:44.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:3735 write 0xb012b68 thru 0xb014f18 (0x23b1 bytes) 2024-09-11T05:33:44.836 INFO:teuthology.orchestra.run.smithi070.stdout:3736 read 0x2d36491 thru 0x2d41ffe (0xbb6e bytes) 2024-09-11T05:33:44.836 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:44.836 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:44.837 INFO:teuthology.orchestra.run.smithi070.stdout:3740 read 0x7faa848 thru 0x7fb51d5 (0xa98e bytes) 2024-09-11T05:33:44.837 INFO:teuthology.orchestra.run.smithi070.stdout:3741 writesame 0x7f11e9b thru 0x7f130bd data_size 0x1(0x1223 bytes) 2024-09-11T05:33:44.841 INFO:teuthology.orchestra.run.smithi070.stdout:3742 punch from 0x363dde7 to 0x364b65f, (0xd878 bytes) 2024-09-11T05:33:44.841 INFO:teuthology.orchestra.run.smithi070.stdout:3744 writesame 0x4cfca4f thru 0x4d0546a data_size 0x2(0x8a1c bytes) 2024-09-11T05:33:44.855 INFO:teuthology.orchestra.run.smithi070.stdout:3745 read 0x8326317 thru 0x832a808 (0x44f2 bytes) 2024-09-11T05:33:44.855 INFO:teuthology.orchestra.run.smithi070.stdout:3748 write 0x37457f0 thru 0x3750132 (0xa943 bytes) 2024-09-11T05:33:44.870 INFO:teuthology.orchestra.run.smithi070.stdout:3749 trunc from 0xb014f19 to 0xd384d6e 2024-09-11T05:33:44.876 INFO:teuthology.orchestra.run.smithi070.stdout:3750 write 0xa72f0bf thru 0xa7326f8 (0x363a bytes) 2024-09-11T05:33:44.883 INFO:teuthology.orchestra.run.smithi070.stdout:3751 punch from 0xb0009b to 0xb0d27c, (0xd1e1 bytes) 2024-09-11T05:33:44.887 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:44.886+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:44.891 INFO:teuthology.orchestra.run.smithi070.stdout:3753 trunc from 0xd384d6e to 0x694068b 2024-09-11T05:33:44.908 INFO:teuthology.orchestra.run.smithi070.stdout:3754 write 0x72d1db3 thru 0x72dc44d (0xa69b bytes) 2024-09-11T05:33:44.919 INFO:teuthology.orchestra.run.smithi070.stdout:3755 punch from 0x323a7fa to 0x324a14b, (0xf951 bytes) 2024-09-11T05:33:44.919 INFO:teuthology.orchestra.run.smithi070.stdout:3757 writesame 0x5e49b88 thru 0x5e548e2 data_size 0x3(0xad5b bytes) 2024-09-11T05:33:44.932 INFO:teuthology.orchestra.run.smithi070.stdout:3758 punch from 0x49ed9ff to 0x49ef133, (0x1734 bytes) 2024-09-11T05:33:44.933 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:44.933 INFO:teuthology.orchestra.run.smithi070.stdout:3761 write 0x3ca1e46 thru 0x3ca3261 (0x141c bytes) 2024-09-11T05:33:44.939 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:44.939 INFO:teuthology.orchestra.run.smithi070.stdout:3764 punch from 0x386282b to 0x386910f, (0x68e4 bytes) 2024-09-11T05:33:44.940 INFO:teuthology.orchestra.run.smithi070.stdout:3765 read 0x1d0c302 thru 0x1d107b4 (0x44b3 bytes) 2024-09-11T05:33:44.940 INFO:teuthology.orchestra.run.smithi070.stdout:3767 read 0x25f2831 thru 0x25fb385 (0x8b55 bytes) 2024-09-11T05:33:44.940 INFO:teuthology.orchestra.run.smithi070.stdout:3768 trunc from 0x72dc44e to 0x7dc2dbc 2024-09-11T05:33:44.948 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:44.948 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:44.948 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:44.948 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:44.948 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:44.949 INFO:teuthology.orchestra.run.smithi070.stdout:3769 trunc from 0x7dc2dbc to 0x4a5b993 2024-09-11T05:33:44.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:44.963 INFO:teuthology.orchestra.run.smithi070.stdout:3770 punch from 0x4537210 to 0x4540197, (0x8f87 bytes) 2024-09-11T05:33:44.969 INFO:teuthology.orchestra.run.smithi070.stdout:3771 write 0x5200a36 thru 0x5206dba (0x6385 bytes) 2024-09-11T05:33:44.975 INFO:teuthology.orchestra.run.smithi070.stdout:3772 trunc from 0x5206dbb to 0x657686d 2024-09-11T05:33:44.987 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:44.987+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:44.995 INFO:teuthology.orchestra.run.smithi070.stdout:3773 write 0xd6ed607 thru 0xd6f365d (0x6057 bytes) 2024-09-11T05:33:45.000 INFO:teuthology.orchestra.run.smithi070.stdout:3774 read 0x469f92a thru 0x46a2e68 (0x353f bytes) 2024-09-11T05:33:45.007 INFO:teuthology.orchestra.run.smithi070.stdout:3775 write 0xec900f0 thru 0xec98017 (0x7f28 bytes) 2024-09-11T05:33:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:3777 read 0x7910975 thru 0x79183ff (0x7a8b bytes) 2024-09-11T05:33:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:3778 read 0xcd7ed07 thru 0xcd857a8 (0x6aa2 bytes) 2024-09-11T05:33:45.022 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:33:45.023 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:33:45.030 INFO:teuthology.orchestra.run.smithi070.stdout:3779 trunc from 0xec98018 to 0x1399b0b 2024-09-11T05:33:45.041 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-09-11T05:33:43.956400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":869667631,"num_objects":1299,"num_object_clones":406,"num_object_copies":2598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1299,"num_whiteouts":395,"num_read":136673,"num_read_kb":363065,"num_write":12486,"num_write_kb":189860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":734,"num_bytes_recovered":45615205,"num_keys_recovered":42,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9797,"ondisk_log_size":9797,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":467092,"kb_used_data":257736,"kb_used_omap":9,"kb_used_meta":209206,"kb_avail":565763948,"statfs":{"total":579820584960,"available":579342282752,"internally_reserved":0,"allocated":263921664,"data_stored":360190764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9564,"internal_metadata":214227620},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[16,17,0,0,0,0,0,0,0,0,456,56],"upper_bound":4096},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16026,"num_read_kb":4279,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":734,"num_bytes_recovered":45615205,"num_keys_recovered":42,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000530"},"pg_stats":[{"pgid":"3.1f","version":"56'444","reported_seq":3446,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.829719+0000","last_change":"2024-09-11T05:32:57.613041+0000","last_active":"2024-09-11T05:33:42.829719+0000","last_peered":"2024-09-11T05:33:42.829719+0000","last_clean":"2024-09-11T05:33:42.829719+0000","last_became_active":"2024-09-11T05:32:55.616706+0000","last_became_peered":"2024-09-11T05:32:55.616706+0000","last_unstale":"2024-09-11T05:33:42.829719+0000","last_undegraded":"2024-09-11T05:33:42.829719+0000","last_fullsized":"2024-09-11T05:33:42.829719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:09.866555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069887699999999998,"stat_sum":{"num_bytes":37307369,"num_objects":36,"num_object_clones":11,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":11,"num_read":4444,"num_read_kb":20391,"num_write":639,"num_write_kb":8422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"55'144","reported_seq":3014,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.829601+0000","last_change":"2024-09-11T05:32:57.612693+0000","last_active":"2024-09-11T05:33:42.829601+0000","last_peered":"2024-09-11T05:33:42.829601+0000","last_clean":"2024-09-11T05:33:42.829601+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:33:42.829601+0000","last_undegraded":"2024-09-11T05:33:42.829601+0000","last_fullsized":"2024-09-11T05:33:42.829601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:13.144712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039696399999999998,"stat_sum":{"num_bytes":38770777,"num_objects":43,"num_object_clones":12,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":14,"num_read":2826,"num_read_kb":18191,"num_write":129,"num_write_kb":2864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"55'388","reported_seq":11845,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.994152+0000","last_change":"2024-09-11T05:33:42.837128+0000","last_active":"2024-09-11T05:33:42.994152+0000","last_peered":"2024-09-11T05:33:42.994152+0000","last_clean":"2024-09-11T05:33:42.994152+0000","last_became_active":"2024-09-11T05:33:42.833583+0000","last_became_peered":"2024-09-11T05:33:42.833583+0000","last_unstale":"2024-09-11T05:33:42.994152+0000","last_undegraded":"2024-09-11T05:33:42.994152+0000","last_fullsized":"2024-09-11T05:33:42.994152+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:03.774281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057469400000000005,"stat_sum":{"num_bytes":52606763,"num_objects":43,"num_object_clones":15,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":14,"num_read":6128,"num_read_kb":9215,"num_write":507,"num_write_kb":4451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":69,"num_bytes_recovered":2548657,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"56'348","reported_seq":2286,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.829121+0000","last_change":"2024-09-11T05:32:57.610640+0000","last_active":"2024-09-11T05:33:42.829121+0000","last_peered":"2024-09-11T05:33:42.829121+0000","last_clean":"2024-09-11T05:33:42.829121+0000","last_became_active":"2024-09-11T05:32:55.611900+0000","last_became_peered":"2024-09-11T05:32:55.611900+0000","last_unstale":"2024-09-11T05:33:42.829121+0000","last_undegraded":"2024-09-11T05:33:42.829121+0000","last_fullsized":"2024-09-11T05:33:42.829121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:25:56.584482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060489099999999998,"stat_sum":{"num_bytes":56038085,"num_objects":46,"num_object_clones":15,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":14,"num_read":3887,"num_read_kb":24415,"num_write":428,"num_write_kb":15321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"54'367","reported_seq":1246,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.835421+0000","last_change":"2024-09-11T05:33:42.835421+0000","last_active":"2024-09-11T05:33:42.835421+0000","last_peered":"2024-09-11T05:33:42.835421+0000","last_clean":"2024-09-11T05:33:42.835421+0000","last_became_active":"2024-09-11T05:33:42.832898+0000","last_became_peered":"2024-09-11T05:33:42.832898+0000","last_unstale":"2024-09-11T05:33:42.835421+0000","last_undegraded":"2024-09-11T05:33:42.835421+0000","last_fullsized":"2024-09-11T05:33:42.835421+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:37:01.809787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061541299999999998,"stat_sum":{"num_bytes":6996582,"num_objects":35,"num_object_clones":11,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":13,"num_read":1767,"num_read_kb":3505,"num_write":525,"num_write_kb":2114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":993229,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"56'213","reported_seq":2781,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.829258+0000","last_change":"2024-09-11T05:32:57.611081+0000","last_active":"2024-09-11T05:33:42.829258+0000","last_peered":"2024-09-11T05:33:42.829258+0000","last_clean":"2024-09-11T05:33:42.829258+0000","last_became_active":"2024-09-11T05:32:55.612495+0000","last_became_peered":"2024-09-11T05:32:55.612495+0000","last_unstale":"2024-09-11T05:33:42.829258+0000","last_undegraded":"2024-09-11T05:33:42.829258+0000","last_fullsized":"2024-09-11T05:33:42.829258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:59.328319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049061,"stat_sum":{"num_bytes":28936305,"num_objects":50,"num_object_clones":19,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":17,"num_read":3586,"num_read_kb":9654,"num_write":208,"num_write_kb":5935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"56'909","reported_seq":10164,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.829771+0000","last_change":"2024-09-11T05:32:57.610393+0000","last_active":"2024-09-11T05:33:42.829771+0000","last_peered":"2024-09-11T05:33:42.829771+0000","last_clean":"2024-09-11T05:33:42.829771+0000","last_became_active":"2024-09-11T05:32:55.616919+0000","last_became_peered":"2024-09-11T05:32:55.616919+0000","last_unstale":"2024-09-11T05:33:42.829771+0000","last_undegraded":"2024-09-11T05:33:42.829771+0000","last_fullsized":"2024-09-11T05:33:42.829771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:17:57.176711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050971999999999996,"stat_sum":{"num_bytes":11518987,"num_objects":36,"num_object_clones":12,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":13235,"num_read_kb":8493,"num_write":1498,"num_write_kb":4711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"56'321","reported_seq":2020,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.829432+0000","last_change":"2024-09-11T05:32:57.613299+0000","last_active":"2024-09-11T05:33:42.829432+0000","last_peered":"2024-09-11T05:33:42.829432+0000","last_clean":"2024-09-11T05:33:42.829432+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:33:42.829432+0000","last_undegraded":"2024-09-11T05:33:42.829432+0000","last_fullsized":"2024-09-11T05:33:42.829432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:17:28.683266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084187599999999997,"stat_sum":{"num_bytes":7393323,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":2699,"num_read_kb":6470,"num_write":452,"num_write_kb":4749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"55'585","reported_seq":1713,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.834108+0000","last_change":"2024-09-11T05:33:42.834108+0000","last_active":"2024-09-11T05:33:42.834108+0000","last_peered":"2024-09-11T05:33:42.834108+0000","last_clean":"2024-09-11T05:33:42.834108+0000","last_became_active":"2024-09-11T05:33:42.833416+0000","last_became_peered":"2024-09-11T05:33:42.833416+0000","last_unstale":"2024-09-11T05:33:42.834108+0000","last_undegraded":"2024-09-11T05:33:42.834108+0000","last_fullsized":"2024-09-11T05:33:42.834108+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:58:21.685284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065268399999999995,"stat_sum":{"num_bytes":42944714,"num_objects":37,"num_object_clones":12,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":9,"num_read":2952,"num_read_kb":23489,"num_write":904,"num_write_kb":16809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":13290883,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"48'116","reported_seq":3044,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.831157+0000","last_change":"2024-09-11T05:33:42.831157+0000","last_active":"2024-09-11T05:33:42.831157+0000","last_peered":"2024-09-11T05:33:42.831157+0000","last_clean":"2024-09-11T05:33:42.831157+0000","last_became_active":"2024-09-11T05:33:42.830559+0000","last_became_peered":"2024-09-11T05:33:42.830559+0000","last_unstale":"2024-09-11T05:33:42.831157+0000","last_undegraded":"2024-09-11T05:33:42.831157+0000","last_fullsized":"2024-09-11T05:33:42.831157+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:27:12.168938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057970299999999999,"stat_sum":{"num_bytes":13043372,"num_objects":28,"num_object_clones":8,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":7,"num_read":2761,"num_read_kb":6282,"num_write":109,"num_write_kb":1791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":49,"num_bytes_recovered":852701,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"49'334","reported_seq":2085,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.830281+0000","last_change":"2024-09-11T05:32:57.607444+0000","last_active":"2024-09-11T05:33:42.830281+0000","last_peered":"2024-09-11T05:33:42.830281+0000","last_clean":"2024-09-11T05:33:42.830281+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:33:42.830281+0000","last_undegraded":"2024-09-11T05:33:42.830281+0000","last_fullsized":"2024-09-11T05:33:42.830281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:09.402696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066300199999999999,"stat_sum":{"num_bytes":16628161,"num_objects":46,"num_object_clones":13,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":16,"num_read":2556,"num_read_kb":7857,"num_write":499,"num_write_kb":5734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"56'163","reported_seq":10983,"reported_epoch":60,"state":"peering","last_fresh":"2024-09-11T05:33:41.865412+0000","last_change":"2024-09-11T05:33:42.828537+0000","last_active":"2024-09-11T05:33:42.828537+0000","last_peered":"2024-09-11T05:33:41.865412+0000","last_clean":"2024-09-11T05:33:38.815017+0000","last_became_active":"2024-09-11T05:33:40.838018+0000","last_became_peered":"2024-09-11T05:33:40.838018+0000","last_unstale":"2024-09-11T05:33:41.865412+0000","last_undegraded":"2024-09-11T05:33:41.865412+0000","last_fullsized":"2024-09-11T05:33:40.830432+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073758600000000004,"stat_sum":{"num_bytes":16251990,"num_objects":48,"num_object_clones":16,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":14,"num_read":4612,"num_read_kb":10489,"num_write":163,"num_write_kb":7156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":6581396,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.832123+0000","last_change":"2024-09-11T05:33:39.823881+0000","last_active":"2024-09-11T05:33:42.832123+0000","last_peered":"2024-09-11T05:33:42.832123+0000","last_clean":"2024-09-11T05:33:42.832123+0000","last_became_active":"2024-09-11T05:33:39.823581+0000","last_became_peered":"2024-09-11T05:33:39.823581+0000","last_unstale":"2024-09-11T05:33:42.832123+0000","last_undegraded":"2024-09-11T05:33:42.832123+0000","last_fullsized":"2024-09-11T05:33:42.832123+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:45:42.315188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"50'508","reported_seq":3598,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.828037+0000","last_change":"2024-09-11T05:32:57.659941+0000","last_active":"2024-09-11T05:33:42.828037+0000","last_peered":"2024-09-11T05:33:42.828037+0000","last_clean":"2024-09-11T05:33:42.828037+0000","last_became_active":"2024-09-11T05:32:55.613342+0000","last_became_peered":"2024-09-11T05:32:55.613342+0000","last_unstale":"2024-09-11T05:33:42.828037+0000","last_undegraded":"2024-09-11T05:33:42.828037+0000","last_fullsized":"2024-09-11T05:33:42.828037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:46:48.220476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033519099999999998,"stat_sum":{"num_bytes":9619410,"num_objects":37,"num_object_clones":11,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":5041,"num_read_kb":3139,"num_write":797,"num_write_kb":1961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":87,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.831969+0000","last_change":"2024-09-11T05:32:55.614406+0000","last_active":"2024-09-11T05:33:42.831969+0000","last_peered":"2024-09-11T05:33:42.831969+0000","last_clean":"2024-09-11T05:33:42.831969+0000","last_became_active":"2024-09-11T05:32:55.614125+0000","last_became_peered":"2024-09-11T05:32:55.614125+0000","last_unstale":"2024-09-11T05:33:42.831969+0000","last_undegraded":"2024-09-11T05:33:42.831969+0000","last_fullsized":"2024-09-11T05:33:42.831969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:06:59.971006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"55'203","reported_seq":2387,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.826745+0000","last_change":"2024-09-11T05:32:57.618706+0000","last_active":"2024-09-11T05:33:42.826745+0000","last_peered":"2024-09-11T05:33:42.826745+0000","last_clean":"2024-09-11T05:33:42.826745+0000","last_became_active":"2024-09-11T05:32:55.615465+0000","last_became_peered":"2024-09-11T05:32:55.615465+0000","last_unstale":"2024-09-11T05:33:42.826745+0000","last_undegraded":"2024-09-11T05:33:42.826745+0000","last_fullsized":"2024-09-11T05:33:42.826745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:44.853633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099597899999999992,"stat_sum":{"num_bytes":18988984,"num_objects":47,"num_object_clones":18,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":20,"num_read":3140,"num_read_kb":5826,"num_write":182,"num_write_kb":4875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.826698+0000","last_change":"2024-09-11T05:33:39.826825+0000","last_active":"2024-09-11T05:33:42.826698+0000","last_peered":"2024-09-11T05:33:42.826698+0000","last_clean":"2024-09-11T05:33:42.826698+0000","last_became_active":"2024-09-11T05:33:39.826602+0000","last_became_peered":"2024-09-11T05:33:39.826602+0000","last_unstale":"2024-09-11T05:33:42.826698+0000","last_undegraded":"2024-09-11T05:33:42.826698+0000","last_fullsized":"2024-09-11T05:33:42.826698+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:43.445893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"56'527","reported_seq":2606,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.826599+0000","last_change":"2024-09-11T05:32:57.618700+0000","last_active":"2024-09-11T05:33:42.826599+0000","last_peered":"2024-09-11T05:33:42.826599+0000","last_clean":"2024-09-11T05:33:42.826599+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:33:42.826599+0000","last_undegraded":"2024-09-11T05:33:42.826599+0000","last_fullsized":"2024-09-11T05:33:42.826599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:16.111898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010906679999999999,"stat_sum":{"num_bytes":41090281,"num_objects":52,"num_object_clones":15,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":16,"num_read":5076,"num_read_kb":12629,"num_write":654,"num_write_kb":9143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":104,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.829688+0000","last_change":"2024-09-11T05:33:02.663770+0000","last_active":"2024-09-11T05:33:42.829688+0000","last_peered":"2024-09-11T05:33:42.829688+0000","last_clean":"2024-09-11T05:33:42.829688+0000","last_became_active":"2024-09-11T05:33:02.663542+0000","last_became_peered":"2024-09-11T05:33:02.663542+0000","last_unstale":"2024-09-11T05:33:42.829688+0000","last_undegraded":"2024-09-11T05:33:42.829688+0000","last_fullsized":"2024-09-11T05:33:42.829688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:36.032555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"61'274","reported_seq":10675,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.875836+0000","last_change":"2024-09-11T05:32:57.890326+0000","last_active":"2024-09-11T05:33:42.875836+0000","last_peered":"2024-09-11T05:33:42.875836+0000","last_clean":"2024-09-11T05:33:42.875836+0000","last_became_active":"2024-09-11T05:32:55.611732+0000","last_became_peered":"2024-09-11T05:32:55.611732+0000","last_unstale":"2024-09-11T05:33:42.875836+0000","last_undegraded":"2024-09-11T05:33:42.875836+0000","last_fullsized":"2024-09-11T05:33:42.875836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:10:19.697719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045416500000000003,"stat_sum":{"num_bytes":21116738,"num_objects":44,"num_object_clones":13,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":16,"num_read":11249,"num_read_kb":13340,"num_write":236,"num_write_kb":3159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"56'303","reported_seq":2499,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.831132+0000","last_change":"2024-09-11T05:32:57.607689+0000","last_active":"2024-09-11T05:33:42.831132+0000","last_peered":"2024-09-11T05:33:42.831132+0000","last_clean":"2024-09-11T05:33:42.831132+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:33:42.831132+0000","last_undegraded":"2024-09-11T05:33:42.831132+0000","last_fullsized":"2024-09-11T05:33:42.831132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:23.626546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074095900000000002,"stat_sum":{"num_bytes":21985875,"num_objects":32,"num_object_clones":9,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":8,"num_read":2958,"num_read_kb":7799,"num_write":375,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":51,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.826470+0000","last_change":"2024-09-11T05:33:39.832368+0000","last_active":"2024-09-11T05:33:42.826470+0000","last_peered":"2024-09-11T05:33:42.826470+0000","last_clean":"2024-09-11T05:33:42.826470+0000","last_became_active":"2024-09-11T05:33:39.822659+0000","last_became_peered":"2024-09-11T05:33:39.822659+0000","last_unstale":"2024-09-11T05:33:42.826470+0000","last_undegraded":"2024-09-11T05:33:42.826470+0000","last_fullsized":"2024-09-11T05:33:42.826470+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:18:46.195601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"49'150","reported_seq":1320,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.829257+0000","last_change":"2024-09-11T05:32:57.612724+0000","last_active":"2024-09-11T05:33:42.829257+0000","last_peered":"2024-09-11T05:33:42.829257+0000","last_clean":"2024-09-11T05:33:42.829257+0000","last_became_active":"2024-09-11T05:32:55.613283+0000","last_became_peered":"2024-09-11T05:32:55.613283+0000","last_unstale":"2024-09-11T05:33:42.829257+0000","last_undegraded":"2024-09-11T05:33:42.829257+0000","last_fullsized":"2024-09-11T05:33:42.829257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:39.897636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041242399999999999,"stat_sum":{"num_bytes":13640883,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":13,"num_read":1123,"num_read_kb":5219,"num_write":174,"num_write_kb":2882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.827969+0000","last_change":"2024-09-11T05:32:47.726973+0000","last_active":"2024-09-11T05:33:42.827969+0000","last_peered":"2024-09-11T05:33:42.827969+0000","last_clean":"2024-09-11T05:33:42.827969+0000","last_became_active":"2024-09-11T05:32:45.585103+0000","last_became_peered":"2024-09-11T05:32:45.585103+0000","last_unstale":"2024-09-11T05:33:42.827969+0000","last_undegraded":"2024-09-11T05:33:42.827969+0000","last_fullsized":"2024-09-11T05:33:42.827969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:07:32.584388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039722200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"56'314","reported_seq":4199,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.826448+0000","last_change":"2024-09-11T05:32:57.617928+0000","last_active":"2024-09-11T05:33:42.826448+0000","last_peered":"2024-09-11T05:33:42.826448+0000","last_clean":"2024-09-11T05:33:42.826448+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:33:42.826448+0000","last_undegraded":"2024-09-11T05:33:42.826448+0000","last_fullsized":"2024-09-11T05:33:42.826448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:01:33.051897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045617500000000002,"stat_sum":{"num_bytes":28008147,"num_objects":43,"num_object_clones":12,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":10,"num_read":5728,"num_read_kb":13459,"num_write":330,"num_write_kb":3673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.829385+0000","last_change":"2024-09-11T05:33:39.819170+0000","last_active":"2024-09-11T05:33:42.829385+0000","last_peered":"2024-09-11T05:33:42.829385+0000","last_clean":"2024-09-11T05:33:42.829385+0000","last_became_active":"2024-09-11T05:33:39.818868+0000","last_became_peered":"2024-09-11T05:33:39.818868+0000","last_unstale":"2024-09-11T05:33:42.829385+0000","last_undegraded":"2024-09-11T05:33:42.829385+0000","last_fullsized":"2024-09-11T05:33:42.829385+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:58.404920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"56'169","reported_seq":2006,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.826485+0000","last_change":"2024-09-11T05:32:57.890067+0000","last_active":"2024-09-11T05:33:42.826485+0000","last_peered":"2024-09-11T05:33:42.826485+0000","last_clean":"2024-09-11T05:33:42.826485+0000","last_became_active":"2024-09-11T05:32:55.616909+0000","last_became_peered":"2024-09-11T05:32:55.616909+0000","last_unstale":"2024-09-11T05:33:42.826485+0000","last_undegraded":"2024-09-11T05:33:42.826485+0000","last_fullsized":"2024-09-11T05:33:42.826485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:01.315172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054678799999999998,"stat_sum":{"num_bytes":29008550,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":2858,"num_read_kb":10631,"num_write":212,"num_write_kb":6269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":43,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.826668+0000","last_change":"2024-09-11T05:33:39.822577+0000","last_active":"2024-09-11T05:33:42.826668+0000","last_peered":"2024-09-11T05:33:42.826668+0000","last_clean":"2024-09-11T05:33:42.826668+0000","last_became_active":"2024-09-11T05:33:39.818953+0000","last_became_peered":"2024-09-11T05:33:39.818953+0000","last_unstale":"2024-09-11T05:33:42.826668+0000","last_undegraded":"2024-09-11T05:33:42.826668+0000","last_fullsized":"2024-09-11T05:33:42.826668+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:36.140689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":250,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.828998+0000","last_change":"2024-09-11T05:32:39.551254+0000","last_active":"2024-09-11T05:33:42.828998+0000","last_peered":"2024-09-11T05:33:42.828998+0000","last_clean":"2024-09-11T05:33:42.828998+0000","last_became_active":"2024-09-11T05:32:39.550968+0000","last_became_peered":"2024-09-11T05:32:39.550968+0000","last_unstale":"2024-09-11T05:33:42.828998+0000","last_undegraded":"2024-09-11T05:33:42.828998+0000","last_fullsized":"2024-09-11T05:33:42.828998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:09.466849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"56'327","reported_seq":18960,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.828021+0000","last_change":"2024-09-11T05:32:57.660171+0000","last_active":"2024-09-11T05:33:42.828021+0000","last_peered":"2024-09-11T05:33:42.828021+0000","last_clean":"2024-09-11T05:33:42.828021+0000","last_became_active":"2024-09-11T05:32:55.611842+0000","last_became_peered":"2024-09-11T05:32:55.611842+0000","last_unstale":"2024-09-11T05:33:42.828021+0000","last_undegraded":"2024-09-11T05:33:42.828021+0000","last_fullsized":"2024-09-11T05:33:42.828021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:44.669343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042237200000000001,"stat_sum":{"num_bytes":29320276,"num_objects":45,"num_object_clones":16,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":14,"num_read":19917,"num_read_kb":11456,"num_write":358,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"55'168","reported_seq":3752,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.982121+0000","last_change":"2024-09-11T05:33:42.837076+0000","last_active":"2024-09-11T05:33:42.982121+0000","last_peered":"2024-09-11T05:33:42.982121+0000","last_clean":"2024-09-11T05:33:42.982121+0000","last_became_active":"2024-09-11T05:33:42.833311+0000","last_became_peered":"2024-09-11T05:33:42.833311+0000","last_unstale":"2024-09-11T05:33:42.982121+0000","last_undegraded":"2024-09-11T05:33:42.982121+0000","last_fullsized":"2024-09-11T05:33:42.982121+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:28.004098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038649399999999998,"stat_sum":{"num_bytes":22605941,"num_objects":42,"num_object_clones":16,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":3237,"num_read_kb":13723,"num_write":169,"num_write_kb":7845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":70,"num_bytes_recovered":6553756,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"56'205","reported_seq":1962,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.832348+0000","last_change":"2024-09-11T05:33:42.832348+0000","last_active":"2024-09-11T05:33:42.832348+0000","last_peered":"2024-09-11T05:33:42.832348+0000","last_clean":"2024-09-11T05:33:42.832348+0000","last_became_active":"2024-09-11T05:33:42.831628+0000","last_became_peered":"2024-09-11T05:33:42.831628+0000","last_unstale":"2024-09-11T05:33:42.832348+0000","last_undegraded":"2024-09-11T05:33:42.832348+0000","last_fullsized":"2024-09-11T05:33:42.832348+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:56:36.985947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039096600000000002,"stat_sum":{"num_bytes":26748073,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":8,"num_read":1578,"num_read_kb":7280,"num_write":230,"num_write_kb":4066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":2324728,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"54'192","reported_seq":1743,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.828020+0000","last_change":"2024-09-11T05:32:57.659963+0000","last_active":"2024-09-11T05:33:42.828020+0000","last_peered":"2024-09-11T05:33:42.828020+0000","last_clean":"2024-09-11T05:33:42.828020+0000","last_became_active":"2024-09-11T05:32:55.612809+0000","last_became_peered":"2024-09-11T05:32:55.612809+0000","last_unstale":"2024-09-11T05:33:42.828020+0000","last_undegraded":"2024-09-11T05:33:42.828020+0000","last_fullsized":"2024-09-11T05:33:42.828020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:59.897644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035048700000000002,"stat_sum":{"num_bytes":29061756,"num_objects":33,"num_object_clones":8,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":9,"num_read":2024,"num_read_kb":23197,"num_write":218,"num_write_kb":16566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"49'151","reported_seq":1621,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.831083+0000","last_change":"2024-09-11T05:32:57.607220+0000","last_active":"2024-09-11T05:33:42.831083+0000","last_peered":"2024-09-11T05:33:42.831083+0000","last_clean":"2024-09-11T05:33:42.831083+0000","last_became_active":"2024-09-11T05:32:55.611273+0000","last_became_peered":"2024-09-11T05:32:55.611273+0000","last_unstale":"2024-09-11T05:33:42.831083+0000","last_undegraded":"2024-09-11T05:33:42.831083+0000","last_fullsized":"2024-09-11T05:33:42.831083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:52.968434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055575600000000002,"stat_sum":{"num_bytes":20980330,"num_objects":45,"num_object_clones":16,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":13,"num_read":1445,"num_read_kb":8721,"num_write":144,"num_write_kb":3284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"51'182","reported_seq":1820,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.837940+0000","last_change":"2024-09-11T05:33:42.837940+0000","last_active":"2024-09-11T05:33:42.837940+0000","last_peered":"2024-09-11T05:33:42.837940+0000","last_clean":"2024-09-11T05:33:42.837940+0000","last_became_active":"2024-09-11T05:33:42.837189+0000","last_became_peered":"2024-09-11T05:33:42.837189+0000","last_unstale":"2024-09-11T05:33:42.837940+0000","last_undegraded":"2024-09-11T05:33:42.837940+0000","last_fullsized":"2024-09-11T05:33:42.837940+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:29:18.577504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000425738,"stat_sum":{"num_bytes":41390113,"num_objects":36,"num_object_clones":12,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":6,"num_read":1491,"num_read_kb":10329,"num_write":187,"num_write_kb":9198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":4673109,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"56'194","reported_seq":1954,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.827147+0000","last_change":"2024-09-11T05:32:57.891358+0000","last_active":"2024-09-11T05:33:42.827147+0000","last_peered":"2024-09-11T05:33:42.827147+0000","last_clean":"2024-09-11T05:33:42.827147+0000","last_became_active":"2024-09-11T05:32:55.610903+0000","last_became_peered":"2024-09-11T05:32:55.610903+0000","last_unstale":"2024-09-11T05:33:42.827147+0000","last_undegraded":"2024-09-11T05:33:42.827147+0000","last_fullsized":"2024-09-11T05:33:42.827147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:55.304075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060018099999999998,"stat_sum":{"num_bytes":17245905,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":12,"num_read":1730,"num_read_kb":9188,"num_write":191,"num_write_kb":3112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"56'385","reported_seq":3587,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.831985+0000","last_change":"2024-09-11T05:32:57.607163+0000","last_active":"2024-09-11T05:33:42.831985+0000","last_peered":"2024-09-11T05:33:42.831985+0000","last_clean":"2024-09-11T05:33:42.831985+0000","last_became_active":"2024-09-11T05:32:55.614915+0000","last_became_peered":"2024-09-11T05:32:55.614915+0000","last_unstale":"2024-09-11T05:33:42.831985+0000","last_undegraded":"2024-09-11T05:33:42.831985+0000","last_fullsized":"2024-09-11T05:33:42.831985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:58.925014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050988100000000001,"stat_sum":{"num_bytes":28987246,"num_objects":39,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":5179,"num_read_kb":9439,"num_write":406,"num_write_kb":4768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"53'188","reported_seq":2088,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.828888+0000","last_change":"2024-09-11T05:32:57.610399+0000","last_active":"2024-09-11T05:33:42.828888+0000","last_peered":"2024-09-11T05:33:42.828888+0000","last_clean":"2024-09-11T05:33:42.828888+0000","last_became_active":"2024-09-11T05:32:55.614295+0000","last_became_peered":"2024-09-11T05:32:55.614295+0000","last_unstale":"2024-09-11T05:33:42.828888+0000","last_undegraded":"2024-09-11T05:33:42.828888+0000","last_fullsized":"2024-09-11T05:33:42.828888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:20.324697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054624999999999997,"stat_sum":{"num_bytes":53408089,"num_objects":45,"num_object_clones":16,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":17,"num_read":1859,"num_read_kb":10881,"num_write":170,"num_write_kb":2594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"54'441","reported_seq":1470,"reported_epoch":60,"state":"peering","last_fresh":"2024-09-11T05:33:41.940988+0000","last_change":"2024-09-11T05:33:42.826983+0000","last_active":"2024-09-11T05:33:42.826983+0000","last_peered":"2024-09-11T05:33:41.940988+0000","last_clean":"2024-09-11T05:33:36.798948+0000","last_became_active":"2024-09-11T05:33:40.847308+0000","last_became_peered":"2024-09-11T05:33:40.847308+0000","last_unstale":"2024-09-11T05:33:41.940988+0000","last_undegraded":"2024-09-11T05:33:41.940988+0000","last_fullsized":"2024-09-11T05:33:40.825521+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065996499999999999,"stat_sum":{"num_bytes":15841752,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":15,"num_read":2509,"num_read_kb":4745,"num_write":657,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":2534664,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"55'190","reported_seq":9682,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.829711+0000","last_change":"2024-09-11T05:33:42.829711+0000","last_active":"2024-09-11T05:33:42.829711+0000","last_peered":"2024-09-11T05:33:42.829711+0000","last_clean":"2024-09-11T05:33:42.829711+0000","last_became_active":"2024-09-11T05:33:42.828916+0000","last_became_peered":"2024-09-11T05:33:42.828916+0000","last_unstale":"2024-09-11T05:33:42.829711+0000","last_undegraded":"2024-09-11T05:33:42.829711+0000","last_fullsized":"2024-09-11T05:33:42.829711+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:31.866967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046356899999999999,"stat_sum":{"num_bytes":23560631,"num_objects":31,"num_object_clones":10,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":12,"num_read":1714,"num_read_kb":4390,"num_write":193,"num_write_kb":4962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":69,"num_bytes_recovered":2357224,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"54'274","reported_seq":5003,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-11T05:33:42.834972+0000","last_change":"2024-09-11T05:33:42.834972+0000","last_active":"2024-09-11T05:33:42.834972+0000","last_peered":"2024-09-11T05:33:42.834972+0000","last_clean":"2024-09-11T05:33:42.834972+0000","last_became_active":"2024-09-11T05:33:42.833619+0000","last_became_peered":"2024-09-11T05:33:42.833619+0000","last_unstale":"2024-09-11T05:33:42.834972+0000","last_undegraded":"2024-09-11T05:33:42.834972+0000","last_fullsized":"2024-09-11T05:33:42.834972+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:13.908958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049377000000000004,"stat_sum":{"num_bytes":48031836,"num_objects":41,"num_object_clones":15,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":13,"num_read":5248,"num_read_kb":29123,"num_write":381,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":2904839,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":869077244,"num_objects":1295,"num_object_clones":406,"num_object_copies":2590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1295,"num_whiteouts":395,"num_read":136557,"num_read_kb":362965,"num_write":12325,"num_write_kb":187442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":732,"num_bytes_recovered":45615186,"num_keys_recovered":42,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":267755520,"data_stored":367085385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9677,"ondisk_log_size":9677,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62976,"kb_used_data":27624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94308864,"statfs":{"total":96636764160,"available":96572276736,"internally_reserved":0,"allocated":28286976,"data_stored":40333732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69836,"kb_used_data":34480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94302004,"statfs":{"total":96636764160,"available":96565252096,"internally_reserved":0,"allocated":35307520,"data_stored":51039238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79712,"kb_used_data":40204,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94292128,"statfs":{"total":96636764160,"available":96555139072,"internally_reserved":0,"allocated":41168896,"data_stored":57694656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":0,"seq":60129542159,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":60129542160,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68012,"kb_used_data":40980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94303828,"statfs":{"total":96636764160,"available":96567119872,"internally_reserved":0,"allocated":41963520,"data_stored":49996959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,200,56],"upper_bound":4096},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104072,"kb_used_data":58996,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94267768,"statfs":{"total":96636764160,"available":96530194432,"internally_reserved":0,"allocated":60411904,"data_stored":87765307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[16,17],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82484,"kb_used_data":55452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94289356,"statfs":{"total":96636764160,"available":96552300544,"internally_reserved":0,"allocated":56782848,"data_stored":73360872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,256],"upper_bound":2048},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":56090624,"data_stored":73050805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":59121664,"data_stored":86864853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41271296,"data_stored":49686892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9183232,"data_stored":9935797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39882752,"data_stored":56794221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":34611200,"data_stored":50729152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":27594752,"data_stored":40023665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:33:45.043 INFO:tasks.thrashosds.thrasher:Setting 3.6 to [1, 2, 5, 4] 2024-09-11T05:33:45.043 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.6', '1', '2', '5', '4'] 2024-09-11T05:33:45.043 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.6 1 2 5 4 2024-09-11T05:33:45.060 INFO:teuthology.orchestra.run.smithi070.stdout:3780 read 0xace9b8 thru 0xad7fd4 (0x961d bytes) 2024-09-11T05:33:45.060 INFO:teuthology.orchestra.run.smithi070.stdout:3783 punch from 0x136e621 to 0x1372a5a, (0x4439 bytes) 2024-09-11T05:33:45.068 INFO:teuthology.orchestra.run.smithi070.stdout:3785 writesame 0x3408577 thru 0x3417763 data_size 0x1(0xf1ed bytes) 2024-09-11T05:33:45.079 INFO:teuthology.orchestra.run.smithi070.stdout:3786 writesame 0x709d9cb thru 0x70a6b4a data_size 0x18(0x9180 bytes) 2024-09-11T05:33:45.079 INFO:teuthology.orchestra.run.smithi070.stdout:3788 read 0x6a6c84c thru 0x6a707ce (0x3f83 bytes) 2024-09-11T05:33:45.079 INFO:teuthology.orchestra.run.smithi070.stdout:3789 read 0x6204cb0 thru 0x6212ee0 (0xe231 bytes) 2024-09-11T05:33:45.079 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:45.079 INFO:teuthology.orchestra.run.smithi070.stdout:3792 read 0x706fe8d thru 0x7072e44 (0x2fb8 bytes) 2024-09-11T05:33:45.079 INFO:teuthology.orchestra.run.smithi070.stdout:3794 read 0x5ea4893 thru 0x5ea8e7d (0x45eb bytes) 2024-09-11T05:33:45.079 INFO:teuthology.orchestra.run.smithi070.stdout:3796 read 0x2fb806f thru 0x2fc0610 (0x85a2 bytes) 2024-09-11T05:33:45.079 INFO:teuthology.orchestra.run.smithi070.stdout:3797 read 0x681bd65 thru 0x681caef (0xd8b bytes) 2024-09-11T05:33:45.080 INFO:teuthology.orchestra.run.smithi070.stdout:3798 trunc from 0x70a6b4b to 0x78faa56 2024-09-11T05:33:45.088 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:45.087+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:45.089 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:45.089 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:45.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:45.089 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:45.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.090 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116623 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13477888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.090 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:33:45.090 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1973554240000004, 2024-09-11T05:33:45.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9661491070000001, 2024-09-11T05:33:45.090 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.090 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.090 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.090 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116623 2024-09-11T05:33:45.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.091 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:33:45.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:33:45.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889573+0000", 2024-09-11T05:33:45.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:33:45.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889574+0000", 2024-09-11T05:33:45.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4810000000000001e-06 2024-09-11T05:33:45.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889578+0000", 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889581+0000", 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2380000000000002e-06 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890367+0000", 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078646599999999999 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890377+0000", 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5789999999999993e-06 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829092+0000", 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871527899999996 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829101+0000", 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:33:45.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854695+0000", 2024-09-11T05:33:45.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0255937369999999 2024-09-11T05:33:45.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854786+0000", 2024-09-11T05:33:45.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1831999999999998e-05 2024-09-11T05:33:45.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855721+0000", 2024-09-11T05:33:45.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093499800000000004 2024-09-11T05:33:45.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.096 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116624 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13502464~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.096 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:33:45.096 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1973415769999995, 2024-09-11T05:33:45.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9664307189999999, 2024-09-11T05:33:45.097 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116624 2024-09-11T05:33:45.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.097 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:33:45.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:33:45.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889587+0000", 2024-09-11T05:33:45.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:33:45.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889588+0000", 2024-09-11T05:33:45.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T05:33:45.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889592+0000", 2024-09-11T05:33:45.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.472e-06 2024-09-11T05:33:45.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889594+0000", 2024-09-11T05:33:45.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T05:33:45.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890405+0000", 2024-09-11T05:33:45.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00081088199999999997 2024-09-11T05:33:45.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890410+0000", 2024-09-11T05:33:45.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999996e-06 2024-09-11T05:33:45.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829131+0000", 2024-09-11T05:33:45.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93872118999999998 2024-09-11T05:33:45.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829138+0000", 2024-09-11T05:33:45.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1760000000000004e-06 2024-09-11T05:33:45.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855755+0000", 2024-09-11T05:33:45.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026616722 2024-09-11T05:33:45.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855872+0000", 2024-09-11T05:33:45.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116927 2024-09-11T05:33:45.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856017+0000", 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145313 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116625 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13527040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1973303580000003, 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9666986180000001, 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116625 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:33:45.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889598+0000", 2024-09-11T05:33:45.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:33:45.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889599+0000", 2024-09-11T05:33:45.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.144e-06 2024-09-11T05:33:45.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889602+0000", 2024-09-11T05:33:45.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:33:45.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889604+0000", 2024-09-11T05:33:45.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7640000000000001e-06 2024-09-11T05:33:45.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890442+0000", 2024-09-11T05:33:45.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083777099999999996 2024-09-11T05:33:45.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890452+0000", 2024-09-11T05:33:45.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5559999999999996e-06 2024-09-11T05:33:45.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829170+0000", 2024-09-11T05:33:45.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871818900000004 2024-09-11T05:33:45.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829177+0000", 2024-09-11T05:33:45.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7220000000000002e-06 2024-09-11T05:33:45.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856046+0000", 2024-09-11T05:33:45.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026868943 2024-09-11T05:33:45.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856144+0000", 2024-09-11T05:33:45.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8684999999999995e-05 2024-09-11T05:33:45.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856296+0000", 2024-09-11T05:33:45.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151667 2024-09-11T05:33:45.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.109 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.110 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116626 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13551616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.110 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:33:45.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.197319588, 2024-09-11T05:33:45.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.96707056, 2024-09-11T05:33:45.110 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.110 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116626 2024-09-11T05:33:45.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.111 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:33:45.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:33:45.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:33:45.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:33:45.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889610+0000", 2024-09-11T05:33:45.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.186e-06 2024-09-11T05:33:45.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889613+0000", 2024-09-11T05:33:45.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T05:33:45.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889615+0000", 2024-09-11T05:33:45.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:33:45.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890487+0000", 2024-09-11T05:33:45.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087202600000000003 2024-09-11T05:33:45.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890492+0000", 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829202+0000", 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871036299999999 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829209+0000", 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7669999999999998e-06 2024-09-11T05:33:45.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856327+0000", 2024-09-11T05:33:45.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027118465 2024-09-11T05:33:45.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856525+0000", 2024-09-11T05:33:45.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019825499999999999 2024-09-11T05:33:45.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856679+0000", 2024-09-11T05:33:45.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015328 2024-09-11T05:33:45.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.116 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.116 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116627 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13576192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.116 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:33:45.116 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1973097030000002, 2024-09-11T05:33:45.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9673406419999999, 2024-09-11T05:33:45.116 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116627 2024-09-11T05:33:45.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.117 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:33:45.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:33:45.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889619+0000", 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.093e-06 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889622+0000", 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889625+0000", 2024-09-11T05:33:45.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:33:45.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890528+0000", 2024-09-11T05:33:45.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000902804 2024-09-11T05:33:45.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890537+0000", 2024-09-11T05:33:45.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2029999999999998e-06 2024-09-11T05:33:45.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829232+0000", 2024-09-11T05:33:45.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93869459799999999 2024-09-11T05:33:45.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829238+0000", 2024-09-11T05:33:45.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6699999999999997e-06 2024-09-11T05:33:45.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856709+0000", 2024-09-11T05:33:45.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027470925 2024-09-11T05:33:45.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856815+0000", 2024-09-11T05:33:45.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010566899999999999 2024-09-11T05:33:45.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856959+0000", 2024-09-11T05:33:45.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000143752 2024-09-11T05:33:45.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.123 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.123 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116628 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13600768~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.123 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:33:45.123 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1972857079999999, 2024-09-11T05:33:45.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9676105420000001, 2024-09-11T05:33:45.123 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116628 2024-09-11T05:33:45.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.124 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:33:45.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:33:45.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:33:45.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:33:45.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889644+0000", 2024-09-11T05:33:45.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:33:45.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889647+0000", 2024-09-11T05:33:45.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3950000000000001e-06 2024-09-11T05:33:45.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889650+0000", 2024-09-11T05:33:45.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:33:45.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890570+0000", 2024-09-11T05:33:45.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092007999999999999 2024-09-11T05:33:45.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890577+0000", 2024-09-11T05:33:45.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.764e-06 2024-09-11T05:33:45.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829261+0000", 2024-09-11T05:33:45.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93868468500000002 2024-09-11T05:33:45.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829268+0000", 2024-09-11T05:33:45.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T05:33:45.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857004+0000", 2024-09-11T05:33:45.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027736043 2024-09-11T05:33:45.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857102+0000", 2024-09-11T05:33:45.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8066999999999995e-05 2024-09-11T05:33:45.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857253+0000", 2024-09-11T05:33:45.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015050400000000001 2024-09-11T05:33:45.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.129 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.130 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116629 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13625344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.130 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:33:45.130 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1972691969999998, 2024-09-11T05:33:45.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967906154, 2024-09-11T05:33:45.130 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116629 2024-09-11T05:33:45.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.130 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:33:45.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:33:45.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:33:45.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-07 2024-09-11T05:33:45.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889660+0000", 2024-09-11T05:33:45.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5650000000000001e-06 2024-09-11T05:33:45.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889664+0000", 2024-09-11T05:33:45.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4000000000000001e-06 2024-09-11T05:33:45.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889666+0000", 2024-09-11T05:33:45.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:33:45.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890614+0000", 2024-09-11T05:33:45.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00094762999999999998 2024-09-11T05:33:45.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890621+0000", 2024-09-11T05:33:45.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.379e-06 2024-09-11T05:33:45.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829291+0000", 2024-09-11T05:33:45.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866938499999997 2024-09-11T05:33:45.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829298+0000", 2024-09-11T05:33:45.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6610000000000003e-06 2024-09-11T05:33:45.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857284+0000", 2024-09-11T05:33:45.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027986522 2024-09-11T05:33:45.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857393+0000", 2024-09-11T05:33:45.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109054 2024-09-11T05:33:45.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857565+0000", 2024-09-11T05:33:45.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017160999999999999 2024-09-11T05:33:45.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.138 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.139 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116843 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12595200~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.139 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:33:45.139 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1972579750000003, 2024-09-11T05:33:45.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9682605290000001, 2024-09-11T05:33:45.140 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.140 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116843 2024-09-11T05:33:45.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.140 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:33:45.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:33:45.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:33:45.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:33:45.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889671+0000", 2024-09-11T05:33:45.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-11T05:33:45.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889674+0000", 2024-09-11T05:33:45.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.005e-06 2024-09-11T05:33:45.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889677+0000", 2024-09-11T05:33:45.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T05:33:45.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890648+0000", 2024-09-11T05:33:45.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097103399999999996 2024-09-11T05:33:45.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890652+0000", 2024-09-11T05:33:45.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0790000000000002e-06 2024-09-11T05:33:45.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829320+0000", 2024-09-11T05:33:45.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866793199999998 2024-09-11T05:33:45.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829327+0000", 2024-09-11T05:33:45.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5529999999999998e-06 2024-09-11T05:33:45.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857596+0000", 2024-09-11T05:33:45.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028269125 2024-09-11T05:33:45.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857834+0000", 2024-09-11T05:33:45.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023784300000000001 2024-09-11T05:33:45.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857930+0000", 2024-09-11T05:33:45.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6704000000000001e-05 2024-09-11T05:33:45.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.146 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.146 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116844 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12619776~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.146 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:33:45.146 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.197247784, 2024-09-11T05:33:45.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9685250679999999, 2024-09-11T05:33:45.146 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.146 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.146 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116844 2024-09-11T05:33:45.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.147 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:33:45.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:33:45.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:33:45.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:33:45.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889681+0000", 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.229e-06 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889684+0000", 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0130000000000002e-06 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889687+0000", 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7259999999999998e-06 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890685+0000", 2024-09-11T05:33:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099783399999999996 2024-09-11T05:33:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890695+0000", 2024-09-11T05:33:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-09-11T05:33:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829349+0000", 2024-09-11T05:33:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865456300000005 2024-09-11T05:33:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829356+0000", 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5130000000000002e-06 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857959+0000", 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0286034959999999 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858057+0000", 2024-09-11T05:33:45.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8097999999999995e-05 2024-09-11T05:33:45.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858205+0000", 2024-09-11T05:33:45.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147732 2024-09-11T05:33:45.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.152 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.153 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116845 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12644352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.153 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:33:45.153 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1972375509999997, 2024-09-11T05:33:45.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968783033, 2024-09-11T05:33:45.154 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116845 2024-09-11T05:33:45.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.155 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:33:45.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:33:45.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:33:45.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:33:45.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889692+0000", 2024-09-11T05:33:45.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2330000000000001e-06 2024-09-11T05:33:45.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889695+0000", 2024-09-11T05:33:45.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9249999999999999e-06 2024-09-11T05:33:45.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889697+0000", 2024-09-11T05:33:45.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:33:45.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890719+0000", 2024-09-11T05:33:45.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010218429999999999 2024-09-11T05:33:45.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890723+0000", 2024-09-11T05:33:45.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:33:45.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829378+0000", 2024-09-11T05:33:45.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865562000000002 2024-09-11T05:33:45.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829385+0000", 2024-09-11T05:33:45.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4579999999999998e-06 2024-09-11T05:33:45.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858234+0000", 2024-09-11T05:33:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028849288 2024-09-11T05:33:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858337+0000", 2024-09-11T05:33:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102371 2024-09-11T05:33:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858473+0000", 2024-09-11T05:33:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013669299999999999 2024-09-11T05:33:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.167 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.167 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116846 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12668928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.167 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:33:45.168 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1972146260000001, 2024-09-11T05:33:45.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.969056522, 2024-09-11T05:33:45.168 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116846 2024-09-11T05:33:45.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.169 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:33:45.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:33:45.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:33:45.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-07 2024-09-11T05:33:45.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889715+0000", 2024-09-11T05:33:45.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.482e-06 2024-09-11T05:33:45.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889718+0000", 2024-09-11T05:33:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:33:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889721+0000", 2024-09-11T05:33:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-11T05:33:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890762+0000", 2024-09-11T05:33:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010413659999999999 2024-09-11T05:33:45.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890772+0000", 2024-09-11T05:33:45.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5750000000000007e-06 2024-09-11T05:33:45.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829407+0000", 2024-09-11T05:33:45.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93863550699999998 2024-09-11T05:33:45.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829414+0000", 2024-09-11T05:33:45.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5640000000000002e-06 2024-09-11T05:33:45.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858502+0000", 2024-09-11T05:33:45.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0290880099999999 2024-09-11T05:33:45.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858634+0000", 2024-09-11T05:33:45.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013173199999999999 2024-09-11T05:33:45.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858770+0000", 2024-09-11T05:33:45.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135943 2024-09-11T05:33:45.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.175 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.175 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116847 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12693504~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.175 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:33:45.175 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1971849380000004, 2024-09-11T05:33:45.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9692923329999998, 2024-09-11T05:33:45.176 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116847 2024-09-11T05:33:45.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.176 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:33:45.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:33:45.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:33:45.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T05:33:45.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889747+0000", 2024-09-11T05:33:45.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.501e-06 2024-09-11T05:33:45.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889753+0000", 2024-09-11T05:33:45.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1360000000000002e-06 2024-09-11T05:33:45.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889756+0000", 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3110000000000001e-06 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890808+0000", 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010523240000000001 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890813+0000", 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5650000000000003e-06 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829436+0000", 2024-09-11T05:33:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93862351799999999 2024-09-11T05:33:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829443+0000", 2024-09-11T05:33:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5220000000000004e-06 2024-09-11T05:33:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858798+0000", 2024-09-11T05:33:45.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029354903 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858899+0000", 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101414 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859035+0000", 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013589 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116848 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12718080~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1971682530000001, 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9695514759999999, 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116848 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:33:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:33:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889760+0000", 2024-09-11T05:33:45.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:33:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889761+0000", 2024-09-11T05:33:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.189e-06 2024-09-11T05:33:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889764+0000", 2024-09-11T05:33:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:33:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889766+0000", 2024-09-11T05:33:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:33:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890850+0000", 2024-09-11T05:33:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010835479999999999 2024-09-11T05:33:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890857+0000", 2024-09-11T05:33:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6299999999999998e-06 2024-09-11T05:33:45.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829465+0000", 2024-09-11T05:33:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860787000000001 2024-09-11T05:33:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829472+0000", 2024-09-11T05:33:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4420000000000003e-06 2024-09-11T05:33:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859062+0000", 2024-09-11T05:33:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0295903360000001 2024-09-11T05:33:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859169+0000", 2024-09-11T05:33:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010674400000000001 2024-09-11T05:33:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859311+0000", 2024-09-11T05:33:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014209499999999999 2024-09-11T05:33:45.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116849 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12742656~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:33:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1971584670000004, 2024-09-11T05:33:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9698160310000001, 2024-09-11T05:33:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116849 2024-09-11T05:33:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:33:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889771+0000", 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889774+0000", 2024-09-11T05:33:45.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889776+0000", 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.638e-06 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890886+0000", 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011102519999999999 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890891+0000", 2024-09-11T05:33:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2200000000000003e-06 2024-09-11T05:33:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829494+0000", 2024-09-11T05:33:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860342500000005 2024-09-11T05:33:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829501+0000", 2024-09-11T05:33:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4829999999999996e-06 2024-09-11T05:33:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859339+0000", 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0298381320000001 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859440+0000", 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010145 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859585+0000", 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014513300000000001 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.193 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116850 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12767232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:33:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1971374409999997, 2024-09-11T05:33:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970125645, 2024-09-11T05:33:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116850 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889791+0000", 2024-09-11T05:33:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:33:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889792+0000", 2024-09-11T05:33:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4899999999999999e-06 2024-09-11T05:33:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889795+0000", 2024-09-11T05:33:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:33:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889798+0000", 2024-09-11T05:33:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7089999999999998e-06 2024-09-11T05:33:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890924+0000", 2024-09-11T05:33:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001125685 2024-09-11T05:33:45.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890933+0000", 2024-09-11T05:33:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3340000000000008e-06 2024-09-11T05:33:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829523+0000", 2024-09-11T05:33:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858966099999996 2024-09-11T05:33:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829529+0000", 2024-09-11T05:33:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5740000000000001e-06 2024-09-11T05:33:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859614+0000", 2024-09-11T05:33:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0300843289999999 2024-09-11T05:33:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859743+0000", 2024-09-11T05:33:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129407 2024-09-11T05:33:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859916+0000", 2024-09-11T05:33:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017282500000000001 2024-09-11T05:33:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116851 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12791808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:33:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1970975709999996, 2024-09-11T05:33:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970347268, 2024-09-11T05:33:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.201 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116851 2024-09-11T05:33:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:33:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:33:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:33:45.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:33:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889832+0000", 2024-09-11T05:33:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6819999999999999e-06 2024-09-11T05:33:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889838+0000", 2024-09-11T05:33:45.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:33:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889841+0000", 2024-09-11T05:33:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:33:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890957+0000", 2024-09-11T05:33:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001115956 2024-09-11T05:33:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890961+0000", 2024-09-11T05:33:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7050000000000001e-06 2024-09-11T05:33:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829552+0000", 2024-09-11T05:33:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93859101499999997 2024-09-11T05:33:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829558+0000", 2024-09-11T05:33:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5429999999999999e-06 2024-09-11T05:33:45.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859947+0000", 2024-09-11T05:33:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030388248 2024-09-11T05:33:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860043+0000", 2024-09-11T05:33:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5847999999999994e-05 2024-09-11T05:33:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860177+0000", 2024-09-11T05:33:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013484400000000001 2024-09-11T05:33:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116852 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12816384~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:33:45.208 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1970829600000004, 2024-09-11T05:33:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970594859, 2024-09-11T05:33:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116852 2024-09-11T05:33:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889846+0000", 2024-09-11T05:33:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.204e-06 2024-09-11T05:33:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889849+0000", 2024-09-11T05:33:45.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.931e-06 2024-09-11T05:33:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889852+0000", 2024-09-11T05:33:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:33:45.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890993+0000", 2024-09-11T05:33:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001141176 2024-09-11T05:33:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891001+0000", 2024-09-11T05:33:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5259999999999996e-06 2024-09-11T05:33:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829582+0000", 2024-09-11T05:33:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858050800000004 2024-09-11T05:33:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829588+0000", 2024-09-11T05:33:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4980000000000003e-06 2024-09-11T05:33:45.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860207+0000", 2024-09-11T05:33:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030618713 2024-09-11T05:33:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860305+0000", 2024-09-11T05:33:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8209999999999997e-05 2024-09-11T05:33:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860440+0000", 2024-09-11T05:33:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134692 2024-09-11T05:33:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116853 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12840960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:33:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.197072242, 2024-09-11T05:33:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.97084075, 2024-09-11T05:33:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116853 2024-09-11T05:33:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:33:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:33:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889856+0000", 2024-09-11T05:33:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:33:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889857+0000", 2024-09-11T05:33:45.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.435e-06 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889860+0000", 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9620000000000002e-06 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889863+0000", 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891036+0000", 2024-09-11T05:33:45.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011734580000000001 2024-09-11T05:33:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891042+0000", 2024-09-11T05:33:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3290000000000001e-06 2024-09-11T05:33:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829611+0000", 2024-09-11T05:33:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856954299999995 2024-09-11T05:33:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829618+0000", 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860465+0000", 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0308472500000001 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860558+0000", 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3253999999999999e-05 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860696+0000", 2024-09-11T05:33:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138169 2024-09-11T05:33:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116854 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12865536~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:33:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1970620509999996, 2024-09-11T05:33:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9710979320000002, 2024-09-11T05:33:45.222 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116854 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889867+0000", 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.155e-06 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889871+0000", 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9260000000000002e-06 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889875+0000", 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.262e-06 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891070+0000", 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011945160000000001 2024-09-11T05:33:45.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891079+0000", 2024-09-11T05:33:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3759999999999997e-06 2024-09-11T05:33:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829642+0000", 2024-09-11T05:33:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856325900000004 2024-09-11T05:33:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829649+0000", 2024-09-11T05:33:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:33:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860726+0000", 2024-09-11T05:33:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.031076791 2024-09-11T05:33:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860831+0000", 2024-09-11T05:33:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105003 2024-09-11T05:33:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860964+0000", 2024-09-11T05:33:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013285700000000001 2024-09-11T05:33:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116855 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12890112~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:33:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1970472709999997, 2024-09-11T05:33:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.971277814, 2024-09-11T05:33:45.228 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116855 2024-09-11T05:33:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:33:45.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:33:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817809+0000", 2024-09-11T05:33:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.92792850999999998 2024-09-11T05:33:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817815+0000", 2024-09-11T05:33:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4110000000000001e-06 2024-09-11T05:33:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817827+0000", 2024-09-11T05:33:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2031000000000001e-05 2024-09-11T05:33:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817837+0000", 2024-09-11T05:33:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2159999999999995e-06 2024-09-11T05:33:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829673+0000", 2024-09-11T05:33:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011836197 2024-09-11T05:33:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829679+0000", 2024-09-11T05:33:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5390000000000004e-06 2024-09-11T05:33:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861000+0000", 2024-09-11T05:33:45.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0313209539999999 2024-09-11T05:33:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861080+0000", 2024-09-11T05:33:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9606999999999999e-05 2024-09-11T05:33:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861158+0000", 2024-09-11T05:33:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8349000000000005e-05 2024-09-11T05:33:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.236 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.236 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:45.237 INFO:teuthology.orchestra.run.smithi070.stdout:3799 trunc from 0x78faa56 to 0x3590d5c 2024-09-11T05:33:45.237 INFO:teuthology.orchestra.run.smithi070.stdout:3800 read 0x34f662e thru 0x34ff57f (0x8f52 bytes) 2024-09-11T05:33:45.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:45.240 INFO:teuthology.orchestra.run.smithi070.stdout:3801 write 0x79211d9 thru 0x79257ff (0x4627 bytes) 2024-09-11T05:33:45.240 INFO:teuthology.orchestra.run.smithi070.stdout:3802 read 0x34adefe thru 0x34b4fe4 (0x70e7 bytes) 2024-09-11T05:33:45.240 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:45.240 INFO:teuthology.orchestra.run.smithi070.stdout:3804 writesame 0x2d81da4 thru 0x2d84710 data_size 0x7(0x296d bytes) 2024-09-11T05:33:45.240 INFO:teuthology.orchestra.run.smithi070.stdout:3805 write 0x9d84912 thru 0x9d8ca70 (0x815f bytes) 2024-09-11T05:33:45.241 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:45.241 INFO:teuthology.orchestra.run.smithi070.stdout:3807 write 0xa851b25 thru 0xa859ac7 (0x7fa3 bytes) 2024-09-11T05:33:45.241 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:45.241 INFO:teuthology.orchestra.run.smithi070.stdout:3809 punch from 0x6c408a9 to 0x6c475b6, (0x6d0d bytes) 2024-09-11T05:33:45.241 INFO:teuthology.orchestra.run.smithi070.stdout:3810 write 0x3169a01 thru 0x31735e7 (0x9be7 bytes) 2024-09-11T05:33:45.241 INFO:teuthology.orchestra.run.smithi070.stdout:3811 read 0x7bf6fbb thru 0x7bfceff (0x5f45 bytes) 2024-09-11T05:33:45.241 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:45.242 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:45.242 INFO:teuthology.orchestra.run.smithi070.stdout:3815 trunc from 0xa859ac8 to 0x3d23991 2024-09-11T05:33:45.242 INFO:teuthology.orchestra.run.smithi070.stdout:3816 write 0xb0c1bc9 thru 0xb0cc514 (0xa94c bytes) 2024-09-11T05:33:45.242 INFO:teuthology.orchestra.run.smithi070.stdout:3817 writesame 0x93e3b20 thru 0x93f309d data_size 0x43(0xf57e bytes) 2024-09-11T05:33:45.242 INFO:teuthology.orchestra.run.smithi070.stdout:3818 read 0x109ffb2 thru 0x10af88e (0xf8dd bytes) 2024-09-11T05:33:45.243 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:45.243 INFO:teuthology.orchestra.run.smithi070.stdout:3821 punch from 0x5344866 to 0x5350a18, (0xc1b2 bytes) 2024-09-11T05:33:45.243 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:45.243 INFO:teuthology.orchestra.run.smithi070.stdout:3824 punch from 0x1ea7fc8 to 0x1eb5605, (0xd63d bytes) 2024-09-11T05:33:45.243 INFO:teuthology.orchestra.run.smithi070.stdout:3825 read 0x958c8ac thru 0x958d727 (0xe7c bytes) 2024-09-11T05:33:45.243 INFO:teuthology.orchestra.run.smithi070.stdout:3826 trunc from 0xb0cc515 to 0xb229566 2024-09-11T05:33:45.243 INFO:teuthology.orchestra.run.smithi070.stdout:3827 punch from 0x99efa87 to 0x99f6ebc, (0x7435 bytes) 2024-09-11T05:33:45.244 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:45.244 INFO:teuthology.orchestra.run.smithi070.stdout:3831 trunc from 0xb229566 to 0xa4b2410 2024-09-11T05:33:45.244 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:45.236+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:45.256 INFO:teuthology.orchestra.run.smithi070.stdout:3832 trunc from 0xa4b2410 to 0x1cd879d 2024-09-11T05:33:45.269 INFO:teuthology.orchestra.run.smithi070.stdout:3835 read 0x100ef02 thru 0x1015c79 (0x6d78 bytes) 2024-09-11T05:33:45.277 INFO:teuthology.orchestra.run.smithi070.stdout:3836 writesame 0x3f89cc8 thru 0x3f93f06 data_size 0x75(0xa23f bytes) 2024-09-11T05:33:45.286 INFO:teuthology.orchestra.run.smithi070.stdout:3837 write 0x68f3ca3 thru 0x68f82fe (0x465c bytes) 2024-09-11T05:33:45.302 INFO:teuthology.orchestra.run.smithi070.stdout:3838 write 0x6da518a thru 0x6daf905 (0xa77c bytes) 2024-09-11T05:33:45.327 INFO:teuthology.orchestra.run.smithi070.stdout:3839 write 0xdffaed8 thru 0xe00a251 (0xf37a bytes) 2024-09-11T05:33:45.338 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:45.337+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:45.341 INFO:teuthology.orchestra.run.smithi070.stdout:3840 punch from 0x145ca6f to 0x1469b5d, (0xd0ee bytes) 2024-09-11T05:33:45.346 INFO:teuthology.orchestra.run.smithi070.stdout:3841 write 0xe166a22 thru 0xe16ef7f (0x855e bytes) 2024-09-11T05:33:45.355 INFO:teuthology.orchestra.run.smithi070.stdout:3842 write 0x22a208 thru 0x22ef1b (0x4d14 bytes) 2024-09-11T05:33:45.378 INFO:teuthology.orchestra.run.smithi070.stdout:3843 read 0xbfbb8d2 thru 0xbfbfe70 (0x459f bytes) 2024-09-11T05:33:45.378 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:45.378 INFO:teuthology.orchestra.run.smithi070.stdout:3846 read 0x82f3089 thru 0x8302981 (0xf8f9 bytes) 2024-09-11T05:33:45.380 INFO:teuthology.orchestra.run.smithi070.stdout:3847 trunc from 0xe16ef80 to 0xc88cdd4 2024-09-11T05:33:45.380 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:45.380 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:45.381 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:45.381 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:45.391 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:45.393 INFO:teuthology.orchestra.run.smithi070.stdout:3850 writesame 0x5474085 thru 0x547e41a data_size 0x1(0xa396 bytes) 2024-09-11T05:33:45.420 INFO:teuthology.orchestra.run.smithi070.stdout:3852 writesame 0x5cfdcce thru 0x5d01a98 data_size 0x1(0x3dcb bytes) 2024-09-11T05:33:45.431 INFO:teuthology.orchestra.run.smithi070.stdout:3853 read 0x6b701eb thru 0x6b746e4 (0x44fa bytes) 2024-09-11T05:33:45.431 INFO:teuthology.orchestra.run.smithi070.stdout:3854 read 0x75bb69d thru 0x75bbee6 (0x84a bytes) 2024-09-11T05:33:45.431 INFO:teuthology.orchestra.run.smithi070.stdout:3856 writesame 0x13c4470 thru 0x13d3ef1 data_size 0x6e(0xfa82 bytes) 2024-09-11T05:33:45.438 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:45.437+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:45.449 INFO:teuthology.orchestra.run.smithi070.stdout:3857 trunc from 0xc88cdd4 to 0x17c1f2 2024-09-11T05:33:45.520 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:45.520 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:45.520 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:45.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:45.532 INFO:teuthology.orchestra.run.smithi070.stdout:3858 write 0x99786c0 thru 0x9982a33 (0xa374 bytes) 2024-09-11T05:33:45.547 INFO:teuthology.orchestra.run.smithi070.stdout:3860 trunc from 0x9982a34 to 0xda650ea 2024-09-11T05:33:45.548 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:45.547+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:45.554 INFO:teuthology.orchestra.run.smithi070.stdout:3861 trunc from 0xda650ea to 0xc6425bc 2024-09-11T05:33:45.567 INFO:teuthology.orchestra.run.smithi070.stdout:3862 write 0xd40e39f thru 0xd41bedc (0xdb3e bytes) 2024-09-11T05:33:45.580 INFO:teuthology.orchestra.run.smithi070.stdout:3863 writesame 0xc3a0c06 thru 0xc3a51ea data_size 0x1(0x45e5 bytes) 2024-09-11T05:33:45.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:33:45.596 INFO:teuthology.orchestra.run.smithi070.stdout:3864 trunc from 0xd41bedd to 0x9ecd9bb 2024-09-11T05:33:45.610 INFO:teuthology.orchestra.run.smithi070.stdout:3865 writesame 0x744ab54 thru 0x745810a data_size 0x3(0xd5b7 bytes) 2024-09-11T05:33:45.634 INFO:teuthology.orchestra.run.smithi070.stdout:3866 trunc from 0x9ecd9bb to 0x270abd1 2024-09-11T05:33:45.640 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:45.640+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:45.648 INFO:teuthology.orchestra.run.smithi070.stdout:3867 read 0xe08647 thru 0xe14228 (0xbbe2 bytes) 2024-09-11T05:33:45.648 INFO:teuthology.orchestra.run.smithi070.stdout:3868 read 0x1398e47 thru 0x13a13e9 (0x85a3 bytes) 2024-09-11T05:33:45.667 INFO:teuthology.orchestra.run.smithi070.stdout:3869 write 0xc0536b4 thru 0xc0590b3 (0x5a00 bytes) 2024-09-11T05:33:45.671 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:45.671 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:45.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:45.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:45.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.671 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:33:45.671 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:45.671 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.078536098000001, 2024-09-11T05:33:45.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:33:45.671 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:45.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:33:45.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:33:45.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:33:45.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.673 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:45.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:45.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:33:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:33:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:33:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:33:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:33:45.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:33:45.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:33:45.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:33:45.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:33:45.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:33:45.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.676 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.677 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.677 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.677 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:33:45.677 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.501600838000002, 2024-09-11T05:33:45.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:33:45.677 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:33:45.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:33:45.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:33:45.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:33:45.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:33:45.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:33:45.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:33:45.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:33:45.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.681 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.681 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.681 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:45.682 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.501582038999999, 2024-09-11T05:33:45.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:33:45.682 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:33:45.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.682 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:33:45.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:33:45.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.501558008, 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:45.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:33:45.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:33:45.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:33:45.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:33:45.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:45.690 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.501481219999999, 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:45.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:45.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:45.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:33:45.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:33:45.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:33:45.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:33:45.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:33:45.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:33:45.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:33:45.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:33:45.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:33:45.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:33:45.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:33:45.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:33:45.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:33:45.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.695 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.695 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.695 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:45.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.501453897000001, 2024-09-11T05:33:45.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:33:45.696 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:33:45.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.696 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:33:45.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:33:45.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:33:45.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:33:45.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:33:45.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:33:45.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:33:45.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:33:45.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:33:45.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:33:45.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:33:45.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:33:45.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.700 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.700 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.700 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:45.701 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.501435349000001, 2024-09-11T05:33:45.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:33:45.701 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:33:45.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.701 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:45.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:45.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:45.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:33:45.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:33:45.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:33:45.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:33:45.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:33:45.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:33:45.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:33:45.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:33:45.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:33:45.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:33:45.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:33:45.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:33:45.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:33:45.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.705 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.705 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.705 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:33:45.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.501417278000002, 2024-09-11T05:33:45.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:33:45.706 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.706 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:33:45.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.706 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:33:45.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:33:45.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:33:45.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:33:45.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:33:45.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:33:45.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:33:45.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:33:45.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:33:45.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:33:45.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.499819635000001, 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:33:45.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.711 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:33:45.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:33:45.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:33:45.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:33:45.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:33:45.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:33:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:33:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:33:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:33:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:33:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.714 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.715 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.715 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:45.715 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.499799309, 2024-09-11T05:33:45.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:33:45.715 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.715 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.715 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:33:45.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.716 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:45.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:45.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:33:45.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:33:45.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:33:45.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:33:45.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:33:45.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.719 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.719 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.719 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:45.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.499760310999999, 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:45.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:45.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:45.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:33:45.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:33:45.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:33:45.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:33:45.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:33:45.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:33:45.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:33:45.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:33:45.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:33:45.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:33:45.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:33:45.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:33:45.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:33:45.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.724 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.724 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.724 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:33:45.724 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.499739669, 2024-09-11T05:33:45.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:33:45.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:33:45.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:33:45.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:33:45.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:33:45.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:33:45.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:33:45.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:33:45.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:33:45.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:33:45.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:33:45.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.729 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.729 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.729 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:33:45.729 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.499616805999999, 2024-09-11T05:33:45.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:33:45.729 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.730 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:33:45.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.730 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:33:45.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:33:45.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:33:45.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:33:45.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:33:45.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:33:45.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:33:45.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:33:45.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:33:45.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:33:45.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:33:45.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:33:45.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:33:45.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:33:45.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:33:45.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:33:45.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.499457248999999, 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.734 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:33:45.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.735 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:33:45.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:33:45.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:33:45.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:33:45.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:33:45.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:33:45.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:33:45.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:33:45.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:33:45.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:33:45.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:33:45.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:33:45.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.739 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.739 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:33:45.739 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.497772582, 2024-09-11T05:33:45.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:33:45.739 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:33:45.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.739 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:33:45.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:33:45.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:33:45.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:33:45.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:33:45.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:33:45.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:33:45.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:33:45.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:33:45.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:33:45.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:33:45.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:33:45.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:33:45.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:33:45.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:33:45.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:33:45.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.743 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.743 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.744 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:33:45.744 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.497744576999999, 2024-09-11T05:33:45.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:33:45.744 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.744 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.744 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:33:45.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.744 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:33:45.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:33:45.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:33:45.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:33:45.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:33:45.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:33:45.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:33:45.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:33:45.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:33:45.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:33:45.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:33:45.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:33:45.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:33:45.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:33:45.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:33:45.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:33:45.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.748 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.748 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44388 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8118272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.748 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:33:45.748 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.496353244000002, 2024-09-11T05:33:45.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044546074999999997, 2024-09-11T05:33:45.749 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.749 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44388 2024-09-11T05:33:45.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.749 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:33:45.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:33:45.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172487+0000", 2024-09-11T05:33:45.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-11T05:33:45.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172490+0000", 2024-09-11T05:33:45.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5090000000000002e-06 2024-09-11T05:33:45.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172497+0000", 2024-09-11T05:33:45.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:33:45.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172502+0000", 2024-09-11T05:33:45.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2000000000000002e-06 2024-09-11T05:33:45.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216878+0000", 2024-09-11T05:33:45.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044375900000000003 2024-09-11T05:33:45.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216925+0000", 2024-09-11T05:33:45.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7058999999999998e-05 2024-09-11T05:33:45.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216982+0000", 2024-09-11T05:33:45.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6932000000000003e-05 2024-09-11T05:33:45.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.753 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.754 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:33:45.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.496278113999999, 2024-09-11T05:33:45.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:33:45.754 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:33:45.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:33:45.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:33:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:33:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:33:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:33:45.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:33:45.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:33:45.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:33:45.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:33:45.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:33:45.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:33:45.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:33:45.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:33:45.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:33:45.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:33:45.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:33:45.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.759 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.759 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.759 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:33:45.759 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.496092813000001, 2024-09-11T05:33:45.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:33:45.760 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.760 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:33:45.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.760 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:33:45.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:33:45.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:33:45.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:33:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:33:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:33:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:33:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:33:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:33:45.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:33:45.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:33:45.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:33:45.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:33:45.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:33:45.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:33:45.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:33:45.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.764 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.764 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:45.765 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:33:45.765 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.495921358, 2024-09-11T05:33:45.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:33:45.765 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:45.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:45.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:45.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:45.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:45.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:45.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:33:45.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.765 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:45.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:45.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:33:45.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:45.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:33:45.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:45.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:45.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:33:45.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:33:45.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:45.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:33:45.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:33:45.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:45.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:33:45.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:33:45.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:45.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:33:45.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:33:45.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:45.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:33:45.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:33:45.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:45.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:33:45.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:33:45.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:45.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:45.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:45.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:33:45.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:33:45.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.769 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:45.769 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:45.769 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:45.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:45.773 INFO:teuthology.orchestra.run.smithi070.stdout:3870 write 0xc944d0d thru 0xc94d72a (0x8a1e bytes) 2024-09-11T05:33:45.773 INFO:teuthology.orchestra.run.smithi070.stdout:3872 write 0x175af00 thru 0x175bb20 (0xc21 bytes) 2024-09-11T05:33:45.773 INFO:teuthology.orchestra.run.smithi070.stdout:3873 read 0xeab083 thru 0xeb5c3e (0xabbc bytes) 2024-09-11T05:33:45.773 INFO:teuthology.orchestra.run.smithi070.stdout:3874 punch from 0x2286eb7 to 0x2292b97, (0xbce0 bytes) 2024-09-11T05:33:45.773 INFO:teuthology.orchestra.run.smithi070.stdout:3877 trunc from 0xc94d72b to 0x54f0267 2024-09-11T05:33:45.773 INFO:teuthology.orchestra.run.smithi070.stdout:3878 read 0x14efc9c thru 0x14fcd3e (0xd0a3 bytes) 2024-09-11T05:33:45.773 INFO:teuthology.orchestra.run.smithi070.stdout:3879 read 0x3ee1884 thru 0x3ee1ef0 (0x66d bytes) 2024-09-11T05:33:45.773 INFO:teuthology.orchestra.run.smithi070.stdout:3881 trunc from 0x54f0267 to 0x33f7765 2024-09-11T05:33:45.773 INFO:teuthology.orchestra.run.smithi070.stdout:3882 read 0x125808a thru 0x125837c (0x2f3 bytes) 2024-09-11T05:33:45.773 INFO:teuthology.orchestra.run.smithi070.stdout:3883 read 0xd48cf0 thru 0xd4ca35 (0x3d46 bytes) 2024-09-11T05:33:45.773 INFO:teuthology.orchestra.run.smithi070.stdout:3888 read 0x18b9cf5 thru 0x18be0f4 (0x4400 bytes) 2024-09-11T05:33:45.773 INFO:teuthology.orchestra.run.smithi070.stdout:3889 write 0x2ae98ba thru 0x2aec048 (0x278f bytes) 2024-09-11T05:33:45.774 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:45.774 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:45.774 INFO:teuthology.orchestra.run.smithi070.stdout:3890 trunc from 0x33f7765 to 0x6b248f7 2024-09-11T05:33:45.775 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:45.775 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:45.776 INFO:teuthology.orchestra.run.smithi070.stdout:3891 writesame 0xcec90d0 thru 0xced7071 data_size 0x7d(0xdfa2 bytes) 2024-09-11T05:33:45.776 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:45.776 INFO:teuthology.orchestra.run.smithi070.stdout:3893 punch from 0x5eca233 to 0x5ecc1df, (0x1fac bytes) 2024-09-11T05:33:45.776 INFO:teuthology.orchestra.run.smithi070.stdout:3894 read 0x956eee3 thru 0x957af51 (0xc06f bytes) 2024-09-11T05:33:45.776 INFO:teuthology.orchestra.run.smithi070.stdout:3895 writesame 0x50aca7 thru 0x519b94 data_size 0x77(0xeeee bytes) 2024-09-11T05:33:45.776 INFO:teuthology.orchestra.run.smithi070.stdout:3896 write 0x224c2f3 thru 0x224f19c (0x2eaa bytes) 2024-09-11T05:33:45.776 INFO:teuthology.orchestra.run.smithi070.stdout:3897 read 0x3ad6fa7 thru 0x3adeb01 (0x7b5b bytes) 2024-09-11T05:33:45.776 INFO:teuthology.orchestra.run.smithi070.stdout:3898 write 0x15ede1 thru 0x160a07 (0x1c27 bytes) 2024-09-11T05:33:45.777 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:45.777 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:45.777 INFO:teuthology.orchestra.run.smithi070.stdout:3899 writesame 0x1c74bcd thru 0x1c776fa data_size 0x1(0x2b2e bytes) 2024-09-11T05:33:45.777 INFO:teuthology.orchestra.run.smithi070.stdout:3900 write 0xccd3fcd thru 0xcce04a4 (0xc4d8 bytes) 2024-09-11T05:33:45.778 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:45.769+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:45.783 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:45.783 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:45.785 INFO:teuthology.orchestra.run.smithi070.stdout:3903 writesame 0xfbe7d3 thru 0xfc5df4 data_size 0x1(0x7622 bytes) 2024-09-11T05:33:45.808 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:45.808 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:45.809 INFO:teuthology.orchestra.run.smithi070.stdout:3904 writesame 0x2a245e2 thru 0x2a32e42 data_size 0x1f(0xe861 bytes) 2024-09-11T05:33:45.824 INFO:teuthology.orchestra.run.smithi070.stdout:3905 read 0x1b4fb8c thru 0x1b596c1 (0x9b36 bytes) 2024-09-11T05:33:45.826 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:45.826 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:45.832 INFO:teuthology.orchestra.run.smithi070.stdout:3907 trunc from 0xced7072 to 0x606ad19 2024-09-11T05:33:45.838 INFO:teuthology.orchestra.run.smithi070.stderr:set 3.6 pg_upmap_items mapping to [1->2,5->4] 2024-09-11T05:33:45.848 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:45.848 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:45.865 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:45.865 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:45.871 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:45.871+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:45.888 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:45.888 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:45.897 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:45.944 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:33:45.988 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:45.988+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:46.000 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:46.000 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:46.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:46.073 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:46.073+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:46.111 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:46.111 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:46.119 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:46.174 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:46.173+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:46.221 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:46.221 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:46.230 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:46.274 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:46.273+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:46.332 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:46.333 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:46.341 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:46.376 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:46.376+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:46.476 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:46.475+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:46.482 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:46.483 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:46.491 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:46.577 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:46.577+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:46.634 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:46.634 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:46.642 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:46.686 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:46.685+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:46.745 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:46.745 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:46.753 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:46.779 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:46.779+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:46.848 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T05:33:46.880 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:46.879+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:46.898 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:46.898 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:46.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:46.990 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:46.989+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:47.049 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:47.049 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:47.058 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:47.081 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:47.080+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:47.182 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:47.181+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:47.201 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:47.201 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:47.210 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:47.284 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:47.283+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:47.361 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:47.383 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:47.382+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:47.484 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:47.484 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:47.484 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:47.484+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:47.494 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:47.586 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:47.585+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:47.641 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:47.641 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:47.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:47.686 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:47.686+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:47.787 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:47.786+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:47.791 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:47.791 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:47.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:47.877 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:33:47.927 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:47.927+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:47.947 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:47.947 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:47.957 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:47.989 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:47.988+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:48.006 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:48.006 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:48.023 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:48.023 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:48.039 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:48.039 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:48.055 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:48.056 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:48.073 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:48.073 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:48.090 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:48.090 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:48.090 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:48.089+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:48.100 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:48.101 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:48.101 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:48.107 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:48.107 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:48.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:48.123 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:48.124 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:48.191 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:48.191+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:48.227 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:48.227 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:48.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:48.227 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:48.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.227 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36429 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8585216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.227 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:48.227 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144697697000002, 2024-09-11T05:33:48.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035281438999999998, 2024-09-11T05:33:48.228 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.228 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.228 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.228 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.228 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.228 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36429 2024-09-11T05:33:48.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.228 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:48.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:48.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081346+0000", 2024-09-11T05:33:48.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:33:48.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081348+0000", 2024-09-11T05:33:48.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:33:48.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081355+0000", 2024-09-11T05:33:48.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2230000000000001e-06 2024-09-11T05:33:48.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081360+0000", 2024-09-11T05:33:48.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0499999999999999e-06 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116334+0000", 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.034973889000000001 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116410+0000", 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6001000000000006e-05 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116627+0000", 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000216956 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36430 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9437184~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144589633999999, 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035492782, 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.232 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36430 2024-09-11T05:33:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081454+0000", 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.99e-07 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081458+0000", 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7160000000000001e-06 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081468+0000", 2024-09-11T05:33:48.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9629999999999993e-06 2024-09-11T05:33:48.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081474+0000", 2024-09-11T05:33:48.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2060000000000004e-06 2024-09-11T05:33:48.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116658+0000", 2024-09-11T05:33:48.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03518454 2024-09-11T05:33:48.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116734+0000", 2024-09-11T05:33:48.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5703000000000003e-05 2024-09-11T05:33:48.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116946+0000", 2024-09-11T05:33:48.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211955 2024-09-11T05:33:48.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.236 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36431 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9895936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144558508999999, 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035819799999999999, 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36431 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.237 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:48.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:48.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081485+0000", 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081493+0000", 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9629999999999998e-06 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081500+0000", 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7070000000000003e-06 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081504+0000", 2024-09-11T05:33:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:33:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116993+0000", 2024-09-11T05:33:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035489224 2024-09-11T05:33:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117083+0000", 2024-09-11T05:33:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9560000000000003e-05 2024-09-11T05:33:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117304+0000", 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221244 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36448 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 327680~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144531807, 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036143304000000001, 2024-09-11T05:33:48.241 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36448 2024-09-11T05:33:48.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.242 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:48.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081512+0000", 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081514+0000", 2024-09-11T05:33:48.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081520+0000", 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4269999999999996e-06 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081525+0000", 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6140000000000002e-06 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117333+0000", 2024-09-11T05:33:48.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035808385999999998 2024-09-11T05:33:48.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117446+0000", 2024-09-11T05:33:48.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113161 2024-09-11T05:33:48.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117654+0000", 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020835800000000001 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36449 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1638400~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144512579000001, 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036464895999999997, 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.246 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36449 2024-09-11T05:33:48.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.247 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:48.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081531+0000", 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081533+0000", 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8649999999999999e-06 2024-09-11T05:33:48.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081538+0000", 2024-09-11T05:33:48.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7769999999999999e-06 2024-09-11T05:33:48.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081543+0000", 2024-09-11T05:33:48.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4390000000000002e-06 2024-09-11T05:33:48.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117686+0000", 2024-09-11T05:33:48.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036142760000000003 2024-09-11T05:33:48.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117768+0000", 2024-09-11T05:33:48.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2521000000000005e-05 2024-09-11T05:33:48.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117995+0000", 2024-09-11T05:33:48.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022715699999999999 2024-09-11T05:33:48.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.250 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36450 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144494711, 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036798323000000001, 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36450 2024-09-11T05:33:48.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.252 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:48.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:48.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081549+0000", 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1699999999999999e-07 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081550+0000", 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081557+0000", 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:33:48.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081561+0000", 2024-09-11T05:33:48.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2880000000000003e-06 2024-09-11T05:33:48.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118042+0000", 2024-09-11T05:33:48.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036480984000000001 2024-09-11T05:33:48.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118142+0000", 2024-09-11T05:33:48.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100043 2024-09-11T05:33:48.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118347+0000", 2024-09-11T05:33:48.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020477399999999999 2024-09-11T05:33:48.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.255 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.255 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36451 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4259840~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.255 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:48.256 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144476880999999, 2024-09-11T05:33:48.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037058173, 2024-09-11T05:33:48.256 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.256 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36451 2024-09-11T05:33:48.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.256 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:48.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:48.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:48.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:33:48.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081568+0000", 2024-09-11T05:33:48.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:33:48.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081573+0000", 2024-09-11T05:33:48.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999998e-06 2024-09-11T05:33:48.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081575+0000", 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.605e-06 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118377+0000", 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036801831 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118459+0000", 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1983000000000004e-05 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118624+0000", 2024-09-11T05:33:48.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000165353 2024-09-11T05:33:48.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.260 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.260 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36452 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5570560~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.260 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:48.260 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144464500000002, 2024-09-11T05:33:48.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037358132000000002, 2024-09-11T05:33:48.260 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36452 2024-09-11T05:33:48.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.261 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:48.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081579+0000", 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4600000000000001e-07 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081580+0000", 2024-09-11T05:33:48.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081583+0000", 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9119999999999998e-06 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081586+0000", 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.371e-06 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118666+0000", 2024-09-11T05:33:48.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037079933000000002 2024-09-11T05:33:48.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118725+0000", 2024-09-11T05:33:48.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8600000000000001e-05 2024-09-11T05:33:48.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118937+0000", 2024-09-11T05:33:48.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211931 2024-09-11T05:33:48.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.264 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.265 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36453 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6881280~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.265 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:48.265 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144453850000001, 2024-09-11T05:33:48.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037649803000000003, 2024-09-11T05:33:48.265 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36453 2024-09-11T05:33:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081590+0000", 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-11T05:33:48.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081593+0000", 2024-09-11T05:33:48.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0110000000000001e-06 2024-09-11T05:33:48.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081596+0000", 2024-09-11T05:33:48.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7609999999999999e-06 2024-09-11T05:33:48.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118965+0000", 2024-09-11T05:33:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037368971000000001 2024-09-11T05:33:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119037+0000", 2024-09-11T05:33:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2300999999999998e-05 2024-09-11T05:33:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119239+0000", 2024-09-11T05:33:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020146000000000001 2024-09-11T05:33:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36454 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8192000~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144443794000001, 2024-09-11T05:33:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037930403000000001, 2024-09-11T05:33:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36454 2024-09-11T05:33:48.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.271 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:48.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:48.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081600+0000", 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081603+0000", 2024-09-11T05:33:48.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:33:48.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081606+0000", 2024-09-11T05:33:48.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4099999999999998e-06 2024-09-11T05:33:48.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119274+0000", 2024-09-11T05:33:48.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037668407000000001 2024-09-11T05:33:48.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119340+0000", 2024-09-11T05:33:48.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5685000000000006e-05 2024-09-11T05:33:48.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119530+0000", 2024-09-11T05:33:48.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000189688 2024-09-11T05:33:48.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.274 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.275 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36455 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9502720~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.275 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:48.275 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144433644999999, 2024-09-11T05:33:48.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038210565000000002, 2024-09-11T05:33:48.275 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36455 2024-09-11T05:33:48.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.275 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:48.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:48.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081610+0000", 2024-09-11T05:33:48.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:48.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081611+0000", 2024-09-11T05:33:48.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0279999999999999e-06 2024-09-11T05:33:48.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081613+0000", 2024-09-11T05:33:48.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8430000000000001e-06 2024-09-11T05:33:48.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081616+0000", 2024-09-11T05:33:48.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6350000000000002e-06 2024-09-11T05:33:48.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119555+0000", 2024-09-11T05:33:48.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037939252999999999 2024-09-11T05:33:48.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119629+0000", 2024-09-11T05:33:48.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3868999999999994e-05 2024-09-11T05:33:48.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119820+0000", 2024-09-11T05:33:48.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190724 2024-09-11T05:33:48.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.279 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36480 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 393216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.279 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:48.279 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.14442408, 2024-09-11T05:33:48.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039217429999999998, 2024-09-11T05:33:48.280 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36480 2024-09-11T05:33:48.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.280 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:48.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:48.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:48.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:48.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081620+0000", 2024-09-11T05:33:48.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4900000000000004e-07 2024-09-11T05:33:48.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081624+0000", 2024-09-11T05:33:48.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:33:48.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081627+0000", 2024-09-11T05:33:48.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6520000000000002e-06 2024-09-11T05:33:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119851+0000", 2024-09-11T05:33:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038224209000000002 2024-09-11T05:33:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120518+0000", 2024-09-11T05:33:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066708900000000005 2024-09-11T05:33:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120836+0000", 2024-09-11T05:33:48.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031833300000000002 2024-09-11T05:33:48.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.284 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.284 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36481 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1703936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.284 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:48.284 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144413192999998, 2024-09-11T05:33:48.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039545442, 2024-09-11T05:33:48.284 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36481 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:48.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:48.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:48.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081631+0000", 2024-09-11T05:33:48.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0839999999999999e-06 2024-09-11T05:33:48.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081635+0000", 2024-09-11T05:33:48.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.743e-06 2024-09-11T05:33:48.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081637+0000", 2024-09-11T05:33:48.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.661e-06 2024-09-11T05:33:48.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120887+0000", 2024-09-11T05:33:48.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039249876000000003 2024-09-11T05:33:48.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120968+0000", 2024-09-11T05:33:48.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0253999999999994e-05 2024-09-11T05:33:48.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121175+0000", 2024-09-11T05:33:48.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020761099999999999 2024-09-11T05:33:48.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.288 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.289 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36482 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 3014656~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.289 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:48.289 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144402631999998, 2024-09-11T05:33:48.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040344708999999999, 2024-09-11T05:33:48.289 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.290 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36482 2024-09-11T05:33:48.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.290 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:48.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:48.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081641+0000", 2024-09-11T05:33:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081647+0000", 2024-09-11T05:33:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:33:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081651+0000", 2024-09-11T05:33:48.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2080000000000002e-06 2024-09-11T05:33:48.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081654+0000", 2024-09-11T05:33:48.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:33:48.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121203+0000", 2024-09-11T05:33:48.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039549466999999998 2024-09-11T05:33:48.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121267+0000", 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3713999999999993e-05 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121985+0000", 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071827299999999996 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.293 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36483 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4325376~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144386073, 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040925571000000001, 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36483 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081661+0000", 2024-09-11T05:33:48.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.296e-06 2024-09-11T05:33:48.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081665+0000", 2024-09-11T05:33:48.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9269999999999998e-06 2024-09-11T05:33:48.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081668+0000", 2024-09-11T05:33:48.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.615e-06 2024-09-11T05:33:48.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122019+0000", 2024-09-11T05:33:48.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040350886000000002 2024-09-11T05:33:48.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122108+0000", 2024-09-11T05:33:48.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8671000000000005e-05 2024-09-11T05:33:48.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122582+0000", 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047494900000000001 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36484 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5636096~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144371645, 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041537567999999997, 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36484 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:48.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081672+0000", 2024-09-11T05:33:48.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-07 2024-09-11T05:33:48.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081673+0000", 2024-09-11T05:33:48.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.212e-06 2024-09-11T05:33:48.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081676+0000", 2024-09-11T05:33:48.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6940000000000001e-06 2024-09-11T05:33:48.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081679+0000", 2024-09-11T05:33:48.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8260000000000001e-06 2024-09-11T05:33:48.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122615+0000", 2024-09-11T05:33:48.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040935421999999999 2024-09-11T05:33:48.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122892+0000", 2024-09-11T05:33:48.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027731099999999997 2024-09-11T05:33:48.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123209+0000", 2024-09-11T05:33:48.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000316872 2024-09-11T05:33:48.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.302 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36485 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6946816~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144359434999998, 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041869008999999999, 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36485 2024-09-11T05:33:48.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:48.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:33:48.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081685+0000", 2024-09-11T05:33:48.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029e-06 2024-09-11T05:33:48.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081689+0000", 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0709999999999996e-06 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081692+0000", 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389999999999999e-06 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123245+0000", 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041553759000000003 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123331+0000", 2024-09-11T05:33:48.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5885999999999997e-05 2024-09-11T05:33:48.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123553+0000", 2024-09-11T05:33:48.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022129499999999999 2024-09-11T05:33:48.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.307 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.308 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36486 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8257536~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.308 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:48.308 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144348417, 2024-09-11T05:33:48.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042204617999999999, 2024-09-11T05:33:48.308 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36486 2024-09-11T05:33:48.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.309 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:48.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:48.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081698+0000", 2024-09-11T05:33:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6490000000000001e-06 2024-09-11T05:33:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081702+0000", 2024-09-11T05:33:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7249999999999999e-06 2024-09-11T05:33:48.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081705+0000", 2024-09-11T05:33:48.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7379999999999999e-06 2024-09-11T05:33:48.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123583+0000", 2024-09-11T05:33:48.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041878604999999999 2024-09-11T05:33:48.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123666+0000", 2024-09-11T05:33:48.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2027000000000006e-05 2024-09-11T05:33:48.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123899+0000", 2024-09-11T05:33:48.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000233663 2024-09-11T05:33:48.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.312 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.312 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36487 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9568256~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:48.313 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:48.313 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.144335243, 2024-09-11T05:33:48.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043010712999999999, 2024-09-11T05:33:48.313 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36487 2024-09-11T05:33:48.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.313 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:48.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:48.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:48.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.16e-07 2024-09-11T05:33:48.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081709+0000", 2024-09-11T05:33:48.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2100000000000001e-06 2024-09-11T05:33:48.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081713+0000", 2024-09-11T05:33:48.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.811e-06 2024-09-11T05:33:48.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081716+0000", 2024-09-11T05:33:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.112e-06 2024-09-11T05:33:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123961+0000", 2024-09-11T05:33:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042244482999999999 2024-09-11T05:33:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124043+0000", 2024-09-11T05:33:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2066999999999999e-05 2024-09-11T05:33:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124718+0000", 2024-09-11T05:33:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067581399999999995 2024-09-11T05:33:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:43696 3.10 3:0e50cb16:::rbd_data.112dcdbd4c7c.0000000000000007:14 [read 2088960~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.188115026999998, 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035281203999999997, 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 43696 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-07 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037930+0000", 2024-09-11T05:33:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5540000000000001e-06 2024-09-11T05:33:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037935+0000", 2024-09-11T05:33:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0610000000000003e-06 2024-09-11T05:33:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037939+0000", 2024-09-11T05:33:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1239999999999998e-06 2024-09-11T05:33:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073102+0000", 2024-09-11T05:33:48.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035163341000000001 2024-09-11T05:33:48.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073159+0000", 2024-09-11T05:33:48.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6316000000000001e-05 2024-09-11T05:33:48.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073209+0000", 2024-09-11T05:33:48.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0512e-05 2024-09-11T05:33:48.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.322 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.322 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.322 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:48.324 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:48.324 INFO:teuthology.orchestra.run.smithi070.stdout:3909 read 0x2ec8380 thru 0x2ec8463 (0xe4 bytes) 2024-09-11T05:33:48.324 INFO:teuthology.orchestra.run.smithi070.stdout:3910 read 0x49c20e1 thru 0x49cb3f3 (0x9313 bytes) 2024-09-11T05:33:48.325 INFO:teuthology.orchestra.run.smithi070.stdout:3911 writesame 0x3e4e1a3 thru 0x3e5d8de data_size 0x2(0xf73c bytes) 2024-09-11T05:33:48.325 INFO:teuthology.orchestra.run.smithi070.stdout:3913 write 0xb145678 thru 0xb147403 (0x1d8c bytes) 2024-09-11T05:33:48.325 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.325 INFO:teuthology.orchestra.run.smithi070.stdout:3916 read 0x3c5a31a thru 0x3c5ed15 (0x49fc bytes) 2024-09-11T05:33:48.325 INFO:teuthology.orchestra.run.smithi070.stdout:3917 trunc from 0xb147404 to 0x1393ca9 2024-09-11T05:33:48.325 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:48.323+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:48.332 INFO:teuthology.orchestra.run.smithi070.stdout:3918 trunc from 0x1393ca9 to 0xcb44cf 2024-09-11T05:33:48.344 INFO:teuthology.orchestra.run.smithi070.stdout:3923 read 0x16c3ff thru 0x175b25 (0x9727 bytes) 2024-09-11T05:33:48.360 INFO:teuthology.orchestra.run.smithi070.stdout:3924 writesame 0x90a7885 thru 0x90ac393 data_size 0x23(0x4b0f bytes) 2024-09-11T05:33:48.360 INFO:teuthology.orchestra.run.smithi070.stdout:3925 writesame 0x3386245 thru 0x338d477 data_size 0x5(0x7233 bytes) 2024-09-11T05:33:48.377 INFO:teuthology.orchestra.run.smithi070.stdout:3926 trunc from 0x90ac394 to 0xe703d45 2024-09-11T05:33:48.384 INFO:teuthology.orchestra.run.smithi070.stdout:3927 write 0xa29f58 thru 0xa2d692 (0x373b bytes) 2024-09-11T05:33:48.391 INFO:teuthology.orchestra.run.smithi070.stdout:3928 trunc from 0xe703d45 to 0xcbc61d6 2024-09-11T05:33:48.403 INFO:teuthology.orchestra.run.smithi070.stdout:3929 trunc from 0xcbc61d6 to 0x69e41c9 2024-09-11T05:33:48.409 INFO:teuthology.orchestra.run.smithi070.stdout:3930 punch from 0x52fbce4 to 0x5309085, (0xd3a1 bytes) 2024-09-11T05:33:48.423 INFO:teuthology.orchestra.run.smithi070.stdout:3932 write 0xdee97c4 thru 0xdeeec73 (0x54b0 bytes) 2024-09-11T05:33:48.424 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:48.423+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:48.432 INFO:teuthology.orchestra.run.smithi070.stdout:3933 punch from 0x1c8ac28 to 0x1c8eda0, (0x4178 bytes) 2024-09-11T05:33:48.432 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.432 INFO:teuthology.orchestra.run.smithi070.stdout:3936 trunc from 0xdeeec74 to 0xd21f149 2024-09-11T05:33:48.443 INFO:teuthology.orchestra.run.smithi070.stdout:3938 write 0x5620743 thru 0x562c9c5 (0xc283 bytes) 2024-09-11T05:33:48.450 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:48.450 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:48.450 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:48.450 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:48.456 INFO:teuthology.orchestra.run.smithi070.stdout:3941 punch from 0xd23a53 to 0xd2d4e1, (0x9a8e bytes) 2024-09-11T05:33:48.456 INFO:teuthology.orchestra.run.smithi070.stdout:3942 write 0x6bf4bde thru 0x6c02e62 (0xe285 bytes) 2024-09-11T05:33:48.460 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:48.470 INFO:teuthology.orchestra.run.smithi070.stdout:3943 write 0xbd770b1 thru 0xbd7c12e (0x507e bytes) 2024-09-11T05:33:48.476 INFO:teuthology.orchestra.run.smithi070.stdout:3949 writesame 0x2e1fdd8 thru 0x2e2adb1 data_size 0x7b(0xafda bytes) 2024-09-11T05:33:48.490 INFO:teuthology.orchestra.run.smithi070.stdout:3950 trunc from 0xd21f149 to 0xe5fec9e 2024-09-11T05:33:48.497 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.497 INFO:teuthology.orchestra.run.smithi070.stdout:3952 writesame 0x8bcaf20 thru 0x8bd6826 data_size 0x13(0xb907 bytes) 2024-09-11T05:33:48.508 INFO:teuthology.orchestra.run.smithi070.stdout:3953 read 0xcf06a22 thru 0xcf087fd (0x1ddc bytes) 2024-09-11T05:33:48.508 INFO:teuthology.orchestra.run.smithi070.stdout:3955 punch from 0x81ab01a to 0x81b85a1, (0xd587 bytes) 2024-09-11T05:33:48.508 INFO:teuthology.orchestra.run.smithi070.stdout:3957 writesame 0x731494c thru 0x731728b data_size 0x21(0x2940 bytes) 2024-09-11T05:33:48.512 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.512 INFO:teuthology.orchestra.run.smithi070.stdout:3959 write 0x5f65eee thru 0x5f69bbb (0x3cce bytes) 2024-09-11T05:33:48.522 INFO:teuthology.orchestra.run.smithi070.stdout:3961 write 0x6c889f1 thru 0x6c9836b (0xf97b bytes) 2024-09-11T05:33:48.524 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:48.523+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:48.528 INFO:teuthology.orchestra.run.smithi070.stdout:3962 read 0xa785073 thru 0xa78ad7c (0x5d0a bytes) 2024-09-11T05:33:48.528 INFO:teuthology.orchestra.run.smithi070.stdout:3965 write 0x6d486c5 thru 0x6d52a37 (0xa373 bytes) 2024-09-11T05:33:48.530 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.539 INFO:teuthology.orchestra.run.smithi070.stdout:3969 trunc from 0xe5fec9e to 0x7deb4ac 2024-09-11T05:33:48.553 INFO:teuthology.orchestra.run.smithi070.stdout:3970 trunc from 0x7deb4ac to 0x9f9dca3 2024-09-11T05:33:48.558 INFO:teuthology.orchestra.run.smithi070.stdout:3971 writesame 0x606c9ec thru 0x606faf9 data_size 0x45(0x310e bytes) 2024-09-11T05:33:48.562 INFO:teuthology.orchestra.run.smithi070.stdout:3972 write 0x4aa08bb thru 0x4aa7026 (0x676c bytes) 2024-09-11T05:33:48.577 INFO:teuthology.orchestra.run.smithi070.stdout:3973 trunc from 0x9f9dca3 to 0x3ad2a87 2024-09-11T05:33:48.592 INFO:teuthology.orchestra.run.smithi070.stdout:3974 read 0x9563b7 thru 0x95aeca (0x4b14 bytes) 2024-09-11T05:33:48.600 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:48.600 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:48.604 INFO:teuthology.orchestra.run.smithi070.stdout:3975 writesame 0x8b38fd8 thru 0x8b45948 data_size 0x35(0xc971 bytes) 2024-09-11T05:33:48.604 INFO:teuthology.orchestra.run.smithi070.stdout:3976 punch from 0x10ecc6f to 0x10f4ffd, (0x838e bytes) 2024-09-11T05:33:48.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:48.614 INFO:teuthology.orchestra.run.smithi070.stdout:3978 write 0xc63ba3b thru 0xc63e00f (0x25d5 bytes) 2024-09-11T05:33:48.620 INFO:teuthology.orchestra.run.smithi070.stdout:3980 punch from 0x2a698bd to 0x2a6d3ab, (0x3aee bytes) 2024-09-11T05:33:48.620 INFO:teuthology.orchestra.run.smithi070.stdout:3981 trunc from 0xc63e010 to 0xce9209d 2024-09-11T05:33:48.624 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:48.624+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:48.626 INFO:teuthology.orchestra.run.smithi070.stdout:3984 read 0xb2229 thru 0xb38c7 (0x169f bytes) 2024-09-11T05:33:48.627 INFO:teuthology.orchestra.run.smithi070.stdout:3985 read 0xce8e3ba thru 0xce8f3b9 (0x1000 bytes) 2024-09-11T05:33:48.627 INFO:teuthology.orchestra.run.smithi070.stdout:3986 writesame 0x414e7bf thru 0x4150dc7 data_size 0xd(0x2609 bytes) 2024-09-11T05:33:48.631 INFO:teuthology.orchestra.run.smithi070.stdout:3987 read 0x98f7373 thru 0x990181e (0xa4ac bytes) 2024-09-11T05:33:48.631 INFO:teuthology.orchestra.run.smithi070.stdout:3988 read 0x6687658 thru 0x669119c (0x9b45 bytes) 2024-09-11T05:33:48.631 INFO:teuthology.orchestra.run.smithi070.stdout:3989 write 0xcc0036f thru 0xcc05799 (0x542b bytes) 2024-09-11T05:33:48.637 INFO:teuthology.orchestra.run.smithi070.stdout:3990 read 0xc523e6d thru 0xc52b2b9 (0x744d bytes) 2024-09-11T05:33:48.637 INFO:teuthology.orchestra.run.smithi070.stdout:3991 write 0xac14279 thru 0xac21ac5 (0xd84d bytes) 2024-09-11T05:33:48.646 INFO:teuthology.orchestra.run.smithi070.stdout:3992 write 0x67f4ff3 thru 0x6800c36 (0xbc44 bytes) 2024-09-11T05:33:48.658 INFO:teuthology.orchestra.run.smithi070.stdout:3993 write 0x14a4dd4 thru 0x14ab835 (0x6a62 bytes) 2024-09-11T05:33:48.678 INFO:teuthology.orchestra.run.smithi070.stdout:3996 trunc from 0xce9209d to 0x6272995 2024-09-11T05:33:48.694 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.694 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.703 INFO:teuthology.orchestra.run.smithi070.stdout:3999 write 0x8b92f9a thru 0x8b9a5b8 (0x761f bytes) 2024-09-11T05:33:48.711 INFO:teuthology.orchestra.run.smithi070.stdout:4000 punch from 0x80571e3 to 0x8062ff0, (0xbe0d bytes) 2024-09-11T05:33:48.711 INFO:teuthology.orchestra.run.smithi070.stdout:4002 write 0x38628ac thru 0x3864f8f (0x26e4 bytes) 2024-09-11T05:33:48.716 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.716 INFO:teuthology.orchestra.run.smithi070.stdout:4004 read 0x4a583dc thru 0x4a63353 (0xaf78 bytes) 2024-09-11T05:33:48.716 INFO:teuthology.orchestra.run.smithi070.stdout:4005 write 0x1d25b08 thru 0x1d30563 (0xaa5c bytes) 2024-09-11T05:33:48.725 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:48.724+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:48.728 INFO:teuthology.orchestra.run.smithi070.stdout:4007 read 0x4bcaf64 thru 0x4bcedce (0x3e6b bytes) 2024-09-11T05:33:48.728 INFO:teuthology.orchestra.run.smithi070.stdout:4008 read 0x870c130 thru 0x870d359 (0x122a bytes) 2024-09-11T05:33:48.728 INFO:teuthology.orchestra.run.smithi070.stdout:4010 write 0x5897f49 thru 0x58a6056 (0xe10e bytes) 2024-09-11T05:33:48.732 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:48.732 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:48.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:48.732 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:48.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.733 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116623 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13477888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.733 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:33:48.733 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8412383249999991, 2024-09-11T05:33:48.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9661491070000001, 2024-09-11T05:33:48.733 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116623 2024-09-11T05:33:48.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.733 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:33:48.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:33:48.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889573+0000", 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889574+0000", 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4810000000000001e-06 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889578+0000", 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889581+0000", 2024-09-11T05:33:48.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2380000000000002e-06 2024-09-11T05:33:48.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890367+0000", 2024-09-11T05:33:48.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078646599999999999 2024-09-11T05:33:48.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890377+0000", 2024-09-11T05:33:48.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5789999999999993e-06 2024-09-11T05:33:48.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829092+0000", 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871527899999996 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829101+0000", 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854695+0000", 2024-09-11T05:33:48.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0255937369999999 2024-09-11T05:33:48.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854786+0000", 2024-09-11T05:33:48.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1831999999999998e-05 2024-09-11T05:33:48.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855721+0000", 2024-09-11T05:33:48.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093499800000000004 2024-09-11T05:33:48.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.738 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116624 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13502464~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8412244780000009, 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9664307189999999, 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116624 2024-09-11T05:33:48.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889587+0000", 2024-09-11T05:33:48.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:33:48.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889588+0000", 2024-09-11T05:33:48.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T05:33:48.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889592+0000", 2024-09-11T05:33:48.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.472e-06 2024-09-11T05:33:48.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889594+0000", 2024-09-11T05:33:48.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T05:33:48.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890405+0000", 2024-09-11T05:33:48.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00081088199999999997 2024-09-11T05:33:48.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890410+0000", 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999996e-06 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829131+0000", 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93872118999999998 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829138+0000", 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1760000000000004e-06 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855755+0000", 2024-09-11T05:33:48.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026616722 2024-09-11T05:33:48.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855872+0000", 2024-09-11T05:33:48.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116927 2024-09-11T05:33:48.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856017+0000", 2024-09-11T05:33:48.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145313 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116625 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13527040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8412132589999999, 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9666986180000001, 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116625 2024-09-11T05:33:48.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.746 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:33:48.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:33:48.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889598+0000", 2024-09-11T05:33:48.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:33:48.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889599+0000", 2024-09-11T05:33:48.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.144e-06 2024-09-11T05:33:48.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889602+0000", 2024-09-11T05:33:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:33:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889604+0000", 2024-09-11T05:33:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7640000000000001e-06 2024-09-11T05:33:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890442+0000", 2024-09-11T05:33:48.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083777099999999996 2024-09-11T05:33:48.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890452+0000", 2024-09-11T05:33:48.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5559999999999996e-06 2024-09-11T05:33:48.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829170+0000", 2024-09-11T05:33:48.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871818900000004 2024-09-11T05:33:48.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829177+0000", 2024-09-11T05:33:48.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7220000000000002e-06 2024-09-11T05:33:48.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856046+0000", 2024-09-11T05:33:48.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026868943 2024-09-11T05:33:48.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856144+0000", 2024-09-11T05:33:48.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8684999999999995e-05 2024-09-11T05:33:48.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856296+0000", 2024-09-11T05:33:48.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151667 2024-09-11T05:33:48.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.751 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.752 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116626 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13551616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.752 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:33:48.752 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8412024890000005, 2024-09-11T05:33:48.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.96707056, 2024-09-11T05:33:48.752 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116626 2024-09-11T05:33:48.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.753 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:33:48.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:33:48.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:33:48.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:33:48.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889610+0000", 2024-09-11T05:33:48.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.186e-06 2024-09-11T05:33:48.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889613+0000", 2024-09-11T05:33:48.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T05:33:48.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889615+0000", 2024-09-11T05:33:48.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:33:48.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890487+0000", 2024-09-11T05:33:48.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087202600000000003 2024-09-11T05:33:48.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890492+0000", 2024-09-11T05:33:48.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:33:48.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829202+0000", 2024-09-11T05:33:48.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871036299999999 2024-09-11T05:33:48.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829209+0000", 2024-09-11T05:33:48.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7669999999999998e-06 2024-09-11T05:33:48.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856327+0000", 2024-09-11T05:33:48.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027118465 2024-09-11T05:33:48.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856525+0000", 2024-09-11T05:33:48.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019825499999999999 2024-09-11T05:33:48.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856679+0000", 2024-09-11T05:33:48.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015328 2024-09-11T05:33:48.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.758 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.758 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116627 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13576192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.758 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:33:48.758 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8411926039999997, 2024-09-11T05:33:48.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9673406419999999, 2024-09-11T05:33:48.759 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116627 2024-09-11T05:33:48.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.759 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:33:48.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:33:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:33:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889619+0000", 2024-09-11T05:33:48.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.093e-06 2024-09-11T05:33:48.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889622+0000", 2024-09-11T05:33:48.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T05:33:48.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889625+0000", 2024-09-11T05:33:48.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:33:48.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890528+0000", 2024-09-11T05:33:48.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000902804 2024-09-11T05:33:48.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890537+0000", 2024-09-11T05:33:48.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2029999999999998e-06 2024-09-11T05:33:48.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829232+0000", 2024-09-11T05:33:48.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93869459799999999 2024-09-11T05:33:48.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829238+0000", 2024-09-11T05:33:48.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6699999999999997e-06 2024-09-11T05:33:48.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856709+0000", 2024-09-11T05:33:48.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027470925 2024-09-11T05:33:48.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856815+0000", 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010566899999999999 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856959+0000", 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000143752 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.765 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116628 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13600768~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.765 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:33:48.765 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8411686090000003, 2024-09-11T05:33:48.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9676105420000001, 2024-09-11T05:33:48.765 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116628 2024-09-11T05:33:48.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:33:48.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:33:48.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889644+0000", 2024-09-11T05:33:48.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:33:48.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889647+0000", 2024-09-11T05:33:48.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3950000000000001e-06 2024-09-11T05:33:48.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889650+0000", 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890570+0000", 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092007999999999999 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890577+0000", 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.764e-06 2024-09-11T05:33:48.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829261+0000", 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93868468500000002 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829268+0000", 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857004+0000", 2024-09-11T05:33:48.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027736043 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857102+0000", 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8066999999999995e-05 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857253+0000", 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015050400000000001 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.771 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116629 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13625344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.771 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:33:48.771 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8411520980000002, 2024-09-11T05:33:48.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967906154, 2024-09-11T05:33:48.771 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116629 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:33:48.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-07 2024-09-11T05:33:48.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889660+0000", 2024-09-11T05:33:48.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5650000000000001e-06 2024-09-11T05:33:48.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889664+0000", 2024-09-11T05:33:48.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4000000000000001e-06 2024-09-11T05:33:48.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889666+0000", 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890614+0000", 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00094762999999999998 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890621+0000", 2024-09-11T05:33:48.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.379e-06 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829291+0000", 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866938499999997 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829298+0000", 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6610000000000003e-06 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857284+0000", 2024-09-11T05:33:48.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027986522 2024-09-11T05:33:48.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857393+0000", 2024-09-11T05:33:48.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109054 2024-09-11T05:33:48.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857565+0000", 2024-09-11T05:33:48.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017160999999999999 2024-09-11T05:33:48.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.776 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.777 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116843 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12595200~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.777 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:33:48.777 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8411408760000008, 2024-09-11T05:33:48.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9682605290000001, 2024-09-11T05:33:48.777 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.777 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116843 2024-09-11T05:33:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:33:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:33:48.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:33:48.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:33:48.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889671+0000", 2024-09-11T05:33:48.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-11T05:33:48.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889674+0000", 2024-09-11T05:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.005e-06 2024-09-11T05:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889677+0000", 2024-09-11T05:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T05:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890648+0000", 2024-09-11T05:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097103399999999996 2024-09-11T05:33:48.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890652+0000", 2024-09-11T05:33:48.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0790000000000002e-06 2024-09-11T05:33:48.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829320+0000", 2024-09-11T05:33:48.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866793199999998 2024-09-11T05:33:48.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829327+0000", 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5529999999999998e-06 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857596+0000", 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028269125 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857834+0000", 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023784300000000001 2024-09-11T05:33:48.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857930+0000", 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6704000000000001e-05 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116844 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12619776~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8411306849999995, 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9685250679999999, 2024-09-11T05:33:48.783 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116844 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889681+0000", 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.229e-06 2024-09-11T05:33:48.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889684+0000", 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0130000000000002e-06 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889687+0000", 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7259999999999998e-06 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890685+0000", 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099783399999999996 2024-09-11T05:33:48.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890695+0000", 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829349+0000", 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865456300000005 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829356+0000", 2024-09-11T05:33:48.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5130000000000002e-06 2024-09-11T05:33:48.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857959+0000", 2024-09-11T05:33:48.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0286034959999999 2024-09-11T05:33:48.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858057+0000", 2024-09-11T05:33:48.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8097999999999995e-05 2024-09-11T05:33:48.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858205+0000", 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147732 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116845 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12644352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8411204520000002, 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968783033, 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116845 2024-09-11T05:33:48.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.790 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:33:48.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:33:48.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:33:48.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:33:48.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889692+0000", 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2330000000000001e-06 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889695+0000", 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9249999999999999e-06 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889697+0000", 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890719+0000", 2024-09-11T05:33:48.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010218429999999999 2024-09-11T05:33:48.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890723+0000", 2024-09-11T05:33:48.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:33:48.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829378+0000", 2024-09-11T05:33:48.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865562000000002 2024-09-11T05:33:48.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829385+0000", 2024-09-11T05:33:48.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4579999999999998e-06 2024-09-11T05:33:48.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858234+0000", 2024-09-11T05:33:48.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028849288 2024-09-11T05:33:48.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858337+0000", 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102371 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858473+0000", 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013669299999999999 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116846 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12668928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8410975270000005, 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.969056522, 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116846 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:33:48.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:33:48.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:33:48.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-07 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889715+0000", 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.482e-06 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889718+0000", 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889721+0000", 2024-09-11T05:33:48.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890762+0000", 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010413659999999999 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890772+0000", 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5750000000000007e-06 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829407+0000", 2024-09-11T05:33:48.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93863550699999998 2024-09-11T05:33:48.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829414+0000", 2024-09-11T05:33:48.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5640000000000002e-06 2024-09-11T05:33:48.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858502+0000", 2024-09-11T05:33:48.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0290880099999999 2024-09-11T05:33:48.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858634+0000", 2024-09-11T05:33:48.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013173199999999999 2024-09-11T05:33:48.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858770+0000", 2024-09-11T05:33:48.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135943 2024-09-11T05:33:48.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.801 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116847 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12693504~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8410678390000008, 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9692923329999998, 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116847 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.802 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T05:33:48.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889747+0000", 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.501e-06 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889753+0000", 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1360000000000002e-06 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889756+0000", 2024-09-11T05:33:48.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3110000000000001e-06 2024-09-11T05:33:48.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890808+0000", 2024-09-11T05:33:48.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010523240000000001 2024-09-11T05:33:48.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890813+0000", 2024-09-11T05:33:48.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5650000000000003e-06 2024-09-11T05:33:48.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829436+0000", 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93862351799999999 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829443+0000", 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5220000000000004e-06 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858798+0000", 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029354903 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858899+0000", 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101414 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859035+0000", 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013589 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116848 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12718080~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:33:48.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8410511540000005, 2024-09-11T05:33:48.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9695514759999999, 2024-09-11T05:33:48.808 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.808 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116848 2024-09-11T05:33:48.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.808 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889760+0000", 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889761+0000", 2024-09-11T05:33:48.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.189e-06 2024-09-11T05:33:48.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889764+0000", 2024-09-11T05:33:48.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:33:48.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889766+0000", 2024-09-11T05:33:48.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890850+0000", 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010835479999999999 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890857+0000", 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6299999999999998e-06 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829465+0000", 2024-09-11T05:33:48.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860787000000001 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829472+0000", 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4420000000000003e-06 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859062+0000", 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0295903360000001 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859169+0000", 2024-09-11T05:33:48.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010674400000000001 2024-09-11T05:33:48.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859311+0000", 2024-09-11T05:33:48.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014209499999999999 2024-09-11T05:33:48.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.813 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.813 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116849 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12742656~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.813 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:33:48.814 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8410413679999991, 2024-09-11T05:33:48.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9698160310000001, 2024-09-11T05:33:48.814 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.814 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116849 2024-09-11T05:33:48.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.814 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889771+0000", 2024-09-11T05:33:48.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:33:48.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889774+0000", 2024-09-11T05:33:48.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:33:48.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889776+0000", 2024-09-11T05:33:48.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.638e-06 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890886+0000", 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011102519999999999 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890891+0000", 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2200000000000003e-06 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829494+0000", 2024-09-11T05:33:48.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860342500000005 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829501+0000", 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4829999999999996e-06 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859339+0000", 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0298381320000001 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859440+0000", 2024-09-11T05:33:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010145 2024-09-11T05:33:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859585+0000", 2024-09-11T05:33:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014513300000000001 2024-09-11T05:33:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116850 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12767232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.819 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8410203420000002, 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970125645, 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116850 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889791+0000", 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889792+0000", 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4899999999999999e-06 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889795+0000", 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889798+0000", 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7089999999999998e-06 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890924+0000", 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001125685 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890933+0000", 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3340000000000008e-06 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829523+0000", 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858966099999996 2024-09-11T05:33:48.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829529+0000", 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5740000000000001e-06 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859614+0000", 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0300843289999999 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859743+0000", 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129407 2024-09-11T05:33:48.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859916+0000", 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017282500000000001 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116851 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12791808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.840980472, 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970347268, 2024-09-11T05:33:48.825 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116851 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:33:48.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:33:48.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:33:48.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889832+0000", 2024-09-11T05:33:48.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6819999999999999e-06 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889838+0000", 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889841+0000", 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890957+0000", 2024-09-11T05:33:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001115956 2024-09-11T05:33:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890961+0000", 2024-09-11T05:33:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7050000000000001e-06 2024-09-11T05:33:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829552+0000", 2024-09-11T05:33:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93859101499999997 2024-09-11T05:33:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829558+0000", 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5429999999999999e-06 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859947+0000", 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030388248 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860043+0000", 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5847999999999994e-05 2024-09-11T05:33:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860177+0000", 2024-09-11T05:33:48.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013484400000000001 2024-09-11T05:33:48.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.831 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.831 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116852 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12816384~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.831 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:33:48.831 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8409658610000008, 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970594859, 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116852 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:33:48.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889846+0000", 2024-09-11T05:33:48.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.204e-06 2024-09-11T05:33:48.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889849+0000", 2024-09-11T05:33:48.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.931e-06 2024-09-11T05:33:48.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889852+0000", 2024-09-11T05:33:48.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:33:48.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890993+0000", 2024-09-11T05:33:48.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001141176 2024-09-11T05:33:48.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891001+0000", 2024-09-11T05:33:48.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5259999999999996e-06 2024-09-11T05:33:48.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829582+0000", 2024-09-11T05:33:48.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858050800000004 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829588+0000", 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4980000000000003e-06 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860207+0000", 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030618713 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860305+0000", 2024-09-11T05:33:48.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8209999999999997e-05 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860440+0000", 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134692 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116853 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12840960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8409551430000004, 2024-09-11T05:33:48.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.97084075, 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116853 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889856+0000", 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889857+0000", 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.435e-06 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889860+0000", 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9620000000000002e-06 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889863+0000", 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891036+0000", 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011734580000000001 2024-09-11T05:33:48.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891042+0000", 2024-09-11T05:33:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3290000000000001e-06 2024-09-11T05:33:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829611+0000", 2024-09-11T05:33:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856954299999995 2024-09-11T05:33:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829618+0000", 2024-09-11T05:33:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T05:33:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860465+0000", 2024-09-11T05:33:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0308472500000001 2024-09-11T05:33:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860558+0000", 2024-09-11T05:33:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3253999999999999e-05 2024-09-11T05:33:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860696+0000", 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138169 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116854 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12865536~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8409449519999992, 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9710979320000002, 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116854 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889867+0000", 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.155e-06 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889871+0000", 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9260000000000002e-06 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889875+0000", 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.262e-06 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891070+0000", 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011945160000000001 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891079+0000", 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3759999999999997e-06 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829642+0000", 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856325900000004 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829649+0000", 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:33:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860726+0000", 2024-09-11T05:33:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.031076791 2024-09-11T05:33:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860831+0000", 2024-09-11T05:33:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105003 2024-09-11T05:33:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860964+0000", 2024-09-11T05:33:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013285700000000001 2024-09-11T05:33:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116855 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12890112~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:33:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8409301720000002, 2024-09-11T05:33:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.971277814, 2024-09-11T05:33:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116855 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:48.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:33:48.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:48.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:48.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817809+0000", 2024-09-11T05:33:48.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.92792850999999998 2024-09-11T05:33:48.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:48.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817815+0000", 2024-09-11T05:33:48.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4110000000000001e-06 2024-09-11T05:33:48.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:48.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817827+0000", 2024-09-11T05:33:48.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2031000000000001e-05 2024-09-11T05:33:48.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:48.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817837+0000", 2024-09-11T05:33:48.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2159999999999995e-06 2024-09-11T05:33:48.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829673+0000", 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011836197 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829679+0000", 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5390000000000004e-06 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861000+0000", 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0313209539999999 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861080+0000", 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9606999999999999e-05 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861158+0000", 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8349000000000005e-05 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:48.854 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:48.856 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:48.858 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.858 INFO:teuthology.orchestra.run.smithi070.stdout:4012 write 0x408e2f0 thru 0x4093c0d (0x591e bytes) 2024-09-11T05:33:48.858 INFO:teuthology.orchestra.run.smithi070.stdout:4014 punch from 0x41c1688 to 0x41c3aac, (0x2424 bytes) 2024-09-11T05:33:48.858 INFO:teuthology.orchestra.run.smithi070.stdout:4016 write 0x5c6c37a thru 0x5c71c2b (0x58b2 bytes) 2024-09-11T05:33:48.858 INFO:teuthology.orchestra.run.smithi070.stdout:4018 write 0xcc4c0bb thru 0xcc55da5 (0x9ceb bytes) 2024-09-11T05:33:48.858 INFO:teuthology.orchestra.run.smithi070.stdout:4019 write 0x8f217ab thru 0x8f2eaed (0xd343 bytes) 2024-09-11T05:33:48.859 INFO:teuthology.orchestra.run.smithi070.stdout:4021 punch from 0x64bbc8 to 0x65685f, (0xac97 bytes) 2024-09-11T05:33:48.859 INFO:teuthology.orchestra.run.smithi070.stdout:4023 writesame 0x10e4334 thru 0x10f0cb8 data_size 0x1(0xc985 bytes) 2024-09-11T05:33:48.859 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.859 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.859 INFO:teuthology.orchestra.run.smithi070.stdout:4026 trunc from 0xcc55da6 to 0x51ce967 2024-09-11T05:33:48.859 INFO:teuthology.orchestra.run.smithi070.stdout:4028 write 0x433ba1a thru 0x434ba0b (0xfff2 bytes) 2024-09-11T05:33:48.859 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:48.854+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:48.863 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:33:48.882 INFO:teuthology.orchestra.run.smithi070.stdout:4030 write 0xe72cf41 thru 0xe730fb9 (0x4079 bytes) 2024-09-11T05:33:48.886 INFO:teuthology.orchestra.run.smithi070.stdout:4031 writesame 0x8b24378 thru 0x8b2c5dc data_size 0x3(0x8265 bytes) 2024-09-11T05:33:48.898 INFO:teuthology.orchestra.run.smithi070.stdout:4033 read 0x163862e thru 0x163ab64 (0x2537 bytes) 2024-09-11T05:33:48.898 INFO:teuthology.orchestra.run.smithi070.stdout:4034 read 0x8736005 thru 0x873c2c5 (0x62c1 bytes) 2024-09-11T05:33:48.898 INFO:teuthology.orchestra.run.smithi070.stdout:4036 punch from 0xc7ada79 to 0xc7b0ae3, (0x306a bytes) 2024-09-11T05:33:48.898 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.900 INFO:teuthology.orchestra.run.smithi070.stdout:4042 trunc from 0xe730fba to 0xd00c1bb 2024-09-11T05:33:48.915 INFO:teuthology.orchestra.run.smithi070.stdout:4043 punch from 0x17c469e to 0x17d1d76, (0xd6d8 bytes) 2024-09-11T05:33:48.915 INFO:teuthology.orchestra.run.smithi070.stdout:4045 read 0xa388583 thru 0xa398542 (0xffc0 bytes) 2024-09-11T05:33:48.915 INFO:teuthology.orchestra.run.smithi070.stdout:4048 writesame 0x8a2b500 thru 0x8a31fc0 data_size 0x1(0x6ac1 bytes) 2024-09-11T05:33:48.936 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.936 INFO:teuthology.orchestra.run.smithi070.stdout:4050 read 0x447c623 thru 0x4489e15 (0xd7f3 bytes) 2024-09-11T05:33:48.936 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.936 INFO:teuthology.orchestra.run.smithi070.stdout:4052 write 0x75d4cc0 thru 0x75d69b0 (0x1cf1 bytes) 2024-09-11T05:33:48.941 INFO:teuthology.orchestra.run.smithi070.stdout:4053 write 0x991c35f thru 0x99246cd (0x836f bytes) 2024-09-11T05:33:48.948 INFO:teuthology.orchestra.run.smithi070.stdout:4054 read 0x2922afa thru 0x2928e62 (0x6369 bytes) 2024-09-11T05:33:48.948 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.948 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.957 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:48.955+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:48.958 INFO:teuthology.orchestra.run.smithi070.stdout:4057 trunc from 0xd00c1bb to 0x46d18a3 2024-09-11T05:33:48.980 INFO:teuthology.orchestra.run.smithi070.stdout:4058 writesame 0x56ce94b thru 0x56cfc68 data_size 0x1(0x131e bytes) 2024-09-11T05:33:48.980 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:48.980 INFO:teuthology.orchestra.run.smithi070.stdout:4060 read 0x5583abb thru 0x558d1bb (0x9701 bytes) 2024-09-11T05:33:48.988 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:48.988 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:48.989 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:48.994 INFO:teuthology.orchestra.run.smithi070.stdout:4061 write 0xcdfb1c2 thru 0xce0342e (0x826d bytes) 2024-09-11T05:33:49.000 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:49.002 INFO:teuthology.orchestra.run.smithi070.stdout:4064 read 0x50bd25d thru 0x50c67f2 (0x9596 bytes) 2024-09-11T05:33:49.002 INFO:teuthology.orchestra.run.smithi070.stdout:4065 read 0x7cee884 thru 0x7cf8270 (0x99ed bytes) 2024-09-11T05:33:49.002 INFO:teuthology.orchestra.run.smithi070.stdout:4066 write 0x3f3fe9f thru 0x3f41e06 (0x1f68 bytes) 2024-09-11T05:33:49.011 INFO:teuthology.orchestra.run.smithi070.stdout:4067 write 0xe53136e thru 0xe5374e4 (0x6177 bytes) 2024-09-11T05:33:49.018 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:49.018 INFO:teuthology.orchestra.run.smithi070.stdout:4070 read 0xa5dd416 thru 0xa5e01c8 (0x2db3 bytes) 2024-09-11T05:33:49.018 INFO:teuthology.orchestra.run.smithi070.stdout:4072 punch from 0xad846a6 to 0xad8c448, (0x7da2 bytes) 2024-09-11T05:33:49.018 INFO:teuthology.orchestra.run.smithi070.stdout:4073 writesame 0x8cfad37 thru 0x8cff3c0 data_size 0x1(0x468a bytes) 2024-09-11T05:33:49.030 INFO:teuthology.orchestra.run.smithi070.stdout:4074 write 0xb817d8f thru 0xb826748 (0xe9ba bytes) 2024-09-11T05:33:49.041 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:49.042 INFO:teuthology.orchestra.run.smithi070.stdout:4077 write 0xc8b0c6d thru 0xc8b5a63 (0x4df7 bytes) 2024-09-11T05:33:49.046 INFO:teuthology.orchestra.run.smithi070.stdout:4078 punch from 0x8a061e5 to 0x8a13de4, (0xdbff bytes) 2024-09-11T05:33:49.055 INFO:teuthology.orchestra.run.smithi070.stdout:4079 trunc from 0xe5374e5 to 0x6dbf588 2024-09-11T05:33:49.057 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:49.056+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:49.081 INFO:teuthology.orchestra.run.smithi070.stdout:4080 write 0xab14f0c thru 0xab22f55 (0xe04a bytes) 2024-09-11T05:33:49.093 INFO:teuthology.orchestra.run.smithi070.stdout:4081 write 0x6b953a2 thru 0x6b96766 (0x13c5 bytes) 2024-09-11T05:33:49.104 INFO:teuthology.orchestra.run.smithi070.stdout:4082 write 0xc97e459 thru 0xc98230a (0x3eb2 bytes) 2024-09-11T05:33:49.109 INFO:teuthology.orchestra.run.smithi070.stdout:4086 write 0x84eaea1 thru 0x84eb22c (0x38c bytes) 2024-09-11T05:33:49.113 INFO:teuthology.orchestra.run.smithi070.stdout:4087 trunc from 0xc98230b to 0xd618de1 2024-09-11T05:33:49.119 INFO:teuthology.orchestra.run.smithi070.stdout:4089 write 0xa196477 thru 0xa1a32ac (0xce36 bytes) 2024-09-11T05:33:49.122 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:49.122 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:49.122 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:49.122 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:49.122 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:49.128 INFO:teuthology.orchestra.run.smithi070.stdout:4090 read 0x762fc1c thru 0x763186d (0x1c52 bytes) 2024-09-11T05:33:49.134 INFO:teuthology.orchestra.run.smithi070.stdout:4091 trunc from 0xd618de1 to 0x9598145 2024-09-11T05:33:49.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:49.149 INFO:teuthology.orchestra.run.smithi070.stdout:4092 read 0x6c39fd7 thru 0x6c3fb6e (0x5b98 bytes) 2024-09-11T05:33:49.149 INFO:teuthology.orchestra.run.smithi070.stdout:4093 read 0x8d88825 thru 0x8d8ee68 (0x6644 bytes) 2024-09-11T05:33:49.149 INFO:teuthology.orchestra.run.smithi070.stdout:4094 read 0x6969b30 thru 0x6975a63 (0xbf34 bytes) 2024-09-11T05:33:49.149 INFO:teuthology.orchestra.run.smithi070.stdout:4095 write 0x79be26c thru 0x79bfd02 (0x1a97 bytes) 2024-09-11T05:33:49.152 INFO:teuthology.orchestra.run.smithi070.stdout:4096 punch from 0x58ff316 to 0x590a44d, (0xb137 bytes) 2024-09-11T05:33:49.152 INFO:teuthology.orchestra.run.smithi070.stdout:4097 write 0x6f3ca04 thru 0x6f4374f (0x6d4c bytes) 2024-09-11T05:33:49.158 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:49.157+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:49.163 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:49.163 INFO:teuthology.orchestra.run.smithi070.stdout:4101 punch from 0x4bce6e2 to 0x4bd30f0, (0x4a0e bytes) 2024-09-11T05:33:49.163 INFO:teuthology.orchestra.run.smithi070.stdout:4102 punch from 0x247807d to 0x24805d0, (0x8553 bytes) 2024-09-11T05:33:49.169 INFO:teuthology.orchestra.run.smithi070.stdout:4103 write 0xa1b540d thru 0xa1c40d8 (0xeccc bytes) 2024-09-11T05:33:49.180 INFO:teuthology.orchestra.run.smithi070.stdout:4104 write 0x1593b00 thru 0x1593e19 (0x31a bytes) 2024-09-11T05:33:49.188 INFO:teuthology.orchestra.run.smithi070.stdout:4105 trunc from 0xa1c40d9 to 0xe78696f 2024-09-11T05:33:49.198 INFO:teuthology.orchestra.run.smithi070.stdout:4106 trunc from 0xe78696f to 0xa57cafd 2024-09-11T05:33:49.205 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:49.205 INFO:teuthology.orchestra.run.smithi070.stdout:4108 write 0x7a0e91d thru 0x7a18256 (0x993a bytes) 2024-09-11T05:33:49.213 INFO:teuthology.orchestra.run.smithi070.stdout:4109 read 0x66b2168 thru 0x66b2193 (0x2c bytes) 2024-09-11T05:33:49.213 INFO:teuthology.orchestra.run.smithi070.stdout:4112 punch from 0x549f82c to 0x54abeb0, (0xc684 bytes) 2024-09-11T05:33:49.213 INFO:teuthology.orchestra.run.smithi070.stdout:4113 punch from 0x45ae995 to 0x45b9fea, (0xb655 bytes) 2024-09-11T05:33:49.213 INFO:teuthology.orchestra.run.smithi070.stdout:4117 read 0x47e4096 thru 0x47e92bb (0x5226 bytes) 2024-09-11T05:33:49.213 INFO:teuthology.orchestra.run.smithi070.stdout:4118 writesame 0x6675b8f thru 0x6676d33 data_size 0x1(0x11a5 bytes) 2024-09-11T05:33:49.228 INFO:teuthology.orchestra.run.smithi070.stdout:4119 write 0xdd339f7 thru 0xdd3ab16 (0x7120 bytes) 2024-09-11T05:33:49.260 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:49.259+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.670469941, 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.262 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:33:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:33:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:33:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:33:49.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:33:49.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:33:49.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:33:49.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:33:49.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:33:49.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:33:49.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:33:49.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:33:49.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:33:49.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:49.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:33:49.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:33:49.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:33:49.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:33:49.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.093534681000001, 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:33:49.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:49.271 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.093515881999998, 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:49.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:33:49.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:33:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.276 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.276 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:49.276 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.093491851, 2024-09-11T05:33:49.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:33:49.276 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.276 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.276 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.276 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:33:49.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.277 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:49.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:49.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:49.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:33:49.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:33:49.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:33:49.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:33:49.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:33:49.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:33:49.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:33:49.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:33:49.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:33:49.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:33:49.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:33:49.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:33:49.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:33:49.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.281 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.281 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.281 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:49.281 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.093415062999998, 2024-09-11T05:33:49.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:33:49.281 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:33:49.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.282 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:49.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:49.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:49.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:33:49.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:33:49.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:33:49.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:33:49.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:33:49.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:33:49.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:33:49.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:33:49.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:33:49.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:33:49.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:33:49.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.093387740000001, 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:33:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:33:49.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:33:49.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:33:49.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:33:49.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:33:49.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.291 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.291 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:49.291 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.093369192000001, 2024-09-11T05:33:49.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:33:49.291 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:33:49.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.292 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:49.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:49.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:49.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:33:49.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:33:49.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:33:49.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:33:49.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:33:49.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:33:49.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:33:49.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.295 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.296 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.296 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:33:49.296 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.093351121000001, 2024-09-11T05:33:49.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:33:49.296 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:33:49.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:33:49.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:33:49.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:33:49.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:33:49.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:33:49.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:33:49.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:33:49.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:33:49.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:33:49.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:33:49.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:33:49.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:33:49.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:33:49.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.300 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.300 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.301 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:33:49.301 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.091753478000001, 2024-09-11T05:33:49.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:33:49.301 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.301 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:33:49.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.301 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:33:49.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:33:49.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:33:49.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:33:49.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:33:49.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:33:49.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:33:49.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:33:49.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:33:49.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:33:49.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:33:49.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:33:49.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:33:49.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:33:49.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:33:49.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:33:49.305 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.305 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.305 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.306 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.306 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:49.306 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.091733152, 2024-09-11T05:33:49.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:33:49.306 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.306 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.306 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.306 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.306 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.306 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.307 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:33:49.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.307 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:49.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:49.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:49.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:33:49.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:33:49.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:33:49.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:33:49.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:33:49.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:33:49.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:33:49.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:33:49.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:33:49.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:33:49.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:33:49.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:33:49.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:33:49.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.311 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.311 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.311 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:49.311 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.091694153999999, 2024-09-11T05:33:49.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:33:49.311 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:33:49.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.312 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:49.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:49.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:49.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:33:49.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:33:49.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:33:49.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:33:49.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:33:49.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:33:49.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:33:49.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:33:49.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:33:49.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:33:49.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:33:49.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:33:49.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:33:49.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.316 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.316 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.316 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:33:49.316 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.091673512, 2024-09-11T05:33:49.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:33:49.316 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:33:49.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.317 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:33:49.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:33:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:33:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:33:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:33:49.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:33:49.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:33:49.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:33:49.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:33:49.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:33:49.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:33:49.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:33:49.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:33:49.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:33:49.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:33:49.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:33:49.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.321 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.321 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.321 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:33:49.321 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.091550648999998, 2024-09-11T05:33:49.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:33:49.322 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:33:49.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.322 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:33:49.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:33:49.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:33:49.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:33:49.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:33:49.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:33:49.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:33:49.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:33:49.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:33:49.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:33:49.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:33:49.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:33:49.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:33:49.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:33:49.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:33:49.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:33:49.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.327 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.327 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.327 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:33:49.327 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.091391091999999, 2024-09-11T05:33:49.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:33:49.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:33:49.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:33:49.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:33:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:33:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:33:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:33:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:33:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:33:49.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:33:49.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:33:49.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:33:49.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:33:49.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:33:49.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:33:49.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.332 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.332 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.332 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:33:49.332 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.089706424999999, 2024-09-11T05:33:49.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:33:49.332 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:33:49.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.333 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:33:49.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:33:49.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:33:49.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:33:49.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:33:49.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:33:49.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:33:49.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:33:49.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:33:49.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:33:49.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:33:49.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:33:49.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:33:49.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:33:49.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:33:49.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.089678419999998, 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:33:49.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:33:49.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:33:49.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:33:49.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:33:49.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:33:49.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:33:49.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:33:49.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:33:49.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.341 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.341 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44388 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8118272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.341 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.088287087000001, 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044546074999999997, 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44388 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:33:49.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172487+0000", 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172490+0000", 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5090000000000002e-06 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172497+0000", 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172502+0000", 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2000000000000002e-06 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216878+0000", 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044375900000000003 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216925+0000", 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7058999999999998e-05 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216982+0000", 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6932000000000003e-05 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.345 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.088211956999999, 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.346 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:33:49.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:33:49.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:33:49.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:33:49.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:33:49.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:33:49.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:33:49.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:33:49.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:33:49.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:33:49.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:33:49.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:33:49.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:33:49.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:33:49.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.350 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.351 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.351 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:33:49.351 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.088026656, 2024-09-11T05:33:49.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:33:49.351 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:33:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:33:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:33:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:33:49.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:33:49.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:33:49.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:33:49.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:33:49.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:33:49.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:33:49.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:33:49.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:33:49.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:33:49.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:33:49.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:33:49.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:33:49.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:33:49.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.355 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.356 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:49.356 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:33:49.356 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.087855201, 2024-09-11T05:33:49.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:33:49.356 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:49.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:49.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:49.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:49.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:49.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:33:49.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.357 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:49.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:49.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:33:49.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:49.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:33:49.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:49.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:49.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:33:49.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:33:49.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:49.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:33:49.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:33:49.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:33:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:33:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:33:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:33:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:33:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:49.361 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:49.361 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:49.362 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:49.362 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:49.361+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:49.463 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:49.462+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:49.465 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:49.465 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:49.465 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:49.465 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:49.473 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:49.563 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:49.563+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:49.618 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:49.618 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:49.618 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:49.618 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:49.618 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:49.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:49.671 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:49.670+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:49.729 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:49.729 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:49.729 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:49.729 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:33:49.729 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:49.741 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:49.782 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:49.781+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:49.855 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T05:33:49.865 INFO:teuthology.orchestra.run.smithi070.stdout:4120 trunc from 0xdd3ab17 to 0xc43c684 2024-09-11T05:33:49.865 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:49.864+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:49.879 INFO:teuthology.orchestra.run.smithi070.stdout:4121 read 0x57c8530 thru 0x57d2e92 (0xa963 bytes) 2024-09-11T05:33:49.880 INFO:teuthology.orchestra.run.smithi070.stdout:4122 read 0x47c6fd7 thru 0x47d0a4a (0x9a74 bytes) 2024-09-11T05:33:49.880 INFO:teuthology.orchestra.run.smithi070.stdout:4124 read 0xbf93efa thru 0xbf9cd34 (0x8e3b bytes) 2024-09-11T05:33:49.880 INFO:teuthology.orchestra.run.smithi070.stdout:4125 read 0x153b9c4 thru 0x153f308 (0x3945 bytes) 2024-09-11T05:33:49.880 INFO:teuthology.orchestra.run.smithi070.stdout:4127 write 0x4be8aa thru 0x4ca264 (0xb9bb bytes) 2024-09-11T05:33:49.892 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:49.892 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:49.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.892 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:147321 3.4 e67/22 3:23327949:::rbd_object_map.112d55d87bfc:head v 67'1177, mlcod=67'1172)", 2024-09-11T05:33:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.887669+0000", 2024-09-11T05:33:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0049009179999999998, 2024-09-11T05:33:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0049167530000000003, 2024-09-11T05:33:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.887669+0000", 2024-09-11T05:33:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:49.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.887669+0000", 2024-09-11T05:33:49.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:49.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:49.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.887670+0000", 2024-09-11T05:33:49.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.06e-07 2024-09-11T05:33:49.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:49.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.887674+0000", 2024-09-11T05:33:49.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1690000000000002e-06 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.887682+0000", 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.96e-06 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.887688+0000", 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6790000000000002e-06 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:49.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.887726+0000", 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8080999999999997e-05 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.887741+0000", 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5603e-05 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:147325 3.0 3:03da2cd2:::rbd_data.112d55d87bfc.000000000000000d:head [set-alloc-hint object_size 262144 write_size 262144,write 237568~613 in=613b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.888455+0000", 2024-09-11T05:33:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0041148850000000004, 2024-09-11T05:33:49.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0041696980000000003, 2024-09-11T05:33:49.897 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:49.897 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:49.897 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:33:49.897 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:49.897 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:49.897 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.897 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 147325 2024-09-11T05:33:49.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.897 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:49.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:49.897 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.888455+0000", 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.888455+0000", 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.888456+0000", 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0400000000000005e-07 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.888461+0000", 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7090000000000001e-06 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.888470+0000", 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0710000000000001e-06 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.888475+0000", 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8350000000000003e-06 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.888520+0000", 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4947000000000002e-05 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.888603+0000", 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2855000000000005e-05 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 7", 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.888683+0000", 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0099999999999995e-05 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.890717+0000", 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0020343029999999999 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:147327 3.0 3:0544c294:::rbd_data.112d55d87bfc.0000000000000012:head [set-alloc-hint object_size 262144 write_size 262144,write 229376~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.891023+0000", 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.001547128, 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0016481060000000001, 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 147327 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.891023+0000", 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.891023+0000", 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:49.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.891024+0000", 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4300000000000002e-07 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.891032+0000", 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5550000000000003e-06 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.891042+0000", 2024-09-11T05:33:49.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5300000000000002e-06 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.891047+0000", 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8359999999999999e-06 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.891087+0000", 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0136000000000003e-05 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:49.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.891210+0000", 2024-09-11T05:33:49.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012277699999999999 2024-09-11T05:33:49.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:49.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:49.905 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 7", 2024-09-11T05:33:49.905 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.891342+0000", 2024-09-11T05:33:49.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013278199999999999 2024-09-11T05:33:49.905 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:49.905 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:49.905 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:49.905 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:49.905 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-11T05:33:49.905 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 3 2024-09-11T05:33:49.905 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:49.906 INFO:teuthology.orchestra.run.smithi070.stdout:4128 read 0xaac938c thru 0xaad8461 (0xf0d6 bytes) 2024-09-11T05:33:49.906 INFO:teuthology.orchestra.run.smithi070.stdout:4130 write 0xb30de65 thru 0xb311064 (0x3200 bytes) 2024-09-11T05:33:49.906 INFO:teuthology.orchestra.run.smithi070.stdout:4131 write 0x59d237a thru 0x59d94b1 (0x7138 bytes) 2024-09-11T05:33:49.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:49.915 INFO:teuthology.orchestra.run.smithi070.stdout:4132 read 0x496c4d4 thru 0x4975e68 (0x9995 bytes) 2024-09-11T05:33:49.915 INFO:teuthology.orchestra.run.smithi070.stdout:4133 writesame 0x6d0c292 thru 0x6d17f97 data_size 0xf(0xbd06 bytes) 2024-09-11T05:33:49.922 INFO:teuthology.orchestra.run.smithi070.stdout:4134 write 0x1923599 thru 0x192af11 (0x7979 bytes) 2024-09-11T05:33:49.929 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:49.930 INFO:teuthology.orchestra.run.smithi070.stdout:4136 punch from 0x2b75210 to 0x2b76de2, (0x1bd2 bytes) 2024-09-11T05:33:49.930 INFO:teuthology.orchestra.run.smithi070.stdout:4138 read 0xb639c74 thru 0xb648318 (0xe6a5 bytes) 2024-09-11T05:33:49.930 INFO:teuthology.orchestra.run.smithi070.stdout:4139 read 0x5df4c2b thru 0x5df7dba (0x3190 bytes) 2024-09-11T05:33:49.930 INFO:teuthology.orchestra.run.smithi070.stdout:4140 clone 26 order 25 su 1048576 sc 3 2024-09-11T05:33:49.966 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:49.965+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:50.013 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:50.013 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:50.013 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:50.013 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:50.013 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:50.021 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:50.067 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:50.066+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:50.126 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:50.126 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:50.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45829 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 6995968~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.758409793999999, 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031286190999999998, 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45829 2024-09-11T05:33:50.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.128 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.128 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:50.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.128 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:50.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366836+0000", 2024-09-11T05:33:50.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4199999999999996e-07 2024-09-11T05:33:50.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366838+0000", 2024-09-11T05:33:50.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9929999999999998e-06 2024-09-11T05:33:50.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366844+0000", 2024-09-11T05:33:50.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0430000000000004e-06 2024-09-11T05:33:50.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366848+0000", 2024-09-11T05:33:50.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6040000000000003e-06 2024-09-11T05:33:50.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398029+0000", 2024-09-11T05:33:50.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031180349 2024-09-11T05:33:50.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398070+0000", 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1421999999999997e-05 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398121+0000", 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1238e-05 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45830 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7045120~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:50.131 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.758390222999999, 2024-09-11T05:33:50.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031383187999999999, 2024-09-11T05:33:50.132 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.132 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.132 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.132 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.132 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.132 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.132 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45830 2024-09-11T05:33:50.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.132 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.132 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.132 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.51e-07 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366857+0000", 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9259999999999999e-06 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366863+0000", 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7069999999999997e-06 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366868+0000", 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7380000000000002e-06 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398147+0000", 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031279757999999998 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398189+0000", 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1597999999999997e-05 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398238+0000", 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.901e-05 2024-09-11T05:33:50.135 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.136 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.136 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.136 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45831 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7094272~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.136 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:50.136 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.758371096000001, 2024-09-11T05:33:50.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031481960000000003, 2024-09-11T05:33:50.136 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.136 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.136 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.136 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45831 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:50.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4200000000000002e-07 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366876+0000", 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0020000000000001e-06 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366882+0000", 2024-09-11T05:33:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7690000000000002e-06 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366887+0000", 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119999999999999e-06 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398263+0000", 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031376023000000003 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398306+0000", 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3220999999999998e-05 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398356+0000", 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45832 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7143424~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:50.140 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.758352475999999, 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031581625000000002, 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45832 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:50.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367199+0000", 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00030624 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367205+0000", 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1090000000000003e-06 2024-09-11T05:33:50.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367213+0000", 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8979999999999996e-06 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367219+0000", 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398380+0000", 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031160931999999999 2024-09-11T05:33:50.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398425+0000", 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4548000000000001e-05 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398474+0000", 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9298000000000001e-05 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45833 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7192576~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.758011191000001, 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031369229999999998, 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45833 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.145 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9400000000000005e-07 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367237+0000", 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4439999999999998e-06 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367243+0000", 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367249+0000", 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2240000000000003e-06 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398507+0000", 2024-09-11T05:33:50.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031257994999999997 2024-09-11T05:33:50.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398551+0000", 2024-09-11T05:33:50.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4178000000000003e-05 2024-09-11T05:33:50.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398603+0000", 2024-09-11T05:33:50.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2178000000000001e-05 2024-09-11T05:33:50.148 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.148 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.149 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.149 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45834 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7241728~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.149 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:50.149 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.757989460000001, 2024-09-11T05:33:50.149 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031466477, 2024-09-11T05:33:50.149 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.149 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.149 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.149 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.149 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.149 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.150 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45834 2024-09-11T05:33:50.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.150 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:50.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:50.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5200000000000002e-07 2024-09-11T05:33:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367258+0000", 2024-09-11T05:33:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1110000000000002e-06 2024-09-11T05:33:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.152 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367264+0000", 2024-09-11T05:33:50.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0290000000000002e-06 2024-09-11T05:33:50.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.152 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.152 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367269+0000", 2024-09-11T05:33:50.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:33:50.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.152 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.152 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398628+0000", 2024-09-11T05:33:50.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031358587 2024-09-11T05:33:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398671+0000", 2024-09-11T05:33:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3035999999999999e-05 2024-09-11T05:33:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398722+0000", 2024-09-11T05:33:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1511000000000002e-05 2024-09-11T05:33:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.154 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45835 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7290880~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.154 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:50.154 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.757969886000001, 2024-09-11T05:33:50.154 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031565589999999998, 2024-09-11T05:33:50.154 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.154 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.154 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.154 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.154 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.154 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.155 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45835 2024-09-11T05:33:50.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.155 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:50.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:50.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367276+0000", 2024-09-11T05:33:50.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.96e-07 2024-09-11T05:33:50.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367278+0000", 2024-09-11T05:33:50.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0279999999999999e-06 2024-09-11T05:33:50.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.157 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.157 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367283+0000", 2024-09-11T05:33:50.157 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8340000000000004e-06 2024-09-11T05:33:50.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.157 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.157 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.157 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367289+0000", 2024-09-11T05:33:50.157 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:33:50.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.157 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.157 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.157 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398747+0000", 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031458211999999999 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398788+0000", 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0998999999999998e-05 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398841+0000", 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2465e-05 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45836 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7340032~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.75794981, 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031663635000000002, 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45836 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368490+0000", 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0011952410000000001 2024-09-11T05:33:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.161 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368494+0000", 2024-09-11T05:33:50.161 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4649999999999999e-06 2024-09-11T05:33:50.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.161 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368503+0000", 2024-09-11T05:33:50.161 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0920000000000004e-06 2024-09-11T05:33:50.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.162 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368509+0000", 2024-09-11T05:33:50.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4130000000000003e-06 2024-09-11T05:33:50.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.162 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.162 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.162 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398865+0000", 2024-09-11T05:33:50.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030355473000000001 2024-09-11T05:33:50.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.162 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.162 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.162 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398907+0000", 2024-09-11T05:33:50.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1882999999999999e-05 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398959+0000", 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2067999999999997e-05 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45844 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7733248~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.756570666999998, 2024-09-11T05:33:50.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031248306, 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45844 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:50.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368675+0000", 2024-09-11T05:33:50.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4700000000000001e-07 2024-09-11T05:33:50.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.166 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368680+0000", 2024-09-11T05:33:50.166 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3750000000000002e-06 2024-09-11T05:33:50.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.166 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.166 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.166 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368687+0000", 2024-09-11T05:33:50.166 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3080000000000004e-06 2024-09-11T05:33:50.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.166 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.166 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.166 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368692+0000", 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2329999999999997e-06 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399832+0000", 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031139723000000001 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399872+0000", 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0880000000000002e-05 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399923+0000", 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.024e-05 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45845 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7782400~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.756546833000002, 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031339210999999999, 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.168 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45845 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:50.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368699+0000", 2024-09-11T05:33:50.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:33:50.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368701+0000", 2024-09-11T05:33:50.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0389999999999999e-06 2024-09-11T05:33:50.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.171 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368706+0000", 2024-09-11T05:33:50.171 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5570000000000003e-06 2024-09-11T05:33:50.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.171 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.171 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.171 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368711+0000", 2024-09-11T05:33:50.171 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0930000000000002e-06 2024-09-11T05:33:50.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.171 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.171 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.171 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399947+0000", 2024-09-11T05:33:50.172 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031235810999999999 2024-09-11T05:33:50.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.172 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.172 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.172 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399989+0000", 2024-09-11T05:33:50.172 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1430000000000001e-05 2024-09-11T05:33:50.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.172 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.172 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.172 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400037+0000", 2024-09-11T05:33:50.172 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8838999999999998e-05 2024-09-11T05:33:50.172 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45846 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7831552~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.756527732999999, 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031434484999999998, 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.173 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.174 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45846 2024-09-11T05:33:50.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.174 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.174 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.174 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:50.174 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.174 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.174 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:50.174 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368718+0000", 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6600000000000002e-07 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368720+0000", 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0140000000000001e-06 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368726+0000", 2024-09-11T05:33:50.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8719999999999999e-06 2024-09-11T05:33:50.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368730+0000", 2024-09-11T05:33:50.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:33:50.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400061+0000", 2024-09-11T05:33:50.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031331141 2024-09-11T05:33:50.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400102+0000", 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0419e-05 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400152+0000", 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9926000000000003e-05 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.178 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45847 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7880704~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.178 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:50.178 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.756508621999998, 2024-09-11T05:33:50.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031531412000000002, 2024-09-11T05:33:50.178 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.178 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.178 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.178 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.178 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.178 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.178 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45847 2024-09-11T05:33:50.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.179 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:50.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:50.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.180 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368737+0000", 2024-09-11T05:33:50.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:33:50.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.180 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.180 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368739+0000", 2024-09-11T05:33:50.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.81e-06 2024-09-11T05:33:50.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.180 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.180 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368744+0000", 2024-09-11T05:33:50.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8919999999999997e-06 2024-09-11T05:33:50.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.181 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368749+0000", 2024-09-11T05:33:50.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7149999999999997e-06 2024-09-11T05:33:50.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.181 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400176+0000", 2024-09-11T05:33:50.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031426740000000002 2024-09-11T05:33:50.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400218+0000", 2024-09-11T05:33:50.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2338e-05 2024-09-11T05:33:50.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400268+0000", 2024-09-11T05:33:50.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9580000000000003e-05 2024-09-11T05:33:50.182 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.182 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.182 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.182 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45848 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7929856~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.756489825999999, 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031629162000000002, 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45848 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368756+0000", 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.184 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368758+0000", 2024-09-11T05:33:50.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.951e-06 2024-09-11T05:33:50.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.185 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.185 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368763+0000", 2024-09-11T05:33:50.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.801e-06 2024-09-11T05:33:50.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.185 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.185 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368768+0000", 2024-09-11T05:33:50.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1100000000000002e-06 2024-09-11T05:33:50.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400292+0000", 2024-09-11T05:33:50.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031524033 2024-09-11T05:33:50.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400336+0000", 2024-09-11T05:33:50.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3272999999999997e-05 2024-09-11T05:33:50.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400384+0000", 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8634999999999998e-05 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45849 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7979008~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.756470434000001, 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031732415, 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.187 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45849 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.188 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0100000000000005e-07 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368777+0000", 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0260000000000002e-06 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368783+0000", 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7089999999999999e-06 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368788+0000", 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4029999999999998e-06 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400409+0000", 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031620663 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400453+0000", 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4376999999999999e-05 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400507+0000", 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3736000000000002e-05 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.191 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45850 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8028160~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.756450972, 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031830000999999997, 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45850 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.192 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:50.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:50.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368795+0000", 2024-09-11T05:33:50.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0399999999999996e-07 2024-09-11T05:33:50.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368796+0000", 2024-09-11T05:33:50.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.933e-06 2024-09-11T05:33:50.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368803+0000", 2024-09-11T05:33:50.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0619999999999997e-06 2024-09-11T05:33:50.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368807+0000", 2024-09-11T05:33:50.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.685e-06 2024-09-11T05:33:50.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400531+0000", 2024-09-11T05:33:50.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031723784999999997 2024-09-11T05:33:50.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400573+0000", 2024-09-11T05:33:50.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2079999999999997e-05 2024-09-11T05:33:50.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400624+0000", 2024-09-11T05:33:50.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0952000000000003e-05 2024-09-11T05:33:50.196 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.196 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.196 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.196 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45851 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8077312~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:50.196 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:50.196 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 24.756431978999998, 2024-09-11T05:33:50.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031929358999999997, 2024-09-11T05:33:50.197 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.197 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.197 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.197 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.197 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.197 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.197 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45851 2024-09-11T05:33:50.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.197 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.197 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.197 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:50.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:50.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370488+0000", 2024-09-11T05:33:50.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.001674743 2024-09-11T05:33:50.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370491+0000", 2024-09-11T05:33:50.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.444e-06 2024-09-11T05:33:50.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370500+0000", 2024-09-11T05:33:50.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0650000000000005e-06 2024-09-11T05:33:50.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370507+0000", 2024-09-11T05:33:50.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:33:50.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400648+0000", 2024-09-11T05:33:50.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030141889000000002 2024-09-11T05:33:50.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400691+0000", 2024-09-11T05:33:50.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2290999999999999e-05 2024-09-11T05:33:50.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400742+0000", 2024-09-11T05:33:50.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1717e-05 2024-09-11T05:33:50.201 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.201 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.201 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.202 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145920 3.18 3:1a554328:::rbd_data.112d9958e8ce.000000000000000a:1b [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:33:50.202 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:33:50.202 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6504224699999996, 2024-09-11T05:33:50.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031231273, 2024-09-11T05:33:50.202 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.202 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.202 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.202 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145920 2024-09-11T05:33:50.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474824+0000", 2024-09-11T05:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.046e-06 2024-09-11T05:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474827+0000", 2024-09-11T05:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3859999999999999e-06 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474830+0000", 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5790000000000002e-06 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.505951+0000", 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031121328 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.505995+0000", 2024-09-11T05:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4175000000000003e-05 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506054+0000", 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8553e-05 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145921 3.18 3:1a554328:::rbd_data.112d9958e8ce.000000000000000a:1b [read 180224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6504123540000002, 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031340051000000001, 2024-09-11T05:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145921 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.16e-07 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474834+0000", 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.08e-06 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474837+0000", 2024-09-11T05:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.954e-06 2024-09-11T05:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474839+0000", 2024-09-11T05:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506080+0000", 2024-09-11T05:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031240232 2024-09-11T05:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506119+0000", 2024-09-11T05:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9065e-05 2024-09-11T05:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506173+0000", 2024-09-11T05:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4054000000000001e-05 2024-09-11T05:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145922 3.18 3:1a554328:::rbd_data.112d9958e8ce.000000000000000a:1b [read 200704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474842+0000", 2024-09-11T05:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.650402733, 2024-09-11T05:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031453192999999997, 2024-09-11T05:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145922 2024-09-11T05:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474842+0000", 2024-09-11T05:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474842+0000", 2024-09-11T05:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474843+0000", 2024-09-11T05:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.03e-07 2024-09-11T05:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474844+0000", 2024-09-11T05:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0589999999999999e-06 2024-09-11T05:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474847+0000", 2024-09-11T05:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3160000000000001e-06 2024-09-11T05:33:50.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474849+0000", 2024-09-11T05:33:50.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4549999999999998e-06 2024-09-11T05:33:50.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506196+0000", 2024-09-11T05:33:50.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031346442000000002 2024-09-11T05:33:50.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506239+0000", 2024-09-11T05:33:50.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3027e-05 2024-09-11T05:33:50.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506295+0000", 2024-09-11T05:33:50.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6691000000000003e-05 2024-09-11T05:33:50.215 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.215 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.215 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.216 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145933 3.18 3:1952fba0:::rbd_data.112d55d87bfc.0000000000000007:head [stat,truncate 155648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:33:50.216 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:33:50.216 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.6503929299999998, 2024-09-11T05:33:50.216 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.03262636, 2024-09-11T05:33:50.216 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:50.216 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:50.216 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:50.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:50.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:50.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:50.216 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145933 2024-09-11T05:33:50.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.217 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:50.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:50.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:33:50.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:50.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:33:50.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:50.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474853+0000", 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.17e-06 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474857+0000", 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1039999999999998e-06 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:50.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474860+0000", 2024-09-11T05:33:50.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8670000000000004e-06 2024-09-11T05:33:50.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:50.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506326+0000", 2024-09-11T05:33:50.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031465323000000003 2024-09-11T05:33:50.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:50.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506367+0000", 2024-09-11T05:33:50.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1155000000000002e-05 2024-09-11T05:33:50.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:50.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506445+0000", 2024-09-11T05:33:50.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8347000000000001e-05 2024-09-11T05:33:50.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:50.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507206+0000", 2024-09-11T05:33:50.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00076036099999999998 2024-09-11T05:33:50.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:50.221 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507390+0000", 2024-09-11T05:33:50.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00018462799999999999 2024-09-11T05:33:50.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:50.221 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507440+0000", 2024-09-11T05:33:50.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9604999999999997e-05 2024-09-11T05:33:50.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:50.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:50.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:50.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507478+0000", 2024-09-11T05:33:50.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8593999999999997e-05 2024-09-11T05:33:50.222 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.222 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.222 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.222 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:50.222 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:50.222 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:50.222 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:33:50.224 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:50.222+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:50.224 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:50.325 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:50.323+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:50.345 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:50.346 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:50.362 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:50.362 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:50.370 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:50.370 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:50.371 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:50.371 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:50.378 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:50.378 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:50.380 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:50.394 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:50.394 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:50.411 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:50.411 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:50.425 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:50.424+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:50.428 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:50.428 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:50.444 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:50.445 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:50.461 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:50.461 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:50.484 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:50.485 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:50.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:50.537 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:50.536+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:50.596 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:50.596 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:50.604 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:50.645 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:50.644+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:50.728 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:50.727+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:50.745 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:50.746 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:50.754 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:50.828 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:50.827+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:50.855 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 5, 6, 7] out_osds: [4, 3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:33:50.855 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:33:50.856 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-11T05:33:50.856 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T05:33:50.856 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T05:33:50.856 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-11T05:33:50.857 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:50.857 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:50.865 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:50.923 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone25 from 0xc43c684 (overlap 0x17c1f2) to 0x0 2024-09-11T05:33:50.929 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:50.928+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:50.983 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T05:33:50.983 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:51.012 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-11T05:33:51.021 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:51.021 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:51.029 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:51.030 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:51.030+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:51.131 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:51.130+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:51.156 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:51.156 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:51.168 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:51.232 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:51.232+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:51.317 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:51.317 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:51.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:51.333 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:51.333+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:51.339 INFO:teuthology.orchestra.run.smithi070.stdout:4141 write 0x63253cf thru 0x632ce95 (0x7ac7 bytes) 2024-09-11T05:33:51.350 INFO:teuthology.orchestra.run.smithi070.stdout:4143 write 0xc29191f thru 0xc29ab17 (0x91f9 bytes) 2024-09-11T05:33:51.360 INFO:teuthology.orchestra.run.smithi070.stdout:4144 write 0xc87e918 thru 0xc882599 (0x3c82 bytes) 2024-09-11T05:33:51.365 INFO:teuthology.orchestra.run.smithi070.stdout:4145 trunc from 0xc88259a to 0x9fb99fd 2024-09-11T05:33:51.386 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.386 INFO:teuthology.orchestra.run.smithi070.stdout:4148 punch from 0x4237a98 to 0x42452b6, (0xd81e bytes) 2024-09-11T05:33:51.387 INFO:teuthology.orchestra.run.smithi070.stdout:4149 read 0x83cb24e thru 0x83da665 (0xf418 bytes) 2024-09-11T05:33:51.390 INFO:teuthology.orchestra.run.smithi070.stdout:4150 trunc from 0x9fb99fd to 0xce93d9d 2024-09-11T05:33:51.395 INFO:teuthology.orchestra.run.smithi070.stdout:4151 read 0x537bf81 thru 0x5382537 (0x65b7 bytes) 2024-09-11T05:33:51.395 INFO:teuthology.orchestra.run.smithi070.stdout:4152 read 0x87fbfe9 thru 0x88052f7 (0x930f bytes) 2024-09-11T05:33:51.403 INFO:teuthology.orchestra.run.smithi070.stdout:4153 trunc from 0xce93d9d to 0x65d7fa9 2024-09-11T05:33:51.410 INFO:teuthology.orchestra.run.smithi070.stdout:4154 read 0x329e47e thru 0x32ad34d (0xeed0 bytes) 2024-09-11T05:33:51.411 INFO:teuthology.orchestra.run.smithi070.stdout:4156 writesame 0x642d679 thru 0x643a403 data_size 0x1(0xcd8b bytes) 2024-09-11T05:33:51.435 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:51.433+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:51.442 INFO:teuthology.orchestra.run.smithi070.stdout:4157 punch from 0x475fcb to 0x4831a8, (0xd1dd bytes) 2024-09-11T05:33:51.442 INFO:teuthology.orchestra.run.smithi070.stdout:4159 punch from 0x342e09e to 0x343168f, (0x35f1 bytes) 2024-09-11T05:33:51.443 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.443 INFO:teuthology.orchestra.run.smithi070.stdout:4162 read 0x2729ad6 thru 0x2735af0 (0xc01b bytes) 2024-09-11T05:33:51.443 INFO:teuthology.orchestra.run.smithi070.stdout:4164 punch from 0x42f6105 to 0x43059b5, (0xf8b0 bytes) 2024-09-11T05:33:51.443 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:51.443 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:51.456 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:51.457 INFO:teuthology.orchestra.run.smithi070.stdout:4165 write 0xcdfdf72 thru 0xcdffc7e (0x1d0d bytes) 2024-09-11T05:33:51.459 INFO:teuthology.orchestra.run.smithi070.stdout:4166 read 0x5e33167 thru 0x5e40167 (0xd001 bytes) 2024-09-11T05:33:51.459 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.459 INFO:teuthology.orchestra.run.smithi070.stdout:4170 read 0x3f5d741 thru 0x3f6cc62 (0xf522 bytes) 2024-09-11T05:33:51.460 INFO:teuthology.orchestra.run.smithi070.stdout:4172 writesame 0xb7d66b thru 0xb8d13f data_size 0x1(0xfad5 bytes) 2024-09-11T05:33:51.508 INFO:teuthology.orchestra.run.smithi070.stdout:4174 write 0xce90f44 thru 0xce9f2ca (0xe387 bytes) 2024-09-11T05:33:51.511 INFO:teuthology.orchestra.run.smithi070.stdout:4176 read 0x33d1a4 thru 0x34830e (0xb16b bytes) 2024-09-11T05:33:51.513 INFO:teuthology.orchestra.run.smithi070.stdout:4177 trunc from 0xce9f2cb to 0xb5b5c1b 2024-09-11T05:33:51.526 INFO:teuthology.orchestra.run.smithi070.stdout:4178 write 0x6359cf2 thru 0x635a24f (0x55e bytes) 2024-09-11T05:33:51.527 INFO:teuthology.orchestra.run.smithi070.stdout:4179 punch from 0x3964bce to 0x396dbcf, (0x9001 bytes) 2024-09-11T05:33:51.527 INFO:teuthology.orchestra.run.smithi070.stdout:4180 read 0x932be56 thru 0x932e485 (0x2630 bytes) 2024-09-11T05:33:51.534 INFO:teuthology.orchestra.run.smithi070.stdout:4181 writesame 0xcb3e713 thru 0xcb403fa data_size 0x28(0x1ce8 bytes) 2024-09-11T05:33:51.534 INFO:teuthology.orchestra.run.smithi070.stdout:4185 writesame 0x82c6be thru 0x82cd9c data_size 0x1(0x6df bytes) 2024-09-11T05:33:51.535 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:51.535+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:51.536 INFO:teuthology.orchestra.run.smithi070.stdout:4186 write 0x96b3102 thru 0x96bdb00 (0xa9ff bytes) 2024-09-11T05:33:51.538 INFO:teuthology.orchestra.run.smithi070.stdout:4187 read 0x6616108 thru 0x661fefe (0x9df7 bytes) 2024-09-11T05:33:51.538 INFO:teuthology.orchestra.run.smithi070.stdout:4188 write 0xb94b51b thru 0xb9569ac (0xb492 bytes) 2024-09-11T05:33:51.540 INFO:teuthology.orchestra.run.smithi070.stdout:4189 read 0x2dc599b thru 0x2dd30dc (0xd742 bytes) 2024-09-11T05:33:51.541 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.541 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.541 INFO:teuthology.orchestra.run.smithi070.stdout:4192 writesame 0xbba0f76 thru 0xbba90d7 data_size 0x1(0x8162 bytes) 2024-09-11T05:33:51.575 INFO:teuthology.orchestra.run.smithi070.stdout:4194 trunc from 0xcb403fb to 0x1ebc930 2024-09-11T05:33:51.578 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:51.578 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:51.593 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:51.621 INFO:teuthology.orchestra.run.smithi070.stdout:4195 write 0x9a04bd4 thru 0x9a0e9e1 (0x9e0e bytes) 2024-09-11T05:33:51.624 INFO:teuthology.orchestra.run.smithi070.stdout:4196 read 0x388b9e9 thru 0x38995fd (0xdc15 bytes) 2024-09-11T05:33:51.624 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.624 INFO:teuthology.orchestra.run.smithi070.stdout:4199 read 0x8ecfb11 thru 0x8ed6a4a (0x6f3a bytes) 2024-09-11T05:33:51.625 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.625 INFO:teuthology.orchestra.run.smithi070.stdout:4202 punch from 0x3583287 to 0x3585ffa, (0x2d73 bytes) 2024-09-11T05:33:51.625 INFO:teuthology.orchestra.run.smithi070.stdout:4203 read 0x1f4e8c3 thru 0x1f5bbde (0xd31c bytes) 2024-09-11T05:33:51.625 INFO:teuthology.orchestra.run.smithi070.stdout:4204 writesame 0x8b3c4f7 thru 0x8b417d6 data_size 0x11(0x52e0 bytes) 2024-09-11T05:33:51.635 INFO:teuthology.orchestra.run.smithi070.stdout:4205 trunc from 0x9a0e9e2 to 0x2785fa0 2024-09-11T05:33:51.636 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:51.634+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:51.646 INFO:teuthology.orchestra.run.smithi070.stdout:4206 writesame 0x21e39d thru 0x226a56 data_size 0x5(0x86ba bytes) 2024-09-11T05:33:51.651 INFO:teuthology.orchestra.run.smithi070.stdout:4207 read 0x1636603 thru 0x164342b (0xce29 bytes) 2024-09-11T05:33:51.657 INFO:teuthology.orchestra.run.smithi070.stdout:4210 write 0x291f2ce thru 0x292ac70 (0xb9a3 bytes) 2024-09-11T05:33:51.659 INFO:teuthology.orchestra.run.smithi070.stdout:4211 punch from 0x25ff978 to 0x260b2cb, (0xb953 bytes) 2024-09-11T05:33:51.659 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.659 INFO:teuthology.orchestra.run.smithi070.stdout:4213 punch from 0xf45abf to 0xf4b8de, (0x5e1f bytes) 2024-09-11T05:33:51.669 INFO:teuthology.orchestra.run.smithi070.stdout:4215 write 0x65d1a98 thru 0x65d37e9 (0x1d52 bytes) 2024-09-11T05:33:51.672 INFO:teuthology.orchestra.run.smithi070.stdout:4216 read 0x4bf6902 thru 0x4c04c5b (0xe35a bytes) 2024-09-11T05:33:51.672 INFO:teuthology.orchestra.run.smithi070.stdout:4218 read 0x1ff0624 thru 0x1ff2970 (0x234d bytes) 2024-09-11T05:33:51.681 INFO:teuthology.orchestra.run.smithi070.stdout:4219 write 0x87c9932 thru 0x87d430b (0xa9da bytes) 2024-09-11T05:33:51.683 INFO:teuthology.orchestra.run.smithi070.stdout:4220 write 0x79312de thru 0x793beb3 (0xabd6 bytes) 2024-09-11T05:33:51.686 INFO:teuthology.orchestra.run.smithi070.stdout:4221 writesame 0x6a2d655 thru 0x6a308eb data_size 0x1(0x3297 bytes) 2024-09-11T05:33:51.695 INFO:teuthology.orchestra.run.smithi070.stdout:4222 write 0x1d23a68 thru 0x1d30c38 (0xd1d1 bytes) 2024-09-11T05:33:51.705 INFO:teuthology.orchestra.run.smithi070.stdout:4224 write 0xaef98ae thru 0xaf020fd (0x8850 bytes) 2024-09-11T05:33:51.707 INFO:teuthology.orchestra.run.smithi070.stdout:4225 read 0x15dfe16 thru 0x15e6758 (0x6943 bytes) 2024-09-11T05:33:51.707 INFO:teuthology.orchestra.run.smithi070.stdout:4228 punch from 0x6abd385 to 0x6ac5ee0, (0x8b5b bytes) 2024-09-11T05:33:51.715 INFO:teuthology.orchestra.run.smithi070.stdout:4231 write 0xc9835df thru 0xc98ecf5 (0xb717 bytes) 2024-09-11T05:33:51.719 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.719 INFO:teuthology.orchestra.run.smithi070.stdout:4234 write 0x67b3679 thru 0x67b89e6 (0x536e bytes) 2024-09-11T05:33:51.720 INFO:teuthology.orchestra.run.smithi070.stdout:4235 write 0x2a5f020 thru 0x2a69a60 (0xaa41 bytes) 2024-09-11T05:33:51.721 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.728 INFO:teuthology.orchestra.run.smithi070.stdout:4238 write 0xdaaa40d thru 0xdab1e3b (0x7a2f bytes) 2024-09-11T05:33:51.730 INFO:teuthology.orchestra.run.smithi070.stdout:4239 writesame 0x949fa0b thru 0x94aed48 data_size 0x41(0xf33e bytes) 2024-09-11T05:33:51.737 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:51.737+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:51.739 INFO:teuthology.orchestra.run.smithi070.stdout:4240 trunc from 0xdab1e3c to 0x882e743 2024-09-11T05:33:51.754 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:51.754 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:51.756 INFO:teuthology.orchestra.run.smithi070.stdout:4241 trunc from 0x882e743 to 0xc9652ca 2024-09-11T05:33:51.761 INFO:teuthology.orchestra.run.smithi070.stdout:4242 punch from 0xb4084d2 to 0xb412365, (0x9e93 bytes) 2024-09-11T05:33:51.761 INFO:teuthology.orchestra.run.smithi070.stdout:4248 writesame 0x570ef08 thru 0x57121fa data_size 0x1(0x32f3 bytes) 2024-09-11T05:33:51.765 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:51.776 INFO:teuthology.orchestra.run.smithi070.stdout:4249 write 0xcc544a3 thru 0xcc60682 (0xc1e0 bytes) 2024-09-11T05:33:51.778 INFO:teuthology.orchestra.run.smithi070.stdout:4251 writesame 0x711c2b1 thru 0x712a26b data_size 0x4f(0xdfbb bytes) 2024-09-11T05:33:51.780 INFO:teuthology.orchestra.run.smithi070.stdout:4252 punch from 0xb614996 to 0xb621989, (0xcff3 bytes) 2024-09-11T05:33:51.780 INFO:teuthology.orchestra.run.smithi070.stdout:4253 write 0xac561f1 thru 0xac5b931 (0x5741 bytes) 2024-09-11T05:33:51.789 INFO:teuthology.orchestra.run.smithi070.stdout:4254 write 0xdd11c35 thru 0xdd175f0 (0x59bc bytes) 2024-09-11T05:33:51.791 INFO:teuthology.orchestra.run.smithi070.stdout:4256 read 0x23d3ffd thru 0x23dfa7b (0xba7f bytes) 2024-09-11T05:33:51.791 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.792 INFO:teuthology.orchestra.run.smithi070.stdout:4258 write 0x2cfc0f5 thru 0x2d04567 (0x8473 bytes) 2024-09-11T05:33:51.793 INFO:teuthology.orchestra.run.smithi070.stdout:4260 punch from 0x5598f12 to 0x5599511, (0x5ff bytes) 2024-09-11T05:33:51.794 INFO:teuthology.orchestra.run.smithi070.stdout:4261 trunc from 0xdd175f1 to 0xe7abbe7 2024-09-11T05:33:51.799 INFO:teuthology.orchestra.run.smithi070.stdout:4263 trunc from 0xe7abbe7 to 0xdc2e72c 2024-09-11T05:33:51.807 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.807 INFO:teuthology.orchestra.run.smithi070.stdout:4268 write 0x3b9244 thru 0x3b9b2d (0x8ea bytes) 2024-09-11T05:33:51.808 INFO:teuthology.orchestra.run.smithi070.stdout:4269 read 0x631c6b3 thru 0x632b2b7 (0xec05 bytes) 2024-09-11T05:33:51.809 INFO:teuthology.orchestra.run.smithi070.stdout:4270 read 0x169d763 thru 0x16aaa50 (0xd2ee bytes) 2024-09-11T05:33:51.809 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.809 INFO:teuthology.orchestra.run.smithi070.stdout:4272 punch from 0xa08d1ea to 0xa08f370, (0x2186 bytes) 2024-09-11T05:33:51.816 INFO:teuthology.orchestra.run.smithi070.stdout:4273 write 0xea4e04d thru 0xea4f8b1 (0x1865 bytes) 2024-09-11T05:33:51.817 INFO:teuthology.orchestra.run.smithi070.stdout:4275 write 0xc27ea86 thru 0xc2834da (0x4a55 bytes) 2024-09-11T05:33:51.819 INFO:teuthology.orchestra.run.smithi070.stdout:4277 punch from 0x8ab2a6e to 0x8abb6d2, (0x8c64 bytes) 2024-09-11T05:33:51.819 INFO:teuthology.orchestra.run.smithi070.stdout:4278 read 0x776e8b1 thru 0x7776621 (0x7d71 bytes) 2024-09-11T05:33:51.819 INFO:teuthology.orchestra.run.smithi070.stdout:4280 read 0x97ee5e3 thru 0x97f459f (0x5fbd bytes) 2024-09-11T05:33:51.820 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.824 INFO:teuthology.orchestra.run.smithi070.stdout:4283 trunc from 0xea4f8b2 to 0xaa414c1 2024-09-11T05:33:51.835 INFO:teuthology.orchestra.run.smithi070.stdout:4286 read 0x947d453 thru 0x9483a53 (0x6601 bytes) 2024-09-11T05:33:51.835 INFO:teuthology.orchestra.run.smithi070.stdout:4288 read 0x343e7f6 thru 0x344d4c7 (0xecd2 bytes) 2024-09-11T05:33:51.835 INFO:teuthology.orchestra.run.smithi070.stdout:4290 writesame 0x830673 thru 0x834037 data_size 0x1(0x39c5 bytes) 2024-09-11T05:33:51.837 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:51.836+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:51.845 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.855 INFO:teuthology.orchestra.run.smithi070.stdout:4292 write 0xd906db9 thru 0xd9144aa (0xd6f2 bytes) 2024-09-11T05:33:51.857 INFO:teuthology.orchestra.run.smithi070.stdout:4293 writesame 0xcaa6fdd thru 0xcaaf840 data_size 0x1d(0x8864 bytes) 2024-09-11T05:33:51.859 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.860 INFO:teuthology.orchestra.run.smithi070.stdout:4295 read 0x386e9f7 thru 0x3877c96 (0x92a0 bytes) 2024-09-11T05:33:51.860 INFO:teuthology.orchestra.run.smithi070.stdout:4296 write 0x1ae3023 thru 0x1ae67e6 (0x37c4 bytes) 2024-09-11T05:33:51.861 INFO:teuthology.orchestra.run.smithi070.stdout:4297 read 0xb8c66e1 thru 0xb8d4570 (0xde90 bytes) 2024-09-11T05:33:51.862 INFO:teuthology.orchestra.run.smithi070.stdout:4298 punch from 0xa7df736 to 0xa7e0c03, (0x14cd bytes) 2024-09-11T05:33:51.862 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.862 INFO:teuthology.orchestra.run.smithi070.stdout:4301 read 0xe3ec70 thru 0xe452f8 (0x6689 bytes) 2024-09-11T05:33:51.862 INFO:teuthology.orchestra.run.smithi070.stdout:4302 write 0x46ee8ee thru 0x46f4ae4 (0x61f7 bytes) 2024-09-11T05:33:51.864 INFO:teuthology.orchestra.run.smithi070.stdout:4303 punch from 0x444f9ab to 0x4450217, (0x86c bytes) 2024-09-11T05:33:51.864 INFO:teuthology.orchestra.run.smithi070.stdout:4304 write 0x7d957ff thru 0x7da3262 (0xda64 bytes) 2024-09-11T05:33:51.866 INFO:teuthology.orchestra.run.smithi070.stdout:4305 read 0xa35529a thru 0xa35cdcb (0x7b32 bytes) 2024-09-11T05:33:51.866 INFO:teuthology.orchestra.run.smithi070.stdout:4307 read 0x81415b6 thru 0x8141f67 (0x9b2 bytes) 2024-09-11T05:33:51.867 INFO:teuthology.orchestra.run.smithi070.stdout:4308 read 0x37f1a63 thru 0x37f7554 (0x5af2 bytes) 2024-09-11T05:33:51.867 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.867 INFO:teuthology.orchestra.run.smithi070.stdout:4312 writesame 0x2d8651f thru 0x2d90098 data_size 0x7(0x9b7a bytes) 2024-09-11T05:33:51.872 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.872 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:51.876 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:33:51.876 INFO:teuthology.orchestra.run.smithi070.stdout:4315 trunc from 0xd9144ab to 0xab573ce 2024-09-11T05:33:51.896 INFO:teuthology.orchestra.run.smithi070.stdout:4316 write 0xca4b07d thru 0xca525b3 (0x7537 bytes) 2024-09-11T05:33:51.901 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:51.901 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:51.909 INFO:teuthology.orchestra.run.smithi070.stdout:4317 trunc from 0xca525b4 to 0x45be8ea 2024-09-11T05:33:51.915 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:51.921 INFO:teuthology.orchestra.run.smithi070.stdout:4318 write 0x2b2da13 thru 0x2b3b2a8 (0xd896 bytes) 2024-09-11T05:33:51.930 INFO:teuthology.orchestra.run.smithi070.stdout:4319 writesame 0x6282373 thru 0x6283bdf data_size 0xd(0x186d bytes) 2024-09-11T05:33:51.931 INFO:teuthology.orchestra.run.smithi070.stdout:4320 write 0x3a0abb6 thru 0x3a131f0 (0x863b bytes) 2024-09-11T05:33:51.933 INFO:teuthology.orchestra.run.smithi070.stdout:4321 read 0x504c66e thru 0x504f3a3 (0x2d36 bytes) 2024-09-11T05:33:51.933 INFO:teuthology.orchestra.run.smithi070.stdout:4322 writesame 0x443eb96 thru 0x4446dff data_size 0x1(0x826a bytes) 2024-09-11T05:33:51.938 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:51.936+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:51.966 INFO:teuthology.orchestra.run.smithi070.stdout:4326 writesame 0xde1c13f thru 0xde293f1 data_size 0x1(0xd2b3 bytes) 2024-09-11T05:33:51.966 INFO:teuthology.orchestra.run.smithi070.stdout:4327 read 0x5ded256 thru 0x5def084 (0x1e2f bytes) 2024-09-11T05:33:51.966 INFO:teuthology.orchestra.run.smithi070.stdout:4328 punch from 0x90576c5 to 0x905f4b4, (0x7def bytes) 2024-09-11T05:33:51.966 INFO:teuthology.orchestra.run.smithi070.stdout:4330 writesame 0xc23f266 thru 0xc24933e data_size 0x1(0xa0d9 bytes) 2024-09-11T05:33:51.990 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:52.004 INFO:teuthology.orchestra.run.smithi070.stdout:4332 trunc from 0xde293f2 to 0x2860b39 2024-09-11T05:33:52.019 INFO:teuthology.orchestra.run.smithi070.stdout:4334 clone 27 order 20 su 16384 sc 13 2024-09-11T05:33:52.038 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:52.038 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:52.039 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:52.039+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:52.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:52.139 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:52.138+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:52.192 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:52.192 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:52.201 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:52.243 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:52.241+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:52.341 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:52.340+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:52.344 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:52.344 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:52.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:52.442 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:52.441+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:52.473 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:33:52.497 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:52.497 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:52.506 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:52.547 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:52.546+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:52.596 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:52.597 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:52.614 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:52.614 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:52.630 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:52.630 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:52.644 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:52.644+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:52.646 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:52.646 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:52.654 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:52.654 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:52.654 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:52.654 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:52.663 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:52.664 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:52.664 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:52.680 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:52.680 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:52.744 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:52.743+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:52.768 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:33:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.177210192999993, 2024-09-11T05:33:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:33:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:33:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:33:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:33:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:33:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:33:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:33:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:33:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.600274933000001, 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:33:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:33:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.600256133999999, 2024-09-11T05:33:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:33:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:33:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:33:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:33:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:33:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:33:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.600232103, 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:33:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.600155314999999, 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:33:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:33:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:33:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:33:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:33:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:33:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:33:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:33:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:33:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.600127992000001, 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.600109444000001, 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:33:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:33:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:33:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:33:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.600091373000001, 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:33:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:33:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:33:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:33:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:33:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:33:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:33:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:33:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:33:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:33:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.598493730000001, 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:33:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:33:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:33:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:33:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:33:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:33:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:33:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:33:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.598473404, 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:33:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:33:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:33:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:33:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:33:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:33:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:33:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:33:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.598434405999999, 2024-09-11T05:33:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:33:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:33:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:33:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:33:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:33:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:33:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:33:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:33:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:33:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:33:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:33:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.598413764, 2024-09-11T05:33:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:33:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:33:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:33:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:33:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:33:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:33:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:33:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:33:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:33:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:33:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.598290900999999, 2024-09-11T05:33:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:33:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:33:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:33:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:33:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:33:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:33:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:33:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:33:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:33:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:33:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.598131343999999, 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:33:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:33:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:33:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:33:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:33:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.596446676999999, 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:33:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:33:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.596418671999999, 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:33:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:33:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:33:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:33:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:33:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:33:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:33:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44388 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8118272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:33:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.595027339000001, 2024-09-11T05:33:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044546074999999997, 2024-09-11T05:33:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44388 2024-09-11T05:33:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:33:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172487+0000", 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172490+0000", 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5090000000000002e-06 2024-09-11T05:33:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172497+0000", 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172502+0000", 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2000000000000002e-06 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216878+0000", 2024-09-11T05:33:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044375900000000003 2024-09-11T05:33:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216925+0000", 2024-09-11T05:33:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7058999999999998e-05 2024-09-11T05:33:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216982+0000", 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6932000000000003e-05 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.594952208999999, 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:33:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:33:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:33:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:33:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:33:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:33:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:33:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:33:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:33:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:33:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:33:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:33:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.594766908, 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:33:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:33:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:33:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:33:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:33:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:33:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:33:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:33:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.594595453, 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:33:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:33:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:33:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:33:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:33:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:33:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:33:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:33:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:33:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:33:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:33:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:33:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:52.863 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:52.864 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:52.865 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:52.862+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:52.870 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T05:33:52.898 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:52.898 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:52.916 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:52.917 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:52.929 INFO:teuthology.orchestra.run.smithi070.stdout:leaving image image_client.0-clone26 intact 2024-09-11T05:33:52.965 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:52.965+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:52.977 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:52.977 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:52.977 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:52.977 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:52.986 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:52.990 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-11T05:33:53.001 INFO:teuthology.orchestra.run.smithi070.stdout:4335 write 0x3748684 thru 0x3757114 (0xea91 bytes) 2024-09-11T05:33:53.014 INFO:teuthology.orchestra.run.smithi070.stdout:4336 punch from 0xfd1ae9 to 0xfdf696, (0xdbad bytes) 2024-09-11T05:33:53.014 INFO:teuthology.orchestra.run.smithi070.stdout:4337 read 0xcc19c1 thru 0xcc93db (0x7a1b bytes) 2024-09-11T05:33:53.014 INFO:teuthology.orchestra.run.smithi070.stdout:4340 write 0x240fa67 thru 0x2413501 (0x3a9b bytes) 2024-09-11T05:33:53.044 INFO:teuthology.orchestra.run.smithi070.stdout:4341 writesame 0xb5998db thru 0xb5a686a data_size 0x9(0xcf90 bytes) 2024-09-11T05:33:53.044 INFO:teuthology.orchestra.run.smithi070.stdout:4342 write 0x7790335 thru 0x779cf6c (0xcc38 bytes) 2024-09-11T05:33:53.053 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:53.053 INFO:teuthology.orchestra.run.smithi070.stdout:4344 punch from 0x57c1d66 to 0x57c6362, (0x45fc bytes) 2024-09-11T05:33:53.053 INFO:teuthology.orchestra.run.smithi070.stdout:4345 write 0xf1ad3b thru 0xf1c699 (0x195f bytes) 2024-09-11T05:33:53.066 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:53.065+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:53.080 INFO:teuthology.orchestra.run.smithi070.stdout:4347 write 0xd5a8c38 thru 0xd5b2be9 (0x9fb2 bytes) 2024-09-11T05:33:53.092 INFO:teuthology.orchestra.run.smithi070.stdout:4348 writesame 0xdc36649 thru 0xdc45362 data_size 0x59(0xed1a bytes) 2024-09-11T05:33:53.092 INFO:teuthology.orchestra.run.smithi070.stdout:4349 write 0x68efcec thru 0x68f3842 (0x3b57 bytes) 2024-09-11T05:33:53.095 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:53.095 INFO:teuthology.orchestra.run.smithi070.stdout:4352 punch from 0x9d7c443 to 0x9d85924, (0x94e1 bytes) 2024-09-11T05:33:53.095 INFO:teuthology.orchestra.run.smithi070.stdout:4353 read 0xdaa9006 thru 0xdab8013 (0xf00e bytes) 2024-09-11T05:33:53.110 INFO:teuthology.orchestra.run.smithi070.stdout:4354 trunc from 0xdc45363 to 0x1251250 2024-09-11T05:33:53.160 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:53.160 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:53.160 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:53.160 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:53.160 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:53.166 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:53.166+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:53.171 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:53.187 INFO:teuthology.orchestra.run.smithi070.stdout:4355 trunc from 0x1251250 to 0x8ad570f 2024-09-11T05:33:53.194 INFO:teuthology.orchestra.run.smithi070.stdout:4357 read 0x84058ec thru 0x8410e84 (0xb599 bytes) 2024-09-11T05:33:53.202 INFO:teuthology.orchestra.run.smithi070.stdout:4358 trunc from 0x8ad570f to 0x1e47f6c 2024-09-11T05:33:53.208 INFO:teuthology.orchestra.run.smithi070.stdout:4360 trunc from 0x1e47f6c to 0x1949767 2024-09-11T05:33:53.215 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:53.215 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:53.232 INFO:teuthology.orchestra.run.smithi070.stdout:4363 writesame 0x9ae2fc4 thru 0x9ae82af data_size 0x74(0x52ec bytes) 2024-09-11T05:33:53.232 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:53.236 INFO:teuthology.orchestra.run.smithi070.stdout:4365 trunc from 0x9ae82b0 to 0x63c3fa5 2024-09-11T05:33:53.241 INFO:teuthology.orchestra.run.smithi070.stdout:4366 read 0x2d41b44 thru 0x2d4bb02 (0x9fbf bytes) 2024-09-11T05:33:53.241 INFO:teuthology.orchestra.run.smithi070.stdout:4368 writesame 0x6244f0d thru 0x6245e90 data_size 0x4(0xf84 bytes) 2024-09-11T05:33:53.260 INFO:teuthology.orchestra.run.smithi070.stdout:4369 write 0xd9cab96 thru 0xd9cdc0f (0x307a bytes) 2024-09-11T05:33:53.264 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:53.264 INFO:teuthology.orchestra.run.smithi070.stdout:4372 writesame 0xd918a0 thru 0xd9fa7f data_size 0x10(0xe1e0 bytes) 2024-09-11T05:33:53.267 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:53.267+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:53.268 INFO:teuthology.orchestra.run.smithi070.stdout:4374 write 0xd2cfe48 thru 0xd2d947b (0x9634 bytes) 2024-09-11T05:33:53.274 INFO:teuthology.orchestra.run.smithi070.stdout:4375 read 0x484df3f thru 0x4854fd2 (0x7094 bytes) 2024-09-11T05:33:53.274 INFO:teuthology.orchestra.run.smithi070.stdout:4377 punch from 0x8387058 to 0x8391669, (0xa611 bytes) 2024-09-11T05:33:53.274 INFO:teuthology.orchestra.run.smithi070.stdout:4378 punch from 0x3cff51e to 0x3d00335, (0xe17 bytes) 2024-09-11T05:33:53.274 INFO:teuthology.orchestra.run.smithi070.stdout:4379 writesame 0x6d4fc5 thru 0x6d7b5b data_size 0x1(0x2b97 bytes) 2024-09-11T05:33:53.289 INFO:teuthology.orchestra.run.smithi070.stdout:4381 punch from 0x9ac973d to 0x9ace887, (0x514a bytes) 2024-09-11T05:33:53.290 INFO:teuthology.orchestra.run.smithi070.stdout:4383 writesame 0xc6701b1 thru 0xc67782c data_size 0x2(0x767c bytes) 2024-09-11T05:33:53.299 INFO:teuthology.orchestra.run.smithi070.stdout:4384 write 0x17daecc thru 0x17e3778 (0x88ad bytes) 2024-09-11T05:33:53.301 INFO:teuthology.orchestra.run.smithi070.stdout:4385 writesame 0x3db7a14 thru 0x3dbbba3 data_size 0x8(0x4190 bytes) 2024-09-11T05:33:53.305 INFO:teuthology.orchestra.run.smithi070.stdout:4386 write 0x70a1df1 thru 0x70a1f19 (0x129 bytes) 2024-09-11T05:33:53.308 INFO:teuthology.orchestra.run.smithi070.stdout:4387 write 0xd2cf8e3 thru 0xd2d6eaa (0x75c8 bytes) 2024-09-11T05:33:53.310 INFO:teuthology.orchestra.run.smithi070.stdout:4388 write 0x114b03a thru 0x115881e (0xd7e5 bytes) 2024-09-11T05:33:53.323 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:53.323 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:53.324 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:53.324 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:33:53.324 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:53.324 INFO:teuthology.orchestra.run.smithi070.stdout:4389 trunc from 0xd9cdc10 to 0x33791c3 2024-09-11T05:33:53.333 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:53.337 INFO:teuthology.orchestra.run.smithi070.stdout:4390 punch from 0x20d4506 to 0x20df522, (0xb01c bytes) 2024-09-11T05:33:53.337 INFO:teuthology.orchestra.run.smithi070.stdout:4391 punch from 0x1a65f7a to 0x1a688c4, (0x294a bytes) 2024-09-11T05:33:53.337 INFO:teuthology.orchestra.run.smithi070.stdout:4392 writesame 0x8ab999 thru 0x8b0d4a data_size 0x3(0x53b2 bytes) 2024-09-11T05:33:53.354 INFO:teuthology.orchestra.run.smithi070.stdout:4394 punch from 0xfaeefc to 0xfba122, (0xb226 bytes) 2024-09-11T05:33:53.354 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:53.372 INFO:teuthology.orchestra.run.smithi070.stdout:4396 writesame 0xe242c98 thru 0xe24eb32 data_size 0x5(0xbe9b bytes) 2024-09-11T05:33:53.372 INFO:teuthology.orchestra.run.smithi070.stdout:4397 write 0x6453c0e thru 0x6453c4f (0x42 bytes) 2024-09-11T05:33:53.374 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:53.374+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:53.375 INFO:teuthology.orchestra.run.smithi070.stdout:4398 writesame 0x86578f2 thru 0x866596a data_size 0xf(0xe079 bytes) 2024-09-11T05:33:53.386 INFO:teuthology.orchestra.run.smithi070.stdout:4399 punch from 0x46eee63 to 0x46f9929, (0xaac6 bytes) 2024-09-11T05:33:53.386 INFO:teuthology.orchestra.run.smithi070.stdout:4401 write 0x14a2e10 thru 0x14ad1f3 (0xa3e4 bytes) 2024-09-11T05:33:53.388 INFO:teuthology.orchestra.run.smithi070.stdout:4403 read 0xb3ed2b1 thru 0xb3f46cc (0x741c bytes) 2024-09-11T05:33:53.388 INFO:teuthology.orchestra.run.smithi070.stdout:4404 writesame 0xa10b29a thru 0xa11a2ba data_size 0x1f(0xf021 bytes) 2024-09-11T05:33:53.395 INFO:teuthology.orchestra.run.smithi070.stdout:4405 punch from 0x5e1c17 to 0x5e82ec, (0x66d5 bytes) 2024-09-11T05:33:53.400 INFO:teuthology.orchestra.run.smithi070.stdout:4406 writesame 0xe738fc9 thru 0xe742126 data_size 0x17(0x915e bytes) 2024-09-11T05:33:53.401 INFO:teuthology.orchestra.run.smithi070.stdout:4407 read 0x4cb5ae thru 0x4cd8b7 (0x230a bytes) 2024-09-11T05:33:53.401 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:53.401 INFO:teuthology.orchestra.run.smithi070.stdout:4410 writesame 0x1d8bbbf thru 0x1d9090b data_size 0xb(0x4d4d bytes) 2024-09-11T05:33:53.408 INFO:teuthology.orchestra.run.smithi070.stdout:4411 write 0xd173268 thru 0xd17c18d (0x8f26 bytes) 2024-09-11T05:33:53.416 INFO:teuthology.orchestra.run.smithi070.stdout:4413 writesame 0x6917c6d thru 0x6923f25 data_size 0x1(0xc2b9 bytes) 2024-09-11T05:33:53.447 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:53.447 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:53.447 INFO:teuthology.orchestra.run.smithi070.stdout:4416 writesame 0xa3e7b61 thru 0xa3eb56c data_size 0xa(0x3a0c bytes) 2024-09-11T05:33:53.449 INFO:teuthology.orchestra.run.smithi070.stdout:4417 writesame 0x78d125d thru 0x78d9929 data_size 0x1(0x86cd bytes) 2024-09-11T05:33:53.469 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:53.469+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:53.472 INFO:teuthology.orchestra.run.smithi070.stdout:4418 read 0x76fed6c thru 0x76ffe73 (0x1108 bytes) 2024-09-11T05:33:53.477 INFO:teuthology.orchestra.run.smithi070.stdout:4419 trunc from 0xe742127 to 0xb691bd1 2024-09-11T05:33:53.485 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:53.485 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:53.485 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:53.485 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:53.492 INFO:teuthology.orchestra.run.smithi070.stdout:4420 punch from 0x589c27b to 0x58a08e7, (0x466c bytes) 2024-09-11T05:33:53.494 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:53.500 INFO:teuthology.orchestra.run.smithi070.stdout:4421 write 0xca4ddf3 thru 0xca5523b (0x7449 bytes) 2024-09-11T05:33:53.509 INFO:teuthology.orchestra.run.smithi070.stdout:4422 punch from 0x12f6e2b to 0x12fbbb9, (0x4d8e bytes) 2024-09-11T05:33:53.509 INFO:teuthology.orchestra.run.smithi070.stdout:4423 writesame 0xa9dde9c thru 0xa9e4307 data_size 0x2(0x646c bytes) 2024-09-11T05:33:53.518 INFO:teuthology.orchestra.run.smithi070.stdout:4424 clone 28 order 23 su 262144 sc 15 2024-09-11T05:33:53.570 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:53.569+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:53.639 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:53.639 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:53.639 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:53.639 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:53.639 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:53.648 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:53.691 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:53.691+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:53.753 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:53.753 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:53.753 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:53.753 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:53.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.753 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45829 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 6995968~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.754 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:53.754 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.384760739000001, 2024-09-11T05:33:53.754 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031286190999999998, 2024-09-11T05:33:53.754 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.754 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.754 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.754 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.754 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.754 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.754 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45829 2024-09-11T05:33:53.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.754 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:33:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366836+0000", 2024-09-11T05:33:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4199999999999996e-07 2024-09-11T05:33:53.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.756 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.756 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366838+0000", 2024-09-11T05:33:53.756 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9929999999999998e-06 2024-09-11T05:33:53.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.756 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.756 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366844+0000", 2024-09-11T05:33:53.756 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0430000000000004e-06 2024-09-11T05:33:53.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.756 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.757 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366848+0000", 2024-09-11T05:33:53.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6040000000000003e-06 2024-09-11T05:33:53.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.757 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.757 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.757 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398029+0000", 2024-09-11T05:33:53.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031180349 2024-09-11T05:33:53.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.757 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.757 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.757 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398070+0000", 2024-09-11T05:33:53.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1421999999999997e-05 2024-09-11T05:33:53.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.758 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.758 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398121+0000", 2024-09-11T05:33:53.758 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1238e-05 2024-09-11T05:33:53.758 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.758 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.758 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.758 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45830 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7045120~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.758 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:53.758 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.384741168000001, 2024-09-11T05:33:53.758 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031383187999999999, 2024-09-11T05:33:53.759 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.759 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.759 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.759 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.759 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.759 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.759 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45830 2024-09-11T05:33:53.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.759 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.759 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.759 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.759 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.51e-07 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.760 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.761 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366857+0000", 2024-09-11T05:33:53.761 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9259999999999999e-06 2024-09-11T05:33:53.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.761 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.761 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.761 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366863+0000", 2024-09-11T05:33:53.761 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7069999999999997e-06 2024-09-11T05:33:53.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.761 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.761 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.761 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366868+0000", 2024-09-11T05:33:53.761 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7380000000000002e-06 2024-09-11T05:33:53.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.762 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.762 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398147+0000", 2024-09-11T05:33:53.762 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031279757999999998 2024-09-11T05:33:53.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.762 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.762 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398189+0000", 2024-09-11T05:33:53.762 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1597999999999997e-05 2024-09-11T05:33:53.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.762 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398238+0000", 2024-09-11T05:33:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.901e-05 2024-09-11T05:33:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45831 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7094272~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.384722041, 2024-09-11T05:33:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031481960000000003, 2024-09-11T05:33:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45831 2024-09-11T05:33:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:33:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4200000000000002e-07 2024-09-11T05:33:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366876+0000", 2024-09-11T05:33:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0020000000000001e-06 2024-09-11T05:33:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366882+0000", 2024-09-11T05:33:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7690000000000002e-06 2024-09-11T05:33:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366887+0000", 2024-09-11T05:33:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119999999999999e-06 2024-09-11T05:33:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398263+0000", 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031376023000000003 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398306+0000", 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3220999999999998e-05 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398356+0000", 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.768 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.768 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.768 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45832 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7143424~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.768 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:53.768 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.384703421000001, 2024-09-11T05:33:53.768 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031581625000000002, 2024-09-11T05:33:53.768 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.768 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.768 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.768 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.768 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.768 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45832 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367199+0000", 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00030624 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367205+0000", 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1090000000000003e-06 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367213+0000", 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8979999999999996e-06 2024-09-11T05:33:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367219+0000", 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398380+0000", 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031160931999999999 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398425+0000", 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4548000000000001e-05 2024-09-11T05:33:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.772 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.772 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.772 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398474+0000", 2024-09-11T05:33:53.772 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9298000000000001e-05 2024-09-11T05:33:53.772 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.772 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.772 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.772 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.772 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45833 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7192576~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.772 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:53.772 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.384362136, 2024-09-11T05:33:53.773 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031369229999999998, 2024-09-11T05:33:53.773 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.773 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.773 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.773 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.773 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.773 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.773 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45833 2024-09-11T05:33:53.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.773 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.773 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.773 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.773 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9400000000000005e-07 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.774 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.775 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367237+0000", 2024-09-11T05:33:53.775 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4439999999999998e-06 2024-09-11T05:33:53.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.775 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.775 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.775 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367243+0000", 2024-09-11T05:33:53.775 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:33:53.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.775 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.775 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.775 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367249+0000", 2024-09-11T05:33:53.775 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2240000000000003e-06 2024-09-11T05:33:53.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.776 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.776 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.776 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398507+0000", 2024-09-11T05:33:53.776 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031257994999999997 2024-09-11T05:33:53.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.776 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.776 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.776 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398551+0000", 2024-09-11T05:33:53.776 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4178000000000003e-05 2024-09-11T05:33:53.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.777 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.777 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.777 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398603+0000", 2024-09-11T05:33:53.777 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2178000000000001e-05 2024-09-11T05:33:53.777 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.777 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.777 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.777 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.777 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45834 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7241728~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.777 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:53.777 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.384340405, 2024-09-11T05:33:53.777 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031466477, 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45834 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5200000000000002e-07 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367258+0000", 2024-09-11T05:33:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1110000000000002e-06 2024-09-11T05:33:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367264+0000", 2024-09-11T05:33:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0290000000000002e-06 2024-09-11T05:33:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367269+0000", 2024-09-11T05:33:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:33:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.780 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398628+0000", 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031358587 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398671+0000", 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3035999999999999e-05 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398722+0000", 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1511000000000002e-05 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.781 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.782 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.782 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.782 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45835 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7290880~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.782 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:53.782 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.384320831, 2024-09-11T05:33:53.782 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031565589999999998, 2024-09-11T05:33:53.782 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.782 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.782 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.782 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.782 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.782 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.783 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45835 2024-09-11T05:33:53.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.783 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.783 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.783 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.783 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:53.783 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.783 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.783 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:33:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367276+0000", 2024-09-11T05:33:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.96e-07 2024-09-11T05:33:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367278+0000", 2024-09-11T05:33:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0279999999999999e-06 2024-09-11T05:33:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.785 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.785 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.785 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367283+0000", 2024-09-11T05:33:53.785 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8340000000000004e-06 2024-09-11T05:33:53.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.785 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.785 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.785 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367289+0000", 2024-09-11T05:33:53.785 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:33:53.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.785 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.785 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.785 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398747+0000", 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031458211999999999 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398788+0000", 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0998999999999998e-05 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398841+0000", 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2465e-05 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.786 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45836 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7340032~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.384300755000002, 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031663635000000002, 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45836 2024-09-11T05:33:53.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.788 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.788 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.788 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:53.788 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.788 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.788 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:33:53.788 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.789 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.789 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368490+0000", 2024-09-11T05:33:53.789 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0011952410000000001 2024-09-11T05:33:53.789 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.789 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.789 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.789 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368494+0000", 2024-09-11T05:33:53.789 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4649999999999999e-06 2024-09-11T05:33:53.789 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.789 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.789 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.789 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368503+0000", 2024-09-11T05:33:53.789 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0920000000000004e-06 2024-09-11T05:33:53.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.790 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.790 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.790 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368509+0000", 2024-09-11T05:33:53.790 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4130000000000003e-06 2024-09-11T05:33:53.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.790 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.790 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.791 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398865+0000", 2024-09-11T05:33:53.792 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030355473000000001 2024-09-11T05:33:53.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.792 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.792 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.792 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398907+0000", 2024-09-11T05:33:53.792 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1882999999999999e-05 2024-09-11T05:33:53.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.792 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.792 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.792 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398959+0000", 2024-09-11T05:33:53.792 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2067999999999997e-05 2024-09-11T05:33:53.792 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.792 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.793 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.793 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.793 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45844 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7733248~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.793 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:53.793 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.382921612000001, 2024-09-11T05:33:53.793 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031248306, 2024-09-11T05:33:53.793 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.793 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.793 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.793 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.793 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.793 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.794 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45844 2024-09-11T05:33:53.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.794 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.794 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.794 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.794 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:53.794 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.794 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.794 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.794 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:33:53.794 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.795 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.795 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.795 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368675+0000", 2024-09-11T05:33:53.795 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4700000000000001e-07 2024-09-11T05:33:53.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.795 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.795 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.795 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368680+0000", 2024-09-11T05:33:53.795 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3750000000000002e-06 2024-09-11T05:33:53.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.795 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.795 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.795 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368687+0000", 2024-09-11T05:33:53.796 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3080000000000004e-06 2024-09-11T05:33:53.796 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.796 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.796 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.796 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368692+0000", 2024-09-11T05:33:53.796 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2329999999999997e-06 2024-09-11T05:33:53.796 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.796 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.796 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.796 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399832+0000", 2024-09-11T05:33:53.796 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031139723000000001 2024-09-11T05:33:53.796 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.796 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.797 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.797 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399872+0000", 2024-09-11T05:33:53.797 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0880000000000002e-05 2024-09-11T05:33:53.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.797 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.797 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.797 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399923+0000", 2024-09-11T05:33:53.797 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.024e-05 2024-09-11T05:33:53.797 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.797 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.797 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.797 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45845 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7782400~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.382897778, 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031339210999999999, 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45845 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.798 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.799 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.799 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:53.799 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.799 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.799 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.799 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:33:53.799 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.799 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.799 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.799 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368699+0000", 2024-09-11T05:33:53.800 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:33:53.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.800 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.800 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.800 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368701+0000", 2024-09-11T05:33:53.800 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0389999999999999e-06 2024-09-11T05:33:53.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.800 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.800 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.800 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368706+0000", 2024-09-11T05:33:53.800 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5570000000000003e-06 2024-09-11T05:33:53.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.800 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.801 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.801 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368711+0000", 2024-09-11T05:33:53.801 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0930000000000002e-06 2024-09-11T05:33:53.801 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.801 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.801 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.801 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399947+0000", 2024-09-11T05:33:53.801 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031235810999999999 2024-09-11T05:33:53.801 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.801 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.801 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.801 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399989+0000", 2024-09-11T05:33:53.801 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1430000000000001e-05 2024-09-11T05:33:53.802 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.802 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.802 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.802 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400037+0000", 2024-09-11T05:33:53.802 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8838999999999998e-05 2024-09-11T05:33:53.802 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.802 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.802 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.802 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.802 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.802 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45846 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7831552~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.802 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:53.802 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.382878678000001, 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031434484999999998, 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45846 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:53.803 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.804 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.804 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.804 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.804 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:33:53.804 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.804 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.804 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.804 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.804 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368718+0000", 2024-09-11T05:33:53.804 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6600000000000002e-07 2024-09-11T05:33:53.804 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.804 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368720+0000", 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0140000000000001e-06 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368726+0000", 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8719999999999999e-06 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368730+0000", 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:33:53.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.806 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.806 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.806 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400061+0000", 2024-09-11T05:33:53.806 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031331141 2024-09-11T05:33:53.806 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.806 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.806 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.806 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400102+0000", 2024-09-11T05:33:53.806 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0419e-05 2024-09-11T05:33:53.806 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.806 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.806 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.807 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400152+0000", 2024-09-11T05:33:53.807 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9926000000000003e-05 2024-09-11T05:33:53.807 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.807 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.807 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45847 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7880704~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.382859567000001, 2024-09-11T05:33:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031531412000000002, 2024-09-11T05:33:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45847 2024-09-11T05:33:53.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.809 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.809 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.809 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.809 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:53.809 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.809 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.809 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.809 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:33:53.809 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.809 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.809 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.810 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368737+0000", 2024-09-11T05:33:53.810 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:33:53.810 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.810 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.810 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.810 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368739+0000", 2024-09-11T05:33:53.810 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.81e-06 2024-09-11T05:33:53.810 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.810 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.810 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.810 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368744+0000", 2024-09-11T05:33:53.810 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8919999999999997e-06 2024-09-11T05:33:53.810 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.811 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.811 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.811 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368749+0000", 2024-09-11T05:33:53.811 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7149999999999997e-06 2024-09-11T05:33:53.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.811 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.811 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.811 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400176+0000", 2024-09-11T05:33:53.811 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031426740000000002 2024-09-11T05:33:53.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.811 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.811 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400218+0000", 2024-09-11T05:33:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2338e-05 2024-09-11T05:33:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400268+0000", 2024-09-11T05:33:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9580000000000003e-05 2024-09-11T05:33:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.812 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45848 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7929856~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.813 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:53.813 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.382840771000001, 2024-09-11T05:33:53.813 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031629162000000002, 2024-09-11T05:33:53.813 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.813 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.813 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.813 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.813 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.813 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.813 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45848 2024-09-11T05:33:53.813 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.813 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.813 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.814 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.814 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:53.814 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.814 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.814 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.814 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:33:53.814 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.814 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.814 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.814 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368756+0000", 2024-09-11T05:33:53.814 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:33:53.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.815 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.815 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.815 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368758+0000", 2024-09-11T05:33:53.815 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.951e-06 2024-09-11T05:33:53.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.815 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.815 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.815 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368763+0000", 2024-09-11T05:33:53.815 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.801e-06 2024-09-11T05:33:53.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.815 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.815 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.816 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368768+0000", 2024-09-11T05:33:53.816 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1100000000000002e-06 2024-09-11T05:33:53.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.816 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.816 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.816 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400292+0000", 2024-09-11T05:33:53.816 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031524033 2024-09-11T05:33:53.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.816 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.816 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.816 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400336+0000", 2024-09-11T05:33:53.816 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3272999999999997e-05 2024-09-11T05:33:53.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.817 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.817 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.817 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400384+0000", 2024-09-11T05:33:53.817 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8634999999999998e-05 2024-09-11T05:33:53.817 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.817 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.817 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.817 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.817 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.817 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45849 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7979008~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.817 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:53.817 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.382821378999999, 2024-09-11T05:33:53.818 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031732415, 2024-09-11T05:33:53.818 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.818 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.818 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.818 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.818 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.818 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.818 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45849 2024-09-11T05:33:53.818 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.818 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.818 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.818 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.818 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:53.819 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.819 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.819 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.819 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:53.819 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.819 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.819 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.819 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:33:53.819 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0100000000000005e-07 2024-09-11T05:33:53.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.819 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.820 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.820 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368777+0000", 2024-09-11T05:33:53.820 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0260000000000002e-06 2024-09-11T05:33:53.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.820 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.820 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.820 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368783+0000", 2024-09-11T05:33:53.820 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7089999999999999e-06 2024-09-11T05:33:53.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.820 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.820 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.820 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368788+0000", 2024-09-11T05:33:53.820 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4029999999999998e-06 2024-09-11T05:33:53.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.821 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.821 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.821 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400409+0000", 2024-09-11T05:33:53.821 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031620663 2024-09-11T05:33:53.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.821 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.821 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.821 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400453+0000", 2024-09-11T05:33:53.821 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4376999999999999e-05 2024-09-11T05:33:53.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.821 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.821 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.822 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400507+0000", 2024-09-11T05:33:53.822 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3736000000000002e-05 2024-09-11T05:33:53.822 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.822 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.822 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.822 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.822 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.822 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45850 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8028160~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.822 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:53.822 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.382801916999998, 2024-09-11T05:33:53.822 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031830000999999997, 2024-09-11T05:33:53.822 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.822 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.823 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.823 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.823 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.823 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.823 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45850 2024-09-11T05:33:53.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.823 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.823 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.823 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.823 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:53.823 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.823 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.824 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.824 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:33:53.824 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.824 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.824 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.824 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.824 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368795+0000", 2024-09-11T05:33:53.824 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0399999999999996e-07 2024-09-11T05:33:53.824 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.824 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.824 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.824 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368796+0000", 2024-09-11T05:33:53.824 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.933e-06 2024-09-11T05:33:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368803+0000", 2024-09-11T05:33:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0619999999999997e-06 2024-09-11T05:33:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368807+0000", 2024-09-11T05:33:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.685e-06 2024-09-11T05:33:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.826 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400531+0000", 2024-09-11T05:33:53.826 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031723784999999997 2024-09-11T05:33:53.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.826 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.826 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.826 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400573+0000", 2024-09-11T05:33:53.826 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2079999999999997e-05 2024-09-11T05:33:53.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.826 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.826 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.826 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400624+0000", 2024-09-11T05:33:53.826 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0952000000000003e-05 2024-09-11T05:33:53.826 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.827 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.827 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.827 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.827 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.827 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45851 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8077312~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:53.827 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:53.827 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.382782924000001, 2024-09-11T05:33:53.827 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031929358999999997, 2024-09-11T05:33:53.827 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.827 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.827 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.827 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.828 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.828 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.828 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45851 2024-09-11T05:33:53.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.828 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.828 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.828 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.828 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:53.828 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.828 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.828 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.828 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:33:53.829 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.829 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.829 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.829 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370488+0000", 2024-09-11T05:33:53.829 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.001674743 2024-09-11T05:33:53.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.829 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.829 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.829 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370491+0000", 2024-09-11T05:33:53.829 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.444e-06 2024-09-11T05:33:53.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.829 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370500+0000", 2024-09-11T05:33:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0650000000000005e-06 2024-09-11T05:33:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370507+0000", 2024-09-11T05:33:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:33:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400648+0000", 2024-09-11T05:33:53.830 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030141889000000002 2024-09-11T05:33:53.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.831 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.831 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.831 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400691+0000", 2024-09-11T05:33:53.831 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2290999999999999e-05 2024-09-11T05:33:53.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.831 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.831 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.831 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400742+0000", 2024-09-11T05:33:53.831 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1717e-05 2024-09-11T05:33:53.831 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.831 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.831 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.832 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.832 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145920 3.18 3:1a554328:::rbd_data.112d9958e8ce.000000000000000a:1b [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:33:53.832 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:33:53.832 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2767734149999992, 2024-09-11T05:33:53.832 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031231273, 2024-09-11T05:33:53.832 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.832 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.832 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.832 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.832 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.832 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.832 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145920 2024-09-11T05:33:53.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.833 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.833 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.833 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.833 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:33:53.833 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.833 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.833 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.833 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:33:53.833 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474824+0000", 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.046e-06 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474827+0000", 2024-09-11T05:33:53.834 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3859999999999999e-06 2024-09-11T05:33:53.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.835 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.835 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.835 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474830+0000", 2024-09-11T05:33:53.835 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5790000000000002e-06 2024-09-11T05:33:53.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.835 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.835 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.835 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.505951+0000", 2024-09-11T05:33:53.835 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031121328 2024-09-11T05:33:53.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.835 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.835 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.505995+0000", 2024-09-11T05:33:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4175000000000003e-05 2024-09-11T05:33:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506054+0000", 2024-09-11T05:33:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8553e-05 2024-09-11T05:33:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145921 3.18 3:1a554328:::rbd_data.112d9958e8ce.000000000000000a:1b [read 180224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:33:53.837 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:33:53.837 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2767632990000006, 2024-09-11T05:33:53.837 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031340051000000001, 2024-09-11T05:33:53.837 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.837 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.837 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.837 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.837 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.837 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.837 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145921 2024-09-11T05:33:53.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.837 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.838 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.838 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.838 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:33:53.838 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.838 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.838 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.838 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:33:53.838 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.838 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.838 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.16e-07 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474834+0000", 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.08e-06 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474837+0000", 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.954e-06 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.840 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.840 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474839+0000", 2024-09-11T05:33:53.840 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:33:53.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.840 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.840 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506080+0000", 2024-09-11T05:33:53.840 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031240232 2024-09-11T05:33:53.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.840 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.840 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506119+0000", 2024-09-11T05:33:53.841 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9065e-05 2024-09-11T05:33:53.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.841 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.841 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.841 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506173+0000", 2024-09-11T05:33:53.841 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4054000000000001e-05 2024-09-11T05:33:53.841 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.841 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.841 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.841 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.841 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145922 3.18 3:1a554328:::rbd_data.112d9958e8ce.000000000000000a:1b [read 200704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:33:53.841 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474842+0000", 2024-09-11T05:33:53.842 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2767536780000004, 2024-09-11T05:33:53.842 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031453192999999997, 2024-09-11T05:33:53.842 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.842 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.842 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:53.842 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.842 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.842 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.842 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145922 2024-09-11T05:33:53.842 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.842 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.842 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.842 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474842+0000", 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474842+0000", 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474843+0000", 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.03e-07 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.843 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.844 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474844+0000", 2024-09-11T05:33:53.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0589999999999999e-06 2024-09-11T05:33:53.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.844 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.844 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474847+0000", 2024-09-11T05:33:53.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3160000000000001e-06 2024-09-11T05:33:53.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.844 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.844 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474849+0000", 2024-09-11T05:33:53.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4549999999999998e-06 2024-09-11T05:33:53.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506196+0000", 2024-09-11T05:33:53.845 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031346442000000002 2024-09-11T05:33:53.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506239+0000", 2024-09-11T05:33:53.846 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3027e-05 2024-09-11T05:33:53.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.846 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.846 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.846 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506295+0000", 2024-09-11T05:33:53.846 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6691000000000003e-05 2024-09-11T05:33:53.846 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.846 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.846 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.846 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.846 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145933 3.18 3:1952fba0:::rbd_data.112d55d87bfc.0000000000000007:head [stat,truncate 155648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:33:53.846 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:33:53.847 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 8.2767438749999993, 2024-09-11T05:33:53.847 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.03262636, 2024-09-11T05:33:53.847 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:53.847 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:53.847 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:53.847 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:53.847 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:53.847 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:53.847 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145933 2024-09-11T05:33:53.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.847 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:53.847 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:33:53.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474853+0000", 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.17e-06 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474857+0000", 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1039999999999998e-06 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474860+0000", 2024-09-11T05:33:53.849 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8670000000000004e-06 2024-09-11T05:33:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506326+0000", 2024-09-11T05:33:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031465323000000003 2024-09-11T05:33:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506367+0000", 2024-09-11T05:33:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1155000000000002e-05 2024-09-11T05:33:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 6", 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506445+0000", 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8347000000000001e-05 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507206+0000", 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00076036099999999998 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507390+0000", 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00018462799999999999 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.852 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:53.852 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507440+0000", 2024-09-11T05:33:53.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9604999999999997e-05 2024-09-11T05:33:53.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:53.852 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:53.852 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:53.852 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507478+0000", 2024-09-11T05:33:53.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8593999999999997e-05 2024-09-11T05:33:53.852 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.852 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.852 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.852 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:53.852 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:53.853 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:53.854 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:53.854 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:53.854+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:53.946 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone27 from 0xca5523c (overlap 0x1251250) to 0x0 2024-09-11T05:33:53.954 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:53.953+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:54.023 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:54.024 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:54.024 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.024 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:151403 3.18 e70/22 3:18340977:::rbd_data.112d8aef5ed2.0000000000000081:head v 70'366, mlcod=69'363)", 2024-09-11T05:33:54.024 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:54.022423+0000", 2024-09-11T05:33:54.024 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00074360500000000005, 2024-09-11T05:33:54.024 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00076626099999999996, 2024-09-11T05:33:54.024 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.024 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.024 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.024 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.024 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.025 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.025 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022423+0000", 2024-09-11T05:33:54.025 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.025 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.025 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.025 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.025 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022423+0000", 2024-09-11T05:33:54.025 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.025 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.025 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.025 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.025 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022424+0000", 2024-09-11T05:33:54.025 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1200000000000003e-07 2024-09-11T05:33:54.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.026 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.026 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.026 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022430+0000", 2024-09-11T05:33:54.026 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8279999999999999e-06 2024-09-11T05:33:54.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.026 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.026 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.026 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022443+0000", 2024-09-11T05:33:54.026 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2753e-05 2024-09-11T05:33:54.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.026 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.026 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.027 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022449+0000", 2024-09-11T05:33:54.027 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6950000000000003e-06 2024-09-11T05:33:54.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.027 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.027 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022514+0000", 2024-09-11T05:33:54.027 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4453000000000001e-05 2024-09-11T05:33:54.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.027 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.027 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022534+0000", 2024-09-11T05:33:54.027 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9905e-05 2024-09-11T05:33:54.027 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.028 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.028 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.028 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.028 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_repop(client.4397.0:151405 3.b e70/22 3:d6c584e5:::rbd_data.112d8aef5ed2.0000000000000087:head v 70'240, mlcod=68'237)", 2024-09-11T05:33:54.028 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:54.022804+0000", 2024-09-11T05:33:54.028 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.00036293099999999998, 2024-09-11T05:33:54.028 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00045220999999999998, 2024-09-11T05:33:54.028 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.028 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.028 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.028 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.028 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.029 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.029 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022804+0000", 2024-09-11T05:33:54.029 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.029 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.030 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022804+0000", 2024-09-11T05:33:54.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.030 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022805+0000", 2024-09-11T05:33:54.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5300000000000003e-07 2024-09-11T05:33:54.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.030 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022811+0000", 2024-09-11T05:33:54.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0349999999999998e-06 2024-09-11T05:33:54.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.031 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.031 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.031 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022821+0000", 2024-09-11T05:33:54.031 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0353999999999999e-05 2024-09-11T05:33:54.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.031 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.031 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.031 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022829+0000", 2024-09-11T05:33:54.031 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3189999999999997e-06 2024-09-11T05:33:54.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.031 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.031 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022947+0000", 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000118798 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.022964+0000", 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6722e-05 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 2 2024-09-11T05:33:54.032 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:54.034 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:54.055 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:54.053+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:54.094 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-11T05:33:54.138 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:54.138 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:54.138 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:54.138 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:54.138 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:54.148 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:54.148 INFO:teuthology.orchestra.run.smithi070.stdout:4426 punch from 0x9692c3c to 0x96940a9, (0x146d bytes) 2024-09-11T05:33:54.152 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.152 INFO:teuthology.orchestra.run.smithi070.stdout:4429 write 0xf938c0 thru 0xf973d6 (0x3b17 bytes) 2024-09-11T05:33:54.167 INFO:teuthology.orchestra.run.smithi070.stdout:4430 read 0x4e50660 thru 0x4e55cd2 (0x5673 bytes) 2024-09-11T05:33:54.168 INFO:teuthology.orchestra.run.smithi070.stdout:4431 write 0x8754359 thru 0x8759776 (0x541e bytes) 2024-09-11T05:33:54.174 INFO:teuthology.orchestra.run.smithi070.stdout:4432 write 0x907eab8 thru 0x907ed61 (0x2aa bytes) 2024-09-11T05:33:54.192 INFO:teuthology.orchestra.run.smithi070.stdout:4434 trunc from 0xca5523c to 0x282a681 2024-09-11T05:33:54.192 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:54.192+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:54.257 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:54.255+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116713 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13060096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:33:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.460434971, 2024-09-11T05:33:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599235, 2024-09-11T05:33:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116713 2024-09-11T05:33:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:33:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:33:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813321+0000", 2024-09-11T05:33:54.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000005e-07 2024-09-11T05:33:54.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813323+0000", 2024-09-11T05:33:54.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.667e-06 2024-09-11T05:33:54.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813331+0000", 2024-09-11T05:33:54.280 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6529999999999994e-06 2024-09-11T05:33:54.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.280 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.280 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813336+0000", 2024-09-11T05:33:54.280 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:33:54.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.280 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.280 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813688+0000", 2024-09-11T05:33:54.280 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035143199999999999 2024-09-11T05:33:54.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:54.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813692+0000", 2024-09-11T05:33:54.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5120000000000002e-06 2024-09-11T05:33:54.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816304+0000", 2024-09-11T05:33:54.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026115449999999998 2024-09-11T05:33:54.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816308+0000", 2024-09-11T05:33:54.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2370000000000003e-06 2024-09-11T05:33:54.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.282 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.282 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821720+0000", 2024-09-11T05:33:54.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0054114869999999 2024-09-11T05:33:54.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.282 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.282 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821724+0000", 2024-09-11T05:33:54.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:33:54.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873101+0000", 2024-09-11T05:33:54.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0513774279999999 2024-09-11T05:33:54.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873159+0000", 2024-09-11T05:33:54.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819000000000003e-05 2024-09-11T05:33:54.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.284 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873244+0000", 2024-09-11T05:33:54.284 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4300000000000003e-05 2024-09-11T05:33:54.284 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.284 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.284 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.284 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.284 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116714 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.284 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:33:54.284 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.460392336, 2024-09-11T05:33:54.284 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600505999999998, 2024-09-11T05:33:54.284 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116714 2024-09-11T05:33:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:33:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:33:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:33:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:33:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813366+0000", 2024-09-11T05:33:54.287 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6919999999999998e-06 2024-09-11T05:33:54.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.287 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.287 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.287 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813373+0000", 2024-09-11T05:33:54.287 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8689999999999998e-06 2024-09-11T05:33:54.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.287 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.287 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.287 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813378+0000", 2024-09-11T05:33:54.287 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2159999999999997e-06 2024-09-11T05:33:54.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.287 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.288 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813733+0000", 2024-09-11T05:33:54.288 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035530300000000001 2024-09-11T05:33:54.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.288 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:54.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813739+0000", 2024-09-11T05:33:54.288 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8819999999999998e-06 2024-09-11T05:33:54.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.288 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816340+0000", 2024-09-11T05:33:54.289 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002600598 2024-09-11T05:33:54.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.289 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.289 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.289 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816349+0000", 2024-09-11T05:33:54.289 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9169999999999995e-06 2024-09-11T05:33:54.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.289 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.289 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.289 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821745+0000", 2024-09-11T05:33:54.289 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005396416 2024-09-11T05:33:54.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.290 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.290 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.290 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821750+0000", 2024-09-11T05:33:54.290 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:33:54.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.290 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.290 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.290 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873269+0000", 2024-09-11T05:33:54.290 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0515195159999999 2024-09-11T05:33:54.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.290 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.290 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.290 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873328+0000", 2024-09-11T05:33:54.291 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9222999999999999e-05 2024-09-11T05:33:54.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.291 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.291 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.291 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873413+0000", 2024-09-11T05:33:54.291 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4983999999999998e-05 2024-09-11T05:33:54.291 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.291 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.291 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.291 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.291 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116715 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13109248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.292 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:33:54.292 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.460350855, 2024-09-11T05:33:54.292 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0602519180000001, 2024-09-11T05:33:54.292 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.292 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.292 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.292 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.292 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.292 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.292 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116715 2024-09-11T05:33:54.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.292 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.293 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:33:54.293 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.293 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.293 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:33:54.293 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.293 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.293 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813405+0000", 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.51e-07 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813407+0000", 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813414+0000", 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.686e-06 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.294 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813419+0000", 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4249999999999997e-06 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813774+0000", 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035460800000000002 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813778+0000", 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.295 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.296 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816375+0000", 2024-09-11T05:33:54.296 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025967730000000001 2024-09-11T05:33:54.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.296 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.296 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.296 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816379+0000", 2024-09-11T05:33:54.296 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3780000000000003e-06 2024-09-11T05:33:54.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.296 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.296 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.296 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821770+0000", 2024-09-11T05:33:54.296 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053903040000001 2024-09-11T05:33:54.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.297 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.297 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821774+0000", 2024-09-11T05:33:54.297 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:33:54.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.297 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.297 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873437+0000", 2024-09-11T05:33:54.297 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051663155 2024-09-11T05:33:54.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873500+0000", 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3027000000000005e-05 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873656+0000", 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015580800000000001 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.298 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116716 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13133824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.460308398, 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0605170350000002, 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116716 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.299 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5799999999999999e-07 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.300 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.301 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.301 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813450+0000", 2024-09-11T05:33:54.301 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7659999999999999e-06 2024-09-11T05:33:54.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.301 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.301 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.301 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813458+0000", 2024-09-11T05:33:54.301 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7430000000000002e-06 2024-09-11T05:33:54.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.301 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.301 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.301 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813464+0000", 2024-09-11T05:33:54.302 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:33:54.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.302 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.302 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.302 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813814+0000", 2024-09-11T05:33:54.302 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035073199999999998 2024-09-11T05:33:54.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.302 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.302 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:54.302 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813819+0000", 2024-09-11T05:33:54.302 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:33:54.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.302 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.303 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.303 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816410+0000", 2024-09-11T05:33:54.303 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025904349999999999 2024-09-11T05:33:54.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.303 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.303 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.303 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816418+0000", 2024-09-11T05:33:54.303 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1610000000000003e-06 2024-09-11T05:33:54.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.303 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.303 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.304 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821794+0000", 2024-09-11T05:33:54.304 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005376391 2024-09-11T05:33:54.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.304 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.304 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.304 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821799+0000", 2024-09-11T05:33:54.304 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4870000000000004e-06 2024-09-11T05:33:54.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.304 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.304 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.304 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873697+0000", 2024-09-11T05:33:54.304 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051898843 2024-09-11T05:33:54.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.305 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.305 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.305 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873810+0000", 2024-09-11T05:33:54.305 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112187 2024-09-11T05:33:54.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.305 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.305 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.305 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873964+0000", 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015412800000000001 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116717 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13158400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.460283314, 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606806560000002, 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.306 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116717 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:33:54.307 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.308 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.308 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.308 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:33:54.308 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:33:54.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.309 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.309 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.309 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813474+0000", 2024-09-11T05:33:54.309 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1830000000000001e-06 2024-09-11T05:33:54.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.309 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.309 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.309 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813481+0000", 2024-09-11T05:33:54.309 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5540000000000003e-06 2024-09-11T05:33:54.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.310 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.310 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813491+0000", 2024-09-11T05:33:54.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0472000000000001e-05 2024-09-11T05:33:54.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.310 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.310 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813867+0000", 2024-09-11T05:33:54.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00037606 2024-09-11T05:33:54.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.310 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:54.310 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813873+0000", 2024-09-11T05:33:54.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.254e-06 2024-09-11T05:33:54.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816443+0000", 2024-09-11T05:33:54.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025701769999999999 2024-09-11T05:33:54.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.312 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.312 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816446+0000", 2024-09-11T05:33:54.312 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:33:54.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.313 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821818+0000", 2024-09-11T05:33:54.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053719830000001 2024-09-11T05:33:54.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.313 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.313 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821823+0000", 2024-09-11T05:33:54.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5560000000000001e-06 2024-09-11T05:33:54.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.314 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.314 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874006+0000", 2024-09-11T05:33:54.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05218342 2024-09-11T05:33:54.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.314 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.314 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874071+0000", 2024-09-11T05:33:54.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4369999999999995e-05 2024-09-11T05:33:54.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.315 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.315 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.315 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874152+0000", 2024-09-11T05:33:54.315 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1658999999999999e-05 2024-09-11T05:33:54.315 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.315 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.315 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.315 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.315 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116718 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13182976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.315 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:33:54.315 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.460251796, 2024-09-11T05:33:54.315 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0609185380000001, 2024-09-11T05:33:54.316 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.316 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.316 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.316 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.316 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.316 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.316 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116718 2024-09-11T05:33:54.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.316 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.316 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.316 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.316 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:33:54.316 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.317 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.317 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:33:54.317 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.317 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.317 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813504+0000", 2024-09-11T05:33:54.317 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7999999999999996e-07 2024-09-11T05:33:54.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.317 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.318 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813506+0000", 2024-09-11T05:33:54.318 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2989999999999999e-06 2024-09-11T05:33:54.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.318 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.318 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.318 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813513+0000", 2024-09-11T05:33:54.318 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8020000000000003e-06 2024-09-11T05:33:54.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.318 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813517+0000", 2024-09-11T05:33:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5639999999999998e-06 2024-09-11T05:33:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813916+0000", 2024-09-11T05:33:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039859800000000001 2024-09-11T05:33:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813922+0000", 2024-09-11T05:33:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:33:54.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.320 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.320 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816476+0000", 2024-09-11T05:33:54.320 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025538359999999999 2024-09-11T05:33:54.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.320 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.320 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816481+0000", 2024-09-11T05:33:54.320 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819999999999999e-06 2024-09-11T05:33:54.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.320 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.321 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821843+0000", 2024-09-11T05:33:54.321 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053620299999999 2024-09-11T05:33:54.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.321 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.321 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.321 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821848+0000", 2024-09-11T05:33:54.321 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:33:54.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.321 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.321 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.321 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874191+0000", 2024-09-11T05:33:54.321 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052342935 2024-09-11T05:33:54.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874300+0000", 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000108764 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874422+0000", 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012221399999999999 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116719 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13207552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.460210998000001, 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0611734350000002, 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116719 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.323 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.324 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.324 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:33:54.324 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.324 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.324 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.324 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:33:54.324 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.324 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.324 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.324 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813545+0000", 2024-09-11T05:33:54.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2600000000000002e-07 2024-09-11T05:33:54.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813547+0000", 2024-09-11T05:33:54.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3329999999999999e-06 2024-09-11T05:33:54.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813553+0000", 2024-09-11T05:33:54.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4640000000000003e-06 2024-09-11T05:33:54.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.326 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.326 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.326 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813558+0000", 2024-09-11T05:33:54.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:33:54.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.326 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.326 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.326 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813952+0000", 2024-09-11T05:33:54.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039390999999999997 2024-09-11T05:33:54.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.326 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.326 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:54.327 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813955+0000", 2024-09-11T05:33:54.327 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.858e-06 2024-09-11T05:33:54.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.327 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.327 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816524+0000", 2024-09-11T05:33:54.327 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002568847 2024-09-11T05:33:54.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.327 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.327 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816533+0000", 2024-09-11T05:33:54.327 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1749999999999994e-06 2024-09-11T05:33:54.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821869+0000", 2024-09-11T05:33:54.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053358939999999 2024-09-11T05:33:54.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821876+0000", 2024-09-11T05:33:54.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:33:54.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874454+0000", 2024-09-11T05:33:54.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052577621 2024-09-11T05:33:54.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874546+0000", 2024-09-11T05:33:54.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2151999999999995e-05 2024-09-11T05:33:54.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874718+0000", 2024-09-11T05:33:54.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017183399999999999 2024-09-11T05:33:54.330 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.330 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.330 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.330 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116720 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13232128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.330 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:33:54.330 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.460189112, 2024-09-11T05:33:54.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0614845590000002, 2024-09-11T05:33:54.330 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.330 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.330 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.331 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.331 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.331 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.331 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116720 2024-09-11T05:33:54.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.331 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.331 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.331 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:33:54.331 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.331 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:33:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:33:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5600000000000002e-07 2024-09-11T05:33:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813568+0000", 2024-09-11T05:33:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9089999999999998e-06 2024-09-11T05:33:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.333 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.333 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813573+0000", 2024-09-11T05:33:54.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2059999999999998e-06 2024-09-11T05:33:54.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.333 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.333 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813577+0000", 2024-09-11T05:33:54.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1489999999999996e-06 2024-09-11T05:33:54.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.333 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813987+0000", 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040977800000000002 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813992+0000", 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1540000000000001e-06 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816560+0000", 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025680389999999998 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816566+0000", 2024-09-11T05:33:54.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0679999999999996e-06 2024-09-11T05:33:54.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821907+0000", 2024-09-11T05:33:54.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005341735 2024-09-11T05:33:54.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821916+0000", 2024-09-11T05:33:54.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3659999999999992e-06 2024-09-11T05:33:54.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.336 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874760+0000", 2024-09-11T05:33:54.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052844713 2024-09-11T05:33:54.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.336 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874878+0000", 2024-09-11T05:33:54.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000117321 2024-09-11T05:33:54.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875051+0000", 2024-09-11T05:33:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017286499999999999 2024-09-11T05:33:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116721 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13256704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:33:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.460171758, 2024-09-11T05:33:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0616932019999998, 2024-09-11T05:33:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116721 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:33:54.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813584+0000", 2024-09-11T05:33:54.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2e-07 2024-09-11T05:33:54.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.340 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.340 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813586+0000", 2024-09-11T05:33:54.340 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.277e-06 2024-09-11T05:33:54.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.340 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.340 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.340 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813592+0000", 2024-09-11T05:33:54.340 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5840000000000002e-06 2024-09-11T05:33:54.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.340 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.340 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.341 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813597+0000", 2024-09-11T05:33:54.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2839999999999997e-06 2024-09-11T05:33:54.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.341 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.341 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814028+0000", 2024-09-11T05:33:54.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000430689 2024-09-11T05:33:54.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.341 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:54.341 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814032+0000", 2024-09-11T05:33:54.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3850000000000004e-06 2024-09-11T05:33:54.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816597+0000", 2024-09-11T05:33:54.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00256485 2024-09-11T05:33:54.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816606+0000", 2024-09-11T05:33:54.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:33:54.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821949+0000", 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005342752 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821954+0000", 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2270000000000001e-06 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875095+0000", 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.053140669 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875186+0000", 2024-09-11T05:33:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1391999999999995e-05 2024-09-11T05:33:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875277+0000", 2024-09-11T05:33:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0556000000000005e-05 2024-09-11T05:33:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116722 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13281280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.345 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:33:54.345 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.460134759000001, 2024-09-11T05:33:54.345 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.061825491, 2024-09-11T05:33:54.345 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.345 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.345 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.345 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.345 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.345 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.346 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116722 2024-09-11T05:33:54.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.346 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.346 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.346 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:33:54.346 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.346 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:33:54.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813621+0000", 2024-09-11T05:33:54.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:33:54.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.348 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.348 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813625+0000", 2024-09-11T05:33:54.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.228e-06 2024-09-11T05:33:54.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.348 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.348 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.348 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813635+0000", 2024-09-11T05:33:54.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5179999999999993e-06 2024-09-11T05:33:54.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.348 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.348 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.348 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813641+0000", 2024-09-11T05:33:54.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4710000000000004e-06 2024-09-11T05:33:54.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.349 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.349 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814057+0000", 2024-09-11T05:33:54.349 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00041530099999999997 2024-09-11T05:33:54.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.349 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:54.349 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814060+0000", 2024-09-11T05:33:54.349 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-06 2024-09-11T05:33:54.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.349 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816632+0000", 2024-09-11T05:33:54.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00257186 2024-09-11T05:33:54.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816636+0000", 2024-09-11T05:33:54.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2150000000000003e-06 2024-09-11T05:33:54.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821977+0000", 2024-09-11T05:33:54.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053407110000001 2024-09-11T05:33:54.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821982+0000", 2024-09-11T05:33:54.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:33:54.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.352 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.352 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875307+0000", 2024-09-11T05:33:54.352 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0533247000000001 2024-09-11T05:33:54.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.353 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.353 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875366+0000", 2024-09-11T05:33:54.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8628999999999997e-05 2024-09-11T05:33:54.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.353 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.353 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.353 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875446+0000", 2024-09-11T05:33:54.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0026999999999998e-05 2024-09-11T05:33:54.354 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.354 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.354 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.354 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116723 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13305856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.354 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:33:54.354 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.460101781000001, 2024-09-11T05:33:54.354 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0619630779999998, 2024-09-11T05:33:54.355 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.355 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.355 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.355 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.355 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.355 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.355 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116723 2024-09-11T05:33:54.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.356 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.356 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.356 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.356 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:33:54.356 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.356 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.356 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.357 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:33:54.357 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.357 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.357 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813654+0000", 2024-09-11T05:33:54.357 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:33:54.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.358 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.358 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813661+0000", 2024-09-11T05:33:54.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1890000000000001e-06 2024-09-11T05:33:54.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.358 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.358 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813675+0000", 2024-09-11T05:33:54.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3878e-05 2024-09-11T05:33:54.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.359 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.359 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.359 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813682+0000", 2024-09-11T05:33:54.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.063e-06 2024-09-11T05:33:54.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.359 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816666+0000", 2024-09-11T05:33:54.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029845679999999999 2024-09-11T05:33:54.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816671+0000", 2024-09-11T05:33:54.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:33:54.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.361 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.361 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822024+0000", 2024-09-11T05:33:54.361 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053534660000001 2024-09-11T05:33:54.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.361 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.362 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822028+0000", 2024-09-11T05:33:54.362 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7799999999999998e-06 2024-09-11T05:33:54.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.362 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.362 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.362 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875471+0000", 2024-09-11T05:33:54.362 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05344306 2024-09-11T05:33:54.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.363 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875531+0000", 2024-09-11T05:33:54.363 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0019000000000003e-05 2024-09-11T05:33:54.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.363 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875616+0000", 2024-09-11T05:33:54.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5304999999999997e-05 2024-09-11T05:33:54.364 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.364 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.364 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.364 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116724 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13330432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.364 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:33:54.364 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.460062292, 2024-09-11T05:33:54.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0620902609999998, 2024-09-11T05:33:54.365 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.365 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.365 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.365 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.365 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.365 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.365 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116724 2024-09-11T05:33:54.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.365 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.365 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.365 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.365 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:33:54.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:33:54.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:33:54.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.99e-07 2024-09-11T05:33:54.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.367 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813697+0000", 2024-09-11T05:33:54.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2430000000000001e-06 2024-09-11T05:33:54.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.367 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813704+0000", 2024-09-11T05:33:54.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2980000000000003e-06 2024-09-11T05:33:54.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.367 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813709+0000", 2024-09-11T05:33:54.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8130000000000003e-06 2024-09-11T05:33:54.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.368 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816702+0000", 2024-09-11T05:33:54.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002992864 2024-09-11T05:33:54.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.368 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816711+0000", 2024-09-11T05:33:54.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1840000000000005e-06 2024-09-11T05:33:54.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822050+0000", 2024-09-11T05:33:54.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.00533864 2024-09-11T05:33:54.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822055+0000", 2024-09-11T05:33:54.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:33:54.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875642+0000", 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0535874220000001 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875698+0000", 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5707e-05 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875783+0000", 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5362e-05 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.370 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.371 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116725 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13355008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.371 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:33:54.371 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.460028103999999, 2024-09-11T05:33:54.371 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.06220984, 2024-09-11T05:33:54.371 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.371 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.371 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.371 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.371 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.371 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.371 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116725 2024-09-11T05:33:54.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.372 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.372 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.372 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:33:54.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.372 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.372 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:33:54.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.373 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.373 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813728+0000", 2024-09-11T05:33:54.373 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:33:54.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.373 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.373 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.373 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813730+0000", 2024-09-11T05:33:54.373 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6730000000000001e-06 2024-09-11T05:33:54.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.373 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.373 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.374 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813743+0000", 2024-09-11T05:33:54.374 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2833000000000001e-05 2024-09-11T05:33:54.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.374 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.374 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.374 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813749+0000", 2024-09-11T05:33:54.374 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:33:54.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.374 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.374 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.374 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816726+0000", 2024-09-11T05:33:54.374 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029772090000000002 2024-09-11T05:33:54.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.375 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.375 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816730+0000", 2024-09-11T05:33:54.375 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.518e-06 2024-09-11T05:33:54.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.375 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.375 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822074+0000", 2024-09-11T05:33:54.375 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053444030000001 2024-09-11T05:33:54.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.375 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822079+0000", 2024-09-11T05:33:54.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:33:54.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875807+0000", 2024-09-11T05:33:54.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0537284410000001 2024-09-11T05:33:54.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875858+0000", 2024-09-11T05:33:54.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0574000000000001e-05 2024-09-11T05:33:54.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.377 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.377 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875937+0000", 2024-09-11T05:33:54.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9268000000000001e-05 2024-09-11T05:33:54.377 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.377 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.377 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.377 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116974 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13185024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.377 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.452084268, 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598649249999998, 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116974 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.378 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:33:54.379 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.379 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.379 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.379 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:33:54.379 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.379 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.379 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.379 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:33:54.380 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:33:54.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.380 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.380 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821673+0000", 2024-09-11T05:33:54.380 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.722e-06 2024-09-11T05:33:54.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.380 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.380 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821686+0000", 2024-09-11T05:33:54.380 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2974e-05 2024-09-11T05:33:54.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.381 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.381 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821692+0000", 2024-09-11T05:33:54.381 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:33:54.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.381 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.381 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822089+0000", 2024-09-11T05:33:54.381 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039611699999999998 2024-09-11T05:33:54.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.381 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.381 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822099+0000", 2024-09-11T05:33:54.381 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0029e-05 2024-09-11T05:33:54.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.382 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.382 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.382 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822803+0000", 2024-09-11T05:33:54.382 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000704507 2024-09-11T05:33:54.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.382 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.382 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.382 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822808+0000", 2024-09-11T05:33:54.382 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6460000000000001e-06 2024-09-11T05:33:54.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.382 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.382 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.383 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881361+0000", 2024-09-11T05:33:54.383 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0585529680000001 2024-09-11T05:33:54.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.383 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.383 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881432+0000", 2024-09-11T05:33:54.383 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:33:54.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.383 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.383 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881536+0000", 2024-09-11T05:33:54.383 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000103243 2024-09-11T05:33:54.383 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.384 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.384 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.384 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.384 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116975 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13209600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.384 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:33:54.384 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.452055934000001, 2024-09-11T05:33:54.384 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.060124761, 2024-09-11T05:33:54.384 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.384 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.385 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.385 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.385 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.385 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.385 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116975 2024-09-11T05:33:54.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.385 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.385 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.385 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.385 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:33:54.385 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.385 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.386 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.386 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:33:54.386 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.386 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.386 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.386 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821700+0000", 2024-09-11T05:33:54.386 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:33:54.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.386 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821701+0000", 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8369999999999999e-06 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821708+0000", 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5520000000000001e-06 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821713+0000", 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.091e-06 2024-09-11T05:33:54.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.388 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.388 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.388 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822135+0000", 2024-09-11T05:33:54.388 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00042166399999999998 2024-09-11T05:33:54.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.388 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.388 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.388 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822143+0000", 2024-09-11T05:33:54.388 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3089999999999996e-06 2024-09-11T05:33:54.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.388 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.388 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.389 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822820+0000", 2024-09-11T05:33:54.389 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000677145 2024-09-11T05:33:54.389 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.389 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.389 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.389 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822824+0000", 2024-09-11T05:33:54.389 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.641e-06 2024-09-11T05:33:54.389 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.389 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.389 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.389 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881569+0000", 2024-09-11T05:33:54.389 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.058744785 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881674+0000", 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000105111 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881824+0000", 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000150197 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.391 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.391 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116976 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13234176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.391 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:33:54.391 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.452026955000001, 2024-09-11T05:33:54.391 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0603909900000001, 2024-09-11T05:33:54.391 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.391 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.391 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.391 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.391 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.392 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.392 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116976 2024-09-11T05:33:54.392 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.392 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.392 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.392 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.392 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:33:54.392 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.392 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.392 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.392 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.392 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:33:54.393 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.393 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.393 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.393 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.393 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821729+0000", 2024-09-11T05:33:54.393 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:33:54.393 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.393 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.393 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.393 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821731+0000", 2024-09-11T05:33:54.393 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0250000000000001e-06 2024-09-11T05:33:54.393 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821737+0000", 2024-09-11T05:33:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8839999999999997e-06 2024-09-11T05:33:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821743+0000", 2024-09-11T05:33:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1050000000000003e-06 2024-09-11T05:33:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.394 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822194+0000", 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000451574 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822203+0000", 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9449999999999999e-06 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822835+0000", 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000632019 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.395 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.396 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822839+0000", 2024-09-11T05:33:54.396 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8229999999999997e-06 2024-09-11T05:33:54.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.396 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.396 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.396 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881861+0000", 2024-09-11T05:33:54.396 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.059021776 2024-09-11T05:33:54.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.396 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.396 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.396 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881976+0000", 2024-09-11T05:33:54.396 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00011531699999999999 2024-09-11T05:33:54.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.397 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.397 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.397 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882119+0000", 2024-09-11T05:33:54.397 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000143077 2024-09-11T05:33:54.397 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.397 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.397 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.397 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.397 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.397 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116977 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13258752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.397 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:33:54.397 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.451975721, 2024-09-11T05:33:54.398 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606236920000001, 2024-09-11T05:33:54.398 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.398 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.398 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.398 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.398 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.398 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.398 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116977 2024-09-11T05:33:54.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.398 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.398 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.398 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.398 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:33:54.399 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.399 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.399 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.399 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.399 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:33:54.399 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.399 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.400 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.400 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.400 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821782+0000", 2024-09-11T05:33:54.400 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7719999999999999e-06 2024-09-11T05:33:54.400 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.400 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.400 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.400 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821785+0000", 2024-09-11T05:33:54.400 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9409999999999999e-06 2024-09-11T05:33:54.400 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.400 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.400 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.401 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821793+0000", 2024-09-11T05:33:54.401 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:33:54.401 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.401 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.401 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821799+0000", 2024-09-11T05:33:54.401 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4609999999999999e-06 2024-09-11T05:33:54.401 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.401 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.401 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822246+0000", 2024-09-11T05:33:54.401 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044669000000000002 2024-09-11T05:33:54.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.402 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.402 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.402 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822254+0000", 2024-09-11T05:33:54.402 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1859999999999992e-06 2024-09-11T05:33:54.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.402 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.402 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.402 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822850+0000", 2024-09-11T05:33:54.402 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005962340000001 2024-09-11T05:33:54.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.402 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.402 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.403 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822854+0000", 2024-09-11T05:33:54.403 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5310000000000002e-06 2024-09-11T05:33:54.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.403 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.403 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.403 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882149+0000", 2024-09-11T05:33:54.403 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0592958729999999 2024-09-11T05:33:54.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.403 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.403 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.403 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882253+0000", 2024-09-11T05:33:54.403 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104058 2024-09-11T05:33:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882403+0000", 2024-09-11T05:33:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014958800000000001 2024-09-11T05:33:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116978 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13283328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:33:54.404 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.451945498000001, 2024-09-11T05:33:54.405 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0608297769999999, 2024-09-11T05:33:54.405 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.405 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.405 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.405 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.405 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.405 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.405 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116978 2024-09-11T05:33:54.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.405 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.405 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:33:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:33:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:33:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:33:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821813+0000", 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821820+0000", 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3669999999999999e-06 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821825+0000", 2024-09-11T05:33:54.407 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5119999999999999e-06 2024-09-11T05:33:54.408 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.408 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.408 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.408 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822273+0000", 2024-09-11T05:33:54.408 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044727900000000003 2024-09-11T05:33:54.408 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.408 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.408 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.408 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822278+0000", 2024-09-11T05:33:54.408 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7529999999999998e-06 2024-09-11T05:33:54.408 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.408 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.408 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.409 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822865+0000", 2024-09-11T05:33:54.409 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005861579999999 2024-09-11T05:33:54.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.409 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.409 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.409 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822868+0000", 2024-09-11T05:33:54.409 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4659999999999999e-06 2024-09-11T05:33:54.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.409 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.409 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.409 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882434+0000", 2024-09-11T05:33:54.409 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0595660170000001 2024-09-11T05:33:54.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.410 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.410 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.410 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882502+0000", 2024-09-11T05:33:54.410 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7442999999999998e-05 2024-09-11T05:33:54.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.410 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.410 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.410 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882639+0000", 2024-09-11T05:33:54.411 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013779999999999999 2024-09-11T05:33:54.411 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.411 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.411 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.411 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.411 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.411 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116980 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13332480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.411 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:33:54.411 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.450405976000001, 2024-09-11T05:33:54.411 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598269180000002, 2024-09-11T05:33:54.411 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.411 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.412 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.412 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.412 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.412 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.412 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116980 2024-09-11T05:33:54.412 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.412 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.412 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.412 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.412 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:33:54.412 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.412 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.413 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.413 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.413 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:33:54.413 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.413 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.413 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.413 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823350+0000", 2024-09-11T05:33:54.413 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:33:54.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.413 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.413 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.413 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823352+0000", 2024-09-11T05:33:54.414 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5459999999999998e-06 2024-09-11T05:33:54.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.414 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.414 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.414 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823360+0000", 2024-09-11T05:33:54.414 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4359999999999996e-06 2024-09-11T05:33:54.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.414 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.414 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.414 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823365+0000", 2024-09-11T05:33:54.414 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3079999999999998e-06 2024-09-11T05:33:54.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.415 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.415 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.415 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823418+0000", 2024-09-11T05:33:54.415 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2735999999999998e-05 2024-09-11T05:33:54.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.415 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.415 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.415 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823423+0000", 2024-09-11T05:33:54.415 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3410000000000002e-06 2024-09-11T05:33:54.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.415 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.416 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.416 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822895+0000", 2024-09-11T05:33:54.416 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99947249000000005 2024-09-11T05:33:54.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.416 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.416 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.416 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822899+0000", 2024-09-11T05:33:54.416 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6169999999999998e-06 2024-09-11T05:33:54.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.416 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.416 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.416 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882964+0000", 2024-09-11T05:33:54.416 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0600650840000001 2024-09-11T05:33:54.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.417 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.417 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.417 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883020+0000", 2024-09-11T05:33:54.417 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5563000000000003e-05 2024-09-11T05:33:54.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.417 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.417 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.417 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883176+0000", 2024-09-11T05:33:54.417 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015629500000000001 2024-09-11T05:33:54.417 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.417 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.418 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.418 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.418 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.418 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116981 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13357056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:54.418 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:33:54.418 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.450381996000001, 2024-09-11T05:33:54.418 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600075910000002, 2024-09-11T05:33:54.418 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.418 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.418 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.418 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.418 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.418 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.419 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116981 2024-09-11T05:33:54.419 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.419 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.419 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.419 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.419 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:33:54.419 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.419 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.419 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.419 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.419 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:33:54.419 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.419 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.420 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.420 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.420 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:33:54.420 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.01e-07 2024-09-11T05:33:54.420 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.420 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.420 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.420 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823376+0000", 2024-09-11T05:33:54.420 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:33:54.420 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.420 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.420 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823381+0000", 2024-09-11T05:33:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000001e-06 2024-09-11T05:33:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823386+0000", 2024-09-11T05:33:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5349999999999998e-06 2024-09-11T05:33:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823447+0000", 2024-09-11T05:33:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1277000000000003e-05 2024-09-11T05:33:54.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.422 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.422 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.422 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823456+0000", 2024-09-11T05:33:54.422 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8859999999999993e-06 2024-09-11T05:33:54.422 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.422 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.422 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.422 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822914+0000", 2024-09-11T05:33:54.422 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99945797999999997 2024-09-11T05:33:54.422 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.422 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.422 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.422 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822918+0000", 2024-09-11T05:33:54.423 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5810000000000001e-06 2024-09-11T05:33:54.423 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.423 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.423 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.423 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883209+0000", 2024-09-11T05:33:54.423 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0602916899999999 2024-09-11T05:33:54.423 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.423 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.423 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.423 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883292+0000", 2024-09-11T05:33:54.423 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2849000000000006e-05 2024-09-11T05:33:54.423 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.424 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.424 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.424 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883381+0000", 2024-09-11T05:33:54.424 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8585000000000007e-05 2024-09-11T05:33:54.424 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.424 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.424 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.424 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.424 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.424 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:54.426 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:54.427 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:4437 writesame 0xeacd8d2 thru 0xeadd687 data_size 0x4b(0xfdb6 bytes) 2024-09-11T05:33:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:4438 trunc from 0xeadd688 to 0x473ca02 2024-09-11T05:33:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:4439 trunc from 0x473ca02 to 0xd47956c 2024-09-11T05:33:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:4441 trunc from 0xd47956c to 0x1a0f991 2024-09-11T05:33:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:4442 write 0x5ff5c3c thru 0x5fff257 (0x961c bytes) 2024-09-11T05:33:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:4443 write 0x4db6004 thru 0x4dc2364 (0xc361 bytes) 2024-09-11T05:33:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:4444 trunc from 0x5fff258 to 0x854af04 2024-09-11T05:33:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:4445 write 0x8ab2861 thru 0x8ab97ea (0x6f8a bytes) 2024-09-11T05:33:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:4446 read 0xfa019d thru 0xfaf51e (0xf382 bytes) 2024-09-11T05:33:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:4448 write 0xe86fe5e thru 0xe874c54 (0x4df7 bytes) 2024-09-11T05:33:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:4449 punch from 0xcfac557 to 0xcfb9457, (0xcf00 bytes) 2024-09-11T05:33:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:4450 read 0xd08b60c thru 0xd08daeb (0x24e0 bytes) 2024-09-11T05:33:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:4451 trunc from 0xe874c55 to 0x3bd82a3 2024-09-11T05:33:54.429 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:54.424+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:54.446 INFO:teuthology.orchestra.run.smithi070.stdout:4452 writesame 0x7794685 thru 0x77980a1 data_size 0x39(0x3a1d bytes) 2024-09-11T05:33:54.447 INFO:teuthology.orchestra.run.smithi070.stdout:4453 read 0x4b2a124 thru 0x4b2dd6e (0x3c4b bytes) 2024-09-11T05:33:54.447 INFO:teuthology.orchestra.run.smithi070.stdout:4454 read 0x2ed8657 thru 0x2ee03a8 (0x7d52 bytes) 2024-09-11T05:33:54.448 INFO:teuthology.orchestra.run.smithi070.stdout:4455 write 0x129cf3e thru 0x12a1674 (0x4737 bytes) 2024-09-11T05:33:54.449 INFO:teuthology.orchestra.run.smithi070.stdout:4456 read 0x5d6cab thru 0x5da79a (0x3af0 bytes) 2024-09-11T05:33:54.458 INFO:teuthology.orchestra.run.smithi070.stdout:4457 trunc from 0x77980a2 to 0x10301ac 2024-09-11T05:33:54.474 INFO:teuthology.orchestra.run.smithi070.stdout:4458 trunc from 0x10301ac to 0x7fc6262 2024-09-11T05:33:54.479 INFO:teuthology.orchestra.run.smithi070.stdout:4459 punch from 0x6679938 to 0x667f3c9, (0x5a91 bytes) 2024-09-11T05:33:54.479 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.479 INFO:teuthology.orchestra.run.smithi070.stdout:4461 read 0x1ac0575 thru 0x1ac538e (0x4e1a bytes) 2024-09-11T05:33:54.479 INFO:teuthology.orchestra.run.smithi070.stdout:4463 read 0x2d29026 thru 0x2d311d5 (0x81b0 bytes) 2024-09-11T05:33:54.479 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.480 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.488 INFO:teuthology.orchestra.run.smithi070.stdout:4467 write 0xb42e99f thru 0xb43cf36 (0xe598 bytes) 2024-09-11T05:33:54.494 INFO:teuthology.orchestra.run.smithi070.stdout:4469 trunc from 0xb43cf37 to 0xde0be30 2024-09-11T05:33:54.499 INFO:teuthology.orchestra.run.smithi070.stdout:4470 write 0x557355 thru 0x55d6e0 (0x638c bytes) 2024-09-11T05:33:54.501 INFO:teuthology.orchestra.run.smithi070.stdout:4471 trunc from 0xde0be30 to 0xe9c92e7 2024-09-11T05:33:54.513 INFO:teuthology.orchestra.run.smithi070.stdout:4472 trunc from 0xe9c92e7 to 0x8de7b4c 2024-09-11T05:33:54.519 INFO:teuthology.orchestra.run.smithi070.stdout:4473 read 0x6425298 thru 0x642742f (0x2198 bytes) 2024-09-11T05:33:54.520 INFO:teuthology.orchestra.run.smithi070.stdout:4475 punch from 0x5fbe55a to 0x5fcc561, (0xe007 bytes) 2024-09-11T05:33:54.523 INFO:teuthology.orchestra.run.smithi070.stdout:4476 trunc from 0x8de7b4c to 0x5e6c76b 2024-09-11T05:33:54.526 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:54.526+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:54.537 INFO:teuthology.orchestra.run.smithi070.stdout:4479 trunc from 0x5e6c76b to 0x48c3d9d 2024-09-11T05:33:54.545 INFO:teuthology.orchestra.run.smithi070.stdout:4480 punch from 0x21b6008 to 0x21b951d, (0x3515 bytes) 2024-09-11T05:33:54.545 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.558 INFO:teuthology.orchestra.run.smithi070.stdout:4483 write 0xab94c3b thru 0xab9f2a1 (0xa667 bytes) 2024-09-11T05:33:54.561 INFO:teuthology.orchestra.run.smithi070.stdout:4485 punch from 0x94c8f5 to 0x9553c8, (0x8ad3 bytes) 2024-09-11T05:33:54.561 INFO:teuthology.orchestra.run.smithi070.stdout:4486 read 0xa89182e thru 0xa892634 (0xe07 bytes) 2024-09-11T05:33:54.562 INFO:teuthology.orchestra.run.smithi070.stdout:4487 trunc from 0xab9f2a2 to 0xc6dffea 2024-09-11T05:33:54.568 INFO:teuthology.orchestra.run.smithi070.stdout:4488 write 0x832ad61 thru 0x832d0a9 (0x2349 bytes) 2024-09-11T05:33:54.570 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.571 INFO:teuthology.orchestra.run.smithi070.stdout:4490 writesame 0x7555d2f thru 0x755835c data_size 0x1b(0x262e bytes) 2024-09-11T05:33:54.572 INFO:teuthology.orchestra.run.smithi070.stdout:4491 punch from 0x2b43db5 to 0x2b50cab, (0xcef6 bytes) 2024-09-11T05:33:54.572 INFO:teuthology.orchestra.run.smithi070.stdout:4492 writesame 0x46798af thru 0x467da06 data_size 0x4(0x4158 bytes) 2024-09-11T05:33:54.574 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:54.574 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:54.574 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:54.574 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:54.576 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.576 INFO:teuthology.orchestra.run.smithi070.stdout:4494 writesame 0x50e8b2d thru 0x50ee865 data_size 0x6f(0x5d39 bytes) 2024-09-11T05:33:54.578 INFO:teuthology.orchestra.run.smithi070.stdout:4496 punch from 0x4e1f065 to 0x4e2ec73, (0xfc0e bytes) 2024-09-11T05:33:54.583 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:54.591 INFO:teuthology.orchestra.run.smithi070.stdout:4497 trunc from 0xc6dffea to 0x1259751 2024-09-11T05:33:54.615 INFO:teuthology.orchestra.run.smithi070.stdout:4498 writesame 0x207740a thru 0x20852ac data_size 0x1(0xdea3 bytes) 2024-09-11T05:33:54.622 INFO:teuthology.orchestra.run.smithi070.stdout:4500 write 0x2c1d0f1 thru 0x2c234f3 (0x6403 bytes) 2024-09-11T05:33:54.624 INFO:teuthology.orchestra.run.smithi070.stdout:4503 trunc from 0x2c234f4 to 0x2d715c4 2024-09-11T05:33:54.630 INFO:teuthology.orchestra.run.smithi070.stdout:4504 write 0x1e68aa9 thru 0x1e6ecb7 (0x620f bytes) 2024-09-11T05:33:54.631 INFO:teuthology.orchestra.run.smithi070.stdout:4506 read 0x1c68cf thru 0x1d34bd (0xcbef bytes) 2024-09-11T05:33:54.632 INFO:teuthology.orchestra.run.smithi070.stdout:4508 writesame 0x8f6e7 thru 0x9671c data_size 0x35(0x7036 bytes) 2024-09-11T05:33:54.637 INFO:teuthology.orchestra.run.smithi070.stdout:4509 trunc from 0x2d715c4 to 0x5a5a5c 2024-09-11T05:33:54.649 INFO:teuthology.orchestra.run.smithi070.stdout:4510 read 0x16fd86 thru 0x17c526 (0xc7a1 bytes) 2024-09-11T05:33:54.650 INFO:teuthology.orchestra.run.smithi070.stdout:4511 read 0x2172d0 thru 0x21d4eb (0x621c bytes) 2024-09-11T05:33:54.665 INFO:teuthology.orchestra.run.smithi070.stdout:4512 trunc from 0x5a5a5c to 0xd41ddbe 2024-09-11T05:33:54.668 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:54.668+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:54.672 INFO:teuthology.orchestra.run.smithi070.stdout:4514 write 0x937aaac thru 0x937f36d (0x48c2 bytes) 2024-09-11T05:33:54.681 INFO:teuthology.orchestra.run.smithi070.stdout:4515 writesame 0xe284041 thru 0xe292757 data_size 0x1(0xe717 bytes) 2024-09-11T05:33:54.681 INFO:teuthology.orchestra.run.smithi070.stdout:4516 write 0x54cf31d thru 0x54dbdfc (0xcae0 bytes) 2024-09-11T05:33:54.683 INFO:teuthology.orchestra.run.smithi070.stdout:4517 read 0xc5dbf40 thru 0xc5e9e52 (0xdf13 bytes) 2024-09-11T05:33:54.683 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.690 INFO:teuthology.orchestra.run.smithi070.stdout:4519 trunc from 0xe292758 to 0x7ef8b7f 2024-09-11T05:33:54.697 INFO:teuthology.orchestra.run.smithi070.stdout:4520 read 0x8f7ff1 thru 0x907220 (0xf230 bytes) 2024-09-11T05:33:54.704 INFO:teuthology.orchestra.run.smithi070.stdout:4521 trunc from 0x7ef8b7f to 0x1d1ebda 2024-09-11T05:33:54.717 INFO:teuthology.orchestra.run.smithi070.stdout:4523 punch from 0xeaa914 to 0xeaef83, (0x466f bytes) 2024-09-11T05:33:54.717 INFO:teuthology.orchestra.run.smithi070.stdout:4524 read 0x4755d1 thru 0x47d4fd (0x7f2d bytes) 2024-09-11T05:33:54.717 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.728 INFO:teuthology.orchestra.run.smithi070.stdout:4526 trunc from 0x1d1ebda to 0xb621ec9 2024-09-11T05:33:54.729 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:54.728+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:54.730 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:54.730 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:54.730 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:54.733 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.733 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.734 INFO:teuthology.orchestra.run.smithi070.stdout:4532 read 0x1ff8289 thru 0x1ffdb28 (0x58a0 bytes) 2024-09-11T05:33:54.734 INFO:teuthology.orchestra.run.smithi070.stdout:4534 read 0x216ba96 thru 0x2173aaf (0x801a bytes) 2024-09-11T05:33:54.739 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:54.740 INFO:teuthology.orchestra.run.smithi070.stdout:4536 write 0xc429cf3 thru 0xc42e201 (0x450f bytes) 2024-09-11T05:33:54.743 INFO:teuthology.orchestra.run.smithi070.stdout:4537 write 0xb551940 thru 0xb56062a (0xeceb bytes) 2024-09-11T05:33:54.748 INFO:teuthology.orchestra.run.smithi070.stdout:4540 trunc from 0xc42e202 to 0xa5c0a12 2024-09-11T05:33:54.754 INFO:teuthology.orchestra.run.smithi070.stdout:4541 write 0x29383ac thru 0x29402cf (0x7f24 bytes) 2024-09-11T05:33:54.756 INFO:teuthology.orchestra.run.smithi070.stdout:4544 read 0xdc8fee thru 0xdd860c (0xf61f bytes) 2024-09-11T05:33:54.756 INFO:teuthology.orchestra.run.smithi070.stdout:4545 write 0x6be718a thru 0x6bf5be0 (0xea57 bytes) 2024-09-11T05:33:54.758 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.766 INFO:teuthology.orchestra.run.smithi070.stdout:4547 write 0xc121e5e thru 0xc12fd67 (0xdf0a bytes) 2024-09-11T05:33:54.783 INFO:teuthology.orchestra.run.smithi070.stdout:4548 trunc from 0xc12fd68 to 0x36c612 2024-09-11T05:33:54.799 INFO:teuthology.orchestra.run.smithi070.stdout:4550 punch from 0xe5ce3 to 0xf2354, (0xc671 bytes) 2024-09-11T05:33:54.809 INFO:teuthology.orchestra.run.smithi070.stdout:4551 write 0x478f974 thru 0x479eb45 (0xf1d2 bytes) 2024-09-11T05:33:54.813 INFO:teuthology.orchestra.run.smithi070.stdout:4552 trunc from 0x479eb46 to 0x2636c36 2024-09-11T05:33:54.821 INFO:teuthology.orchestra.run.smithi070.stdout:4553 punch from 0x17a419c to 0x17ac231, (0x8095 bytes) 2024-09-11T05:33:54.821 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.827 INFO:teuthology.orchestra.run.smithi070.stdout:4555 write 0x385b7b9 thru 0x386215e (0x69a6 bytes) 2024-09-11T05:33:54.828 INFO:teuthology.orchestra.run.smithi070.stdout:4557 read 0x2bdd188 thru 0x2be7320 (0xa199 bytes) 2024-09-11T05:33:54.829 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:54.827+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:54.835 INFO:teuthology.orchestra.run.smithi070.stdout:4558 write 0x52cac4e thru 0x52d4c5e (0xa011 bytes) 2024-09-11T05:33:54.847 INFO:teuthology.orchestra.run.smithi070.stdout:4560 writesame 0x9138e86 thru 0x91407a6 data_size 0x1(0x7921 bytes) 2024-09-11T05:33:54.847 INFO:teuthology.orchestra.run.smithi070.stdout:4561 writesame 0x41308d4 thru 0x413f4b9 data_size 0x7a(0xebe6 bytes) 2024-09-11T05:33:54.848 INFO:teuthology.orchestra.run.smithi070.stdout:4562 read 0x3d312c5 thru 0x3d34e46 (0x3b82 bytes) 2024-09-11T05:33:54.849 INFO:teuthology.orchestra.run.smithi070.stdout:4563 writesame 0x8cb4467 thru 0x8cb6be5 data_size 0x1(0x277f bytes) 2024-09-11T05:33:54.856 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:54.856 INFO:teuthology.orchestra.run.smithi070.stdout:4566 read 0x2ed91a0 thru 0x2ee70ce (0xdf2f bytes) 2024-09-11T05:33:54.857 INFO:teuthology.orchestra.run.smithi070.stdout:4567 write 0x12b1341 thru 0x12b736b (0x602b bytes) 2024-09-11T05:33:54.860 INFO:teuthology.orchestra.run.smithi070.stdout:4568 write 0x20a79f1 thru 0x20aef14 (0x7524 bytes) 2024-09-11T05:33:54.872 INFO:teuthology.orchestra.run.smithi070.stdout:4571 write 0xde245a8 thru 0xde2db5d (0x95b6 bytes) 2024-09-11T05:33:54.876 INFO:teuthology.orchestra.run.smithi070.stdout:4572 trunc from 0xde2db5e to 0xd41b6a2 2024-09-11T05:33:54.885 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:33:54.885 INFO:teuthology.orchestra.run.smithi070.stdout:4574 write 0x537882c thru 0x5388530 (0xfd05 bytes) 2024-09-11T05:33:54.887 INFO:teuthology.orchestra.run.smithi070.stdout:4575 writesame 0x7a1db2b thru 0x7a1e356 data_size 0x2(0x82c bytes) 2024-09-11T05:33:54.888 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:54.889 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:54.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:54.889 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:54.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.889 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:54.889 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:54.889 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 44.238851818000001, 2024-09-11T05:33:54.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:33:54.889 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.890 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.890 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:54.890 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.890 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.890 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.890 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:33:54.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.890 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:54.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.891 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:54.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.891 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:33:54.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:33:54.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:33:54.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:33:54.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:33:54.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:33:54.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:33:54.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:33:54.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:33:54.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:33:54.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:54.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:33:54.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:33:54.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:54.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:33:54.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:33:54.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.896 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:146253 3.6 3:64dbadcf:::rbd_data.112d55d87bfc.0000000000000332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-11T05:33:54.896 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:33:54.896 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 9.0500369099999993, 2024-09-11T05:33:54.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4166483809999999, 2024-09-11T05:33:54.896 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.896 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.896 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:54.896 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.896 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.896 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.896 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 146253 2024-09-11T05:33:54.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.896 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.897 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:33:54.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.897 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:33:54.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837090+0000", 2024-09-11T05:33:54.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.73e-06 2024-09-11T05:33:54.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837096+0000", 2024-09-11T05:33:54.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3500000000000002e-06 2024-09-11T05:33:54.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837115+0000", 2024-09-11T05:33:54.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8556e-05 2024-09-11T05:33:54.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837124+0000", 2024-09-11T05:33:54.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6739999999999992e-06 2024-09-11T05:33:54.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837184+0000", 2024-09-11T05:33:54.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9960000000000002e-05 2024-09-11T05:33:54.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:33:54.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837188+0000", 2024-09-11T05:33:54.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:33:54.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840481+0000", 2024-09-11T05:33:54.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032924080000000001 2024-09-11T05:33:54.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.901 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840497+0000", 2024-09-11T05:33:54.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6140000000000001e-05 2024-09-11T05:33:54.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.901 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850737+0000", 2024-09-11T05:33:54.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0102404119999999 2024-09-11T05:33:54.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850747+0000", 2024-09-11T05:33:54.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7969999999999995e-06 2024-09-11T05:33:54.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252495+0000", 2024-09-11T05:33:54.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.401748131 2024-09-11T05:33:54.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252636+0000", 2024-09-11T05:33:54.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014118900000000001 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252737+0000", 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00010058 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253433+0000", 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00069601999999999999 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:54.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253604+0000", 2024-09-11T05:33:54.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000170824 2024-09-11T05:33:54.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:54.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253649+0000", 2024-09-11T05:33:54.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5050999999999999e-05 2024-09-11T05:33:54.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253736+0000", 2024-09-11T05:33:54.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7509000000000005e-05 2024-09-11T05:33:54.904 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.904 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:147298 3.6 3:652e51de:::rbd_data.112d55d87bfc.0000000000000377:head [set-alloc-hint object_size 262144 write_size 262144,write 122880~2839] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.6534963339999997, 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62981612099999995, 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 147298 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233630+0000", 2024-09-11T05:33:54.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5489999999999999e-06 2024-09-11T05:33:54.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233637+0000", 2024-09-11T05:33:54.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.272e-06 2024-09-11T05:33:54.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233654+0000", 2024-09-11T05:33:54.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6283999999999999e-05 2024-09-11T05:33:54.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233662+0000", 2024-09-11T05:33:54.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.875e-06 2024-09-11T05:33:54.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233723+0000", 2024-09-11T05:33:54.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1501000000000006e-05 2024-09-11T05:33:54.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:54.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233732+0000", 2024-09-11T05:33:54.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0699999999999996e-06 2024-09-11T05:33:54.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862055+0000", 2024-09-11T05:33:54.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62832274799999999 2024-09-11T05:33:54.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862219+0000", 2024-09-11T05:33:54.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016404899999999999 2024-09-11T05:33:54.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:54.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862313+0000", 2024-09-11T05:33:54.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4105999999999997e-05 2024-09-11T05:33:54.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:54.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862981+0000", 2024-09-11T05:33:54.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00066744199999999997 2024-09-11T05:33:54.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.911 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:54.911 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863382+0000", 2024-09-11T05:33:54.911 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040111200000000002 2024-09-11T05:33:54.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.911 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:54.911 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863419+0000", 2024-09-11T05:33:54.911 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6974000000000002e-05 2024-09-11T05:33:54.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.911 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.911 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863445+0000", 2024-09-11T05:33:54.911 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6139000000000002e-05 2024-09-11T05:33:54.912 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.912 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.912 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.912 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.912 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151292 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.912 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:33:54.912 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93084493899999998, 2024-09-11T05:33:54.912 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054346481000000002, 2024-09-11T05:33:54.912 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.912 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.912 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.912 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.913 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.913 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.913 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151292 2024-09-11T05:33:54.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.913 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:33:54.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956283+0000", 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2450000000000001e-06 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956290+0000", 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0910000000000004e-06 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956296+0000", 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.947e-06 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010460+0000", 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054164165 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.916 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010537+0000", 2024-09-11T05:33:54.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6965000000000006e-05 2024-09-11T05:33:54.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.916 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010626+0000", 2024-09-11T05:33:54.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9628000000000003e-05 2024-09-11T05:33:54.916 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.916 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.916 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.917 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151293 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1933312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.917 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:33:54.917 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93082209599999999, 2024-09-11T05:33:54.917 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054563858999999999, 2024-09-11T05:33:54.917 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.917 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.917 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.917 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.917 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.917 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.917 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151293 2024-09-11T05:33:54.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.918 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.918 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.918 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:33:54.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.918 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.918 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:33:54.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.46e-07 2024-09-11T05:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956306+0000", 2024-09-11T05:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2259999999999999e-06 2024-09-11T05:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.920 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956312+0000", 2024-09-11T05:33:54.920 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:33:54.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.920 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.920 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956317+0000", 2024-09-11T05:33:54.920 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:33:54.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.921 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010671+0000", 2024-09-11T05:33:54.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054353830999999998 2024-09-11T05:33:54.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.921 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010757+0000", 2024-09-11T05:33:54.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6120999999999998e-05 2024-09-11T05:33:54.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010867+0000", 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000109687 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151294 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2179072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.930800234, 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054741825000000001, 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.922 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.923 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.923 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.923 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.923 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151294 2024-09-11T05:33:54.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.923 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.924 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:33:54.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.925 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:33:54.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.925 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:33:54.926 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.84e-07 2024-09-11T05:33:54.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.926 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.926 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.926 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956326+0000", 2024-09-11T05:33:54.926 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.483e-06 2024-09-11T05:33:54.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.927 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.927 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.927 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956330+0000", 2024-09-11T05:33:54.927 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8519999999999997e-06 2024-09-11T05:33:54.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.927 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.927 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.927 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956334+0000", 2024-09-11T05:33:54.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4139999999999998e-06 2024-09-11T05:33:54.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010894+0000", 2024-09-11T05:33:54.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054560243000000001 2024-09-11T05:33:54.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010970+0000", 2024-09-11T05:33:54.929 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6138999999999997e-05 2024-09-11T05:33:54.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.930 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.930 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011067+0000", 2024-09-11T05:33:54.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6409999999999993e-05 2024-09-11T05:33:54.930 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.930 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.930 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.931 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.931 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151295 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2392064~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.931 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:33:54.931 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93078756299999998, 2024-09-11T05:33:54.931 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054949748999999999, 2024-09-11T05:33:54.931 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.931 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.931 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.932 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.932 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.932 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.932 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151295 2024-09-11T05:33:54.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.932 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.932 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.932 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.932 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:33:54.932 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.932 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.932 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.933 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:33:54.933 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.933 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.933 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.933 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956338+0000", 2024-09-11T05:33:54.933 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.23e-07 2024-09-11T05:33:54.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.934 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.934 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.934 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956339+0000", 2024-09-11T05:33:54.934 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.243e-06 2024-09-11T05:33:54.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.934 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.934 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.934 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956342+0000", 2024-09-11T05:33:54.934 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.473e-06 2024-09-11T05:33:54.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.934 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.935 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.935 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956345+0000", 2024-09-11T05:33:54.935 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:33:54.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.935 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.935 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.935 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011109+0000", 2024-09-11T05:33:54.935 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054763698999999999 2024-09-11T05:33:54.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.935 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.935 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.935 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011188+0000", 2024-09-11T05:33:54.935 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8887999999999994e-05 2024-09-11T05:33:54.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.936 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.936 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.936 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011287+0000", 2024-09-11T05:33:54.936 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9504000000000001e-05 2024-09-11T05:33:54.936 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.936 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.936 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.936 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.936 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151296 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.936 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:33:54.937 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.930776453, 2024-09-11T05:33:54.937 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055045187000000002, 2024-09-11T05:33:54.937 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.937 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.937 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.937 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.937 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.937 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.937 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151296 2024-09-11T05:33:54.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.937 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.937 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.937 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:33:54.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:33:54.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956349+0000", 2024-09-11T05:33:54.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:33:54.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.939 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.939 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956350+0000", 2024-09-11T05:33:54.939 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:33:54.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.939 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.939 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956353+0000", 2024-09-11T05:33:54.939 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.016e-06 2024-09-11T05:33:54.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.939 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.939 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956355+0000", 2024-09-11T05:33:54.940 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5509999999999998e-06 2024-09-11T05:33:54.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.940 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.940 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.940 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011303+0000", 2024-09-11T05:33:54.940 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054947306000000001 2024-09-11T05:33:54.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.940 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.940 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.940 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011342+0000", 2024-09-11T05:33:54.940 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9057999999999998e-05 2024-09-11T05:33:54.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011394+0000", 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1925999999999997e-05 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151297 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2818048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93076652199999999, 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055238158000000002, 2024-09-11T05:33:54.941 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.942 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.942 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.942 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.942 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.942 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.942 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151297 2024-09-11T05:33:54.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.942 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.942 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.942 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.942 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:33:54.943 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.943 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.943 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.943 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:33:54.943 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.943 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.943 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.943 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956359+0000", 2024-09-11T05:33:54.943 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:33:54.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.943 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.944 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.944 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956360+0000", 2024-09-11T05:33:54.944 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1030000000000001e-06 2024-09-11T05:33:54.944 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.944 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.944 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.944 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956363+0000", 2024-09-11T05:33:54.944 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.021e-06 2024-09-11T05:33:54.944 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.944 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.944 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.945 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956365+0000", 2024-09-11T05:33:54.945 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4770000000000002e-06 2024-09-11T05:33:54.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.945 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.945 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011425+0000", 2024-09-11T05:33:54.945 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055059967000000001 2024-09-11T05:33:54.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.945 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.945 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011506+0000", 2024-09-11T05:33:54.945 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1063000000000006e-05 2024-09-11T05:33:54.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011597+0000", 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0299999999999999e-05 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151298 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3031040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93075655599999996, 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055425825999999997, 2024-09-11T05:33:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151298 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.948 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.948 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:33:54.948 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.948 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.948 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.948 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.948 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956369+0000", 2024-09-11T05:33:54.948 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4400000000000001e-07 2024-09-11T05:33:54.948 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.948 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.949 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.949 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956370+0000", 2024-09-11T05:33:54.949 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.068e-06 2024-09-11T05:33:54.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.949 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.949 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.949 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956373+0000", 2024-09-11T05:33:54.949 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0419999999999998e-06 2024-09-11T05:33:54.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.949 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.949 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.950 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956375+0000", 2024-09-11T05:33:54.950 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:33:54.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.950 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.950 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.950 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011631+0000", 2024-09-11T05:33:54.950 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055255116999999999 2024-09-11T05:33:54.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.950 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.950 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.950 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011703+0000", 2024-09-11T05:33:54.950 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2554999999999999e-05 2024-09-11T05:33:54.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.951 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.951 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.951 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011794+0000", 2024-09-11T05:33:54.951 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1119999999999995e-05 2024-09-11T05:33:54.951 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.951 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.951 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.951 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.952 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151299 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3276800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.952 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:33:54.952 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93074525399999997, 2024-09-11T05:33:54.952 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055567477999999997, 2024-09-11T05:33:54.952 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.952 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.952 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.952 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.952 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.952 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.952 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151299 2024-09-11T05:33:54.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.953 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.953 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.953 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.953 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:33:54.953 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.953 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.953 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.953 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.953 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:33:54.953 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.953 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.953 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.954 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.954 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:33:54.954 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:33:54.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.954 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.954 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.954 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956382+0000", 2024-09-11T05:33:54.954 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.72e-06 2024-09-11T05:33:54.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.954 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.954 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956386+0000", 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0990000000000001e-06 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956390+0000", 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.318e-06 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011823+0000", 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055432976000000002 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.955 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011882+0000", 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8656999999999998e-05 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011947+0000", 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5177000000000003e-05 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151300 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3489792~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.956 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:33:54.957 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93072878699999995, 2024-09-11T05:33:54.957 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055745232999999998, 2024-09-11T05:33:54.957 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.957 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.957 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.957 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.957 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.957 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.957 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151300 2024-09-11T05:33:54.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.957 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956397+0000", 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:33:54.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956398+0000", 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.869e-06 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956404+0000", 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956407+0000", 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.191e-06 2024-09-11T05:33:54.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011981+0000", 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055573553999999997 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012051+0000", 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9542999999999995e-05 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012141+0000", 2024-09-11T05:33:54.960 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0845000000000002e-05 2024-09-11T05:33:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151301 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3702784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:33:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93071385799999995, 2024-09-11T05:33:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055834747999999997, 2024-09-11T05:33:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.962 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.962 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.962 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151301 2024-09-11T05:33:54.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.962 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.962 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.962 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.962 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:33:54.962 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.962 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.962 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956413+0000", 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2810000000000001e-06 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.964 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.964 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956416+0000", 2024-09-11T05:33:54.964 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1559999999999999e-06 2024-09-11T05:33:54.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.964 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.964 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.964 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956418+0000", 2024-09-11T05:33:54.964 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:33:54.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.964 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.964 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.965 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012155+0000", 2024-09-11T05:33:54.965 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055736651999999998 2024-09-11T05:33:54.965 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.965 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.965 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.965 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012193+0000", 2024-09-11T05:33:54.965 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7848000000000001e-05 2024-09-11T05:33:54.965 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.965 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.965 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.965 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012246+0000", 2024-09-11T05:33:54.965 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3041000000000003e-05 2024-09-11T05:33:54.966 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.966 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.966 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.966 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.966 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.966 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151302 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3915776~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.966 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:33:54.966 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93070375500000002, 2024-09-11T05:33:54.966 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056035532999999998, 2024-09-11T05:33:54.966 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.966 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.967 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.967 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.967 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.967 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.967 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151302 2024-09-11T05:33:54.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.967 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.967 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.967 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.967 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:33:54.967 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.968 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.968 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:33:54.968 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.968 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.968 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:33:54.968 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:33:54.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956426+0000", 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.853e-06 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956430+0000", 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3699999999999999e-06 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956432+0000", 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5979999999999999e-06 2024-09-11T05:33:54.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012281+0000", 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055848644000000003 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012358+0000", 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6662000000000006e-05 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012457+0000", 2024-09-11T05:33:54.970 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9197999999999995e-05 2024-09-11T05:33:54.971 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.971 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.971 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.971 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.971 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.971 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151303 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4128768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.971 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:33:54.971 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93068917299999998, 2024-09-11T05:33:54.971 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056186709000000001, 2024-09-11T05:33:54.971 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.971 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.972 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.972 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.972 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.972 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.972 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151303 2024-09-11T05:33:54.972 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.972 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.972 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.972 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.972 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:33:54.972 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.972 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.972 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956437+0000", 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.201e-06 2024-09-11T05:33:54.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.974 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.974 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.974 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956440+0000", 2024-09-11T05:33:54.974 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-06 2024-09-11T05:33:54.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.974 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.974 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.974 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956443+0000", 2024-09-11T05:33:54.974 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5909999999999998e-06 2024-09-11T05:33:54.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.974 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.974 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012494+0000", 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056051541000000003 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012558+0000", 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3347000000000002e-05 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012622+0000", 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4760999999999999e-05 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.975 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.976 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.976 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.976 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151304 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.976 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:33:54.976 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93067911599999997, 2024-09-11T05:33:54.976 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056360149999999998, 2024-09-11T05:33:54.977 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.977 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.977 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.977 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.977 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.977 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.978 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151304 2024-09-11T05:33:54.978 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.978 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.978 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.978 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.979 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:33:54.979 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.979 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.979 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.979 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:33:54.979 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.980 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.980 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.980 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:33:54.980 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:33:54.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.981 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.981 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.981 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956447+0000", 2024-09-11T05:33:54.981 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.153e-06 2024-09-11T05:33:54.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.981 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.982 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.982 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956450+0000", 2024-09-11T05:33:54.982 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9909999999999998e-06 2024-09-11T05:33:54.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.982 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.982 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.983 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956453+0000", 2024-09-11T05:33:54.983 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.447e-06 2024-09-11T05:33:54.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.983 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.983 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.983 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012660+0000", 2024-09-11T05:33:54.984 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056207510000000002 2024-09-11T05:33:54.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.984 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.984 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.984 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012741+0000", 2024-09-11T05:33:54.985 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0734000000000003e-05 2024-09-11T05:33:54.985 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.985 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.985 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.985 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012806+0000", 2024-09-11T05:33:54.985 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5087999999999998e-05 2024-09-11T05:33:54.986 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.986 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.986 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.986 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.986 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.986 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151305 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4587520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.986 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:33:54.987 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93066935500000003, 2024-09-11T05:33:54.987 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056476407999999999, 2024-09-11T05:33:54.987 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.987 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.987 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.987 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.987 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.988 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.988 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151305 2024-09-11T05:33:54.988 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.988 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.988 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.988 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.989 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:33:54.989 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.989 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.989 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:54.989 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:33:54.990 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:54.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.990 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.990 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:54.990 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:33:54.990 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:33:54.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.991 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.991 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:54.991 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956457+0000", 2024-09-11T05:33:54.991 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.353e-06 2024-09-11T05:33:54.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.992 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.992 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:54.992 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956460+0000", 2024-09-11T05:33:54.992 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0060000000000001e-06 2024-09-11T05:33:54.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.993 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.993 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:54.993 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956463+0000", 2024-09-11T05:33:54.993 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.452e-06 2024-09-11T05:33:54.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.993 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.994 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:54.994 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012834+0000", 2024-09-11T05:33:54.994 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056370917999999999 2024-09-11T05:33:54.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.994 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.994 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:54.995 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012877+0000", 2024-09-11T05:33:54.995 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000999999999997e-05 2024-09-11T05:33:54.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.995 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.995 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:54.995 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012932+0000", 2024-09-11T05:33:54.996 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5470000000000003e-05 2024-09-11T05:33:54.996 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.996 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:54.996 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:54.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.996 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.997 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151306 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4800512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:54.997 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:33:54.997 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93065937499999996, 2024-09-11T05:33:54.997 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056579203000000002, 2024-09-11T05:33:54.997 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:54.998 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:54.998 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:54.998 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:54.998 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:54.998 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:54.998 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151306 2024-09-11T05:33:54.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:54.999 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:54.999 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:54.999 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:54.999 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:33:54.999 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:55.000 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.000 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.000 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:55.000 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:33:55.000 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:55.000 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.001 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.001 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:55.001 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:33:55.001 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.28e-07 2024-09-11T05:33:55.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.002 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.002 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:55.002 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956467+0000", 2024-09-11T05:33:55.002 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.088e-06 2024-09-11T05:33:55.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.002 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.003 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:55.003 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956470+0000", 2024-09-11T05:33:55.003 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0240000000000002e-06 2024-09-11T05:33:55.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.003 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.003 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:55.004 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956472+0000", 2024-09-11T05:33:55.004 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4609999999999998e-06 2024-09-11T05:33:55.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.004 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.004 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:55.004 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012953+0000", 2024-09-11T05:33:55.005 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056480524999999997 2024-09-11T05:33:55.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.005 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.005 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:55.005 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012994+0000", 2024-09-11T05:33:55.006 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1394999999999999e-05 2024-09-11T05:33:55.006 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.006 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.006 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:55.006 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013045+0000", 2024-09-11T05:33:55.006 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0482000000000002e-05 2024-09-11T05:33:55.007 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:55.007 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:55.007 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:55.007 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.007 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.007 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151307 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5013504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:55.008 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:33:55.008 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93064970599999997, 2024-09-11T05:33:55.008 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056680525000000002, 2024-09-11T05:33:55.008 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:55.008 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:55.009 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:55.009 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:55.009 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:55.009 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:55.009 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151307 2024-09-11T05:33:55.009 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.010 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:55.010 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.010 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:55.010 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:33:55.010 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:55.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.011 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.011 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:55.011 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:33:55.011 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:55.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.012 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.012 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:55.012 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:33:55.012 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:33:55.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.013 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.013 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:55.013 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956476+0000", 2024-09-11T05:33:55.013 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0359999999999999e-06 2024-09-11T05:33:55.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.014 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.014 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:55.014 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956479+0000", 2024-09-11T05:33:55.014 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8899999999999999e-06 2024-09-11T05:33:55.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.014 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.015 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:55.015 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956482+0000", 2024-09-11T05:33:55.015 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5380000000000001e-06 2024-09-11T05:33:55.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.015 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.015 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:55.016 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013065+0000", 2024-09-11T05:33:55.016 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056582983000000003 2024-09-11T05:33:55.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.016 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.016 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:55.016 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013104+0000", 2024-09-11T05:33:55.017 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9119999999999998e-05 2024-09-11T05:33:55.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.017 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.017 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:55.017 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013156+0000", 2024-09-11T05:33:55.017 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1743999999999998e-05 2024-09-11T05:33:55.017 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:55.017 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151308 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5226496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.93063237499999996, 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056772738000000003, 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:55.018 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151308 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.019 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:55.020 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:33:55.020 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2599999999999998e-07 2024-09-11T05:33:55.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.020 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.020 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:55.020 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956495+0000", 2024-09-11T05:33:55.020 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9750000000000001e-06 2024-09-11T05:33:55.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.020 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.020 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:55.020 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956499+0000", 2024-09-11T05:33:55.020 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5179999999999998e-06 2024-09-11T05:33:55.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956502+0000", 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7530000000000002e-06 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013177+0000", 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056674536999999997 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013215+0000", 2024-09-11T05:33:55.021 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8578999999999998e-05 2024-09-11T05:33:55.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:55.022 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:55.022 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:55.022 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013265+0000", 2024-09-11T05:33:55.022 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0049999999999997e-05 2024-09-11T05:33:55.022 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:55.022 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:55.022 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:55.022 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:55.022 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:55.022 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:55.023 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:33:55.024 INFO:teuthology.orchestra.run.smithi070.stdout:4577 write 0x3d85089 thru 0x3d8a3af (0x5327 bytes) 2024-09-11T05:33:55.024 INFO:teuthology.orchestra.run.smithi070.stdout:4578 punch from 0x5c956d2 to 0x5ca45a2, (0xeed0 bytes) 2024-09-11T05:33:55.024 INFO:teuthology.orchestra.run.smithi070.stdout:4579 write 0x7be591c thru 0x7bf4e5a (0xf53f bytes) 2024-09-11T05:33:55.024 INFO:teuthology.orchestra.run.smithi070.stdout:4580 clone 29 order 21 su 1048576 sc 10 2024-09-11T05:33:55.025 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:55.024+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:55.025 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:55.125 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:55.123+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:55.131 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:55.131 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:55.131 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:55.131 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:55.140 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:55.147 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:55.164 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:55.164 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:55.182 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:55.183 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:55.226 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:55.226+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:55.250 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:55.250 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:55.258 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:55.327 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:55.327+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:55.414 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:55.415 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:55.416 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:55.417 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:55.428 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:55.428+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:55.429 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:55.437 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:55.437 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:55.455 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:55.455 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:55.471 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:55.471 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:55.488 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:55.488 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:55.533 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:55.533 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:55.534 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:55.532+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:55.542 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:55.630 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:55.630+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:55.686 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:55.686 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:55.694 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:55.737 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:55.737+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:55.797 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:55.797 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:55.805 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:55.847 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:55.846+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:55.883 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T05:33:55.940 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:55.940+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:55.962 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:55.962 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:55.962 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone28 from 0xd41b6a2 (overlap 0x36c612) to 0x57a35 2024-09-11T05:33:55.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:55.992 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 5, 6, 7] out_osds: [4, 3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:33:55.993 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:33:55.993 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-11T05:33:55.993 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T05:33:55.993 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T05:33:55.993 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-11T05:33:56.052 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-11T05:33:56.052 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:56.052+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:56.054 INFO:teuthology.orchestra.run.smithi070.stdout:4581 write 0x71753e0 thru 0x7179ca4 (0x48c5 bytes) 2024-09-11T05:33:56.060 INFO:teuthology.orchestra.run.smithi070.stdout:4582 punch from 0x172ba19 to 0x17338e7, (0x7ece bytes) 2024-09-11T05:33:56.065 INFO:teuthology.orchestra.run.smithi070.stdout:4583 write 0xde59865 thru 0xde5b64d (0x1de9 bytes) 2024-09-11T05:33:56.068 INFO:teuthology.orchestra.run.smithi070.stdout:4584 write 0x9dd97b7 thru 0x9de60c4 (0xc90e bytes) 2024-09-11T05:33:56.072 INFO:teuthology.orchestra.run.smithi070.stdout:4585 read 0x99fc592 thru 0x99fd3c4 (0xe33 bytes) 2024-09-11T05:33:56.072 INFO:teuthology.orchestra.run.smithi070.stdout:4586 punch from 0x450707f to 0x4515bea, (0xeb6b bytes) 2024-09-11T05:33:56.073 INFO:teuthology.orchestra.run.smithi070.stdout:4587 write 0xd6205ca thru 0xd620dea (0x821 bytes) 2024-09-11T05:33:56.076 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.076 INFO:teuthology.orchestra.run.smithi070.stdout:4589 write 0x213198 thru 0x221266 (0xe0cf bytes) 2024-09-11T05:33:56.084 INFO:teuthology.orchestra.run.smithi070.stdout:4590 read 0xdae9c02 thru 0xdaecb29 (0x2f28 bytes) 2024-09-11T05:33:56.084 INFO:teuthology.orchestra.run.smithi070.stdout:4594 writesame 0x673c667 thru 0x674c36f data_size 0x1(0xfd09 bytes) 2024-09-11T05:33:56.104 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:56.104 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T05:33:56.104 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:56.122 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:56.122 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:56.124 INFO:teuthology.orchestra.run.smithi070.stdout:4597 write 0xc0baa60 thru 0xc0c5eb2 (0xb453 bytes) 2024-09-11T05:33:56.128 INFO:teuthology.orchestra.run.smithi070.stdout:4599 read 0xdc78ad5 thru 0xdc825a8 (0x9ad4 bytes) 2024-09-11T05:33:56.132 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:56.144 INFO:teuthology.orchestra.run.smithi070.stdout:4600 trunc from 0xde5b64e to 0x1076c1f 2024-09-11T05:33:56.144 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:56.144+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:56.167 INFO:teuthology.orchestra.run.smithi070.stdout:4602 write 0x192f6cc thru 0x192faef (0x424 bytes) 2024-09-11T05:33:56.170 INFO:teuthology.orchestra.run.smithi070.stdout:4604 write 0x17a7d34 thru 0x17abbcf (0x3e9c bytes) 2024-09-11T05:33:56.173 INFO:teuthology.orchestra.run.smithi070.stdout:4606 read 0x6b7575 thru 0x6b9cfe (0x278a bytes) 2024-09-11T05:33:56.188 INFO:teuthology.orchestra.run.smithi070.stdout:4607 write 0xa101bb9 thru 0xa109edf (0x8327 bytes) 2024-09-11T05:33:56.191 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.191 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.191 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.191 INFO:teuthology.orchestra.run.smithi070.stdout:4616 read 0x10af1d8 thru 0x10afe9b (0xcc4 bytes) 2024-09-11T05:33:56.192 INFO:teuthology.orchestra.run.smithi070.stdout:4617 read 0x238e533 thru 0x2398674 (0xa142 bytes) 2024-09-11T05:33:56.192 INFO:teuthology.orchestra.run.smithi070.stdout:4618 read 0x7c99531 thru 0x7ca42ac (0xad7c bytes) 2024-09-11T05:33:56.192 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.192 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.192 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.201 INFO:teuthology.orchestra.run.smithi070.stdout:4622 trunc from 0xa109ee0 to 0x2699ae5 2024-09-11T05:33:56.226 INFO:teuthology.orchestra.run.smithi070.stdout:4625 write 0xb017214 thru 0xb01bb0b (0x48f8 bytes) 2024-09-11T05:33:56.229 INFO:teuthology.orchestra.run.smithi070.stdout:4627 write 0x11432bd thru 0x1146874 (0x35b8 bytes) 2024-09-11T05:33:56.230 INFO:teuthology.orchestra.run.smithi070.stdout:4628 read 0x5d1d4bd thru 0x5d243c4 (0x6f08 bytes) 2024-09-11T05:33:56.230 INFO:teuthology.orchestra.run.smithi070.stdout:4629 write 0x500aa1a thru 0x50113b9 (0x69a0 bytes) 2024-09-11T05:33:56.235 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:56.235+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:56.238 INFO:teuthology.orchestra.run.smithi070.stdout:4630 write 0xb6e4ab3 thru 0xb6e7638 (0x2b86 bytes) 2024-09-11T05:33:56.241 INFO:teuthology.orchestra.run.smithi070.stdout:4631 read 0x945a5f1 thru 0x94612e7 (0x6cf7 bytes) 2024-09-11T05:33:56.241 INFO:teuthology.orchestra.run.smithi070.stdout:4633 read 0x79cf2e6 thru 0x79d4a34 (0x574f bytes) 2024-09-11T05:33:56.241 INFO:teuthology.orchestra.run.smithi070.stdout:4634 read 0x287fb3c thru 0x2880b25 (0xfea bytes) 2024-09-11T05:33:56.241 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.241 INFO:teuthology.orchestra.run.smithi070.stdout:4638 write 0x4d83be3 thru 0x4d8ca10 (0x8e2e bytes) 2024-09-11T05:33:56.251 INFO:teuthology.orchestra.run.smithi070.stdout:4639 writesame 0xe046763 thru 0xe04a186 data_size 0x4(0x3a24 bytes) 2024-09-11T05:33:56.252 INFO:teuthology.orchestra.run.smithi070.stdout:4641 read 0x166fda1 thru 0x1676e0e (0x706e bytes) 2024-09-11T05:33:56.252 INFO:teuthology.orchestra.run.smithi070.stdout:4642 write 0xc15835f thru 0xc15d107 (0x4da9 bytes) 2024-09-11T05:33:56.255 INFO:teuthology.orchestra.run.smithi070.stdout:4643 punch from 0x3dbaa07 to 0x3dca040, (0xf639 bytes) 2024-09-11T05:33:56.255 INFO:teuthology.orchestra.run.smithi070.stdout:4645 write 0x114e613 thru 0x115038b (0x1d79 bytes) 2024-09-11T05:33:56.256 INFO:teuthology.orchestra.run.smithi070.stdout:4648 read 0x8f30830 thru 0x8f30cde (0x4af bytes) 2024-09-11T05:33:56.257 INFO:teuthology.orchestra.run.smithi070.stdout:4649 read 0xaa1c275 thru 0xaa22448 (0x61d4 bytes) 2024-09-11T05:33:56.257 INFO:teuthology.orchestra.run.smithi070.stdout:4650 write 0xa48742f thru 0xa496605 (0xf1d7 bytes) 2024-09-11T05:33:56.259 INFO:teuthology.orchestra.run.smithi070.stdout:4651 write 0xc229876 thru 0xc22d387 (0x3b12 bytes) 2024-09-11T05:33:56.262 INFO:teuthology.orchestra.run.smithi070.stdout:4652 read 0xdb8ecdd thru 0xdb9c17c (0xd4a0 bytes) 2024-09-11T05:33:56.263 INFO:teuthology.orchestra.run.smithi070.stdout:4653 read 0x1f4c946 thru 0x1f5a01a (0xd6d5 bytes) 2024-09-11T05:33:56.263 INFO:teuthology.orchestra.run.smithi070.stdout:4654 read 0x6904b58 thru 0x690b5aa (0x6a53 bytes) 2024-09-11T05:33:56.263 INFO:teuthology.orchestra.run.smithi070.stdout:4655 write 0xa121da3 thru 0xa1256af (0x390d bytes) 2024-09-11T05:33:56.266 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:56.266 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:56.266 INFO:teuthology.orchestra.run.smithi070.stdout:4657 trunc from 0xe04a187 to 0xe8d0a68 2024-09-11T05:33:56.271 INFO:teuthology.orchestra.run.smithi070.stdout:4658 read 0x1d1b6e3 thru 0x1d27710 (0xc02e bytes) 2024-09-11T05:33:56.271 INFO:teuthology.orchestra.run.smithi070.stdout:4659 writesame 0x2e1a582 thru 0x2e1ab4c data_size 0x1(0x5cb bytes) 2024-09-11T05:33:56.274 INFO:teuthology.orchestra.run.smithi070.stdout:4660 write 0x415aed8 thru 0x41687fe (0xd927 bytes) 2024-09-11T05:33:56.276 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:33:56.278 INFO:teuthology.orchestra.run.smithi070.stdout:4661 write 0xc3d8827 thru 0xc3e045e (0x7c38 bytes) 2024-09-11T05:33:56.281 INFO:teuthology.orchestra.run.smithi070.stdout:4662 punch from 0x623b937 to 0x623e30d, (0x29d6 bytes) 2024-09-11T05:33:56.281 INFO:teuthology.orchestra.run.smithi070.stdout:4663 read 0x877d7d thru 0x87cede (0x5162 bytes) 2024-09-11T05:33:56.282 INFO:teuthology.orchestra.run.smithi070.stdout:4664 punch from 0x613045a to 0x613a63d, (0xa1e3 bytes) 2024-09-11T05:33:56.282 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.282 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.282 INFO:teuthology.orchestra.run.smithi070.stdout:4667 punch from 0x9818c18 to 0x98222ac, (0x9694 bytes) 2024-09-11T05:33:56.283 INFO:teuthology.orchestra.run.smithi070.stdout:4668 read 0xbbc2bf1 thru 0xbbc38e8 (0xcf8 bytes) 2024-09-11T05:33:56.283 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.283 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.283 INFO:teuthology.orchestra.run.smithi070.stdout:4672 read 0xb01f8c1 thru 0xb022182 (0x28c2 bytes) 2024-09-11T05:33:56.283 INFO:teuthology.orchestra.run.smithi070.stdout:4673 read 0x95e15ba thru 0x95e4f5c (0x39a3 bytes) 2024-09-11T05:33:56.283 INFO:teuthology.orchestra.run.smithi070.stdout:4674 read 0xa866a62 thru 0xa874d5c (0xe2fb bytes) 2024-09-11T05:33:56.283 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.283 INFO:teuthology.orchestra.run.smithi070.stdout:4676 read 0x1c756a5 thru 0x1c7f7f7 (0xa153 bytes) 2024-09-11T05:33:56.283 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.283 INFO:teuthology.orchestra.run.smithi070.stdout:4679 write 0x45c7f03 thru 0x45d0f4f (0x904d bytes) 2024-09-11T05:33:56.285 INFO:teuthology.orchestra.run.smithi070.stdout:4680 write 0x39f23ee thru 0x39f3082 (0xc95 bytes) 2024-09-11T05:33:56.303 INFO:teuthology.orchestra.run.smithi070.stdout:4681 trunc from 0xe8d0a68 to 0x15f62b3 2024-09-11T05:33:56.319 INFO:teuthology.orchestra.run.smithi070.stdout:4682 read 0x15e980c thru 0x15f1349 (0x7b3e bytes) 2024-09-11T05:33:56.319 INFO:teuthology.orchestra.run.smithi070.stdout:4683 read 0x3450d0 thru 0x346acf (0x1a00 bytes) 2024-09-11T05:33:56.319 INFO:teuthology.orchestra.run.smithi070.stdout:4684 punch from 0x13e58bc to 0x13f30ce, (0xd812 bytes) 2024-09-11T05:33:56.320 INFO:teuthology.orchestra.run.smithi070.stdout:4685 read 0x61de9a thru 0x624a97 (0x6bfe bytes) 2024-09-11T05:33:56.320 INFO:teuthology.orchestra.run.smithi070.stdout:4687 punch from 0x789387 to 0x7913e3, (0x805c bytes) 2024-09-11T05:33:56.336 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:56.336+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:56.339 INFO:teuthology.orchestra.run.smithi070.stdout:4688 write 0xd7f2a7b thru 0xd800a8b (0xe011 bytes) 2024-09-11T05:33:56.343 INFO:teuthology.orchestra.run.smithi070.stdout:4689 read 0x657f4fa thru 0x6581078 (0x1b7f bytes) 2024-09-11T05:33:56.343 INFO:teuthology.orchestra.run.smithi070.stdout:4690 read 0x2b046ec thru 0x2b0e894 (0xa1a9 bytes) 2024-09-11T05:33:56.343 INFO:teuthology.orchestra.run.smithi070.stdout:4691 punch from 0x234eb6d to 0x2358600, (0x9a93 bytes) 2024-09-11T05:33:56.343 INFO:teuthology.orchestra.run.smithi070.stdout:4693 write 0x8978a95 thru 0x89810f4 (0x8660 bytes) 2024-09-11T05:33:56.346 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.346 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.346 INFO:teuthology.orchestra.run.smithi070.stdout:4696 write 0x3186fc7 thru 0x3189bb3 (0x2bed bytes) 2024-09-11T05:33:56.355 INFO:teuthology.orchestra.run.smithi070.stdout:4697 writesame 0xea094d3 thru 0xea0b1d5 data_size 0x1(0x1d03 bytes) 2024-09-11T05:33:56.355 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.355 INFO:teuthology.orchestra.run.smithi070.stdout:4699 writesame 0x9b5f1e thru 0x9b7b55 data_size 0x38(0x1c38 bytes) 2024-09-11T05:33:56.357 INFO:teuthology.orchestra.run.smithi070.stdout:4700 read 0x2a92409 thru 0x2a9560a (0x3202 bytes) 2024-09-11T05:33:56.357 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.357 INFO:teuthology.orchestra.run.smithi070.stdout:4704 read 0x5ed9db4 thru 0x5edf204 (0x5451 bytes) 2024-09-11T05:33:56.357 INFO:teuthology.orchestra.run.smithi070.stdout:4705 write 0x34af3b thru 0x3565a1 (0xb667 bytes) 2024-09-11T05:33:56.361 INFO:teuthology.orchestra.run.smithi070.stdout:4706 write 0x28b610f thru 0x28c00f3 (0x9fe5 bytes) 2024-09-11T05:33:56.364 INFO:teuthology.orchestra.run.smithi070.stdout:4707 punch from 0x211fee2 to 0x212bd08, (0xbe26 bytes) 2024-09-11T05:33:56.364 INFO:teuthology.orchestra.run.smithi070.stdout:4708 read 0x9e14670 thru 0x9e16954 (0x22e5 bytes) 2024-09-11T05:33:56.364 INFO:teuthology.orchestra.run.smithi070.stdout:4712 read 0x57def22 thru 0x57e26cf (0x37ae bytes) 2024-09-11T05:33:56.364 INFO:teuthology.orchestra.run.smithi070.stdout:4714 writesame 0x9999780 thru 0x99a8876 data_size 0x1(0xf0f7 bytes) 2024-09-11T05:33:56.398 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:56.398 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:56.399 INFO:teuthology.orchestra.run.smithi070.stdout:4715 write 0x7a707c5 thru 0x7a75f3c (0x5778 bytes) 2024-09-11T05:33:56.404 INFO:teuthology.orchestra.run.smithi070.stdout:4716 write 0x568df1a thru 0x5698906 (0xa9ed bytes) 2024-09-11T05:33:56.407 INFO:teuthology.orchestra.run.smithi070.stdout:4717 read 0x7ae1e9f thru 0x7af00a8 (0xe20a bytes) 2024-09-11T05:33:56.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:33:56.409 INFO:teuthology.orchestra.run.smithi070.stdout:4720 read 0x79e1436 thru 0x79ee6cd (0xd298 bytes) 2024-09-11T05:33:56.409 INFO:teuthology.orchestra.run.smithi070.stdout:4721 read 0xcc5750 thru 0xcc673b (0xfec bytes) 2024-09-11T05:33:56.409 INFO:teuthology.orchestra.run.smithi070.stdout:4723 write 0x8458ad2 thru 0x84654b6 (0xc9e5 bytes) 2024-09-11T05:33:56.410 INFO:teuthology.orchestra.run.smithi070.stdout:4726 write 0xb093484 thru 0xb095d09 (0x2886 bytes) 2024-09-11T05:33:56.412 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.412 INFO:teuthology.orchestra.run.smithi070.stdout:4729 write 0x8e62342 thru 0x8e70f4c (0xec0b bytes) 2024-09-11T05:33:56.415 INFO:teuthology.orchestra.run.smithi070.stdout:4730 write 0x2975682 thru 0x29792b5 (0x3c34 bytes) 2024-09-11T05:33:56.418 INFO:teuthology.orchestra.run.smithi070.stdout:4731 read 0x896c577 thru 0x897484e (0x82d8 bytes) 2024-09-11T05:33:56.494 INFO:teuthology.orchestra.run.smithi070.stdout:4732 trunc from 0xea0b1d6 to 0xb2e8aa0 2024-09-11T05:33:56.494 INFO:teuthology.orchestra.run.smithi070.stdout:4733 read 0x124fcd3 thru 0x1253523 (0x3851 bytes) 2024-09-11T05:33:56.494 INFO:teuthology.orchestra.run.smithi070.stdout:4734 write 0xd86594f thru 0xd87054c (0xabfe bytes) 2024-09-11T05:33:56.494 INFO:teuthology.orchestra.run.smithi070.stdout:4735 read 0x549a7bd thru 0x549eb41 (0x4385 bytes) 2024-09-11T05:33:56.494 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.494 INFO:teuthology.orchestra.run.smithi070.stdout:4738 read 0x50fe87d thru 0x5105035 (0x67b9 bytes) 2024-09-11T05:33:56.494 INFO:teuthology.orchestra.run.smithi070.stdout:4739 trunc from 0xd87054d to 0x4d0e317 2024-09-11T05:33:56.495 INFO:teuthology.orchestra.run.smithi070.stdout:4740 trunc from 0x4d0e317 to 0xa33221d 2024-09-11T05:33:56.495 INFO:teuthology.orchestra.run.smithi070.stdout:4741 write 0xc9fa094 thru 0xc9fba37 (0x19a4 bytes) 2024-09-11T05:33:56.495 INFO:teuthology.orchestra.run.smithi070.stdout:4742 write 0x557d3be thru 0x5587d64 (0xa9a7 bytes) 2024-09-11T05:33:56.495 INFO:teuthology.orchestra.run.smithi070.stdout:4743 writesame 0x4b48474 thru 0x4b521de data_size 0x85(0x9d6b bytes) 2024-09-11T05:33:56.495 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:56.493+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:56.495 INFO:teuthology.orchestra.run.smithi070.stdout:4744 write 0xa134d2e thru 0xa13b739 (0x6a0c bytes) 2024-09-11T05:33:56.496 INFO:teuthology.orchestra.run.smithi070.stdout:4746 read 0x74a3ae0 thru 0x74abd8e (0x82af bytes) 2024-09-11T05:33:56.496 INFO:teuthology.orchestra.run.smithi070.stdout:4748 writesame 0x8e4db88 thru 0x8e5d8b1 data_size 0x5(0xfd2a bytes) 2024-09-11T05:33:56.512 INFO:teuthology.orchestra.run.smithi070.stdout:4749 trunc from 0xc9fba38 to 0x654550c 2024-09-11T05:33:56.529 INFO:teuthology.orchestra.run.smithi070.stdout:4750 trunc from 0x654550c to 0x202997 2024-09-11T05:33:56.532 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:56.533 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:56.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:33:56.559 INFO:teuthology.orchestra.run.smithi070.stdout:4751 write 0x2a39cdb thru 0x2a4109d (0x73c3 bytes) 2024-09-11T05:33:56.562 INFO:teuthology.orchestra.run.smithi070.stdout:4753 read 0x41cdf8 thru 0x425ee6 (0x90ef bytes) 2024-09-11T05:33:56.562 INFO:teuthology.orchestra.run.smithi070.stdout:4755 read 0xac9b22 thru 0xad7660 (0xdb3f bytes) 2024-09-11T05:33:56.563 INFO:teuthology.orchestra.run.smithi070.stdout:4756 read 0x16b598a thru 0x16b9129 (0x37a0 bytes) 2024-09-11T05:33:56.576 INFO:teuthology.orchestra.run.smithi070.stdout:4757 write 0x9a0c445 thru 0x9a150d7 (0x8c93 bytes) 2024-09-11T05:33:56.580 INFO:teuthology.orchestra.run.smithi070.stdout:4758 writesame 0x2a8de72 thru 0x2a9dbb0 data_size 0x1(0xfd3f bytes) 2024-09-11T05:33:56.594 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:56.593+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:56.621 INFO:teuthology.orchestra.run.smithi070.stdout:4759 read 0x3704ee thru 0x375979 (0x548c bytes) 2024-09-11T05:33:56.621 INFO:teuthology.orchestra.run.smithi070.stdout:4760 punch from 0x2d9c64 to 0x2e6230, (0xc5cc bytes) 2024-09-11T05:33:56.621 INFO:teuthology.orchestra.run.smithi070.stdout:4762 punch from 0xd4942a to 0xd501f5, (0x6dcb bytes) 2024-09-11T05:33:56.621 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.630 INFO:teuthology.orchestra.run.smithi070.stdout:4764 write 0xcc68dc8 thru 0xcc77e0f (0xf048 bytes) 2024-09-11T05:33:56.633 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.633 INFO:teuthology.orchestra.run.smithi070.stdout:4769 writesame 0x8a00e58 thru 0x8a0cf66 data_size 0x1(0xc10f bytes) 2024-09-11T05:33:56.660 INFO:teuthology.orchestra.run.smithi070.stdout:4770 read 0x741e066 thru 0x74217a6 (0x3741 bytes) 2024-09-11T05:33:56.660 INFO:teuthology.orchestra.run.smithi070.stdout:4772 writesame 0x219dd93 thru 0x21acadb data_size 0x1(0xed49 bytes) 2024-09-11T05:33:56.673 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:56.673 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:56.682 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:33:56.692 INFO:teuthology.orchestra.run.smithi070.stdout:4773 read 0x9cede77 thru 0x9cf2e29 (0x4fb3 bytes) 2024-09-11T05:33:56.692 INFO:teuthology.orchestra.run.smithi070.stdout:4774 writesame 0x126072f thru 0x1269fb7 data_size 0x1(0x9889 bytes) 2024-09-11T05:33:56.694 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:56.694+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:56.720 INFO:teuthology.orchestra.run.smithi070.stdout:4775 trunc from 0xcc77e10 to 0x7ce14b3 2024-09-11T05:33:56.742 INFO:teuthology.orchestra.run.smithi070.stdout:4776 punch from 0x79c5ad5 to 0x79cbc42, (0x616d bytes) 2024-09-11T05:33:56.742 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.742 INFO:teuthology.orchestra.run.smithi070.stdout:4779 read 0x37531c7 thru 0x375b6d7 (0x8511 bytes) 2024-09-11T05:33:56.742 INFO:teuthology.orchestra.run.smithi070.stdout:4780 punch from 0x4281171 to 0x428a6bf, (0x954e bytes) 2024-09-11T05:33:56.742 INFO:teuthology.orchestra.run.smithi070.stdout:4782 read 0x761bdc3 thru 0x7625af0 (0x9d2e bytes) 2024-09-11T05:33:56.742 INFO:teuthology.orchestra.run.smithi070.stdout:4785 read 0x18f97ba thru 0x19090ea (0xf931 bytes) 2024-09-11T05:33:56.742 INFO:teuthology.orchestra.run.smithi070.stdout:4787 read 0x67942f0 thru 0x679d05c (0x8d6d bytes) 2024-09-11T05:33:56.742 INFO:teuthology.orchestra.run.smithi070.stdout:4788 writesame 0x12462d9 thru 0x124905b data_size 0x1(0x2d83 bytes) 2024-09-11T05:33:56.756 INFO:teuthology.orchestra.run.smithi070.stdout:4790 trunc from 0x7ce14b3 to 0xd4ce22b 2024-09-11T05:33:56.761 INFO:teuthology.orchestra.run.smithi070.stdout:4791 write 0x7d32e2f thru 0x7d36708 (0x38da bytes) 2024-09-11T05:33:56.779 INFO:teuthology.orchestra.run.smithi070.stdout:4792 trunc from 0xd4ce22b to 0x3c165f 2024-09-11T05:33:56.788 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:56.788 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:56.791 INFO:teuthology.orchestra.run.smithi070.stdout:4794 punch from 0x1b2bd6 to 0x1bc127, (0x9551 bytes) 2024-09-11T05:33:56.794 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:56.794+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:56.798 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:33:56.803 INFO:teuthology.orchestra.run.smithi070.stdout:4795 writesame 0x5e1b90e thru 0x5e1b956 data_size 0x1(0x49 bytes) 2024-09-11T05:33:56.803 INFO:teuthology.orchestra.run.smithi070.stdout:4797 read 0x1627ce5 thru 0x162c398 (0x46b4 bytes) 2024-09-11T05:33:56.809 INFO:teuthology.orchestra.run.smithi070.stdout:4798 trunc from 0x5e1b957 to 0x738ebc 2024-09-11T05:33:56.819 INFO:teuthology.orchestra.run.smithi070.stdout:4799 trunc from 0x738ebc to 0x3cb45ae 2024-09-11T05:33:56.829 INFO:teuthology.orchestra.run.smithi070.stdout:4800 trunc from 0x3cb45ae to 0x86e8a32 2024-09-11T05:33:56.834 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.834 INFO:teuthology.orchestra.run.smithi070.stdout:4802 read 0xa2dd74 thru 0xa3bc4a (0xded7 bytes) 2024-09-11T05:33:56.834 INFO:teuthology.orchestra.run.smithi070.stdout:4803 write 0x833c3da thru 0x834382e (0x7455 bytes) 2024-09-11T05:33:56.838 INFO:teuthology.orchestra.run.smithi070.stdout:4804 read 0x39d41 thru 0x3af03 (0x11c3 bytes) 2024-09-11T05:33:56.838 INFO:teuthology.orchestra.run.smithi070.stdout:4806 write 0x5efba3f thru 0x5f03477 (0x7a39 bytes) 2024-09-11T05:33:56.852 INFO:teuthology.orchestra.run.smithi070.stdout:4808 writesame 0xcbdb433 thru 0xcbe4a75 data_size 0x1(0x9643 bytes) 2024-09-11T05:33:56.852 INFO:teuthology.orchestra.run.smithi070.stdout:4810 read 0xabe2d55 thru 0xabeba57 (0x8d03 bytes) 2024-09-11T05:33:56.857 INFO:teuthology.orchestra.run.smithi070.stdout:4811 trunc from 0xcbe4a76 to 0x7ba5940 2024-09-11T05:33:56.864 INFO:teuthology.orchestra.run.smithi070.stdout:4812 read 0x28c94b1 thru 0x28d1306 (0x7e56 bytes) 2024-09-11T05:33:56.864 INFO:teuthology.orchestra.run.smithi070.stdout:4813 punch from 0x1ce8dd6 to 0x1cf5f52, (0xd17c bytes) 2024-09-11T05:33:56.864 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.864 INFO:teuthology.orchestra.run.smithi070.stdout:4815 write 0x79eac24 thru 0x79f2ba9 (0x7f86 bytes) 2024-09-11T05:33:56.866 INFO:teuthology.orchestra.run.smithi070.stdout:4816 read 0x4a5fd35 thru 0x4a6c77d (0xca49 bytes) 2024-09-11T05:33:56.866 INFO:teuthology.orchestra.run.smithi070.stdout:4817 write 0x44c7760 thru 0x44d09c2 (0x9263 bytes) 2024-09-11T05:33:56.868 INFO:teuthology.orchestra.run.smithi070.stdout:4819 read 0x12d19f8 thru 0x12d2bf3 (0x11fc bytes) 2024-09-11T05:33:56.869 INFO:teuthology.orchestra.run.smithi070.stdout:4820 write 0x6d8f28 thru 0x6e1590 (0x8669 bytes) 2024-09-11T05:33:56.871 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.877 INFO:teuthology.orchestra.run.smithi070.stdout:4824 write 0x89e2db8 thru 0x89e364d (0x896 bytes) 2024-09-11T05:33:56.880 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.889 INFO:teuthology.orchestra.run.smithi070.stdout:4828 writesame 0xc3fee8b thru 0xc406303 data_size 0x3(0x7479 bytes) 2024-09-11T05:33:56.893 INFO:teuthology.orchestra.run.smithi070.stdout:4830 trunc from 0xc406304 to 0x994c180 2024-09-11T05:33:56.895 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:56.894+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:56.903 INFO:teuthology.orchestra.run.smithi070.stdout:4831 trunc from 0x994c180 to 0x4f6e4f3 2024-09-11T05:33:56.911 INFO:teuthology.orchestra.run.smithi070.stdout:4832 read 0x16d8051 thru 0x16e4ff9 (0xcfa9 bytes) 2024-09-11T05:33:56.912 INFO:teuthology.orchestra.run.smithi070.stdout:4833 trunc from 0x4f6e4f3 to 0x5b3266b 2024-09-11T05:33:56.917 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.917 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.917 INFO:teuthology.orchestra.run.smithi070.stdout:4836 punch from 0x4456ad1 to 0x44669de, (0xff0d bytes) 2024-09-11T05:33:56.917 INFO:teuthology.orchestra.run.smithi070.stdout:4837 write 0xa98f6d thru 0xaa4103 (0xb197 bytes) 2024-09-11T05:33:56.918 INFO:teuthology.orchestra.run.smithi070.stdout:4838 read 0x13c3846 thru 0x13c7e33 (0x45ee bytes) 2024-09-11T05:33:56.919 INFO:teuthology.orchestra.run.smithi070.stdout:4839 write 0x3018fc2 thru 0x301f274 (0x62b3 bytes) 2024-09-11T05:33:56.921 INFO:teuthology.orchestra.run.smithi070.stdout:4841 read 0x2efdfb thru 0x2f1ade (0x1ce4 bytes) 2024-09-11T05:33:56.922 INFO:teuthology.orchestra.run.smithi070.stdout:4842 punch from 0x87a54f to 0x885e06, (0xb8b7 bytes) 2024-09-11T05:33:56.922 INFO:teuthology.orchestra.run.smithi070.stdout:4843 punch from 0xea4318 to 0xea99c2, (0x56aa bytes) 2024-09-11T05:33:56.922 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:56.922 INFO:teuthology.orchestra.run.smithi070.stdout:4845 punch from 0xd67792 to 0xd73466, (0xbcd4 bytes) 2024-09-11T05:33:56.928 INFO:teuthology.orchestra.run.smithi070.stdout:4846 trunc from 0x5b3266b to 0xb2a36e5 2024-09-11T05:33:56.938 INFO:teuthology.orchestra.run.smithi070.stdout:4848 trunc from 0xb2a36e5 to 0x78ea74f 2024-09-11T05:33:56.943 INFO:teuthology.orchestra.run.smithi070.stdout:4849 read 0x5992bcc thru 0x599bafc (0x8f31 bytes) 2024-09-11T05:33:56.943 INFO:teuthology.orchestra.run.smithi070.stdout:4850 read 0x3a863ba thru 0x3a87ff1 (0x1c38 bytes) 2024-09-11T05:33:56.944 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:56.944 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:56.947 INFO:teuthology.orchestra.run.smithi070.stdout:4851 trunc from 0x78ea74f to 0x42d87c4 2024-09-11T05:33:56.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:33:56.955 INFO:teuthology.orchestra.run.smithi070.stdout:4852 read 0x299dfd0 thru 0x29a6235 (0x8266 bytes) 2024-09-11T05:33:56.960 INFO:teuthology.orchestra.run.smithi070.stdout:4854 trunc from 0x42d87c4 to 0x237c5d 2024-09-11T05:33:56.972 INFO:teuthology.orchestra.run.smithi070.stdout:4855 read 0xa5098 thru 0xadb8a (0x8af3 bytes) 2024-09-11T05:33:56.986 INFO:teuthology.orchestra.run.smithi070.stdout:4857 trunc from 0x237c5d to 0xbefc208 2024-09-11T05:33:56.991 INFO:teuthology.orchestra.run.smithi070.stdout:4858 write 0xac64844 thru 0xac64ecf (0x68c bytes) 2024-09-11T05:33:56.995 INFO:teuthology.orchestra.run.smithi070.stdout:4859 trunc from 0xbefc208 to 0xd4699cd 2024-09-11T05:33:56.997 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:56.997+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:57.000 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:57.000 INFO:teuthology.orchestra.run.smithi070.stdout:4862 write 0x38019a7 thru 0x3803550 (0x1baa bytes) 2024-09-11T05:33:57.002 INFO:teuthology.orchestra.run.smithi070.stdout:4866 writesame 0x5ac41ab thru 0x5acfdb7 data_size 0x9(0xbc0d bytes) 2024-09-11T05:33:57.022 INFO:teuthology.orchestra.run.smithi070.stdout:4867 trunc from 0xd4699cd to 0x201f11 2024-09-11T05:33:57.053 INFO:teuthology.orchestra.run.smithi070.stdout:4868 write 0xdc4be40 thru 0xdc5661c (0xa7dd bytes) 2024-09-11T05:33:57.055 INFO:teuthology.orchestra.run.smithi070.stdout:4869 punch from 0xc744dcf to 0xc74d612, (0x8843 bytes) 2024-09-11T05:33:57.056 INFO:teuthology.orchestra.run.smithi070.stdout:4870 read 0x68a3c4b thru 0x68af243 (0xb5f9 bytes) 2024-09-11T05:33:57.057 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:57.058 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:57.060 INFO:teuthology.orchestra.run.smithi070.stdout:4871 write 0xe120ebb thru 0xe12eb7a (0xdcc0 bytes) 2024-09-11T05:33:57.066 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:33:57.069 INFO:teuthology.orchestra.run.smithi070.stdout:4872 trunc from 0xe12eb7b to 0x9577b1b 2024-09-11T05:33:57.077 INFO:teuthology.orchestra.run.smithi070.stdout:4873 read 0x7768c3d thru 0x776d2b2 (0x4676 bytes) 2024-09-11T05:33:57.078 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:57.078 INFO:teuthology.orchestra.run.smithi070.stdout:4875 write 0x8e5296 thru 0x8f042a (0xb195 bytes) 2024-09-11T05:33:57.080 INFO:teuthology.orchestra.run.smithi070.stdout:4877 read 0x648fdb3 thru 0x649c291 (0xc4df bytes) 2024-09-11T05:33:57.080 INFO:teuthology.orchestra.run.smithi070.stdout:4878 write 0x7a46803 thru 0x7a52a23 (0xc221 bytes) 2024-09-11T05:33:57.083 INFO:teuthology.orchestra.run.smithi070.stdout:4880 trunc from 0x9577b1b to 0x98b8a89 2024-09-11T05:33:57.086 INFO:teuthology.orchestra.run.smithi070.stdout:4884 write 0x14c1b59 thru 0x14cb2ee (0x9796 bytes) 2024-09-11T05:33:57.089 INFO:teuthology.orchestra.run.smithi070.stdout:4885 read 0x30fd870 thru 0x3105cc0 (0x8451 bytes) 2024-09-11T05:33:57.090 INFO:teuthology.orchestra.run.smithi070.stdout:4886 read 0x2002684 thru 0x200619e (0x3b1b bytes) 2024-09-11T05:33:57.090 INFO:teuthology.orchestra.run.smithi070.stdout:4887 write 0x366d15e thru 0x367756c (0xa40f bytes) 2024-09-11T05:33:57.092 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:57.092 INFO:teuthology.orchestra.run.smithi070.stdout:4890 punch from 0x7037c10 to 0x703c46b, (0x485b bytes) 2024-09-11T05:33:57.092 INFO:teuthology.orchestra.run.smithi070.stdout:4892 read 0x7c68db3 thru 0x7c6d5d9 (0x4827 bytes) 2024-09-11T05:33:57.092 INFO:teuthology.orchestra.run.smithi070.stdout:4893 writesame 0x1f618bd thru 0x1f6a588 data_size 0x2(0x8ccc bytes) 2024-09-11T05:33:57.096 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:57.096+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:57.103 INFO:teuthology.orchestra.run.smithi070.stdout:4894 punch from 0x6a69f9e to 0x6a70c6e, (0x6cd0 bytes) 2024-09-11T05:33:57.103 INFO:teuthology.orchestra.run.smithi070.stdout:4895 punch from 0x3e8ce3b to 0x3e8fdf2, (0x2fb7 bytes) 2024-09-11T05:33:57.103 INFO:teuthology.orchestra.run.smithi070.stdout:4896 punch from 0x98169e2 to 0x981ff2c, (0x954a bytes) 2024-09-11T05:33:57.108 INFO:teuthology.orchestra.run.smithi070.stdout:4897 write 0x9ca1f3a thru 0x9ca7743 (0x580a bytes) 2024-09-11T05:33:57.110 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:57.110 INFO:teuthology.orchestra.run.smithi070.stdout:4899 read 0x9bf2dd6 thru 0x9bfb530 (0x875b bytes) 2024-09-11T05:33:57.111 INFO:teuthology.orchestra.run.smithi070.stdout:4901 trunc from 0x9ca7744 to 0x92897c4 2024-09-11T05:33:57.117 INFO:teuthology.orchestra.run.smithi070.stdout:4902 read 0x6df2dd0 thru 0x6df9f26 (0x7157 bytes) 2024-09-11T05:33:57.118 INFO:teuthology.orchestra.run.smithi070.stdout:4903 writesame 0x76eba4c thru 0x76f5f94 data_size 0x1(0xa549 bytes) 2024-09-11T05:33:57.141 INFO:teuthology.orchestra.run.smithi070.stdout:4904 writesame 0x189308b thru 0x18948c0 data_size 0x3(0x1836 bytes) 2024-09-11T05:33:57.154 INFO:teuthology.orchestra.run.smithi070.stdout:4905 write 0xbf83bb6 thru 0xbf86b88 (0x2fd3 bytes) 2024-09-11T05:33:57.157 INFO:teuthology.orchestra.run.smithi070.stdout:4906 write 0x9465a4b thru 0x946964f (0x3c05 bytes) 2024-09-11T05:33:57.160 INFO:teuthology.orchestra.run.smithi070.stdout:4907 read 0x2a90b4b thru 0x2a9ee6e (0xe324 bytes) 2024-09-11T05:33:57.160 INFO:teuthology.orchestra.run.smithi070.stdout:4908 read 0x46521af thru 0x4661fe8 (0xfe3a bytes) 2024-09-11T05:33:57.160 INFO:teuthology.orchestra.run.smithi070.stdout:4910 punch from 0xf71ac2 to 0xf777ff, (0x5d3d bytes) 2024-09-11T05:33:57.160 INFO:teuthology.orchestra.run.smithi070.stdout:4911 read 0x6c05e3e thru 0x6c0d998 (0x7b5b bytes) 2024-09-11T05:33:57.160 INFO:teuthology.orchestra.run.smithi070.stdout:4912 writesame 0x1bef388 thru 0x1bf1c19 data_size 0x1(0x2892 bytes) 2024-09-11T05:33:57.172 INFO:teuthology.orchestra.run.smithi070.stdout:4913 writesame 0xc048756 thru 0xc04df9d data_size 0x64(0x5848 bytes) 2024-09-11T05:33:57.179 INFO:teuthology.orchestra.run.smithi070.stdout:4914 write 0xe3ecfb8 thru 0xe3f0c5f (0x3ca8 bytes) 2024-09-11T05:33:57.183 INFO:teuthology.orchestra.run.smithi070.stdout:4915 trunc from 0xe3f0c60 to 0xcfde140 2024-09-11T05:33:57.193 INFO:teuthology.orchestra.run.smithi070.stdout:4916 punch from 0x2b0b998 to 0x2b189b2, (0xd01a bytes) 2024-09-11T05:33:57.193 INFO:teuthology.orchestra.run.smithi070.stdout:4917 writesame 0x3ccd03e thru 0x3cd2db5 data_size 0xc(0x5d78 bytes) 2024-09-11T05:33:57.197 INFO:teuthology.orchestra.run.smithi070.stdout:4918 writesame 0x890db94 thru 0x891c607 data_size 0xa(0xea74 bytes) 2024-09-11T05:33:57.197 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:57.197+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:57.209 INFO:teuthology.orchestra.run.smithi070.stdout:4920 writesame 0xe89883a thru 0xe89dde0 data_size 0x1(0x55a7 bytes) 2024-09-11T05:33:57.209 INFO:teuthology.orchestra.run.smithi070.stdout:4921 read 0x1425de2 thru 0x142b593 (0x57b2 bytes) 2024-09-11T05:33:57.209 INFO:teuthology.orchestra.run.smithi070.stdout:4923 punch from 0x5c565a5 to 0x5c60e0c, (0xa867 bytes) 2024-09-11T05:33:57.209 INFO:teuthology.orchestra.run.smithi070.stdout:4924 write 0xca838e4 thru 0xca8ca13 (0x9130 bytes) 2024-09-11T05:33:57.210 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:57.210 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:57.213 INFO:teuthology.orchestra.run.smithi070.stdout:4927 punch from 0xc59712a to 0xc5a2537, (0xb40d bytes) 2024-09-11T05:33:57.213 INFO:teuthology.orchestra.run.smithi070.stdout:4928 punch from 0xa9b31ce to 0xa9b97f7, (0x6629 bytes) 2024-09-11T05:33:57.213 INFO:teuthology.orchestra.run.smithi070.stdout:4929 punch from 0x1764625 to 0x176ea4a, (0xa425 bytes) 2024-09-11T05:33:57.213 INFO:teuthology.orchestra.run.smithi070.stdout:4930 write 0x6347fa2 thru 0x634d711 (0x5770 bytes) 2024-09-11T05:33:57.215 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:57.216 INFO:teuthology.orchestra.run.smithi070.stdout:4932 write 0x4f7c3b6 thru 0x4f87f2b (0xbb76 bytes) 2024-09-11T05:33:57.218 INFO:teuthology.orchestra.run.smithi070.stdout:4933 write 0xb869618 thru 0xb86cff1 (0x39da bytes) 2024-09-11T05:33:57.219 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:33:57.221 INFO:teuthology.orchestra.run.smithi070.stdout:4934 read 0x2822def thru 0x2822ebd (0xcf bytes) 2024-09-11T05:33:57.221 INFO:teuthology.orchestra.run.smithi070.stdout:4935 read 0xba4fc4c thru 0xba595eb (0x99a0 bytes) 2024-09-11T05:33:57.221 INFO:teuthology.orchestra.run.smithi070.stdout:4936 punch from 0x775ad0b to 0x7768e92, (0xe187 bytes) 2024-09-11T05:33:57.221 INFO:teuthology.orchestra.run.smithi070.stdout:4937 write 0x15537a0 thru 0x1563251 (0xfab2 bytes) 2024-09-11T05:33:57.222 INFO:teuthology.orchestra.run.smithi070.stdout:4938 punch from 0x8ab4120 to 0x8abc420, (0x8300 bytes) 2024-09-11T05:33:57.223 INFO:teuthology.orchestra.run.smithi070.stdout:4939 write 0x30f099e thru 0x30f796e (0x6fd1 bytes) 2024-09-11T05:33:57.225 INFO:teuthology.orchestra.run.smithi070.stdout:4940 punch from 0xa669e37 to 0xa66c10a, (0x22d3 bytes) 2024-09-11T05:33:57.225 INFO:teuthology.orchestra.run.smithi070.stdout:4942 writesame 0x43b8d62 thru 0x43c85cb data_size 0x9(0xf86a bytes) 2024-09-11T05:33:57.231 INFO:teuthology.orchestra.run.smithi070.stdout:4944 write 0xcb581d9 thru 0xcb5d2fd (0x5125 bytes) 2024-09-11T05:33:57.234 INFO:teuthology.orchestra.run.smithi070.stdout:4945 read 0x80e5d4c thru 0x80e9a4e (0x3d03 bytes) 2024-09-11T05:33:57.245 INFO:teuthology.orchestra.run.smithi070.stdout:4946 trunc from 0xe89dde1 to 0x4b38c42 2024-09-11T05:33:57.257 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:57.268 INFO:teuthology.orchestra.run.smithi070.stdout:4949 write 0xa989799 thru 0xa99714c (0xd9b4 bytes) 2024-09-11T05:33:57.271 INFO:teuthology.orchestra.run.smithi070.stdout:4950 read 0x9a0539f thru 0x9a0b843 (0x64a5 bytes) 2024-09-11T05:33:57.271 INFO:teuthology.orchestra.run.smithi070.stdout:4952 write 0x178e520 thru 0x1791b99 (0x367a bytes) 2024-09-11T05:33:57.273 INFO:teuthology.orchestra.run.smithi070.stdout:4953 read 0x82a68a7 thru 0x82b3192 (0xc8ec bytes) 2024-09-11T05:33:57.274 INFO:teuthology.orchestra.run.smithi070.stdout:4955 write 0x167932a thru 0x1684f2d (0xbc04 bytes) 2024-09-11T05:33:57.276 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:57.277 INFO:teuthology.orchestra.run.smithi070.stdout:4958 writesame 0x990744f thru 0x9910824 data_size 0x2(0x93d6 bytes) 2024-09-11T05:33:57.287 INFO:teuthology.orchestra.run.smithi070.stdout:4960 punch from 0xc1cd89 to 0xc1f41a, (0x2691 bytes) 2024-09-11T05:33:57.288 INFO:teuthology.orchestra.run.smithi070.stdout:4961 read 0x8617e32 thru 0x86279b5 (0xfb84 bytes) 2024-09-11T05:33:57.288 INFO:teuthology.orchestra.run.smithi070.stdout:4962 trunc from 0xa99714d to 0xa8f5e78 2024-09-11T05:33:57.297 INFO:teuthology.orchestra.run.smithi070.stdout:4964 punch from 0x164d23f to 0x1658ddd, (0xbb9e bytes) 2024-09-11T05:33:57.297 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:57.297 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:57.297 INFO:teuthology.orchestra.run.smithi070.stdout:4967 punch from 0x213d54e to 0x21450ee, (0x7ba0 bytes) 2024-09-11T05:33:57.299 INFO:teuthology.orchestra.run.smithi070.stdout:4968 trunc from 0xa8f5e78 to 0xc21eb5a 2024-09-11T05:33:57.304 INFO:teuthology.orchestra.run.smithi070.stdout:4969 punch from 0x4200705 to 0x420f2f2, (0xebed bytes) 2024-09-11T05:33:57.304 INFO:teuthology.orchestra.run.smithi070.stdout:4971 read 0x9f67da7 thru 0x9f74879 (0xcad3 bytes) 2024-09-11T05:33:57.304 INFO:teuthology.orchestra.run.smithi070.stdout:4973 read 0x352e763 thru 0x353e74e (0xffec bytes) 2024-09-11T05:33:57.304 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:57.304+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:57.305 INFO:teuthology.orchestra.run.smithi070.stdout:4975 trunc from 0xc21eb5a to 0xca1c7d5 2024-09-11T05:33:57.309 INFO:teuthology.orchestra.run.smithi070.stdout:4977 read 0xae43e30 thru 0xae4de6d (0xa03e bytes) 2024-09-11T05:33:57.322 INFO:teuthology.orchestra.run.smithi070.stdout:4978 trunc from 0xca1c7d5 to 0x20ea989 2024-09-11T05:33:57.332 INFO:teuthology.orchestra.run.smithi070.stdout:4980 read 0xaffdc1 thru 0xb0b388 (0xb5c8 bytes) 2024-09-11T05:33:57.332 INFO:teuthology.orchestra.run.smithi070.stdout:4981 writesame 0x1ff2fe1 thru 0x1ff7932 data_size 0x5(0x4952 bytes) 2024-09-11T05:33:57.344 INFO:teuthology.orchestra.run.smithi070.stdout:4984 write 0x45faf52 thru 0x460a891 (0xf940 bytes) 2024-09-11T05:33:57.352 INFO:teuthology.orchestra.run.smithi070.stdout:4986 trunc from 0x460a892 to 0x7b9a1bb 2024-09-11T05:33:57.362 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:57.362 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:57.365 INFO:teuthology.orchestra.run.smithi070.stdout:4988 write 0xa2aa693 thru 0xa2aeef2 (0x4860 bytes) 2024-09-11T05:33:57.371 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:33:57.374 INFO:teuthology.orchestra.run.smithi070.stdout:4990 writesame 0xc001a57 thru 0xc0056e3 data_size 0x1(0x3c8d bytes) 2024-09-11T05:33:57.374 INFO:teuthology.orchestra.run.smithi070.stdout:4991 writesame 0x9a603cf thru 0x9a6b060 data_size 0x4a(0xac92 bytes) 2024-09-11T05:33:57.377 INFO:teuthology.orchestra.run.smithi070.stdout:4992 write 0x5680134 thru 0x568ddfc (0xdcc9 bytes) 2024-09-11T05:33:57.380 INFO:teuthology.orchestra.run.smithi070.stdout:4993 read 0xb0eb4a0 thru 0xb0f6531 (0xb092 bytes) 2024-09-11T05:33:57.380 INFO:teuthology.orchestra.run.smithi070.stdout:4994 read 0x200c02d thru 0x20157d2 (0x97a6 bytes) 2024-09-11T05:33:57.381 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:57.390 INFO:teuthology.orchestra.run.smithi070.stdout:4998 trunc from 0xc0056e4 to 0x46f1644 2024-09-11T05:33:57.399 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:57.398+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:57.406 INFO:teuthology.orchestra.run.smithi070.stdout:4999 trunc from 0x46f1644 to 0x8e8e4a6 2024-09-11T05:33:57.411 INFO:teuthology.orchestra.run.smithi070.stdout:5000 read 0x570996e thru 0x5711e95 (0x8528 bytes) 2024-09-11T05:33:57.411 INFO:teuthology.orchestra.run.smithi070.stdout:5002 write 0x587b216 thru 0x5886e57 (0xbc42 bytes) 2024-09-11T05:33:57.413 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:57.414 INFO:teuthology.orchestra.run.smithi070.stdout:5006 clone 30 order 24 su 262144 sc 8 2024-09-11T05:33:57.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:33:57.500 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:57.500+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:57.514 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:57.514 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:57.524 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:33:57.608 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:57.608+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:57.619 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:57.619 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:57.636 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:57.652 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:57.667 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:57.667 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:57.668 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:57.668 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:57.676 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:33:57.685 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:57.702 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:57.702 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:57.717 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:57.717+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:57.719 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:33:57.736 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:33:57.736 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:33:57.802 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:33:57.801+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:33:57.820 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:57.820 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:57.820 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:57.820 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:57.820 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:57.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:33:57.899 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:33:57.903 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:57.902+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:57.936 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:57.936 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:57.936 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:57.936 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:57.936 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.936 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116713 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13060096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:57.936 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:33:57.936 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.120891575999998, 2024-09-11T05:33:57.936 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599235, 2024-09-11T05:33:57.936 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:57.936 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:57.936 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116713 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:57.937 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813321+0000", 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000005e-07 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813323+0000", 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.667e-06 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:57.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813331+0000", 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6529999999999994e-06 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813336+0000", 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813688+0000", 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035143199999999999 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:57.939 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813692+0000", 2024-09-11T05:33:57.940 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5120000000000002e-06 2024-09-11T05:33:57.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.940 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.940 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.940 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816304+0000", 2024-09-11T05:33:57.940 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026115449999999998 2024-09-11T05:33:57.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.940 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.940 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.940 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816308+0000", 2024-09-11T05:33:57.940 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2370000000000003e-06 2024-09-11T05:33:57.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.941 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.941 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.941 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821720+0000", 2024-09-11T05:33:57.941 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0054114869999999 2024-09-11T05:33:57.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.941 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.941 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.941 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821724+0000", 2024-09-11T05:33:57.941 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:33:57.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.941 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.941 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.941 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873101+0000", 2024-09-11T05:33:57.942 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0513774279999999 2024-09-11T05:33:57.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.942 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.942 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:57.942 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873159+0000", 2024-09-11T05:33:57.942 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819000000000003e-05 2024-09-11T05:33:57.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.942 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.942 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:57.942 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873244+0000", 2024-09-11T05:33:57.942 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4300000000000003e-05 2024-09-11T05:33:57.942 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.943 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:57.943 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.943 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.943 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116714 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:57.943 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:33:57.943 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.120848940999998, 2024-09-11T05:33:57.943 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600505999999998, 2024-09-11T05:33:57.943 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:57.943 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:57.943 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:57.943 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:57.943 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:57.944 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:57.944 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116714 2024-09-11T05:33:57.944 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.944 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:57.944 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.944 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:57.944 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:33:57.944 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.944 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.944 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.944 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:57.944 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:33:57.944 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813366+0000", 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6919999999999998e-06 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:57.945 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813373+0000", 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8689999999999998e-06 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813378+0000", 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2159999999999997e-06 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813733+0000", 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035530300000000001 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.946 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813739+0000", 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8819999999999998e-06 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816340+0000", 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002600598 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816349+0000", 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9169999999999995e-06 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.947 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.948 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.948 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821745+0000", 2024-09-11T05:33:57.948 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005396416 2024-09-11T05:33:57.948 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.948 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.948 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.948 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821750+0000", 2024-09-11T05:33:57.948 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:33:57.948 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.948 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.948 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.948 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873269+0000", 2024-09-11T05:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0515195159999999 2024-09-11T05:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873328+0000", 2024-09-11T05:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9222999999999999e-05 2024-09-11T05:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873413+0000", 2024-09-11T05:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4983999999999998e-05 2024-09-11T05:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.949 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:57.950 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.950 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.950 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116715 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13109248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:57.950 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:33:57.950 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.120807460000002, 2024-09-11T05:33:57.950 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0602519180000001, 2024-09-11T05:33:57.950 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:57.950 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:57.950 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:57.950 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:57.950 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:57.950 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:57.951 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116715 2024-09-11T05:33:57.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.951 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:57.951 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.951 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:57.951 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:33:57.951 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.951 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.951 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:57.951 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:33:57.951 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813405+0000", 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.51e-07 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813407+0000", 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813414+0000", 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.686e-06 2024-09-11T05:33:57.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.953 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.953 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:57.953 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813419+0000", 2024-09-11T05:33:57.953 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4249999999999997e-06 2024-09-11T05:33:57.953 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.953 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.953 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.953 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813774+0000", 2024-09-11T05:33:57.953 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035460800000000002 2024-09-11T05:33:57.953 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.953 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.954 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:57.954 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813778+0000", 2024-09-11T05:33:57.954 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:33:57.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.954 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.954 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.954 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816375+0000", 2024-09-11T05:33:57.954 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025967730000000001 2024-09-11T05:33:57.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.954 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816379+0000", 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3780000000000003e-06 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821770+0000", 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053903040000001 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821774+0000", 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:33:57.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.956 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.956 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873437+0000", 2024-09-11T05:33:57.956 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051663155 2024-09-11T05:33:57.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.956 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:57.956 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873500+0000", 2024-09-11T05:33:57.956 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3027000000000005e-05 2024-09-11T05:33:57.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.956 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:57.957 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873656+0000", 2024-09-11T05:33:57.957 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015580800000000001 2024-09-11T05:33:57.957 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.957 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:57.957 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.957 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.957 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116716 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13133824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:57.957 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:33:57.957 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.120765002999999, 2024-09-11T05:33:57.957 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0605170350000002, 2024-09-11T05:33:57.957 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:57.958 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:57.958 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:57.958 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:57.958 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:57.958 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:57.958 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116716 2024-09-11T05:33:57.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.958 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:57.958 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.958 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:57.958 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:33:57.958 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5799999999999999e-07 2024-09-11T05:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813450+0000", 2024-09-11T05:33:57.960 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7659999999999999e-06 2024-09-11T05:33:57.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.960 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.960 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:57.960 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813458+0000", 2024-09-11T05:33:57.960 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7430000000000002e-06 2024-09-11T05:33:57.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.960 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.960 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:57.960 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813464+0000", 2024-09-11T05:33:57.960 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:33:57.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.961 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.961 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.961 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813814+0000", 2024-09-11T05:33:57.961 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035073199999999998 2024-09-11T05:33:57.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.961 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.961 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:57.961 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813819+0000", 2024-09-11T05:33:57.961 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:33:57.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.961 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.961 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816410+0000", 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025904349999999999 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816418+0000", 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1610000000000003e-06 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821794+0000", 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005376391 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.962 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821799+0000", 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4870000000000004e-06 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873697+0000", 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051898843 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873810+0000", 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112187 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.964 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:57.964 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873964+0000", 2024-09-11T05:33:57.964 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015412800000000001 2024-09-11T05:33:57.964 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.964 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:57.964 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.964 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.964 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116717 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13158400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:57.964 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:33:57.964 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.120739918999998, 2024-09-11T05:33:57.964 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606806560000002, 2024-09-11T05:33:57.964 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:57.965 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:57.965 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:57.965 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:57.965 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:57.965 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:57.965 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116717 2024-09-11T05:33:57.965 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.965 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:57.965 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.965 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:57.965 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:33:57.965 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.965 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.966 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.966 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:57.966 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:33:57.966 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.966 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.966 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.966 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:57.966 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:33:57.966 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:33:57.966 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.966 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.966 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:57.966 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813474+0000", 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1830000000000001e-06 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813481+0000", 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5540000000000003e-06 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813491+0000", 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0472000000000001e-05 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.967 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813867+0000", 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00037606 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813873+0000", 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.254e-06 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816443+0000", 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025701769999999999 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.968 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.969 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816446+0000", 2024-09-11T05:33:57.969 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:33:57.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.969 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.969 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.969 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821818+0000", 2024-09-11T05:33:57.969 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053719830000001 2024-09-11T05:33:57.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.969 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.969 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.969 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821823+0000", 2024-09-11T05:33:57.969 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5560000000000001e-06 2024-09-11T05:33:57.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.970 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.970 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.970 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874006+0000", 2024-09-11T05:33:57.970 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05218342 2024-09-11T05:33:57.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.970 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.970 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:57.970 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874071+0000", 2024-09-11T05:33:57.970 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4369999999999995e-05 2024-09-11T05:33:57.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.970 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.970 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:57.970 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874152+0000", 2024-09-11T05:33:57.971 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1658999999999999e-05 2024-09-11T05:33:57.971 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.971 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:57.971 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.971 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.971 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.971 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116718 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13182976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:57.971 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:33:57.971 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.120708401000002, 2024-09-11T05:33:57.971 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0609185380000001, 2024-09-11T05:33:57.971 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:57.971 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:57.971 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:57.972 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:57.972 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:57.972 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:57.972 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116718 2024-09-11T05:33:57.972 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.972 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:57.972 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.972 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:57.972 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:33:57.972 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.972 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.972 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.972 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:57.973 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:33:57.973 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.973 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.973 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:57.973 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813504+0000", 2024-09-11T05:33:57.973 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7999999999999996e-07 2024-09-11T05:33:57.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.973 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.973 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:57.973 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813506+0000", 2024-09-11T05:33:57.973 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2989999999999999e-06 2024-09-11T05:33:57.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.974 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.974 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:57.974 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813513+0000", 2024-09-11T05:33:57.974 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8020000000000003e-06 2024-09-11T05:33:57.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.974 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.974 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:57.974 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813517+0000", 2024-09-11T05:33:57.974 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5639999999999998e-06 2024-09-11T05:33:57.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.974 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.974 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.975 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813916+0000", 2024-09-11T05:33:57.975 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039859800000000001 2024-09-11T05:33:57.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.975 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.975 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:57.975 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813922+0000", 2024-09-11T05:33:57.975 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:33:57.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.975 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.975 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.975 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816476+0000", 2024-09-11T05:33:57.975 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025538359999999999 2024-09-11T05:33:57.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.976 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.976 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.976 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816481+0000", 2024-09-11T05:33:57.976 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819999999999999e-06 2024-09-11T05:33:57.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.976 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.976 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.976 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821843+0000", 2024-09-11T05:33:57.976 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053620299999999 2024-09-11T05:33:57.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.976 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.976 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.976 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821848+0000", 2024-09-11T05:33:57.977 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:33:57.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.977 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.977 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.977 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874191+0000", 2024-09-11T05:33:57.977 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052342935 2024-09-11T05:33:57.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.977 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.977 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:57.977 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874300+0000", 2024-09-11T05:33:57.977 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000108764 2024-09-11T05:33:57.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.977 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874422+0000", 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012221399999999999 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116719 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13207552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.120667603000001, 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0611734350000002, 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:57.978 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:57.979 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:57.979 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:57.979 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:57.979 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:57.979 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116719 2024-09-11T05:33:57.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.979 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:57.979 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.979 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:57.979 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:33:57.979 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.979 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.980 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:57.980 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:33:57.980 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.980 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.980 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:57.980 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813545+0000", 2024-09-11T05:33:57.980 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2600000000000002e-07 2024-09-11T05:33:57.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.980 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.980 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:57.980 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813547+0000", 2024-09-11T05:33:57.980 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3329999999999999e-06 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813553+0000", 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4640000000000003e-06 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813558+0000", 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.981 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813952+0000", 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039390999999999997 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813955+0000", 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.858e-06 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816524+0000", 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002568847 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.982 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.983 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816533+0000", 2024-09-11T05:33:57.983 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1749999999999994e-06 2024-09-11T05:33:57.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.983 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.983 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.983 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821869+0000", 2024-09-11T05:33:57.983 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053358939999999 2024-09-11T05:33:57.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.983 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.983 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.983 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821876+0000", 2024-09-11T05:33:57.983 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:33:57.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874454+0000", 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052577621 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874546+0000", 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2151999999999995e-05 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874718+0000", 2024-09-11T05:33:57.984 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017183399999999999 2024-09-11T05:33:57.985 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.985 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:57.985 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.985 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.985 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.985 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116720 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13232128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:57.985 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:33:57.985 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.120645716999999, 2024-09-11T05:33:57.985 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0614845590000002, 2024-09-11T05:33:57.985 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:57.985 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:57.985 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:57.985 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:57.986 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:57.986 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:57.986 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116720 2024-09-11T05:33:57.986 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.986 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:57.986 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.986 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:57.986 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:33:57.986 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.986 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.986 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.986 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:57.987 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:33:57.987 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.987 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.987 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.987 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:57.987 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:33:57.987 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5600000000000002e-07 2024-09-11T05:33:57.987 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.987 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.987 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:57.987 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813568+0000", 2024-09-11T05:33:57.987 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9089999999999998e-06 2024-09-11T05:33:57.987 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.988 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.988 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:57.988 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813573+0000", 2024-09-11T05:33:57.988 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2059999999999998e-06 2024-09-11T05:33:57.988 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.988 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.988 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:57.988 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813577+0000", 2024-09-11T05:33:57.988 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1489999999999996e-06 2024-09-11T05:33:57.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.989 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.989 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.989 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813987+0000", 2024-09-11T05:33:57.989 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040977800000000002 2024-09-11T05:33:57.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.989 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.989 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:57.989 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813992+0000", 2024-09-11T05:33:57.989 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1540000000000001e-06 2024-09-11T05:33:57.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.989 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.989 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.990 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816560+0000", 2024-09-11T05:33:57.990 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025680389999999998 2024-09-11T05:33:57.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.990 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.990 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.990 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816566+0000", 2024-09-11T05:33:57.990 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0679999999999996e-06 2024-09-11T05:33:57.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.990 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.990 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.990 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821907+0000", 2024-09-11T05:33:57.990 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005341735 2024-09-11T05:33:57.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.991 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.991 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.991 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821916+0000", 2024-09-11T05:33:57.991 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3659999999999992e-06 2024-09-11T05:33:57.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.991 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.991 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.991 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874760+0000", 2024-09-11T05:33:57.991 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052844713 2024-09-11T05:33:57.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.991 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.991 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:57.991 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874878+0000", 2024-09-11T05:33:57.992 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000117321 2024-09-11T05:33:57.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.992 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.992 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:57.992 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875051+0000", 2024-09-11T05:33:57.992 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017286499999999999 2024-09-11T05:33:57.992 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.992 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:57.992 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.992 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.992 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116721 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13256704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:57.992 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.120628363000002, 2024-09-11T05:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0616932019999998, 2024-09-11T05:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116721 2024-09-11T05:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.993 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:57.994 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:33:57.994 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.994 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.994 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:57.994 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:33:57.994 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:57.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.994 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.994 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:57.994 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813584+0000", 2024-09-11T05:33:57.994 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2e-07 2024-09-11T05:33:57.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.995 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.995 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:57.995 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813586+0000", 2024-09-11T05:33:57.995 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.277e-06 2024-09-11T05:33:57.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.995 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.995 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:57.995 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813592+0000", 2024-09-11T05:33:57.995 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5840000000000002e-06 2024-09-11T05:33:57.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.995 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.995 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:57.996 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813597+0000", 2024-09-11T05:33:57.996 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2839999999999997e-06 2024-09-11T05:33:57.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.996 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.996 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.996 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814028+0000", 2024-09-11T05:33:57.996 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000430689 2024-09-11T05:33:57.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.996 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.996 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:57.996 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814032+0000", 2024-09-11T05:33:57.996 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3850000000000004e-06 2024-09-11T05:33:57.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.997 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.997 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.997 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816597+0000", 2024-09-11T05:33:57.997 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00256485 2024-09-11T05:33:57.997 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.997 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.997 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.997 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816606+0000", 2024-09-11T05:33:57.997 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:33:57.997 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.997 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.997 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821949+0000", 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005342752 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821954+0000", 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2270000000000001e-06 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875095+0000", 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.053140669 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.998 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.999 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:57.999 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875186+0000", 2024-09-11T05:33:57.999 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1391999999999995e-05 2024-09-11T05:33:57.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.999 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:57.999 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:57.999 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875277+0000", 2024-09-11T05:33:57.999 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0556000000000005e-05 2024-09-11T05:33:57.999 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.999 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:57.999 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:57.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:57.999 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.000 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116722 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13281280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:58.000 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:33:58.000 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.120591363999999, 2024-09-11T05:33:58.000 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.061825491, 2024-09-11T05:33:58.000 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.000 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.000 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.000 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.000 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.000 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.000 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116722 2024-09-11T05:33:58.000 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.000 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813621+0000", 2024-09-11T05:33:58.001 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813625+0000", 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.228e-06 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813635+0000", 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5179999999999993e-06 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.002 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813641+0000", 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4710000000000004e-06 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814057+0000", 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00041530099999999997 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814060+0000", 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-06 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.003 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816632+0000", 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00257186 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816636+0000", 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2150000000000003e-06 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821977+0000", 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053407110000001 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.004 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821982+0000", 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875307+0000", 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0533247000000001 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875366+0000", 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8628999999999997e-05 2024-09-11T05:33:58.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875446+0000", 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0026999999999998e-05 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116723 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13305856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.120558385999999, 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0619630779999998, 2024-09-11T05:33:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116723 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813654+0000", 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813661+0000", 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1890000000000001e-06 2024-09-11T05:33:58.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813675+0000", 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3878e-05 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813682+0000", 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.063e-06 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816666+0000", 2024-09-11T05:33:58.009 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029845679999999999 2024-09-11T05:33:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816671+0000", 2024-09-11T05:33:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:33:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822024+0000", 2024-09-11T05:33:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053534660000001 2024-09-11T05:33:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.010 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822028+0000", 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7799999999999998e-06 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875471+0000", 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05344306 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875531+0000", 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0019000000000003e-05 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875616+0000", 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5304999999999997e-05 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116724 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13330432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.120518897, 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0620902609999998, 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.012 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.013 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.013 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.013 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.013 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.013 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116724 2024-09-11T05:33:58.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.013 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.013 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.013 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.013 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:33:58.013 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.013 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.99e-07 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813697+0000", 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2430000000000001e-06 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.014 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813704+0000", 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2980000000000003e-06 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813709+0000", 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8130000000000003e-06 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816702+0000", 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002992864 2024-09-11T05:33:58.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.016 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.016 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.016 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816711+0000", 2024-09-11T05:33:58.016 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1840000000000005e-06 2024-09-11T05:33:58.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.016 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.016 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.016 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822050+0000", 2024-09-11T05:33:58.016 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.00533864 2024-09-11T05:33:58.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.016 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.016 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.016 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822055+0000", 2024-09-11T05:33:58.017 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:33:58.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.017 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.017 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.017 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875642+0000", 2024-09-11T05:33:58.017 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0535874220000001 2024-09-11T05:33:58.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.017 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.017 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.017 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875698+0000", 2024-09-11T05:33:58.017 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5707e-05 2024-09-11T05:33:58.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875783+0000", 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5362e-05 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116725 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13355008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.120484708999999, 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.06220984, 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.018 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116725 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.019 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813728+0000", 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813730+0000", 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6730000000000001e-06 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.020 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.021 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.021 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813743+0000", 2024-09-11T05:33:58.021 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2833000000000001e-05 2024-09-11T05:33:58.021 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.021 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.021 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.021 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813749+0000", 2024-09-11T05:33:58.021 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:33:58.021 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.021 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.021 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.021 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816726+0000", 2024-09-11T05:33:58.021 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029772090000000002 2024-09-11T05:33:58.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.022 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.022 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.022 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816730+0000", 2024-09-11T05:33:58.022 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.518e-06 2024-09-11T05:33:58.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.022 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.022 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.022 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822074+0000", 2024-09-11T05:33:58.022 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053444030000001 2024-09-11T05:33:58.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.022 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.022 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822079+0000", 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875807+0000", 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0537284410000001 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875858+0000", 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0574000000000001e-05 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.023 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.024 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.024 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875937+0000", 2024-09-11T05:33:58.024 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9268000000000001e-05 2024-09-11T05:33:58.024 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.024 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.024 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.024 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.024 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.024 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116974 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13185024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:58.024 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:33:58.024 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.112540873, 2024-09-11T05:33:58.024 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598649249999998, 2024-09-11T05:33:58.024 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.025 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.025 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.025 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.025 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.025 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.025 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116974 2024-09-11T05:33:58.025 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.025 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.025 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.025 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.025 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:33:58.025 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.025 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821673+0000", 2024-09-11T05:33:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.722e-06 2024-09-11T05:33:58.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.027 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.027 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821686+0000", 2024-09-11T05:33:58.027 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2974e-05 2024-09-11T05:33:58.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.027 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.027 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821692+0000", 2024-09-11T05:33:58.027 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:33:58.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.028 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.028 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822089+0000", 2024-09-11T05:33:58.028 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039611699999999998 2024-09-11T05:33:58.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.028 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.028 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.028 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822099+0000", 2024-09-11T05:33:58.028 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0029e-05 2024-09-11T05:33:58.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.028 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.028 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.028 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822803+0000", 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000704507 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822808+0000", 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6460000000000001e-06 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881361+0000", 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0585529680000001 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.029 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881432+0000", 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881536+0000", 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000103243 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116975 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13209600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:58.030 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:33:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.112512539000001, 2024-09-11T05:33:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.060124761, 2024-09-11T05:33:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116975 2024-09-11T05:33:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:33:58.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.032 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.032 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:33:58.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.032 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.032 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821700+0000", 2024-09-11T05:33:58.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:33:58.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821701+0000", 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8369999999999999e-06 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821708+0000", 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5520000000000001e-06 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821713+0000", 2024-09-11T05:33:58.033 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.091e-06 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822135+0000", 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00042166399999999998 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822143+0000", 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3089999999999996e-06 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822820+0000", 2024-09-11T05:33:58.034 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000677145 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822824+0000", 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.641e-06 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881569+0000", 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.058744785 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.035 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881674+0000", 2024-09-11T05:33:58.036 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000105111 2024-09-11T05:33:58.036 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.036 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.036 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.036 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881824+0000", 2024-09-11T05:33:58.036 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000150197 2024-09-11T05:33:58.036 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.036 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.036 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.036 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.036 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.036 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116976 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13234176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:58.036 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.112483560000001, 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0603909900000001, 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116976 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821729+0000", 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.038 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821731+0000", 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0250000000000001e-06 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821737+0000", 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8839999999999997e-06 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821743+0000", 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1050000000000003e-06 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.039 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.040 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822194+0000", 2024-09-11T05:33:58.040 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000451574 2024-09-11T05:33:58.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.040 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.040 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.040 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822203+0000", 2024-09-11T05:33:58.040 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9449999999999999e-06 2024-09-11T05:33:58.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.040 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.040 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.040 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822835+0000", 2024-09-11T05:33:58.040 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000632019 2024-09-11T05:33:58.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.041 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.041 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.041 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822839+0000", 2024-09-11T05:33:58.041 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8229999999999997e-06 2024-09-11T05:33:58.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.041 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.041 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.041 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881861+0000", 2024-09-11T05:33:58.041 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.059021776 2024-09-11T05:33:58.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.041 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.041 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.042 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881976+0000", 2024-09-11T05:33:58.042 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00011531699999999999 2024-09-11T05:33:58.042 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.042 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.042 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.042 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882119+0000", 2024-09-11T05:33:58.042 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000143077 2024-09-11T05:33:58.042 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.042 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.042 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.042 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.042 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.042 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116977 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13258752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.112432326, 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606236920000001, 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116977 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.043 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.044 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:33:58.044 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.044 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.044 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.044 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:33:58.044 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.044 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.044 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.044 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821782+0000", 2024-09-11T05:33:58.044 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7719999999999999e-06 2024-09-11T05:33:58.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.045 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.045 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.045 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821785+0000", 2024-09-11T05:33:58.045 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9409999999999999e-06 2024-09-11T05:33:58.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.045 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.045 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.045 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821793+0000", 2024-09-11T05:33:58.045 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:33:58.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.045 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.045 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.045 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821799+0000", 2024-09-11T05:33:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4609999999999999e-06 2024-09-11T05:33:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822246+0000", 2024-09-11T05:33:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044669000000000002 2024-09-11T05:33:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822254+0000", 2024-09-11T05:33:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1859999999999992e-06 2024-09-11T05:33:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822850+0000", 2024-09-11T05:33:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005962340000001 2024-09-11T05:33:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822854+0000", 2024-09-11T05:33:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5310000000000002e-06 2024-09-11T05:33:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882149+0000", 2024-09-11T05:33:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0592958729999999 2024-09-11T05:33:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882253+0000", 2024-09-11T05:33:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104058 2024-09-11T05:33:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882403+0000", 2024-09-11T05:33:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014958800000000001 2024-09-11T05:33:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116978 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13283328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:33:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.112402103000001, 2024-09-11T05:33:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0608297769999999, 2024-09-11T05:33:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116978 2024-09-11T05:33:58.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.050 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.050 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.050 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.050 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:33:58.050 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.050 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.050 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.050 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:33:58.050 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.050 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:33:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:33:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821813+0000", 2024-09-11T05:33:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:33:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821820+0000", 2024-09-11T05:33:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3669999999999999e-06 2024-09-11T05:33:58.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.052 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.052 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.052 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821825+0000", 2024-09-11T05:33:58.052 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5119999999999999e-06 2024-09-11T05:33:58.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.052 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.052 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.052 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822273+0000", 2024-09-11T05:33:58.052 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044727900000000003 2024-09-11T05:33:58.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.052 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.052 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.053 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822278+0000", 2024-09-11T05:33:58.053 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7529999999999998e-06 2024-09-11T05:33:58.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.053 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.053 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.053 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822865+0000", 2024-09-11T05:33:58.053 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005861579999999 2024-09-11T05:33:58.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.053 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.053 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.053 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822868+0000", 2024-09-11T05:33:58.053 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4659999999999999e-06 2024-09-11T05:33:58.054 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.054 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.054 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.054 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882434+0000", 2024-09-11T05:33:58.054 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0595660170000001 2024-09-11T05:33:58.054 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.054 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.054 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.054 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882502+0000", 2024-09-11T05:33:58.054 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7442999999999998e-05 2024-09-11T05:33:58.054 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.054 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.054 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882639+0000", 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013779999999999999 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116980 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13332480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.110862580999999, 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598269180000002, 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.055 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.056 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.056 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.056 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.056 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116980 2024-09-11T05:33:58.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.056 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.056 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.056 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.056 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:33:58.056 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.056 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.056 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823350+0000", 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823352+0000", 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5459999999999998e-06 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.057 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823360+0000", 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4359999999999996e-06 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823365+0000", 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3079999999999998e-06 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823418+0000", 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2735999999999998e-05 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.058 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823423+0000", 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3410000000000002e-06 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822895+0000", 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99947249000000005 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822899+0000", 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6169999999999998e-06 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.059 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.060 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.060 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882964+0000", 2024-09-11T05:33:58.060 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0600650840000001 2024-09-11T05:33:58.060 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.060 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.060 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.060 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883020+0000", 2024-09-11T05:33:58.060 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5563000000000003e-05 2024-09-11T05:33:58.060 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.060 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.060 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.060 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883176+0000", 2024-09-11T05:33:58.060 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015629500000000001 2024-09-11T05:33:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116981 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13357056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:33:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.110838601000001, 2024-09-11T05:33:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600075910000002, 2024-09-11T05:33:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.061 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116981 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:33:58.062 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.01e-07 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823376+0000", 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823381+0000", 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000001e-06 2024-09-11T05:33:58.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823386+0000", 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5349999999999998e-06 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823447+0000", 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1277000000000003e-05 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823456+0000", 2024-09-11T05:33:58.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8859999999999993e-06 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822914+0000", 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99945797999999997 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822918+0000", 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5810000000000001e-06 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.065 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883209+0000", 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0602916899999999 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883292+0000", 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2849000000000006e-05 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883381+0000", 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8585000000000007e-05 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.066 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.067 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:58.067 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone29 from 0x8e8e4a6 (overlap 0x201f11) to 0x9a2eb 2024-09-11T05:33:58.068 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:33:58.069 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:58.067+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:58.080 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-11T05:33:58.083 INFO:teuthology.orchestra.run.smithi070.stdout:5008 write 0x85d62 thru 0x90987 (0xac26 bytes) 2024-09-11T05:33:58.092 INFO:teuthology.orchestra.run.smithi070.stdout:5009 write 0x505ba76 thru 0x506b7f1 (0xfd7c bytes) 2024-09-11T05:33:58.102 INFO:teuthology.orchestra.run.smithi070.stdout:5011 trunc from 0x8e8e4a6 to 0x4aa2fbf 2024-09-11T05:33:58.138 INFO:teuthology.orchestra.run.smithi070.stdout:5012 writesame 0xdda7b80 thru 0xdda8e08 data_size 0xd(0x1289 bytes) 2024-09-11T05:33:58.138 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:58.138 INFO:teuthology.orchestra.run.smithi070.stdout:5014 read 0x805cab5 thru 0x806c66c (0xfbb8 bytes) 2024-09-11T05:33:58.138 INFO:teuthology.orchestra.run.smithi070.stdout:5017 writesame 0x7d5d44 thru 0x7d6bf6 data_size 0x1(0xeb3 bytes) 2024-09-11T05:33:58.147 INFO:teuthology.orchestra.run.smithi070.stdout:5018 trunc from 0xdda8e09 to 0x89cec5b 2024-09-11T05:33:58.152 INFO:teuthology.orchestra.run.smithi070.stdout:5019 punch from 0x1dd63fb to 0x1de246a, (0xc06f bytes) 2024-09-11T05:33:58.153 INFO:teuthology.orchestra.run.smithi070.stdout:5020 punch from 0x7f0ab47 to 0x7f17bd5, (0xd08e bytes) 2024-09-11T05:33:58.153 INFO:teuthology.orchestra.run.smithi070.stdout:5021 read 0x34582c2 thru 0x3462b8f (0xa8ce bytes) 2024-09-11T05:33:58.153 INFO:teuthology.orchestra.run.smithi070.stdout:5022 read 0x2b3c4cd thru 0x2b43379 (0x6ead bytes) 2024-09-11T05:33:58.153 INFO:teuthology.orchestra.run.smithi070.stdout:5023 read 0x8786069 thru 0x878f418 (0x93b0 bytes) 2024-09-11T05:33:58.153 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:58.154 INFO:teuthology.orchestra.run.smithi070.stdout:5025 punch from 0x34e71cb to 0x34f67f8, (0xf62d bytes) 2024-09-11T05:33:58.154 INFO:teuthology.orchestra.run.smithi070.stdout:5026 clone 31 order 25 su 1048576 sc 15 2024-09-11T05:33:58.169 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:58.168+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:58.212 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:58.212 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:58.212 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:33:58.212 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:58.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:33:58.270 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:58.269+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:58.323 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:58.323 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:33:58.323 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:33:58.324 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:33:58.324 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:58.332 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:33:58.373 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:58.373+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:58.471 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:58.470+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:58.476 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:33:58.476 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:33:58.476 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:33:58.476 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:33:58.476 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.476 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:33:58.476 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:58.476 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.826495833999999, 2024-09-11T05:33:58.476 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:33:58.477 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.477 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.477 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:58.477 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.477 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.477 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.477 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:33:58.477 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.477 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.477 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.477 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.477 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.478 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.479 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:33:58.479 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:33:58.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.479 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.479 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.479 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:33:58.479 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:33:58.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.479 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.479 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.479 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:33:58.479 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:33:58.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:33:58.480 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:33:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:33:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:33:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:33:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:33:58.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.482 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.482 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:58.482 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:33:58.483 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:33:58.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.483 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.483 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.483 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:33:58.483 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:33:58.483 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.483 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.483 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.483 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.483 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:146253 3.6 3:64dbadcf:::rbd_data.112d55d87bfc.0000000000000332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-11T05:33:58.484 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:33:58.484 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 12.637680926, 2024-09-11T05:33:58.484 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4166483809999999, 2024-09-11T05:33:58.484 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.484 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.484 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:58.484 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.484 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.484 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.484 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 146253 2024-09-11T05:33:58.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.484 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.485 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.485 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.485 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:33:58.485 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.485 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.485 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.485 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:33:58.485 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.485 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.485 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.485 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837090+0000", 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.73e-06 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837096+0000", 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3500000000000002e-06 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837115+0000", 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8556e-05 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.486 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837124+0000", 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6739999999999992e-06 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837184+0000", 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9960000000000002e-05 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837188+0000", 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.487 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840481+0000", 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032924080000000001 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840497+0000", 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6140000000000001e-05 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850737+0000", 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0102404119999999 2024-09-11T05:33:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.489 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.489 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.489 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850747+0000", 2024-09-11T05:33:58.489 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7969999999999995e-06 2024-09-11T05:33:58.489 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.489 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.489 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.489 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252495+0000", 2024-09-11T05:33:58.489 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.401748131 2024-09-11T05:33:58.489 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.489 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.489 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.490 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252636+0000", 2024-09-11T05:33:58.490 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014118900000000001 2024-09-11T05:33:58.490 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.490 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.490 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:58.490 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252737+0000", 2024-09-11T05:33:58.490 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00010058 2024-09-11T05:33:58.490 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.490 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.490 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:58.490 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253433+0000", 2024-09-11T05:33:58.490 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00069601999999999999 2024-09-11T05:33:58.490 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.491 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.491 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:58.491 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253604+0000", 2024-09-11T05:33:58.491 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000170824 2024-09-11T05:33:58.491 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.491 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.491 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:58.491 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253649+0000", 2024-09-11T05:33:58.491 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5050999999999999e-05 2024-09-11T05:33:58.491 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.491 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.491 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.491 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253736+0000", 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7509000000000005e-05 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:147298 3.6 3:652e51de:::rbd_data.112d55d87bfc.0000000000000377:head [set-alloc-hint object_size 262144 write_size 262144,write 122880~2839] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 9.2411403500000002, 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62981612099999995, 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:33:58.492 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.493 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.493 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.493 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 147298 2024-09-11T05:33:58.493 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.493 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.493 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.493 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.493 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:33:58.493 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.493 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.493 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.493 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.494 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:33:58.494 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.494 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.494 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.494 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233630+0000", 2024-09-11T05:33:58.494 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5489999999999999e-06 2024-09-11T05:33:58.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.494 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.494 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.494 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233637+0000", 2024-09-11T05:33:58.494 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.272e-06 2024-09-11T05:33:58.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233654+0000", 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6283999999999999e-05 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233662+0000", 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.875e-06 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233723+0000", 2024-09-11T05:33:58.495 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1501000000000006e-05 2024-09-11T05:33:58.496 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.496 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.496 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:33:58.496 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233732+0000", 2024-09-11T05:33:58.496 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0699999999999996e-06 2024-09-11T05:33:58.496 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.496 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.496 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.496 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862055+0000", 2024-09-11T05:33:58.496 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62832274799999999 2024-09-11T05:33:58.496 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.496 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.496 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.497 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862219+0000", 2024-09-11T05:33:58.497 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016404899999999999 2024-09-11T05:33:58.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.497 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.497 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:33:58.497 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862313+0000", 2024-09-11T05:33:58.497 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4105999999999997e-05 2024-09-11T05:33:58.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.497 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.497 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:33:58.497 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862981+0000", 2024-09-11T05:33:58.497 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00066744199999999997 2024-09-11T05:33:58.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863382+0000", 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040111200000000002 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863419+0000", 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6974000000000002e-05 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863445+0000", 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6139000000000002e-05 2024-09-11T05:33:58.498 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.499 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.499 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.499 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.499 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151292 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.499 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:33:58.499 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5184889550000005, 2024-09-11T05:33:58.499 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054346481000000002, 2024-09-11T05:33:58.499 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.499 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.499 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.499 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.499 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151292 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.500 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956283+0000", 2024-09-11T05:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2450000000000001e-06 2024-09-11T05:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.501 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956290+0000", 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0910000000000004e-06 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956296+0000", 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.947e-06 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010460+0000", 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054164165 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.502 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010537+0000", 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6965000000000006e-05 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010626+0000", 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9628000000000003e-05 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151293 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1933312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:33:58.503 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5184661120000005, 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054563858999999999, 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151293 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:33:58.504 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.505 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.505 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.505 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.505 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:33:58.505 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.505 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.505 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.505 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.505 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:33:58.505 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.46e-07 2024-09-11T05:33:58.505 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.505 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.505 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.506 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956306+0000", 2024-09-11T05:33:58.506 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2259999999999999e-06 2024-09-11T05:33:58.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.506 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.506 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.506 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956312+0000", 2024-09-11T05:33:58.506 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:33:58.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.506 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.506 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.506 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956317+0000", 2024-09-11T05:33:58.506 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:33:58.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010671+0000", 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054353830999999998 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010757+0000", 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6120999999999998e-05 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010867+0000", 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000109687 2024-09-11T05:33:58.507 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.508 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.508 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.508 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.508 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.508 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151294 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2179072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.508 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:33:58.508 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5184442499999999, 2024-09-11T05:33:58.508 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054741825000000001, 2024-09-11T05:33:58.508 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.508 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.508 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.508 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.508 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151294 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:33:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.84e-07 2024-09-11T05:33:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956326+0000", 2024-09-11T05:33:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.483e-06 2024-09-11T05:33:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956330+0000", 2024-09-11T05:33:58.511 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8519999999999997e-06 2024-09-11T05:33:58.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.511 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.511 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.511 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956334+0000", 2024-09-11T05:33:58.511 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4139999999999998e-06 2024-09-11T05:33:58.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.511 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.511 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.511 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010894+0000", 2024-09-11T05:33:58.511 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054560243000000001 2024-09-11T05:33:58.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.512 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.512 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.512 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010970+0000", 2024-09-11T05:33:58.512 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6138999999999997e-05 2024-09-11T05:33:58.512 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.512 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.512 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.512 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011067+0000", 2024-09-11T05:33:58.512 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6409999999999993e-05 2024-09-11T05:33:58.512 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.512 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.512 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.512 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151295 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2392064~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:33:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5184315789999996, 2024-09-11T05:33:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054949748999999999, 2024-09-11T05:33:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151295 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.514 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.515 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956338+0000", 2024-09-11T05:33:58.515 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.23e-07 2024-09-11T05:33:58.515 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.515 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.515 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.515 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956339+0000", 2024-09-11T05:33:58.515 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.243e-06 2024-09-11T05:33:58.515 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.515 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.515 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.515 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956342+0000", 2024-09-11T05:33:58.515 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.473e-06 2024-09-11T05:33:58.515 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.516 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.516 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.516 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956345+0000", 2024-09-11T05:33:58.516 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:33:58.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.516 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.516 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.516 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011109+0000", 2024-09-11T05:33:58.516 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054763698999999999 2024-09-11T05:33:58.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.516 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.516 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.516 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011188+0000", 2024-09-11T05:33:58.517 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8887999999999994e-05 2024-09-11T05:33:58.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.517 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.517 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.517 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011287+0000", 2024-09-11T05:33:58.517 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9504000000000001e-05 2024-09-11T05:33:58.517 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.517 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.517 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.517 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.517 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151296 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5184204690000005, 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055045187000000002, 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151296 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.518 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956349+0000", 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.519 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.520 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.520 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956350+0000", 2024-09-11T05:33:58.520 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:33:58.520 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.520 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.520 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.520 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956353+0000", 2024-09-11T05:33:58.520 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.016e-06 2024-09-11T05:33:58.520 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.520 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.520 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.520 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956355+0000", 2024-09-11T05:33:58.521 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5509999999999998e-06 2024-09-11T05:33:58.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.521 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.521 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.521 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011303+0000", 2024-09-11T05:33:58.521 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054947306000000001 2024-09-11T05:33:58.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.521 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.521 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.521 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011342+0000", 2024-09-11T05:33:58.521 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9057999999999998e-05 2024-09-11T05:33:58.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.521 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.522 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.522 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011394+0000", 2024-09-11T05:33:58.522 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1925999999999997e-05 2024-09-11T05:33:58.522 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.522 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.522 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.522 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.522 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.522 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151297 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2818048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.522 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:33:58.522 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5184105380000004, 2024-09-11T05:33:58.522 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055238158000000002, 2024-09-11T05:33:58.522 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.523 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.523 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.523 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.523 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.523 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.523 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151297 2024-09-11T05:33:58.523 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.523 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.523 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.523 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.523 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:33:58.523 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.523 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.524 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.524 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.524 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:33:58.524 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.524 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.524 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.524 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.524 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956359+0000", 2024-09-11T05:33:58.524 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:33:58.524 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.524 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.524 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.525 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956360+0000", 2024-09-11T05:33:58.525 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1030000000000001e-06 2024-09-11T05:33:58.525 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.525 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.525 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.525 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956363+0000", 2024-09-11T05:33:58.525 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.021e-06 2024-09-11T05:33:58.525 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.525 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.525 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.525 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956365+0000", 2024-09-11T05:33:58.525 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4770000000000002e-06 2024-09-11T05:33:58.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.526 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.526 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.526 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011425+0000", 2024-09-11T05:33:58.526 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055059967000000001 2024-09-11T05:33:58.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.526 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.526 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.526 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011506+0000", 2024-09-11T05:33:58.526 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1063000000000006e-05 2024-09-11T05:33:58.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.526 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.526 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.527 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011597+0000", 2024-09-11T05:33:58.527 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0299999999999999e-05 2024-09-11T05:33:58.527 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.527 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.527 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.527 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.527 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.527 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151298 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3031040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.527 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:33:58.527 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.518400572, 2024-09-11T05:33:58.527 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055425825999999997, 2024-09-11T05:33:58.527 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.527 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.528 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.528 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.528 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.528 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.528 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151298 2024-09-11T05:33:58.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.528 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.528 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.528 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.528 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:33:58.528 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.528 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.529 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.529 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:33:58.529 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.529 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.529 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.529 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956369+0000", 2024-09-11T05:33:58.529 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4400000000000001e-07 2024-09-11T05:33:58.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.529 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.529 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.529 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956370+0000", 2024-09-11T05:33:58.529 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.068e-06 2024-09-11T05:33:58.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.530 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.530 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.530 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956373+0000", 2024-09-11T05:33:58.530 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0419999999999998e-06 2024-09-11T05:33:58.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.530 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.530 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.530 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956375+0000", 2024-09-11T05:33:58.530 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:33:58.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.530 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.531 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.531 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011631+0000", 2024-09-11T05:33:58.531 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055255116999999999 2024-09-11T05:33:58.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.531 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.531 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.531 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011703+0000", 2024-09-11T05:33:58.531 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2554999999999999e-05 2024-09-11T05:33:58.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.531 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.531 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.531 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011794+0000", 2024-09-11T05:33:58.531 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1119999999999995e-05 2024-09-11T05:33:58.532 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.532 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.532 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.532 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.532 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.532 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151299 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3276800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.532 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:33:58.532 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5183892700000001, 2024-09-11T05:33:58.532 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055567477999999997, 2024-09-11T05:33:58.532 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.532 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.532 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.533 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.533 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.533 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.533 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151299 2024-09-11T05:33:58.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.533 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.533 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.533 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.533 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:33:58.533 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.533 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.534 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.534 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:33:58.534 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.534 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.534 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.534 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.534 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:33:58.534 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:33:58.534 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.534 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.534 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.534 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956382+0000", 2024-09-11T05:33:58.534 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.72e-06 2024-09-11T05:33:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956386+0000", 2024-09-11T05:33:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0990000000000001e-06 2024-09-11T05:33:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956390+0000", 2024-09-11T05:33:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.318e-06 2024-09-11T05:33:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011823+0000", 2024-09-11T05:33:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055432976000000002 2024-09-11T05:33:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011882+0000", 2024-09-11T05:33:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8656999999999998e-05 2024-09-11T05:33:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011947+0000", 2024-09-11T05:33:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5177000000000003e-05 2024-09-11T05:33:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151300 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3489792~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:33:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5183728030000001, 2024-09-11T05:33:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055745232999999998, 2024-09-11T05:33:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151300 2024-09-11T05:33:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:33:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:33:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956397+0000", 2024-09-11T05:33:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:33:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956398+0000", 2024-09-11T05:33:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.869e-06 2024-09-11T05:33:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956404+0000", 2024-09-11T05:33:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:33:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956407+0000", 2024-09-11T05:33:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.191e-06 2024-09-11T05:33:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011981+0000", 2024-09-11T05:33:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055573553999999997 2024-09-11T05:33:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012051+0000", 2024-09-11T05:33:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9542999999999995e-05 2024-09-11T05:33:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012141+0000", 2024-09-11T05:33:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0845000000000002e-05 2024-09-11T05:33:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.543 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151301 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3702784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:33:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5183578740000003, 2024-09-11T05:33:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055834747999999997, 2024-09-11T05:33:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151301 2024-09-11T05:33:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:33:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:33:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:33:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:33:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956413+0000", 2024-09-11T05:33:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2810000000000001e-06 2024-09-11T05:33:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956416+0000", 2024-09-11T05:33:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1559999999999999e-06 2024-09-11T05:33:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956418+0000", 2024-09-11T05:33:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:33:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012155+0000", 2024-09-11T05:33:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055736651999999998 2024-09-11T05:33:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012193+0000", 2024-09-11T05:33:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7848000000000001e-05 2024-09-11T05:33:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012246+0000", 2024-09-11T05:33:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3041000000000003e-05 2024-09-11T05:33:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151302 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3915776~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:33:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5183477710000002, 2024-09-11T05:33:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056035532999999998, 2024-09-11T05:33:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151302 2024-09-11T05:33:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:33:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:33:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:33:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:33:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956426+0000", 2024-09-11T05:33:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.853e-06 2024-09-11T05:33:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956430+0000", 2024-09-11T05:33:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3699999999999999e-06 2024-09-11T05:33:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.552 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.552 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956432+0000", 2024-09-11T05:33:58.552 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5979999999999999e-06 2024-09-11T05:33:58.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.552 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.552 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.552 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012281+0000", 2024-09-11T05:33:58.552 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055848644000000003 2024-09-11T05:33:58.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.552 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.552 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.552 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012358+0000", 2024-09-11T05:33:58.552 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6662000000000006e-05 2024-09-11T05:33:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012457+0000", 2024-09-11T05:33:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9197999999999995e-05 2024-09-11T05:33:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151303 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4128768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:33:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5183331889999998, 2024-09-11T05:33:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056186709000000001, 2024-09-11T05:33:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151303 2024-09-11T05:33:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:33:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:33:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:33:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:33:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956437+0000", 2024-09-11T05:33:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.201e-06 2024-09-11T05:33:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956440+0000", 2024-09-11T05:33:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-06 2024-09-11T05:33:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956443+0000", 2024-09-11T05:33:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5909999999999998e-06 2024-09-11T05:33:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012494+0000", 2024-09-11T05:33:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056051541000000003 2024-09-11T05:33:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012558+0000", 2024-09-11T05:33:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3347000000000002e-05 2024-09-11T05:33:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012622+0000", 2024-09-11T05:33:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4760999999999999e-05 2024-09-11T05:33:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151304 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:33:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5183231319999999, 2024-09-11T05:33:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056360149999999998, 2024-09-11T05:33:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151304 2024-09-11T05:33:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:33:58.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:33:58.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:33:58.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:33:58.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956447+0000", 2024-09-11T05:33:58.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.153e-06 2024-09-11T05:33:58.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956450+0000", 2024-09-11T05:33:58.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9909999999999998e-06 2024-09-11T05:33:58.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956453+0000", 2024-09-11T05:33:58.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.447e-06 2024-09-11T05:33:58.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.562 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.562 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012660+0000", 2024-09-11T05:33:58.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056207510000000002 2024-09-11T05:33:58.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.562 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.562 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012741+0000", 2024-09-11T05:33:58.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0734000000000003e-05 2024-09-11T05:33:58.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012806+0000", 2024-09-11T05:33:58.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5087999999999998e-05 2024-09-11T05:33:58.563 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.563 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.563 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.563 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151305 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4587520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.563 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:33:58.563 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5183133709999996, 2024-09-11T05:33:58.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056476407999999999, 2024-09-11T05:33:58.563 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.564 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.564 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.564 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.564 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.564 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.564 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151305 2024-09-11T05:33:58.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.564 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:33:58.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:33:58.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:33:58.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:33:58.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956457+0000", 2024-09-11T05:33:58.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.353e-06 2024-09-11T05:33:58.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.566 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.566 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956460+0000", 2024-09-11T05:33:58.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0060000000000001e-06 2024-09-11T05:33:58.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.566 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.566 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956463+0000", 2024-09-11T05:33:58.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.452e-06 2024-09-11T05:33:58.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012834+0000", 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056370917999999999 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012877+0000", 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000999999999997e-05 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012932+0000", 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5470000000000003e-05 2024-09-11T05:33:58.567 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.568 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.568 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.568 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151306 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4800512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.568 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:33:58.568 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5183033909999999, 2024-09-11T05:33:58.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056579203000000002, 2024-09-11T05:33:58.568 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.568 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.568 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.568 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151306 2024-09-11T05:33:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:33:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.28e-07 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956467+0000", 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.088e-06 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956470+0000", 2024-09-11T05:33:58.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0240000000000002e-06 2024-09-11T05:33:58.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956472+0000", 2024-09-11T05:33:58.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4609999999999998e-06 2024-09-11T05:33:58.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012953+0000", 2024-09-11T05:33:58.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056480524999999997 2024-09-11T05:33:58.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012994+0000", 2024-09-11T05:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1394999999999999e-05 2024-09-11T05:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013045+0000", 2024-09-11T05:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0482000000000002e-05 2024-09-11T05:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.573 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151307 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5013504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.573 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:33:58.573 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5182937220000001, 2024-09-11T05:33:58.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056680525000000002, 2024-09-11T05:33:58.573 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.573 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.573 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.573 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.573 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.573 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.573 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151307 2024-09-11T05:33:58.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.574 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.574 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:33:58.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.574 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:33:58.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956476+0000", 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0359999999999999e-06 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956479+0000", 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8899999999999999e-06 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.575 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956482+0000", 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5380000000000001e-06 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013065+0000", 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056582983000000003 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013104+0000", 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9119999999999998e-05 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013156+0000", 2024-09-11T05:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1743999999999998e-05 2024-09-11T05:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151308 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5226496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 4.5182763909999997, 2024-09-11T05:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056772738000000003, 2024-09-11T05:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:33:58.578 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:33:58.578 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:33:58.578 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:33:58.578 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:33:58.578 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:58.578 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151308 2024-09-11T05:33:58.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.578 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:33:58.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:33:58.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:33:58.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2599999999999998e-07 2024-09-11T05:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956495+0000", 2024-09-11T05:33:58.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9750000000000001e-06 2024-09-11T05:33:58.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:33:58.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956499+0000", 2024-09-11T05:33:58.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5179999999999998e-06 2024-09-11T05:33:58.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:33:58.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956502+0000", 2024-09-11T05:33:58.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7530000000000002e-06 2024-09-11T05:33:58.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:33:58.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013177+0000", 2024-09-11T05:33:58.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056674536999999997 2024-09-11T05:33:58.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:33:58.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013215+0000", 2024-09-11T05:33:58.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8578999999999998e-05 2024-09-11T05:33:58.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:33:58.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:33:58.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:33:58.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013265+0000", 2024-09-11T05:33:58.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0049999999999997e-05 2024-09-11T05:33:58.582 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.582 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.582 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.582 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:33:58.582 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:33:58.582 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:33:58.583 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:58.583+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:58.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:33:58.684 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:58.683+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:58.691 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:58.691 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:58.691 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:58.691 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:58.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:33:58.785 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:58.785+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:58.843 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:58.844 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:58.844 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:58.844 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:58.844 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:58.852 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:33:58.890 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T05:33:58.890 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:58.889+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:58.987 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:58.987+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:58.991 INFO:teuthology.orchestra.run.smithi070.stdout:flattening image image_client.0-clone30 2024-09-11T05:33:59.004 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:59.004 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:59.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:59.004 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:59.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.005 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116524 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.005 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:33:59.005 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191341324, 2024-09-11T05:33:59.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344630100000001, 2024-09-11T05:33:59.005 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.005 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116524 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811270+0000", 2024-09-11T05:33:59.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:33:59.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811272+0000", 2024-09-11T05:33:59.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:33:59.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811278+0000", 2024-09-11T05:33:59.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1970000000000001e-06 2024-09-11T05:33:59.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811283+0000", 2024-09-11T05:33:59.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-09-11T05:33:59.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813113+0000", 2024-09-11T05:33:59.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001830302 2024-09-11T05:33:59.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:59.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813117+0000", 2024-09-11T05:33:59.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0810000000000004e-06 2024-09-11T05:33:59.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814661+0000", 2024-09-11T05:33:59.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015436969999999999 2024-09-11T05:33:59.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814667+0000", 2024-09-11T05:33:59.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6370000000000002e-06 2024-09-11T05:33:59.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826115+0000", 2024-09-11T05:33:59.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114479059999999 2024-09-11T05:33:59.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826123+0000", 2024-09-11T05:33:59.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000004e-06 2024-09-11T05:33:59.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845722+0000", 2024-09-11T05:33:59.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195993000000001 2024-09-11T05:33:59.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845732+0000", 2024-09-11T05:33:59.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T05:33:59.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.015 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.015 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116525 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.015 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:33:59.016 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191321442, 2024-09-11T05:33:59.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344747700000001, 2024-09-11T05:33:59.016 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.016 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.017 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.017 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.017 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.017 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116525 2024-09-11T05:33:59.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.017 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:33:59.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:33:59.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811290+0000", 2024-09-11T05:33:59.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:33:59.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811295+0000", 2024-09-11T05:33:59.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8969999999999999e-06 2024-09-11T05:33:59.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811301+0000", 2024-09-11T05:33:59.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4919999999999998e-06 2024-09-11T05:33:59.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811306+0000", 2024-09-11T05:33:59.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999998e-06 2024-09-11T05:33:59.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813138+0000", 2024-09-11T05:33:59.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001832078 2024-09-11T05:33:59.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:33:59.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813142+0000", 2024-09-11T05:33:59.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0380000000000001e-06 2024-09-11T05:33:59.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814689+0000", 2024-09-11T05:33:59.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546799 2024-09-11T05:33:59.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814695+0000", 2024-09-11T05:33:59.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8739999999999997e-06 2024-09-11T05:33:59.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826148+0000", 2024-09-11T05:33:59.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114527259999999 2024-09-11T05:33:59.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826166+0000", 2024-09-11T05:33:59.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7484999999999999e-05 2024-09-11T05:33:59.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845756+0000", 2024-09-11T05:33:59.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019590609 2024-09-11T05:33:59.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845764+0000", 2024-09-11T05:33:59.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7020000000000001e-06 2024-09-11T05:33:59.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.030 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.031 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116526 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.031 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:33:59.031 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191298644, 2024-09-11T05:33:59.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344863210000002, 2024-09-11T05:33:59.031 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.031 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116526 2024-09-11T05:33:59.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.033 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:33:59.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:33:59.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:33:59.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:33:59.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811315+0000", 2024-09-11T05:33:59.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079999999999999e-06 2024-09-11T05:33:59.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811320+0000", 2024-09-11T05:33:59.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8619999999999999e-06 2024-09-11T05:33:59.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811325+0000", 2024-09-11T05:33:59.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T05:33:59.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814736+0000", 2024-09-11T05:33:59.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034115780000000002 2024-09-11T05:33:59.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814744+0000", 2024-09-11T05:33:59.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5340000000000002e-06 2024-09-11T05:33:59.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826212+0000", 2024-09-11T05:33:59.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114682749999999 2024-09-11T05:33:59.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826225+0000", 2024-09-11T05:33:59.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:33:59.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845789+0000", 2024-09-11T05:33:59.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195649200000001 2024-09-11T05:33:59.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845798+0000", 2024-09-11T05:33:59.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9269999999999994e-06 2024-09-11T05:33:59.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.044 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.044 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116527 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.045 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:33:59.045 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191279712, 2024-09-11T05:33:59.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345095849999999, 2024-09-11T05:33:59.045 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.045 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116527 2024-09-11T05:33:59.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.047 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:33:59.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:33:59.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:33:59.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:33:59.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811334+0000", 2024-09-11T05:33:59.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:33:59.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811340+0000", 2024-09-11T05:33:59.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.691e-06 2024-09-11T05:33:59.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811345+0000", 2024-09-11T05:33:59.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5480000000000003e-06 2024-09-11T05:33:59.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814767+0000", 2024-09-11T05:33:59.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034223190000000001 2024-09-11T05:33:59.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814774+0000", 2024-09-11T05:33:59.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:33:59.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826265+0000", 2024-09-11T05:33:59.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114912460000001 2024-09-11T05:33:59.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826274+0000", 2024-09-11T05:33:59.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3909999999999998e-06 2024-09-11T05:33:59.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845831+0000", 2024-09-11T05:33:59.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195574080000001 2024-09-11T05:33:59.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845841+0000", 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3610000000000007e-06 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116528 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191260273000001, 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345287679999999, 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116528 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:33:59.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811351+0000", 2024-09-11T05:33:59.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T05:33:59.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811353+0000", 2024-09-11T05:33:59.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:33:59.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811359+0000", 2024-09-11T05:33:59.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T05:33:59.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811364+0000", 2024-09-11T05:33:59.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000001e-06 2024-09-11T05:33:59.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814795+0000", 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034316569999999998 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814826+0000", 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0587999999999999e-05 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826309+0000", 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011483444 2024-09-11T05:33:59.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826319+0000", 2024-09-11T05:33:59.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6849999999999996e-06 2024-09-11T05:33:59.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845868+0000", 2024-09-11T05:33:59.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195487110000001 2024-09-11T05:33:59.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845879+0000", 2024-09-11T05:33:59.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1428e-05 2024-09-11T05:33:59.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.060 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.060 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116529 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.060 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:33:59.061 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191241639000001, 2024-09-11T05:33:59.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034542531, 2024-09-11T05:33:59.061 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.061 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.062 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116529 2024-09-11T05:33:59.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.062 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:33:59.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:33:59.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:33:59.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:33:59.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811371+0000", 2024-09-11T05:33:59.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T05:33:59.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811377+0000", 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1580000000000002e-06 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811383+0000", 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.135e-06 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814851+0000", 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034684690000000001 2024-09-11T05:33:59.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814858+0000", 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6969999999999996e-06 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826354+0000", 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114962359999999 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826364+0000", 2024-09-11T05:33:59.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0047999999999999e-05 2024-09-11T05:33:59.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845903+0000", 2024-09-11T05:33:59.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195393610000001 2024-09-11T05:33:59.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845912+0000", 2024-09-11T05:33:59.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2269999999999993e-06 2024-09-11T05:33:59.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.068 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.069 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116530 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.069 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:33:59.069 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191222727, 2024-09-11T05:33:59.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345557429999999, 2024-09-11T05:33:59.069 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.069 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.070 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116530 2024-09-11T05:33:59.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.070 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:33:59.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:33:59.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:33:59.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:33:59.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811390+0000", 2024-09-11T05:33:59.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:33:59.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811396+0000", 2024-09-11T05:33:59.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:33:59.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811402+0000", 2024-09-11T05:33:59.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:33:59.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814879+0000", 2024-09-11T05:33:59.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034769290000000001 2024-09-11T05:33:59.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814885+0000", 2024-09-11T05:33:59.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.156e-06 2024-09-11T05:33:59.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826389+0000", 2024-09-11T05:33:59.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115041140000001 2024-09-11T05:33:59.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826397+0000", 2024-09-11T05:33:59.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:33:59.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845935+0000", 2024-09-11T05:33:59.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195381370000001 2024-09-11T05:33:59.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845944+0000", 2024-09-11T05:33:59.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4540000000000007e-06 2024-09-11T05:33:59.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.075 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.075 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116531 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.075 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:33:59.075 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191202667999999, 2024-09-11T05:33:59.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345764630000001, 2024-09-11T05:33:59.076 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.076 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.076 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.077 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116531 2024-09-11T05:33:59.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.077 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:33:59.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:33:59.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:33:59.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:33:59.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811411+0000", 2024-09-11T05:33:59.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:33:59.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811417+0000", 2024-09-11T05:33:59.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:33:59.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811422+0000", 2024-09-11T05:33:59.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3229999999999997e-06 2024-09-11T05:33:59.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814906+0000", 2024-09-11T05:33:59.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034835389999999999 2024-09-11T05:33:59.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814913+0000", 2024-09-11T05:33:59.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309999999999996e-06 2024-09-11T05:33:59.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826423+0000", 2024-09-11T05:33:59.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115109019999999 2024-09-11T05:33:59.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826431+0000", 2024-09-11T05:33:59.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9410000000000007e-06 2024-09-11T05:33:59.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845975+0000", 2024-09-11T05:33:59.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019543767 2024-09-11T05:33:59.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845984+0000", 2024-09-11T05:33:59.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3530000000000001e-06 2024-09-11T05:33:59.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.084 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.084 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116532 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.084 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:33:59.085 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191182470000001, 2024-09-11T05:33:59.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034588131, 2024-09-11T05:33:59.085 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.085 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116532 2024-09-11T05:33:59.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.085 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811429+0000", 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811431+0000", 2024-09-11T05:33:59.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9910000000000001e-06 2024-09-11T05:33:59.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811437+0000", 2024-09-11T05:33:59.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.049e-06 2024-09-11T05:33:59.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811441+0000", 2024-09-11T05:33:59.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8289999999999998e-06 2024-09-11T05:33:59.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814934+0000", 2024-09-11T05:33:59.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034927220000000002 2024-09-11T05:33:59.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814941+0000", 2024-09-11T05:33:59.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.844e-06 2024-09-11T05:33:59.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826480+0000", 2024-09-11T05:33:59.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115393260000001 2024-09-11T05:33:59.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826496+0000", 2024-09-11T05:33:59.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5406000000000001e-05 2024-09-11T05:33:59.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846008+0000", 2024-09-11T05:33:59.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.01951214 2024-09-11T05:33:59.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846016+0000", 2024-09-11T05:33:59.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4440000000000008e-06 2024-09-11T05:33:59.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.090 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.090 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116533 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.090 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:33:59.090 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191162916, 2024-09-11T05:33:59.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345994049999998, 2024-09-11T05:33:59.091 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.091 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.091 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116533 2024-09-11T05:33:59.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.091 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:33:59.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:33:59.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:33:59.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:33:59.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811450+0000", 2024-09-11T05:33:59.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0940000000000002e-06 2024-09-11T05:33:59.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811457+0000", 2024-09-11T05:33:59.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2729999999999999e-06 2024-09-11T05:33:59.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811461+0000", 2024-09-11T05:33:59.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.673e-06 2024-09-11T05:33:59.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814962+0000", 2024-09-11T05:33:59.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035012530000000002 2024-09-11T05:33:59.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814970+0000", 2024-09-11T05:33:59.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0539999999999997e-06 2024-09-11T05:33:59.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826536+0000", 2024-09-11T05:33:59.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011566049 2024-09-11T05:33:59.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826542+0000", 2024-09-11T05:33:59.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1709999999999999e-06 2024-09-11T05:33:59.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846039+0000", 2024-09-11T05:33:59.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019497168 2024-09-11T05:33:59.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846047+0000", 2024-09-11T05:33:59.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-11T05:33:59.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116534 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:33:59.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191144008999999, 2024-09-11T05:33:59.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034610979, 2024-09-11T05:33:59.097 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116534 2024-09-11T05:33:59.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.098 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:33:59.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:33:59.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811469+0000", 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.871e-06 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811475+0000", 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1689999999999997e-06 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811480+0000", 2024-09-11T05:33:59.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5990000000000004e-06 2024-09-11T05:33:59.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814990+0000", 2024-09-11T05:33:59.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003510876 2024-09-11T05:33:59.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814997+0000", 2024-09-11T05:33:59.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T05:33:59.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826571+0000", 2024-09-11T05:33:59.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115740230000001 2024-09-11T05:33:59.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826576+0000", 2024-09-11T05:33:59.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-11T05:33:59.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846070+0000", 2024-09-11T05:33:59.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194937660000001 2024-09-11T05:33:59.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846078+0000", 2024-09-11T05:33:59.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.038e-06 2024-09-11T05:33:59.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.102 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116535 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:33:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191124850000001, 2024-09-11T05:33:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346218060000001, 2024-09-11T05:33:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116535 2024-09-11T05:33:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:33:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:33:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:33:59.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:33:59.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811488+0000", 2024-09-11T05:33:59.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:33:59.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811495+0000", 2024-09-11T05:33:59.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3960000000000003e-06 2024-09-11T05:33:59.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811500+0000", 2024-09-11T05:33:59.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9910000000000002e-06 2024-09-11T05:33:59.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815019+0000", 2024-09-11T05:33:59.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035190479999999999 2024-09-11T05:33:59.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815025+0000", 2024-09-11T05:33:59.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2550000000000003e-06 2024-09-11T05:33:59.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826604+0000", 2024-09-11T05:33:59.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115789959999999 2024-09-11T05:33:59.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826611+0000", 2024-09-11T05:33:59.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:33:59.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846100+0000", 2024-09-11T05:33:59.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194890569999999 2024-09-11T05:33:59.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846108+0000", 2024-09-11T05:33:59.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4089999999999997e-06 2024-09-11T05:33:59.108 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.108 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.108 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.109 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116536 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.109 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:33:59.109 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191105328999999, 2024-09-11T05:33:59.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034634724, 2024-09-11T05:33:59.109 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.109 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.109 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.109 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.109 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.109 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116536 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811506+0000", 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811508+0000", 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811514+0000", 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0610000000000001e-06 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811519+0000", 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0340000000000004e-06 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815049+0000", 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035296440000000002 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815055+0000", 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826642+0000", 2024-09-11T05:33:59.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011586375 2024-09-11T05:33:59.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826649+0000", 2024-09-11T05:33:59.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-09-11T05:33:59.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846131+0000", 2024-09-11T05:33:59.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194814569999999 2024-09-11T05:33:59.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846140+0000", 2024-09-11T05:33:59.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2240000000000001e-06 2024-09-11T05:33:59.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.114 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.114 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116537 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.114 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:33:59.115 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.19108576, 2024-09-11T05:33:59.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346492180000002, 2024-09-11T05:33:59.115 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116537 2024-09-11T05:33:59.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.115 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811532+0000", 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811538+0000", 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7259999999999996e-06 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811543+0000", 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.164e-06 2024-09-11T05:33:59.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815078+0000", 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003534428 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815086+0000", 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8210000000000002e-06 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826736+0000", 2024-09-11T05:33:59.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116503429999999 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826751+0000", 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4895999999999999e-05 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846165+0000", 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019413854 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846174+0000", 2024-09-11T05:33:59.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3149999999999998e-06 2024-09-11T05:33:59.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.120 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.120 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116538 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:33:59.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191061071, 2024-09-11T05:33:59.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346557729999999, 2024-09-11T05:33:59.120 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116538 2024-09-11T05:33:59.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.121 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:33:59.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811552+0000", 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2869999999999999e-06 2024-09-11T05:33:59.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811559+0000", 2024-09-11T05:33:59.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3820000000000001e-06 2024-09-11T05:33:59.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811564+0000", 2024-09-11T05:33:59.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:33:59.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815109+0000", 2024-09-11T05:33:59.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035450989999999999 2024-09-11T05:33:59.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815115+0000", 2024-09-11T05:33:59.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:33:59.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826780+0000", 2024-09-11T05:33:59.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116645799999999 2024-09-11T05:33:59.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826787+0000", 2024-09-11T05:33:59.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3880000000000002e-06 2024-09-11T05:33:59.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846196+0000", 2024-09-11T05:33:59.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194094069999999 2024-09-11T05:33:59.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846205+0000", 2024-09-11T05:33:59.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.884e-06 2024-09-11T05:33:59.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.126 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.126 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116539 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.126 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:33:59.126 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191041025000001, 2024-09-11T05:33:59.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346668399999999, 2024-09-11T05:33:59.126 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.126 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.126 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116539 2024-09-11T05:33:59.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.127 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:33:59.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:33:59.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:33:59.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:33:59.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811572+0000", 2024-09-11T05:33:59.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:33:59.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811578+0000", 2024-09-11T05:33:59.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T05:33:59.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811583+0000", 2024-09-11T05:33:59.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:33:59.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815137+0000", 2024-09-11T05:33:59.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035540210000000001 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815144+0000", 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5969999999999997e-06 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826851+0000", 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117072149999999 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826860+0000", 2024-09-11T05:33:59.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4200000000000007e-06 2024-09-11T05:33:59.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846228+0000", 2024-09-11T05:33:59.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019368287 2024-09-11T05:33:59.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846236+0000", 2024-09-11T05:33:59.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.541e-06 2024-09-11T05:33:59.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.131 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.132 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116540 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.132 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:33:59.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191021600999999, 2024-09-11T05:33:59.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346767830000001, 2024-09-11T05:33:59.132 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116540 2024-09-11T05:33:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:33:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:33:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:33:59.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:33:59.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811591+0000", 2024-09-11T05:33:59.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:33:59.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811598+0000", 2024-09-11T05:33:59.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T05:33:59.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811603+0000", 2024-09-11T05:33:59.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9470000000000002e-06 2024-09-11T05:33:59.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815168+0000", 2024-09-11T05:33:59.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035651810000000002 2024-09-11T05:33:59.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815174+0000", 2024-09-11T05:33:59.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T05:33:59.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826883+0000", 2024-09-11T05:33:59.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117088830000001 2024-09-11T05:33:59.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826891+0000", 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7179999999999996e-06 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846258+0000", 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019367328 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846266+0000", 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4880000000000001e-06 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.138 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116541 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.138 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:33:59.138 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.191002307000002, 2024-09-11T05:33:59.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346837, 2024-09-11T05:33:59.138 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116541 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811609+0000", 2024-09-11T05:33:59.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:33:59.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811611+0000", 2024-09-11T05:33:59.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8679999999999999e-06 2024-09-11T05:33:59.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811617+0000", 2024-09-11T05:33:59.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:33:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811622+0000", 2024-09-11T05:33:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9370000000000003e-06 2024-09-11T05:33:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815201+0000", 2024-09-11T05:33:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035788679999999998 2024-09-11T05:33:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815207+0000", 2024-09-11T05:33:59.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7530000000000004e-06 2024-09-11T05:33:59.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826988+0000", 2024-09-11T05:33:59.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117802300000001 2024-09-11T05:33:59.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826996+0000", 2024-09-11T05:33:59.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.259e-06 2024-09-11T05:33:59.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846285+0000", 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192892090000001 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846292+0000", 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9399999999999996e-06 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.144 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116542 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.144 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:33:59.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.190983397, 2024-09-11T05:33:59.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034697618, 2024-09-11T05:33:59.144 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116542 2024-09-11T05:33:59.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.145 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:33:59.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:33:59.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811628+0000", 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811629+0000", 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8059999999999999e-06 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811636+0000", 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0990000000000004e-06 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811640+0000", 2024-09-11T05:33:59.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6630000000000001e-06 2024-09-11T05:33:59.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815230+0000", 2024-09-11T05:33:59.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035897009999999998 2024-09-11T05:33:59.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815237+0000", 2024-09-11T05:33:59.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6590000000000001e-06 2024-09-11T05:33:59.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827019+0000", 2024-09-11T05:33:59.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011782261 2024-09-11T05:33:59.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827026+0000", 2024-09-11T05:33:59.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.605e-06 2024-09-11T05:33:59.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846317+0000", 2024-09-11T05:33:59.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192904270000001 2024-09-11T05:33:59.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846325+0000", 2024-09-11T05:33:59.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0530000000000007e-06 2024-09-11T05:33:59.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.149 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.149 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116543 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.190964723, 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0347097559999998, 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116543 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811648+0000", 2024-09-11T05:33:59.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:33:59.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811654+0000", 2024-09-11T05:33:59.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T05:33:59.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811659+0000", 2024-09-11T05:33:59.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9409999999999998e-06 2024-09-11T05:33:59.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815259+0000", 2024-09-11T05:33:59.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035993980000000002 2024-09-11T05:33:59.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815265+0000", 2024-09-11T05:33:59.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-11T05:33:59.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827049+0000", 2024-09-11T05:33:59.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117836019999999 2024-09-11T05:33:59.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:33:59.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827056+0000", 2024-09-11T05:33:59.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3919999999999997e-06 2024-09-11T05:33:59.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846348+0000", 2024-09-11T05:33:59.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192919039999999 2024-09-11T05:33:59.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846356+0000", 2024-09-11T05:33:59.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7449999999999995e-06 2024-09-11T05:33:59.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.156 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.157 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.157 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:59.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:33:59.159 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-11T05:33:59.159 INFO:teuthology.orchestra.run.smithi070.stdout:5028 read 0x38eba7a thru 0x38ee895 (0x2e1c bytes) 2024-09-11T05:33:59.159 INFO:teuthology.orchestra.run.smithi070.stdout:5029 read 0x82ce270 thru 0x82ddbbb (0xf94c bytes) 2024-09-11T05:33:59.159 INFO:teuthology.orchestra.run.smithi070.stdout:5030 writesame 0xdaa6e45 thru 0xdaad822 data_size 0x3(0x69de bytes) 2024-09-11T05:33:59.160 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:33:59.158+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:33:59.169 INFO:teuthology.orchestra.run.smithi070.stdout:5031 trunc from 0xdaad823 to 0x2b450a6 2024-09-11T05:33:59.205 INFO:teuthology.orchestra.run.smithi070.stdout:5032 read 0x268125c thru 0x2689bd0 (0x8975 bytes) 2024-09-11T05:33:59.205 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:33:59.205 INFO:teuthology.orchestra.run.smithi070.stdout:5035 punch from 0x25f23a5 to 0x25f9c37, (0x7892 bytes) 2024-09-11T05:33:59.206 INFO:teuthology.orchestra.run.smithi070.stdout:5036 trunc from 0x2b450a6 to 0x19a8990 2024-09-11T05:33:59.222 INFO:teuthology.orchestra.run.smithi070.stdout:5037 writesame 0x4bcc280 thru 0x4bd2617 data_size 0x4(0x6398 bytes) 2024-09-11T05:33:59.224 INFO:teuthology.orchestra.run.smithi070.stdout:5038 read 0x1a4dac thru 0x1a6d06 (0x1f5b bytes) 2024-09-11T05:33:59.224 INFO:teuthology.orchestra.run.smithi070.stdout:5040 clone 32 order 20 su 262144 sc 14 2024-09-11T05:33:59.259 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:33:59.258+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:33:59.279 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:59.279 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:59.279 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:59.279 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:59.287 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:33:59.360 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:33:59.360+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:33:59.430 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:59.430 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:59.430 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:33:59.431 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:33:59.431 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:59.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:33:59.461 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:33:59.461+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:33:59.543 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:59.543 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:33:59.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:33:59.543 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:33:59.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.543 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36429 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8585216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.543 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:59.543 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460386815, 2024-09-11T05:33:59.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035281438999999998, 2024-09-11T05:33:59.544 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.544 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36429 2024-09-11T05:33:59.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.544 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081346+0000", 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081348+0000", 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081355+0000", 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2230000000000001e-06 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081360+0000", 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0499999999999999e-06 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116334+0000", 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.034973889000000001 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116410+0000", 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6001000000000006e-05 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116627+0000", 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000216956 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.547 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36430 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9437184~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460278752000001, 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035492782, 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36430 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081454+0000", 2024-09-11T05:33:59.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.99e-07 2024-09-11T05:33:59.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081458+0000", 2024-09-11T05:33:59.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7160000000000001e-06 2024-09-11T05:33:59.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081468+0000", 2024-09-11T05:33:59.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9629999999999993e-06 2024-09-11T05:33:59.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081474+0000", 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2060000000000004e-06 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116658+0000", 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03518454 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116734+0000", 2024-09-11T05:33:59.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5703000000000003e-05 2024-09-11T05:33:59.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116946+0000", 2024-09-11T05:33:59.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211955 2024-09-11T05:33:59.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.552 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.552 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36431 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9895936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.552 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:59.552 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460247627000001, 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035819799999999999, 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36431 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:59.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:33:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081485+0000", 2024-09-11T05:33:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:33:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081493+0000", 2024-09-11T05:33:59.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9629999999999998e-06 2024-09-11T05:33:59.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081500+0000", 2024-09-11T05:33:59.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7070000000000003e-06 2024-09-11T05:33:59.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081504+0000", 2024-09-11T05:33:59.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:33:59.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116993+0000", 2024-09-11T05:33:59.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035489224 2024-09-11T05:33:59.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117083+0000", 2024-09-11T05:33:59.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9560000000000003e-05 2024-09-11T05:33:59.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117304+0000", 2024-09-11T05:33:59.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221244 2024-09-11T05:33:59.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.557 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.557 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36448 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 327680~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.557 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:59.557 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460220925000002, 2024-09-11T05:33:59.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036143304000000001, 2024-09-11T05:33:59.557 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.557 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36448 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:33:59.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081512+0000", 2024-09-11T05:33:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:33:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081514+0000", 2024-09-11T05:33:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:33:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081520+0000", 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4269999999999996e-06 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081525+0000", 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6140000000000002e-06 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117333+0000", 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035808385999999998 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117446+0000", 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113161 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117654+0000", 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020835800000000001 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.561 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36449 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1638400~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460201697000002, 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036464895999999997, 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36449 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:59.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:33:59.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081531+0000", 2024-09-11T05:33:59.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081533+0000", 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8649999999999999e-06 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081538+0000", 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7769999999999999e-06 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081543+0000", 2024-09-11T05:33:59.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4390000000000002e-06 2024-09-11T05:33:59.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117686+0000", 2024-09-11T05:33:59.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036142760000000003 2024-09-11T05:33:59.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117768+0000", 2024-09-11T05:33:59.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2521000000000005e-05 2024-09-11T05:33:59.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117995+0000", 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022715699999999999 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36450 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460183829000002, 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036798323000000001, 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36450 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081549+0000", 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1699999999999999e-07 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081550+0000", 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081557+0000", 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081561+0000", 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2880000000000003e-06 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118042+0000", 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036480984000000001 2024-09-11T05:33:59.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118142+0000", 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100043 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118347+0000", 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020477399999999999 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36451 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4259840~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460165998999997, 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037058173, 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36451 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:59.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:59.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:33:59.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081568+0000", 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081573+0000", 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999998e-06 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081575+0000", 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.605e-06 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118377+0000", 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036801831 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118459+0000", 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1983000000000004e-05 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118624+0000", 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000165353 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36452 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5570560~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460153618, 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037358132000000002, 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.575 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36452 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081579+0000", 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4600000000000001e-07 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081580+0000", 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081583+0000", 2024-09-11T05:33:59.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9119999999999998e-06 2024-09-11T05:33:59.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081586+0000", 2024-09-11T05:33:59.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.371e-06 2024-09-11T05:33:59.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118666+0000", 2024-09-11T05:33:59.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037079933000000002 2024-09-11T05:33:59.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118725+0000", 2024-09-11T05:33:59.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8600000000000001e-05 2024-09-11T05:33:59.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118937+0000", 2024-09-11T05:33:59.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211931 2024-09-11T05:33:59.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.579 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36453 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6881280~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460142968, 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037649803000000003, 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36453 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:33:59.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081590+0000", 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081593+0000", 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0110000000000001e-06 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081596+0000", 2024-09-11T05:33:59.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7609999999999999e-06 2024-09-11T05:33:59.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118965+0000", 2024-09-11T05:33:59.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037368971000000001 2024-09-11T05:33:59.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119037+0000", 2024-09-11T05:33:59.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2300999999999998e-05 2024-09-11T05:33:59.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119239+0000", 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020146000000000001 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36454 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8192000~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460132911999999, 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037930403000000001, 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.585 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.585 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.585 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.585 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.585 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36454 2024-09-11T05:33:59.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.585 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:59.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:59.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:33:59.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:59.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081600+0000", 2024-09-11T05:33:59.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081603+0000", 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081606+0000", 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4099999999999998e-06 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119274+0000", 2024-09-11T05:33:59.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037668407000000001 2024-09-11T05:33:59.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119340+0000", 2024-09-11T05:33:59.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5685000000000006e-05 2024-09-11T05:33:59.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119530+0000", 2024-09-11T05:33:59.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000189688 2024-09-11T05:33:59.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.588 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36455 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9502720~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460122763000001, 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038210565000000002, 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36455 2024-09-11T05:33:59.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.590 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:59.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:33:59.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081610+0000", 2024-09-11T05:33:59.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:59.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081611+0000", 2024-09-11T05:33:59.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0279999999999999e-06 2024-09-11T05:33:59.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081613+0000", 2024-09-11T05:33:59.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8430000000000001e-06 2024-09-11T05:33:59.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081616+0000", 2024-09-11T05:33:59.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6350000000000002e-06 2024-09-11T05:33:59.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119555+0000", 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037939252999999999 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119629+0000", 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3868999999999994e-05 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119820+0000", 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190724 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.594 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36480 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 393216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.594 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:59.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460113198000002, 2024-09-11T05:33:59.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039217429999999998, 2024-09-11T05:33:59.594 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36480 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:33:59.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:59.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081620+0000", 2024-09-11T05:33:59.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4900000000000004e-07 2024-09-11T05:33:59.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081624+0000", 2024-09-11T05:33:59.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:33:59.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081627+0000", 2024-09-11T05:33:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6520000000000002e-06 2024-09-11T05:33:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119851+0000", 2024-09-11T05:33:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038224209000000002 2024-09-11T05:33:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120518+0000", 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066708900000000005 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120836+0000", 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031833300000000002 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36481 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1703936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:59.598 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460102311, 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039545442, 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36481 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:59.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:59.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:33:59.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:33:59.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081631+0000", 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0839999999999999e-06 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081635+0000", 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.743e-06 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081637+0000", 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.661e-06 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120887+0000", 2024-09-11T05:33:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039249876000000003 2024-09-11T05:33:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120968+0000", 2024-09-11T05:33:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0253999999999994e-05 2024-09-11T05:33:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121175+0000", 2024-09-11T05:33:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020761099999999999 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36482 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 3014656~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460091749999997, 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040344708999999999, 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36482 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081641+0000", 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081647+0000", 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081651+0000", 2024-09-11T05:33:59.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2080000000000002e-06 2024-09-11T05:33:59.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081654+0000", 2024-09-11T05:33:59.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:33:59.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121203+0000", 2024-09-11T05:33:59.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039549466999999998 2024-09-11T05:33:59.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121267+0000", 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3713999999999993e-05 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121985+0000", 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071827299999999996 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36483 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4325376~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.607 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460075191000001, 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040925571000000001, 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36483 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081661+0000", 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.296e-06 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081665+0000", 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9269999999999998e-06 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081668+0000", 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.615e-06 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122019+0000", 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040350886000000002 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122108+0000", 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8671000000000005e-05 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122582+0000", 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047494900000000001 2024-09-11T05:33:59.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36484 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5636096~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460060763000001, 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041537567999999997, 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36484 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081672+0000", 2024-09-11T05:33:59.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-07 2024-09-11T05:33:59.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081673+0000", 2024-09-11T05:33:59.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.212e-06 2024-09-11T05:33:59.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081676+0000", 2024-09-11T05:33:59.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6940000000000001e-06 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081679+0000", 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8260000000000001e-06 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122615+0000", 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040935421999999999 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122892+0000", 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027731099999999997 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123209+0000", 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000316872 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36485 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6946816~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:59.616 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460048553, 2024-09-11T05:33:59.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041869008999999999, 2024-09-11T05:33:59.617 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.617 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.617 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36485 2024-09-11T05:33:59.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.617 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:59.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:59.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:33:59.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:33:59.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081685+0000", 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029e-06 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081689+0000", 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0709999999999996e-06 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081692+0000", 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389999999999999e-06 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123245+0000", 2024-09-11T05:33:59.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041553759000000003 2024-09-11T05:33:59.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123331+0000", 2024-09-11T05:33:59.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5885999999999997e-05 2024-09-11T05:33:59.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123553+0000", 2024-09-11T05:33:59.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022129499999999999 2024-09-11T05:33:59.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.621 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.621 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36486 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8257536~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.621 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:59.621 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460037534999998, 2024-09-11T05:33:59.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042204617999999999, 2024-09-11T05:33:59.621 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36486 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:59.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081698+0000", 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6490000000000001e-06 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081702+0000", 2024-09-11T05:33:59.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7249999999999999e-06 2024-09-11T05:33:59.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081705+0000", 2024-09-11T05:33:59.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7379999999999999e-06 2024-09-11T05:33:59.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123583+0000", 2024-09-11T05:33:59.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041878604999999999 2024-09-11T05:33:59.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123666+0000", 2024-09-11T05:33:59.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2027000000000006e-05 2024-09-11T05:33:59.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123899+0000", 2024-09-11T05:33:59.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000233663 2024-09-11T05:33:59.625 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.625 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.625 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36487 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9568256~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.460024361000002, 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043010712999999999, 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36487 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.16e-07 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081709+0000", 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2100000000000001e-06 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081713+0000", 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.811e-06 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081716+0000", 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.112e-06 2024-09-11T05:33:59.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123961+0000", 2024-09-11T05:33:59.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042244482999999999 2024-09-11T05:33:59.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124043+0000", 2024-09-11T05:33:59.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2066999999999999e-05 2024-09-11T05:33:59.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124718+0000", 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067581399999999995 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:43696 3.10 3:0e50cb16:::rbd_data.112dcdbd4c7c.0000000000000007:14 [read 2088960~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.503804144999997, 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035281203999999997, 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:33:59.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 43696 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:33:59.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:33:59.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:33:59.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-07 2024-09-11T05:33:59.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:33:59.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037930+0000", 2024-09-11T05:33:59.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5540000000000001e-06 2024-09-11T05:33:59.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037935+0000", 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0610000000000003e-06 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037939+0000", 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1239999999999998e-06 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073102+0000", 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035163341000000001 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073159+0000", 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6316000000000001e-05 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073209+0000", 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0512e-05 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:33:59.634 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:59.636 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:33:59.636 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:33:59.635+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:33:59.736 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:59.736+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:59.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:33:59.782 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:33:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:33:59.782 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:33:59.782 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:33:59.791 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:33:59.871 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:33:59.871 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:33:59.871 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:33:59.871+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:33:59.888 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:33:59.888 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:33:59.909 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:33:59.909 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:33:59.927 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:33:59.928 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:33:59.937 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:33:59.937+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:33:59.946 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:33:59.946 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:33:59.946 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:33:59.946 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:33:59.957 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:33:59.957 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone31 from 0x4bd2618 (overlap 0x19a8990) to 0x1486e0c 2024-09-11T05:33:59.965 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:33:59.966 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:33:59.986 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:33:59.986 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:00.019 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:00.019 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:00.026 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-11T05:34:00.073 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:00.073+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:00.098 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:00.099 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:00.108 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:00.140 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:00.140+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:00.202 INFO:teuthology.orchestra.run.smithi070.stdout:5041 read 0x30c22cc thru 0x30d0ac2 (0xe7f7 bytes) 2024-09-11T05:34:00.207 INFO:teuthology.orchestra.run.smithi070.stdout:5042 trunc from 0x4bd2618 to 0x88a590 2024-09-11T05:34:00.241 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:00.241+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:00.249 INFO:teuthology.orchestra.run.smithi070.stdout:5043 write 0x74b2092 thru 0x74b8b15 (0x6a84 bytes) 2024-09-11T05:34:00.252 INFO:teuthology.orchestra.run.smithi070.stdout:5044 read 0x4a1ea0f thru 0x4a2e133 (0xf725 bytes) 2024-09-11T05:34:00.252 INFO:teuthology.orchestra.run.smithi070.stdout:5045 writesame 0x6f72e42 thru 0x6f7767c data_size 0xb(0x483b bytes) 2024-09-11T05:34:00.255 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:00.270 INFO:teuthology.orchestra.run.smithi070.stdout:5048 writesame 0xe0f63e1 thru 0xe0ffe74 data_size 0x1a(0x9a94 bytes) 2024-09-11T05:34:00.270 INFO:teuthology.orchestra.run.smithi070.stdout:5049 read 0x7ce4e3 thru 0x7cefe3 (0xb01 bytes) 2024-09-11T05:34:00.270 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:00.271 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:00.271 INFO:teuthology.orchestra.run.smithi070.stdout:5050 write 0x7f33f64 thru 0x7f3769f (0x373c bytes) 2024-09-11T05:34:00.273 INFO:teuthology.orchestra.run.smithi070.stdout:5051 read 0x613f536 thru 0x6149a27 (0xa4f2 bytes) 2024-09-11T05:34:00.273 INFO:teuthology.orchestra.run.smithi070.stdout:5052 read 0x34da712 thru 0x34e4f46 (0xa835 bytes) 2024-09-11T05:34:00.289 INFO:teuthology.orchestra.run.smithi070.stdout:5053 trunc from 0xe0ffe75 to 0x2deb4ee 2024-09-11T05:34:00.290 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:00.312 INFO:teuthology.orchestra.run.smithi070.stdout:5054 trunc from 0x2deb4ee to 0xdd90ff5 2024-09-11T05:34:00.317 INFO:teuthology.orchestra.run.smithi070.stdout:5055 write 0x1af7b2f thru 0x1b03580 (0xba52 bytes) 2024-09-11T05:34:00.322 INFO:teuthology.orchestra.run.smithi070.stdout:5057 read 0xa7a3d40 thru 0xa7a97c8 (0x5a89 bytes) 2024-09-11T05:34:00.322 INFO:teuthology.orchestra.run.smithi070.stdout:5058 punch from 0xcbafff4 to 0xcbb8e79, (0x8e85 bytes) 2024-09-11T05:34:00.322 INFO:teuthology.orchestra.run.smithi070.stdout:5059 punch from 0x4144fb6 to 0x4148b1c, (0x3b66 bytes) 2024-09-11T05:34:00.322 INFO:teuthology.orchestra.run.smithi070.stdout:5060 write 0x4a4d989 thru 0x4a563b3 (0x8a2b bytes) 2024-09-11T05:34:00.324 INFO:teuthology.orchestra.run.smithi070.stdout:5061 write 0x54ddd9a thru 0x54ddec7 (0x12e bytes) 2024-09-11T05:34:00.341 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:00.341+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:00.343 INFO:teuthology.orchestra.run.smithi070.stdout:5062 trunc from 0xdd90ff5 to 0x425cf8 2024-09-11T05:34:00.355 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:00.355 INFO:teuthology.orchestra.run.smithi070.stdout:5064 read 0x30cc9c thru 0x31b5cf (0xe934 bytes) 2024-09-11T05:34:00.356 INFO:teuthology.orchestra.run.smithi070.stdout:5067 punch from 0x3628a3 to 0x36cfeb, (0xa748 bytes) 2024-09-11T05:34:00.376 INFO:teuthology.orchestra.run.smithi070.stdout:5068 writesame 0xc5c2038 thru 0xc5d1d10 data_size 0x7(0xfcd9 bytes) 2024-09-11T05:34:00.376 INFO:teuthology.orchestra.run.smithi070.stdout:5069 write 0x8ba4d69 thru 0x8ba65f9 (0x1891 bytes) 2024-09-11T05:34:00.380 INFO:teuthology.orchestra.run.smithi070.stdout:5072 read 0xa049c85 thru 0xa055333 (0xb6af bytes) 2024-09-11T05:34:00.380 INFO:teuthology.orchestra.run.smithi070.stdout:5073 read 0x8bf00f3 thru 0x8bf1a90 (0x199e bytes) 2024-09-11T05:34:00.385 INFO:teuthology.orchestra.run.smithi070.stdout:5074 trunc from 0xc5d1d11 to 0x74f3f54 2024-09-11T05:34:00.395 INFO:teuthology.orchestra.run.smithi070.stdout:5075 read 0x1c53df2 thru 0x1c609e8 (0xcbf7 bytes) 2024-09-11T05:34:00.395 INFO:teuthology.orchestra.run.smithi070.stdout:5077 read 0x3ed6d10 thru 0x3eda9e2 (0x3cd3 bytes) 2024-09-11T05:34:00.395 INFO:teuthology.orchestra.run.smithi070.stdout:5078 writesame 0x6f3bc1 thru 0x6fe7db data_size 0x1(0xac1b bytes) 2024-09-11T05:34:00.407 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:00.407 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:00.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:00.430 INFO:teuthology.orchestra.run.smithi070.stdout:5080 trunc from 0x74f3f54 to 0xda9067c 2024-09-11T05:34:00.436 INFO:teuthology.orchestra.run.smithi070.stdout:5081 flatten 2024-09-11T05:34:00.441 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:00.441+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:34:00.442 INFO:teuthology.orchestra.run.smithi070.stdout:5084 read 0xed46da thru 0xeddbaa (0x94d1 bytes) 2024-09-11T05:34:00.442 INFO:teuthology.orchestra.run.smithi070.stdout:5086 write 0x26ef844 thru 0x26fe6cb (0xee88 bytes) 2024-09-11T05:34:00.453 INFO:teuthology.orchestra.run.smithi070.stdout:5088 trunc from 0xda9067c to 0x8249af6 2024-09-11T05:34:00.460 INFO:teuthology.orchestra.run.smithi070.stdout:5089 read 0x7ed36a5 thru 0x7ee02f5 (0xcc51 bytes) 2024-09-11T05:34:00.464 INFO:teuthology.orchestra.run.smithi070.stdout:5090 trunc from 0x8249af6 to 0x5620da6 2024-09-11T05:34:00.481 INFO:teuthology.orchestra.run.smithi070.stdout:5091 write 0x9ddc555 thru 0x9de3fb3 (0x7a5f bytes) 2024-09-11T05:34:00.483 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:00.495 INFO:teuthology.orchestra.run.smithi070.stdout:5094 trunc from 0x9de3fb4 to 0x74a0c6 2024-09-11T05:34:00.507 INFO:teuthology.orchestra.run.smithi070.stdout:5095 read 0xa0b1d thru 0xa11ea (0x6ce bytes) 2024-09-11T05:34:00.523 INFO:teuthology.orchestra.run.smithi070.stdout:5096 writesame 0x7278f8f thru 0x72837dd data_size 0x1(0xa84f bytes) 2024-09-11T05:34:00.523 INFO:teuthology.orchestra.run.smithi070.stdout:5097 read 0x3c88384 thru 0x3c956dc (0xd359 bytes) 2024-09-11T05:34:00.532 INFO:teuthology.orchestra.run.smithi070.stdout:5099 trunc from 0x72837de to 0xd9cad14 2024-09-11T05:34:00.537 INFO:teuthology.orchestra.run.smithi070.stdout:5100 read 0xadeb394 thru 0xadf99e9 (0xe656 bytes) 2024-09-11T05:34:00.542 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:00.542+0000 7f4c0fd5d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33355) UID: 0 2024-09-11T05:34:00.546 INFO:teuthology.orchestra.run.smithi070.stdout:5101 trunc from 0xd9cad14 to 0x70f0431 2024-09-11T05:34:00.552 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:00.552 INFO:teuthology.orchestra.run.smithi070.stdout:5105 read 0x2ff55fb thru 0x2ff98ef (0x42f5 bytes) 2024-09-11T05:34:00.560 INFO:teuthology.orchestra.run.smithi070.stdout:5106 write 0x8be413f thru 0x8bedb40 (0x9a02 bytes) 2024-09-11T05:34:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:5107 read 0x3a525be thru 0x3a548ce (0x2311 bytes) 2024-09-11T05:34:00.564 INFO:teuthology.orchestra.run.smithi070.stdout:5109 writesame 0x4645f91 thru 0x464bce9 data_size 0x1(0x5d59 bytes) 2024-09-11T05:34:00.566 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:00.566 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:00.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:34:00.584 INFO:teuthology.orchestra.run.smithi070.stdout:5110 trunc from 0x8bedb41 to 0x36cf850 2024-09-11T05:34:00.604 INFO:teuthology.orchestra.run.smithi070.stdout:5111 trunc from 0x36cf850 to 0xb38e5d3 2024-09-11T05:34:00.610 INFO:teuthology.orchestra.run.smithi070.stdout:5112 write 0xb20889a thru 0xb211c96 (0x93fd bytes) 2024-09-11T05:34:00.613 INFO:teuthology.orchestra.run.smithi070.stdout:5113 read 0x5656734 thru 0x5663ad1 (0xd39e bytes) 2024-09-11T05:34:00.613 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:00.613 INFO:teuthology.orchestra.run.smithi070.stdout:5116 read 0x8a9f970 thru 0x8aa6563 (0x6bf4 bytes) 2024-09-11T05:34:00.613 INFO:teuthology.orchestra.run.smithi070.stdout:5118 read 0xa08f7de thru 0xa09e601 (0xee24 bytes) 2024-09-11T05:34:00.614 INFO:teuthology.orchestra.run.smithi070.stdout:5119 write 0x14a65a thru 0x14c8e2 (0x2289 bytes) 2024-09-11T05:34:00.615 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:00.615 INFO:teuthology.orchestra.run.smithi070.stdout:5122 read 0x5da1f43 thru 0x5da979e (0x785c bytes) 2024-09-11T05:34:00.615 INFO:teuthology.orchestra.run.smithi070.stdout:5126 read 0x6fc78af thru 0x6fcd792 (0x5ee4 bytes) 2024-09-11T05:34:00.624 INFO:teuthology.orchestra.run.smithi070.stdout:5127 trunc from 0xb38e5d3 to 0x2eae70f 2024-09-11T05:34:00.635 INFO:teuthology.orchestra.run.smithi070.stdout:5128 read 0x104f35a thru 0x105b953 (0xc5fa bytes) 2024-09-11T05:34:00.643 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:00.643+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:00.648 INFO:teuthology.orchestra.run.smithi070.stdout:5129 write 0x92bcd81 thru 0x92c5225 (0x84a5 bytes) 2024-09-11T05:34:00.658 INFO:teuthology.orchestra.run.smithi070.stdout:5130 trunc from 0x92c5226 to 0x3a1960f 2024-09-11T05:34:00.676 INFO:teuthology.orchestra.run.smithi070.stdout:5131 trunc from 0x3a1960f to 0xb40adb7 2024-09-11T05:34:00.683 INFO:teuthology.orchestra.run.smithi070.stdout:5132 write 0x750e004 thru 0x751dc7d (0xfc7a bytes) 2024-09-11T05:34:00.685 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:00.685 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:00.686 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:00.687 INFO:teuthology.orchestra.run.smithi070.stdout:5134 read 0x867c84f thru 0x868968f (0xce41 bytes) 2024-09-11T05:34:00.687 INFO:teuthology.orchestra.run.smithi070.stdout:5135 read 0x35893ff thru 0x358e909 (0x550b bytes) 2024-09-11T05:34:00.687 INFO:teuthology.orchestra.run.smithi070.stdout:5136 punch from 0x3c0dea6 to 0x3c19d22, (0xbe7c bytes) 2024-09-11T05:34:00.687 INFO:teuthology.orchestra.run.smithi070.stdout:5137 read 0x88b042e thru 0x88bbdc3 (0xb996 bytes) 2024-09-11T05:34:00.694 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:34:00.697 INFO:teuthology.orchestra.run.smithi070.stdout:5138 write 0xebda26a thru 0xebde681 (0x4418 bytes) 2024-09-11T05:34:00.699 INFO:teuthology.orchestra.run.smithi070.stdout:5139 writesame 0x4a546cc thru 0x4a603dd data_size 0x9(0xbd12 bytes) 2024-09-11T05:34:00.722 INFO:teuthology.orchestra.run.smithi070.stdout:5142 trunc from 0xebde682 to 0x2608f9 2024-09-11T05:34:00.739 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:00.740 INFO:teuthology.orchestra.run.smithi070.stdout:5144 read 0x47338 thru 0x4c1c6 (0x4e8f bytes) 2024-09-11T05:34:00.744 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:00.744+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:00.761 INFO:teuthology.orchestra.run.smithi070.stdout:5145 write 0xdec05d0 thru 0xdec3abd (0x34ee bytes) 2024-09-11T05:34:00.764 INFO:teuthology.orchestra.run.smithi070.stdout:5146 read 0xb825df7 thru 0xb82a69a (0x48a4 bytes) 2024-09-11T05:34:00.765 INFO:teuthology.orchestra.run.smithi070.stdout:5147 read 0xb0493f8 thru 0xb04de2d (0x4a36 bytes) 2024-09-11T05:34:00.765 INFO:teuthology.orchestra.run.smithi070.stdout:5148 read 0xc44486 thru 0xc53895 (0xf410 bytes) 2024-09-11T05:34:00.765 INFO:teuthology.orchestra.run.smithi070.stdout:5149 write 0xc334072 thru 0xc3397eb (0x577a bytes) 2024-09-11T05:34:00.767 INFO:teuthology.orchestra.run.smithi070.stdout:5152 writesame 0x77cdd64 thru 0x77d021b data_size 0x5(0x24b8 bytes) 2024-09-11T05:34:00.771 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:00.771 INFO:teuthology.orchestra.run.smithi070.stdout:5158 write 0x2a343f7 thru 0x2a41420 (0xd02a bytes) 2024-09-11T05:34:00.774 INFO:teuthology.orchestra.run.smithi070.stdout:5159 writesame 0xd6f25b4 thru 0xd6f8f1e data_size 0x1(0x696b bytes) 2024-09-11T05:34:00.792 INFO:teuthology.orchestra.run.smithi070.stdout:5161 writesame 0x76a7614 thru 0x76ace35 data_size 0x1d(0x5822 bytes) 2024-09-11T05:34:00.794 INFO:teuthology.orchestra.run.smithi070.stdout:5162 read 0x181ceae thru 0x181d28e (0x3e1 bytes) 2024-09-11T05:34:00.794 INFO:teuthology.orchestra.run.smithi070.stdout:5163 read 0xcaa1ffa thru 0xcab1e4c (0xfe53 bytes) 2024-09-11T05:34:00.795 INFO:teuthology.orchestra.run.smithi070.stdout:5164 read 0x4671f2b thru 0x467f074 (0xd14a bytes) 2024-09-11T05:34:00.804 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:00.804 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:00.805 INFO:teuthology.orchestra.run.smithi070.stdout:5165 trunc from 0xdec3abe to 0x45f8f0f 2024-09-11T05:34:00.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:34:00.816 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:00.834 INFO:teuthology.orchestra.run.smithi070.stdout:5167 writesame 0xd8ef11f thru 0xd8f9b4b data_size 0x1(0xaa2d bytes) 2024-09-11T05:34:00.834 INFO:teuthology.orchestra.run.smithi070.stdout:5168 read 0x78e0f37 thru 0x78ec9b9 (0xba83 bytes) 2024-09-11T05:34:00.834 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:00.834 INFO:teuthology.orchestra.run.smithi070.stdout:5170 read 0x36f930d thru 0x3708061 (0xed55 bytes) 2024-09-11T05:34:00.834 INFO:teuthology.orchestra.run.smithi070.stdout:5171 write 0x28ffa31 thru 0x290eec4 (0xf494 bytes) 2024-09-11T05:34:00.837 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:00.837 INFO:teuthology.orchestra.run.smithi070.stdout:5173 writesame 0x66c9c24 thru 0x66d58d2 data_size 0x9(0xbcaf bytes) 2024-09-11T05:34:00.842 INFO:teuthology.orchestra.run.smithi070.stdout:5175 read 0x868e71a thru 0x869cbbc (0xe4a3 bytes) 2024-09-11T05:34:00.843 INFO:teuthology.orchestra.run.smithi070.stdout:5176 read 0x5beb9f7 thru 0x5bf213c (0x6746 bytes) 2024-09-11T05:34:00.843 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:00.843 INFO:teuthology.orchestra.run.smithi070.stdout:5179 clone 33 order 23 su 262144 sc 3 2024-09-11T05:34:00.845 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:00.845+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:00.905 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:34:00.946 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:00.946+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:00.962 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:00.962 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:00.971 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:01.048 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:01.047+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:01.099 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-11T05:34:01.114 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 5, 6, 7] out_osds: [4, 3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:34:01.114 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:34:01.114 INFO:tasks.thrashosds.thrasher:Killing osd 4, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T05:34:01.114 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-11T05:34:01.115 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:34:01.119 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:01.119 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:01.128 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:01.135 INFO:teuthology.orchestra.run.smithi070.stdout:5180 write 0xe9d3207 thru 0xe9d5d92 (0x2b8c bytes) 2024-09-11T05:34:01.146 INFO:teuthology.orchestra.run.smithi070.stdout:5181 trunc from 0xe9d5d93 to 0x7c0c240 2024-09-11T05:34:01.148 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:01.148+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:01.153 INFO:tasks.ceph.osd.4:Stopped 2024-09-11T05:34:01.153 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.4 2024-09-11T05:34:01.153 INFO:tasks.thrashosds.thrasher:remote for osd 4 is ubuntu@smithi084.front.sepia.ceph.com 2024-09-11T05:34:01.153 DEBUG:teuthology.orchestra.run.smithi084:> type ceph-objectstore-tool 2024-09-11T05:34:01.163 INFO:teuthology.orchestra.run.smithi070.stdout:5183 read 0x690bbb4 thru 0x6911fd0 (0x641d bytes) 2024-09-11T05:34:01.163 INFO:teuthology.orchestra.run.smithi070.stdout:5184 write 0x1bec972 thru 0x1bf82b3 (0xb942 bytes) 2024-09-11T05:34:01.168 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:01.181 INFO:teuthology.orchestra.run.smithi070.stdout:5188 writesame 0xdd5e5ac thru 0xdd61387 data_size 0xa(0x2ddc bytes) 2024-09-11T05:34:01.181 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:01.181 INFO:teuthology.orchestra.run.smithi070.stdout:5192 read 0x4cdc888 thru 0x4ce5081 (0x87fa bytes) 2024-09-11T05:34:01.181 INFO:teuthology.orchestra.run.smithi070.stdout:5194 read 0x22bfd11 thru 0x22c7717 (0x7a07 bytes) 2024-09-11T05:34:01.181 INFO:teuthology.orchestra.run.smithi070.stdout:5196 read 0x6851fa2 thru 0x685cd2e (0xad8d bytes) 2024-09-11T05:34:01.182 INFO:teuthology.orchestra.run.smithi070.stdout:5197 read 0xd277962 thru 0xd2855df (0xdc7e bytes) 2024-09-11T05:34:01.182 INFO:teuthology.orchestra.run.smithi070.stdout:5198 writesame 0x4310be2 thru 0x431aded data_size 0x6(0xa20c bytes) 2024-09-11T05:34:01.188 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:01.188 INFO:teuthology.orchestra.run.smithi070.stdout:5200 read 0x647dac3 thru 0x64822bc (0x47fa bytes) 2024-09-11T05:34:01.188 INFO:teuthology.orchestra.run.smithi070.stdout:5201 writesame 0x676c110 thru 0x676dd8b data_size 0x2(0x1c7c bytes) 2024-09-11T05:34:01.193 INFO:teuthology.orchestra.run.smithi070.stdout:5202 punch from 0x9c815e8 to 0x9c821ef, (0xc07 bytes) 2024-09-11T05:34:01.193 INFO:teuthology.orchestra.run.smithi070.stdout:5203 read 0x4c6dc85 thru 0x4c6f6e7 (0x1a63 bytes) 2024-09-11T05:34:01.193 INFO:teuthology.orchestra.run.smithi070.stdout:5204 punch from 0xa2355a7 to 0xa243ecb, (0xe924 bytes) 2024-09-11T05:34:01.193 INFO:teuthology.orchestra.run.smithi070.stdout:5205 write 0x6a2b4d2 thru 0x6a395d9 (0xe108 bytes) 2024-09-11T05:34:01.197 INFO:teuthology.orchestra.run.smithi070.stdout:5206 read 0xcec45fc thru 0xceca1a9 (0x5bae bytes) 2024-09-11T05:34:01.197 INFO:teuthology.orchestra.run.smithi070.stdout:5207 write 0xbd5c7a1 thru 0xbd66999 (0xa1f9 bytes) 2024-09-11T05:34:01.201 INFO:teuthology.orchestra.run.smithi070.stdout:5211 write 0x23fcb35 thru 0x2407790 (0xac5c bytes) 2024-09-11T05:34:01.205 INFO:teuthology.orchestra.run.smithi070.stdout:5212 writesame 0x885db80 thru 0x8860e14 data_size 0x1(0x3295 bytes) 2024-09-11T05:34:01.208 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T05:34:01.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --op list-pgs 2024-09-11T05:34:01.216 INFO:teuthology.orchestra.run.smithi070.stdout:5213 writesame 0x17c4d6b thru 0x17ca687 data_size 0x1(0x591d bytes) 2024-09-11T05:34:01.239 INFO:teuthology.orchestra.run.smithi070.stdout:5214 writesame 0xe729074 thru 0xe730252 data_size 0x29(0x71df bytes) 2024-09-11T05:34:01.239 INFO:teuthology.orchestra.run.smithi070.stdout:5215 writesame 0x9a9740f thru 0x9aa1258 data_size 0x1(0x9e4a bytes) 2024-09-11T05:34:01.251 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:01.251+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:01.261 INFO:teuthology.orchestra.run.smithi070.stdout:5216 punch from 0x618098 to 0x626fd6, (0xef3e bytes) 2024-09-11T05:34:01.261 INFO:teuthology.orchestra.run.smithi070.stdout:5217 read 0x9faf5b0 thru 0x9fbd613 (0xe064 bytes) 2024-09-11T05:34:01.262 INFO:teuthology.orchestra.run.smithi070.stdout:5218 write 0xc558d29 thru 0xc55b540 (0x2818 bytes) 2024-09-11T05:34:01.266 INFO:teuthology.orchestra.run.smithi070.stdout:5219 write 0x9cbb308 thru 0x9cc22a7 (0x6fa0 bytes) 2024-09-11T05:34:01.286 INFO:teuthology.orchestra.run.smithi070.stdout:5220 trunc from 0xe730253 to 0x2ef3fe 2024-09-11T05:34:01.304 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:01.304 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:01.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:01.316 INFO:teuthology.orchestra.run.smithi070.stdout:5221 writesame 0x4364442 thru 0x43707a1 data_size 0x30(0xc360 bytes) 2024-09-11T05:34:01.333 INFO:teuthology.orchestra.run.smithi070.stdout:5222 writesame 0xe31e6d0 thru 0xe320688 data_size 0x1(0x1fb9 bytes) 2024-09-11T05:34:01.333 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:01.333 INFO:teuthology.orchestra.run.smithi070.stdout:5224 read 0x54cf0a6 thru 0x54d50ab (0x6006 bytes) 2024-09-11T05:34:01.333 INFO:teuthology.orchestra.run.smithi070.stdout:5225 write 0x58e151c thru 0x58ef504 (0xdfe9 bytes) 2024-09-11T05:34:01.336 INFO:teuthology.orchestra.run.smithi070.stdout:5226 read 0xa4702ae thru 0xa47aeec (0xac3f bytes) 2024-09-11T05:34:01.336 INFO:teuthology.orchestra.run.smithi070.stdout:5227 trunc from 0xe320689 to 0xe543a2d 2024-09-11T05:34:01.351 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:01.350+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:01.356 INFO:teuthology.orchestra.run.smithi070.stdout:5228 trunc from 0xe543a2d to 0x24f93f9 2024-09-11T05:34:01.367 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:01.367 INFO:teuthology.orchestra.run.smithi070.stdout:5231 write 0x1d6c9e6 thru 0x1d72677 (0x5c92 bytes) 2024-09-11T05:34:01.390 INFO:teuthology.orchestra.run.smithi070.stdout:5232 write 0xe9decc9 thru 0xe9df9e1 (0xd19 bytes) 2024-09-11T05:34:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:5233 punch from 0xca6deb6 to 0xca75b91, (0x7cdb bytes) 2024-09-11T05:34:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:01.393 INFO:teuthology.orchestra.run.smithi070.stdout:5235 write 0x3f14dc8 thru 0x3f14e7d (0xb6 bytes) 2024-09-11T05:34:01.396 INFO:teuthology.orchestra.run.smithi070.stdout:5236 write 0x7d36132 thru 0x7d3d59d (0x746c bytes) 2024-09-11T05:34:01.411 INFO:teuthology.orchestra.run.smithi070.stdout:5238 trunc from 0xe9df9e2 to 0x475fd79 2024-09-11T05:34:01.423 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:01.423 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:01.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:01.434 INFO:teuthology.orchestra.run.smithi070.stdout:5241 writesame 0x98c96d7 thru 0x98d2c41 data_size 0x1(0x956b bytes) 2024-09-11T05:34:01.435 INFO:teuthology.orchestra.run.smithi070.stdout:5242 trunc from 0x98d2c42 to 0xa65ba85 2024-09-11T05:34:01.440 INFO:teuthology.orchestra.run.smithi070.stdout:5243 read 0x86a08c7 thru 0x86a8a57 (0x8191 bytes) 2024-09-11T05:34:01.441 INFO:teuthology.orchestra.run.smithi070.stdout:5244 write 0x9ce5bf3 thru 0x9cead77 (0x5185 bytes) 2024-09-11T05:34:01.452 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:01.451+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:01.452 INFO:teuthology.orchestra.run.smithi070.stdout:5245 writesame 0xc31258a thru 0xc321c63 data_size 0x13(0xf6da bytes) 2024-09-11T05:34:01.460 INFO:teuthology.orchestra.run.smithi070.stdout:5246 write 0xe4261be thru 0xe42c95e (0x67a1 bytes) 2024-09-11T05:34:01.464 INFO:teuthology.orchestra.run.smithi070.stdout:5248 trunc from 0xe42c95f to 0xeaf1b26 2024-09-11T05:34:01.472 INFO:teuthology.orchestra.run.smithi070.stdout:5252 trunc from 0xeaf1b26 to 0xb7e9342 2024-09-11T05:34:01.483 INFO:teuthology.orchestra.run.smithi070.stdout:5253 read 0x2a61ab thru 0x2ac87f (0x66d5 bytes) 2024-09-11T05:34:01.483 INFO:teuthology.orchestra.run.smithi070.stdout:5254 read 0xa39ebe6 thru 0xa3a8caf (0xa0ca bytes) 2024-09-11T05:34:01.484 INFO:teuthology.orchestra.run.smithi070.stdout:5255 writesame 0x35700f4 thru 0x357c304 data_size 0x1(0xc211 bytes) 2024-09-11T05:34:01.514 INFO:teuthology.orchestra.run.smithi070.stdout:5256 write 0x1186ec9 thru 0x118b365 (0x449d bytes) 2024-09-11T05:34:01.517 INFO:teuthology.orchestra.run.smithi070.stdout:5257 write 0x6d5ded7 thru 0x6d6704e (0x9178 bytes) 2024-09-11T05:34:01.521 INFO:teuthology.orchestra.run.smithi070.stdout:5258 write 0x3a9a8d8 thru 0x3aa7f4f (0xd678 bytes) 2024-09-11T05:34:01.522 INFO:teuthology.orchestra.run.smithi070.stdout:5259 read 0x69d4010 thru 0x69db836 (0x7827 bytes) 2024-09-11T05:34:01.523 INFO:teuthology.orchestra.run.smithi070.stdout:5262 trunc from 0xb7e9342 to 0xbe895a7 2024-09-11T05:34:01.529 INFO:teuthology.orchestra.run.smithi070.stdout:5263 write 0x3ab980b thru 0x3ac8d78 (0xf56e bytes) 2024-09-11T05:34:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:5264 write 0x87f50db thru 0x8801be6 (0xcb0c bytes) 2024-09-11T05:34:01.535 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:01.536 INFO:teuthology.orchestra.run.smithi070.stdout:5267 read 0x6a94975 thru 0x6a9f913 (0xaf9f bytes) 2024-09-11T05:34:01.536 INFO:teuthology.orchestra.run.smithi070.stdout:5268 write 0x94de15a thru 0x94e6b90 (0x8a37 bytes) 2024-09-11T05:34:01.538 INFO:teuthology.orchestra.run.smithi070.stdout:5269 write 0x838a26e thru 0x83927a7 (0x853a bytes) 2024-09-11T05:34:01.539 INFO:teuthology.orchestra.run.smithi070.stdout:5270 write 0x614e146 thru 0x6154a13 (0x68ce bytes) 2024-09-11T05:34:01.541 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:01.541 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:01.541 INFO:teuthology.orchestra.run.smithi070.stdout:5271 read 0x2145d43 thru 0x215228d (0xc54b bytes) 2024-09-11T05:34:01.541 INFO:teuthology.orchestra.run.smithi070.stdout:5272 read 0xb111efb thru 0xb11eda9 (0xceaf bytes) 2024-09-11T05:34:01.541 INFO:teuthology.orchestra.run.smithi070.stdout:5274 write 0x25f7df9 thru 0x26059ed (0xdbf5 bytes) 2024-09-11T05:34:01.547 INFO:teuthology.orchestra.run.smithi070.stdout:5275 trunc from 0xbe895a7 to 0xd99a6f7 2024-09-11T05:34:01.551 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:01.552 INFO:teuthology.orchestra.run.smithi070.stdout:5276 writesame 0x2afa554 thru 0x2b0800a data_size 0x3b(0xdab7 bytes) 2024-09-11T05:34:01.552 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:01.552+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:01.554 INFO:teuthology.orchestra.run.smithi070.stdout:5277 writesame 0x11c2019 thru 0x11d1aa6 data_size 0xd(0xfa8e bytes) 2024-09-11T05:34:01.559 INFO:teuthology.orchestra.run.smithi070.stdout:5278 write 0x9a04de thru 0x9a7545 (0x7068 bytes) 2024-09-11T05:34:01.560 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:01.575 INFO:teuthology.orchestra.run.smithi070.stdout:5280 trunc from 0xd99a6f7 to 0x5fc656 2024-09-11T05:34:01.590 INFO:teuthology.orchestra.run.smithi070.stdout:5281 write 0x1b54e6 thru 0x1bc229 (0x6d44 bytes) 2024-09-11T05:34:01.592 INFO:teuthology.orchestra.run.smithi070.stdout:5285 punch from 0x20107 to 0x256d7, (0x55d0 bytes) 2024-09-11T05:34:01.592 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:01.592 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:01.592 INFO:teuthology.orchestra.run.smithi070.stdout:5290 clone 34 order 25 su 524288 sc 9 2024-09-11T05:34:01.654 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:01.653+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:01.654 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:01.654 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:01.665 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:01.754 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:01.754+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:01.768 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:01.768 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:01.777 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:01.856 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:01.856+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:01.879 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:01.880 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:01.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:01.906 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T05:34:01.960 INFO:teuthology.orchestra.run.smithi070.stdout:flattening image image_client.0-clone33 2024-09-11T05:34:01.961 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:01.960+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:01.995 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-11T05:34:02.001 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:02.001 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:02.013 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:02.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:34:02.058 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:02.058+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:02.159 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:02.158+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:02.172 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:02.172 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:02.182 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:02.202 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:02.203 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:02.221 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:02.221 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:02.238 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:02.238 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:02.255 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:02.255 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:02.255 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-11T05:34:02.259 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:02.259+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:02.272 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:02.272 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:02.289 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:02.310 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:02.311 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:02.319 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:02.319 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:02.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:02.324 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:34:02.324 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:34:02.325 INFO:teuthology.orchestra.run.smithi070.stdout:5291 writesame 0xa09490b thru 0xa09a7aa data_size 0x10(0x5ea0 bytes) 2024-09-11T05:34:02.328 INFO:teuthology.orchestra.run.smithi070.stdout:5294 write 0x997f292 thru 0x998ec2d (0xf99c bytes) 2024-09-11T05:34:02.335 INFO:teuthology.orchestra.run.smithi070.stdout:5295 read 0x9327ea8 thru 0x932b6fd (0x3856 bytes) 2024-09-11T05:34:02.341 INFO:teuthology.orchestra.run.smithi070.stdout:5296 trunc from 0xa09a7ab to 0x535f3ad 2024-09-11T05:34:02.356 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:02.360 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:02.360+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:02.362 INFO:teuthology.orchestra.run.smithi070.stdout:5299 write 0x61cbe59 thru 0x61ccfda (0x1182 bytes) 2024-09-11T05:34:02.364 INFO:teuthology.orchestra.run.smithi070.stdout:5300 read 0x23b859 thru 0x246acc (0xb274 bytes) 2024-09-11T05:34:02.374 INFO:teuthology.orchestra.run.smithi070.stdout:5301 writesame 0xa4194e7 thru 0xa424060 data_size 0x2(0xab7a bytes) 2024-09-11T05:34:02.376 INFO:teuthology.orchestra.run.smithi070.stdout:5303 read 0x9579661 thru 0x957db75 (0x4515 bytes) 2024-09-11T05:34:02.376 INFO:teuthology.orchestra.run.smithi070.stdout:5304 write 0x1822d7e thru 0x1825e75 (0x30f8 bytes) 2024-09-11T05:34:02.382 INFO:teuthology.orchestra.run.smithi070.stdout:5305 trunc from 0xa424061 to 0xe006cee 2024-09-11T05:34:02.387 INFO:teuthology.orchestra.run.smithi070.stdout:5306 read 0x4a3df34 thru 0x4a3f386 (0x1453 bytes) 2024-09-11T05:34:02.393 INFO:teuthology.orchestra.run.smithi070.stdout:5308 trunc from 0xe006cee to 0x990e959 2024-09-11T05:34:02.410 INFO:teuthology.orchestra.run.smithi070.stdout:5309 write 0xd76cf86 thru 0xd773740 (0x67bb bytes) 2024-09-11T05:34:02.412 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:02.412 INFO:teuthology.orchestra.run.smithi070.stdout:5311 read 0x58bc46f thru 0x58be52b (0x20bd bytes) 2024-09-11T05:34:02.412 INFO:teuthology.orchestra.run.smithi070.stdout:5312 writesame 0x9c6bb27 thru 0x9c76cfe data_size 0x2a(0xb1d8 bytes) 2024-09-11T05:34:02.414 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:02.414 INFO:teuthology.orchestra.run.smithi070.stdout:5316 writesame 0x65d35dc thru 0x65dc2e1 data_size 0x21(0x8d06 bytes) 2024-09-11T05:34:02.416 INFO:teuthology.orchestra.run.smithi070.stdout:5317 read 0x48528b6 thru 0x485d47d (0xabc8 bytes) 2024-09-11T05:34:02.416 INFO:teuthology.orchestra.run.smithi070.stdout:5318 read 0x792abce thru 0x793a090 (0xf4c3 bytes) 2024-09-11T05:34:02.417 INFO:teuthology.orchestra.run.smithi070.stdout:5319 writesame 0x1cf22a7 thru 0x1d01535 data_size 0xb(0xf28f bytes) 2024-09-11T05:34:02.421 INFO:teuthology.orchestra.run.smithi070.stdout:5320 write 0x15a5f1 thru 0x166919 (0xc329 bytes) 2024-09-11T05:34:02.423 INFO:teuthology.orchestra.run.smithi070.stdout:5321 write 0x340a177 thru 0x3416121 (0xbfab bytes) 2024-09-11T05:34:02.425 INFO:teuthology.orchestra.run.smithi070.stdout:5322 punch from 0x1942af8 to 0x1951fe3, (0xf4eb bytes) 2024-09-11T05:34:02.425 INFO:teuthology.orchestra.run.smithi070.stdout:5323 read 0x2a3e121 thru 0x2a4a787 (0xc667 bytes) 2024-09-11T05:34:02.425 INFO:teuthology.orchestra.run.smithi070.stdout:5324 trunc from 0xd773741 to 0xdf2fbda 2024-09-11T05:34:02.431 INFO:teuthology.orchestra.run.smithi070.stdout:5325 read 0xcf6f93a thru 0xcf7798b (0x8052 bytes) 2024-09-11T05:34:02.431 INFO:teuthology.orchestra.run.smithi070.stdout:5326 write 0xca1a6cb thru 0xca25231 (0xab67 bytes) 2024-09-11T05:34:02.433 INFO:teuthology.orchestra.run.smithi070.stdout:5327 read 0x7b76c49 thru 0x7b7a3ca (0x3782 bytes) 2024-09-11T05:34:02.435 INFO:teuthology.orchestra.run.smithi070.stdout:5328 read 0x859563e thru 0x85a0927 (0xb2ea bytes) 2024-09-11T05:34:02.436 INFO:teuthology.orchestra.run.smithi070.stdout:5329 write 0x2a575a4 thru 0x2a5dea2 (0x68ff bytes) 2024-09-11T05:34:02.436 INFO:teuthology.orchestra.run.smithi070.stdout:5330 write 0xd2c623 thru 0xd34329 (0x7d07 bytes) 2024-09-11T05:34:02.437 INFO:teuthology.orchestra.run.smithi070.stdout:5331 clone 35 order 22 su 262144 sc 12 2024-09-11T05:34:02.446 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:02.446 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:02.447 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:02.447 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:02.456 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:02.461 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:02.461+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:02.562 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:02.562+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:02.601 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:02.601 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36429 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8585216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:34:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.519031671, 2024-09-11T05:34:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035281438999999998, 2024-09-11T05:34:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36429 2024-09-11T05:34:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:34:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081345+0000", 2024-09-11T05:34:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081346+0000", 2024-09-11T05:34:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:34:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081348+0000", 2024-09-11T05:34:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9400000000000001e-06 2024-09-11T05:34:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081355+0000", 2024-09-11T05:34:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2230000000000001e-06 2024-09-11T05:34:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081360+0000", 2024-09-11T05:34:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0499999999999999e-06 2024-09-11T05:34:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116334+0000", 2024-09-11T05:34:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.034973889000000001 2024-09-11T05:34:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116410+0000", 2024-09-11T05:34:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6001000000000006e-05 2024-09-11T05:34:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116627+0000", 2024-09-11T05:34:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000216956 2024-09-11T05:34:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36430 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9437184~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:34:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518923608000001, 2024-09-11T05:34:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035492782, 2024-09-11T05:34:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36430 2024-09-11T05:34:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:34:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081453+0000", 2024-09-11T05:34:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081454+0000", 2024-09-11T05:34:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.99e-07 2024-09-11T05:34:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081458+0000", 2024-09-11T05:34:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7160000000000001e-06 2024-09-11T05:34:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081468+0000", 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9629999999999993e-06 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081474+0000", 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2060000000000004e-06 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116658+0000", 2024-09-11T05:34:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03518454 2024-09-11T05:34:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116734+0000", 2024-09-11T05:34:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5703000000000003e-05 2024-09-11T05:34:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116946+0000", 2024-09-11T05:34:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211955 2024-09-11T05:34:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36431 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9895936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:34:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518892483000002, 2024-09-11T05:34:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035819799999999999, 2024-09-11T05:34:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36431 2024-09-11T05:34:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:34:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081484+0000", 2024-09-11T05:34:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081485+0000", 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9999999999999998e-07 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081493+0000", 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9629999999999998e-06 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081500+0000", 2024-09-11T05:34:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7070000000000003e-06 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081504+0000", 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6020000000000002e-06 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.116993+0000", 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035489224 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117083+0000", 2024-09-11T05:34:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9560000000000003e-05 2024-09-11T05:34:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117304+0000", 2024-09-11T05:34:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221244 2024-09-11T05:34:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36448 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 327680~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:34:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518865781000002, 2024-09-11T05:34:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036143304000000001, 2024-09-11T05:34:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36448 2024-09-11T05:34:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081511+0000", 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081512+0000", 2024-09-11T05:34:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:34:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081514+0000", 2024-09-11T05:34:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:34:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081520+0000", 2024-09-11T05:34:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4269999999999996e-06 2024-09-11T05:34:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081525+0000", 2024-09-11T05:34:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6140000000000002e-06 2024-09-11T05:34:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117333+0000", 2024-09-11T05:34:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035808385999999998 2024-09-11T05:34:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117446+0000", 2024-09-11T05:34:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113161 2024-09-11T05:34:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117654+0000", 2024-09-11T05:34:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020835800000000001 2024-09-11T05:34:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36449 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1638400~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:34:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518846553000003, 2024-09-11T05:34:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036464895999999997, 2024-09-11T05:34:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36449 2024-09-11T05:34:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:34:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081530+0000", 2024-09-11T05:34:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081531+0000", 2024-09-11T05:34:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:34:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081533+0000", 2024-09-11T05:34:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8649999999999999e-06 2024-09-11T05:34:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081538+0000", 2024-09-11T05:34:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7769999999999999e-06 2024-09-11T05:34:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081543+0000", 2024-09-11T05:34:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4390000000000002e-06 2024-09-11T05:34:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117686+0000", 2024-09-11T05:34:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036142760000000003 2024-09-11T05:34:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117768+0000", 2024-09-11T05:34:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2521000000000005e-05 2024-09-11T05:34:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.117995+0000", 2024-09-11T05:34:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022715699999999999 2024-09-11T05:34:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36450 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:34:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518828685000003, 2024-09-11T05:34:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036798323000000001, 2024-09-11T05:34:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36450 2024-09-11T05:34:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:34:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081548+0000", 2024-09-11T05:34:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081549+0000", 2024-09-11T05:34:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1699999999999999e-07 2024-09-11T05:34:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081550+0000", 2024-09-11T05:34:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:34:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081557+0000", 2024-09-11T05:34:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:34:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081561+0000", 2024-09-11T05:34:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2880000000000003e-06 2024-09-11T05:34:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118042+0000", 2024-09-11T05:34:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036480984000000001 2024-09-11T05:34:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118142+0000", 2024-09-11T05:34:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100043 2024-09-11T05:34:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118347+0000", 2024-09-11T05:34:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020477399999999999 2024-09-11T05:34:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36451 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4259840~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:34:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518810854999998, 2024-09-11T05:34:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037058173, 2024-09-11T05:34:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36451 2024-09-11T05:34:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:34:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:34:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081566+0000", 2024-09-11T05:34:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5100000000000001e-07 2024-09-11T05:34:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081568+0000", 2024-09-11T05:34:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081573+0000", 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999998e-06 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081575+0000", 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.605e-06 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118377+0000", 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036801831 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118459+0000", 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1983000000000004e-05 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118624+0000", 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000165353 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36452 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5570560~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:34:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518798474, 2024-09-11T05:34:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037358132000000002, 2024-09-11T05:34:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36452 2024-09-11T05:34:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:34:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081578+0000", 2024-09-11T05:34:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081579+0000", 2024-09-11T05:34:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4600000000000001e-07 2024-09-11T05:34:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081580+0000", 2024-09-11T05:34:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T05:34:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081583+0000", 2024-09-11T05:34:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9119999999999998e-06 2024-09-11T05:34:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081586+0000", 2024-09-11T05:34:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.371e-06 2024-09-11T05:34:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118666+0000", 2024-09-11T05:34:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037079933000000002 2024-09-11T05:34:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118725+0000", 2024-09-11T05:34:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8600000000000001e-05 2024-09-11T05:34:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118937+0000", 2024-09-11T05:34:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000211931 2024-09-11T05:34:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36453 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6881280~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:34:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518787824, 2024-09-11T05:34:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037649803000000003, 2024-09-11T05:34:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36453 2024-09-11T05:34:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:34:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:34:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081589+0000", 2024-09-11T05:34:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T05:34:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081590+0000", 2024-09-11T05:34:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-11T05:34:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081593+0000", 2024-09-11T05:34:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0110000000000001e-06 2024-09-11T05:34:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081596+0000", 2024-09-11T05:34:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7609999999999999e-06 2024-09-11T05:34:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.118965+0000", 2024-09-11T05:34:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037368971000000001 2024-09-11T05:34:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119037+0000", 2024-09-11T05:34:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2300999999999998e-05 2024-09-11T05:34:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119239+0000", 2024-09-11T05:34:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020146000000000001 2024-09-11T05:34:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36454 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8192000~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:34:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518777768, 2024-09-11T05:34:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037930403000000001, 2024-09-11T05:34:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36454 2024-09-11T05:34:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:34:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:34:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081599+0000", 2024-09-11T05:34:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:34:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081600+0000", 2024-09-11T05:34:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0729999999999999e-06 2024-09-11T05:34:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081603+0000", 2024-09-11T05:34:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:34:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081606+0000", 2024-09-11T05:34:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4099999999999998e-06 2024-09-11T05:34:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119274+0000", 2024-09-11T05:34:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037668407000000001 2024-09-11T05:34:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119340+0000", 2024-09-11T05:34:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5685000000000006e-05 2024-09-11T05:34:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119530+0000", 2024-09-11T05:34:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000189688 2024-09-11T05:34:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36455 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9502720~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518767619000002, 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038210565000000002, 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36455 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:34:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081609+0000", 2024-09-11T05:34:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081610+0000", 2024-09-11T05:34:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:34:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081611+0000", 2024-09-11T05:34:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0279999999999999e-06 2024-09-11T05:34:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081613+0000", 2024-09-11T05:34:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8430000000000001e-06 2024-09-11T05:34:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081616+0000", 2024-09-11T05:34:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6350000000000002e-06 2024-09-11T05:34:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119555+0000", 2024-09-11T05:34:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037939252999999999 2024-09-11T05:34:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119629+0000", 2024-09-11T05:34:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3868999999999994e-05 2024-09-11T05:34:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119820+0000", 2024-09-11T05:34:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190724 2024-09-11T05:34:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36480 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 393216~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:34:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518758054000003, 2024-09-11T05:34:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039217429999999998, 2024-09-11T05:34:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36480 2024-09-11T05:34:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:34:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:34:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081619+0000", 2024-09-11T05:34:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:34:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081620+0000", 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4900000000000004e-07 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081624+0000", 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9870000000000001e-06 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081627+0000", 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6520000000000002e-06 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.119851+0000", 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038224209000000002 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120518+0000", 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066708900000000005 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120836+0000", 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031833300000000002 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36481 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 1703936~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:34:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518747167000001, 2024-09-11T05:34:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039545442, 2024-09-11T05:34:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36481 2024-09-11T05:34:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:34:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:34:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081630+0000", 2024-09-11T05:34:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T05:34:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081631+0000", 2024-09-11T05:34:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0839999999999999e-06 2024-09-11T05:34:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081635+0000", 2024-09-11T05:34:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.743e-06 2024-09-11T05:34:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081637+0000", 2024-09-11T05:34:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.661e-06 2024-09-11T05:34:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120887+0000", 2024-09-11T05:34:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039249876000000003 2024-09-11T05:34:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.120968+0000", 2024-09-11T05:34:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0253999999999994e-05 2024-09-11T05:34:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121175+0000", 2024-09-11T05:34:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020761099999999999 2024-09-11T05:34:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36482 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 3014656~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:34:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518736605999997, 2024-09-11T05:34:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040344708999999999, 2024-09-11T05:34:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36482 2024-09-11T05:34:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:34:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081640+0000", 2024-09-11T05:34:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081641+0000", 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081647+0000", 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081651+0000", 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2080000000000002e-06 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081654+0000", 2024-09-11T05:34:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:34:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121203+0000", 2024-09-11T05:34:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039549466999999998 2024-09-11T05:34:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121267+0000", 2024-09-11T05:34:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3713999999999993e-05 2024-09-11T05:34:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.121985+0000", 2024-09-11T05:34:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071827299999999996 2024-09-11T05:34:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36483 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 4325376~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:34:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518720047000002, 2024-09-11T05:34:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040925571000000001, 2024-09-11T05:34:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36483 2024-09-11T05:34:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081657+0000", 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081661+0000", 2024-09-11T05:34:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.296e-06 2024-09-11T05:34:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081665+0000", 2024-09-11T05:34:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9269999999999998e-06 2024-09-11T05:34:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081668+0000", 2024-09-11T05:34:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.615e-06 2024-09-11T05:34:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122019+0000", 2024-09-11T05:34:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040350886000000002 2024-09-11T05:34:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122108+0000", 2024-09-11T05:34:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8671000000000005e-05 2024-09-11T05:34:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122582+0000", 2024-09-11T05:34:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047494900000000001 2024-09-11T05:34:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36484 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 5636096~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:34:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518705619000002, 2024-09-11T05:34:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041537567999999997, 2024-09-11T05:34:02.674 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36484 2024-09-11T05:34:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:34:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081671+0000", 2024-09-11T05:34:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081672+0000", 2024-09-11T05:34:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-07 2024-09-11T05:34:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081673+0000", 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.212e-06 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081676+0000", 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6940000000000001e-06 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081679+0000", 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8260000000000001e-06 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122615+0000", 2024-09-11T05:34:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040935421999999999 2024-09-11T05:34:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.122892+0000", 2024-09-11T05:34:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027731099999999997 2024-09-11T05:34:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123209+0000", 2024-09-11T05:34:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000316872 2024-09-11T05:34:02.678 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36485 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 6946816~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:34:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518693409000001, 2024-09-11T05:34:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041869008999999999, 2024-09-11T05:34:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.679 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36485 2024-09-11T05:34:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:34:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:34:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081684+0000", 2024-09-11T05:34:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:34:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081685+0000", 2024-09-11T05:34:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029e-06 2024-09-11T05:34:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081689+0000", 2024-09-11T05:34:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0709999999999996e-06 2024-09-11T05:34:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081692+0000", 2024-09-11T05:34:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389999999999999e-06 2024-09-11T05:34:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123245+0000", 2024-09-11T05:34:02.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041553759000000003 2024-09-11T05:34:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123331+0000", 2024-09-11T05:34:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5885999999999997e-05 2024-09-11T05:34:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123553+0000", 2024-09-11T05:34:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022129499999999999 2024-09-11T05:34:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.683 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36486 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 8257536~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:34:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518682390999999, 2024-09-11T05:34:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042204617999999999, 2024-09-11T05:34:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36486 2024-09-11T05:34:02.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.685 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:34:02.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:34:02.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081695+0000", 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081698+0000", 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6490000000000001e-06 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081702+0000", 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7249999999999999e-06 2024-09-11T05:34:02.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081705+0000", 2024-09-11T05:34:02.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7379999999999999e-06 2024-09-11T05:34:02.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123583+0000", 2024-09-11T05:34:02.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041878604999999999 2024-09-11T05:34:02.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123666+0000", 2024-09-11T05:34:02.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2027000000000006e-05 2024-09-11T05:34:02.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123899+0000", 2024-09-11T05:34:02.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000233663 2024-09-11T05:34:02.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.688 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.688 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:36487 3.1c 3:3da38b5f:::rbd_data.112d3507140b.0000000000000000:10 [sparse-read 9568256~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-11T05:34:02.688 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:34:02.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.518669217000003, 2024-09-11T05:34:02.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043010712999999999, 2024-09-11T05:34:02.689 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36487 2024-09-11T05:34:02.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.689 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:34:02.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:34:02.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081708+0000", 2024-09-11T05:34:02.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.16e-07 2024-09-11T05:34:02.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081709+0000", 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2100000000000001e-06 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081713+0000", 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.811e-06 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.081716+0000", 2024-09-11T05:34:02.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.112e-06 2024-09-11T05:34:02.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.123961+0000", 2024-09-11T05:34:02.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042244482999999999 2024-09-11T05:34:02.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124043+0000", 2024-09-11T05:34:02.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2066999999999999e-05 2024-09-11T05:34:02.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:19.124718+0000", 2024-09-11T05:34:02.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067581399999999995 2024-09-11T05:34:02.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.693 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.693 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:43696 3.10 3:0e50cb16:::rbd_data.112dcdbd4c7c.0000000000000007:14 [read 2088960~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:02.693 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:34:02.693 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.562449000999997, 2024-09-11T05:34:02.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035281203999999997, 2024-09-11T05:34:02.693 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 43696 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037928+0000", 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-07 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037930+0000", 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5540000000000001e-06 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037935+0000", 2024-09-11T05:34:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0610000000000003e-06 2024-09-11T05:34:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.037939+0000", 2024-09-11T05:34:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1239999999999998e-06 2024-09-11T05:34:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073102+0000", 2024-09-11T05:34:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035163341000000001 2024-09-11T05:34:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073159+0000", 2024-09-11T05:34:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6316000000000001e-05 2024-09-11T05:34:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.073209+0000", 2024-09-11T05:34:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0512e-05 2024-09-11T05:34:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:02.698 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:02.698 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:02.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:02.700 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:02.698+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:02.800 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:02.800+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:02.844 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:02.844 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:02.844 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:02.844 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:02.853 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:02.901 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:02.901+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:02.960 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone34 from 0xdf2fbda (overlap 0x5fc656) to 0x0 2024-09-11T05:34:03.002 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:03.001+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:03.005 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-11T05:34:03.010 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:03.011 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:03.011 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:03.011 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:03.011 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:03.016 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:03.016 INFO:teuthology.orchestra.run.smithi070.stdout:5333 write 0x5704504 thru 0x57131d9 (0xecd6 bytes) 2024-09-11T05:34:03.020 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:03.024 INFO:teuthology.orchestra.run.smithi070.stdout:5334 write 0xbb8a401 thru 0xbb9539b (0xaf9b bytes) 2024-09-11T05:34:03.028 INFO:teuthology.orchestra.run.smithi070.stdout:5335 punch from 0xb3f6986 to 0xb406767, (0xfde1 bytes) 2024-09-11T05:34:03.028 INFO:teuthology.orchestra.run.smithi070.stdout:5337 write 0x21aa0a5 thru 0x21b50a9 (0xb005 bytes) 2024-09-11T05:34:03.034 INFO:teuthology.orchestra.run.smithi070.stdout:5341 read 0xb965979 thru 0xb96ca10 (0x7098 bytes) 2024-09-11T05:34:03.034 INFO:teuthology.orchestra.run.smithi070.stdout:5343 writesame 0xde1c0df thru 0xde2813b data_size 0x93(0xc05d bytes) 2024-09-11T05:34:03.039 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:03.039 INFO:teuthology.orchestra.run.smithi070.stdout:5347 punch from 0x2af2e7e to 0x2afe390, (0xb512 bytes) 2024-09-11T05:34:03.039 INFO:teuthology.orchestra.run.smithi070.stdout:5349 punch from 0x7b5fd05 to 0x7b690c4, (0x93bf bytes) 2024-09-11T05:34:03.039 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:03.052 INFO:teuthology.orchestra.run.smithi070.stdout:5354 trunc from 0xdf2fbda to 0x2b3288d 2024-09-11T05:34:03.082 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:03.082 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:03.083 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:03.083 INFO:teuthology.orchestra.run.smithi070.stdout:5360 read 0xc47437 thru 0xc4bb84 (0x474e bytes) 2024-09-11T05:34:03.083 INFO:teuthology.orchestra.run.smithi070.stdout:5362 write 0xad9218 thru 0xadf6ae (0x6497 bytes) 2024-09-11T05:34:03.084 INFO:teuthology.orchestra.run.smithi070.stdout:5364 read 0xe84e84 thru 0xe94d86 (0xff03 bytes) 2024-09-11T05:34:03.095 INFO:teuthology.orchestra.run.smithi070.stdout:5365 write 0x73a279e thru 0x73ace6a (0xa6cd bytes) 2024-09-11T05:34:03.097 INFO:teuthology.orchestra.run.smithi070.stdout:5367 clone 36 order 20 su 65536 sc 5 2024-09-11T05:34:03.103 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:03.102+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:03.146 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116623 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13477888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.255178025999999, 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9661491070000001, 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116623 2024-09-11T05:34:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889573+0000", 2024-09-11T05:34:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889574+0000", 2024-09-11T05:34:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4810000000000001e-06 2024-09-11T05:34:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889578+0000", 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889581+0000", 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2380000000000002e-06 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890367+0000", 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078646599999999999 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890377+0000", 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5789999999999993e-06 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829092+0000", 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871527899999996 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829101+0000", 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854695+0000", 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0255937369999999 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854786+0000", 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1831999999999998e-05 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855721+0000", 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093499800000000004 2024-09-11T05:34:03.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116624 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13502464~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.255164179000001, 2024-09-11T05:34:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9664307189999999, 2024-09-11T05:34:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116624 2024-09-11T05:34:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:03.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889587+0000", 2024-09-11T05:34:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:34:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889588+0000", 2024-09-11T05:34:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T05:34:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889592+0000", 2024-09-11T05:34:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.472e-06 2024-09-11T05:34:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889594+0000", 2024-09-11T05:34:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T05:34:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890405+0000", 2024-09-11T05:34:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00081088199999999997 2024-09-11T05:34:03.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890410+0000", 2024-09-11T05:34:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999996e-06 2024-09-11T05:34:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829131+0000", 2024-09-11T05:34:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93872118999999998 2024-09-11T05:34:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829138+0000", 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1760000000000004e-06 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855755+0000", 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026616722 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855872+0000", 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116927 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856017+0000", 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145313 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116625 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13527040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.25515296, 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9666986180000001, 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116625 2024-09-11T05:34:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889598+0000", 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889599+0000", 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.144e-06 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889602+0000", 2024-09-11T05:34:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889604+0000", 2024-09-11T05:34:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7640000000000001e-06 2024-09-11T05:34:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890442+0000", 2024-09-11T05:34:03.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083777099999999996 2024-09-11T05:34:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890452+0000", 2024-09-11T05:34:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5559999999999996e-06 2024-09-11T05:34:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829170+0000", 2024-09-11T05:34:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871818900000004 2024-09-11T05:34:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829177+0000", 2024-09-11T05:34:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7220000000000002e-06 2024-09-11T05:34:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856046+0000", 2024-09-11T05:34:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026868943 2024-09-11T05:34:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856144+0000", 2024-09-11T05:34:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8684999999999995e-05 2024-09-11T05:34:03.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856296+0000", 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151667 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116626 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13551616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.255142190000001, 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.96707056, 2024-09-11T05:34:03.165 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116626 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889610+0000", 2024-09-11T05:34:03.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.186e-06 2024-09-11T05:34:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889613+0000", 2024-09-11T05:34:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T05:34:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889615+0000", 2024-09-11T05:34:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:34:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890487+0000", 2024-09-11T05:34:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087202600000000003 2024-09-11T05:34:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890492+0000", 2024-09-11T05:34:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:34:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829202+0000", 2024-09-11T05:34:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871036299999999 2024-09-11T05:34:03.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829209+0000", 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7669999999999998e-06 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856327+0000", 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027118465 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856525+0000", 2024-09-11T05:34:03.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019825499999999999 2024-09-11T05:34:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856679+0000", 2024-09-11T05:34:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015328 2024-09-11T05:34:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116627 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13576192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:03.171 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.255132305, 2024-09-11T05:34:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9673406419999999, 2024-09-11T05:34:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116627 2024-09-11T05:34:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:34:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889619+0000", 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.093e-06 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889622+0000", 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889625+0000", 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:34:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890528+0000", 2024-09-11T05:34:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000902804 2024-09-11T05:34:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890537+0000", 2024-09-11T05:34:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2029999999999998e-06 2024-09-11T05:34:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829232+0000", 2024-09-11T05:34:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93869459799999999 2024-09-11T05:34:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829238+0000", 2024-09-11T05:34:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6699999999999997e-06 2024-09-11T05:34:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856709+0000", 2024-09-11T05:34:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027470925 2024-09-11T05:34:03.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856815+0000", 2024-09-11T05:34:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010566899999999999 2024-09-11T05:34:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856959+0000", 2024-09-11T05:34:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000143752 2024-09-11T05:34:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116628 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13600768~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.255108310000001, 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9676105420000001, 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116628 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.178 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:34:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889644+0000", 2024-09-11T05:34:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:34:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889647+0000", 2024-09-11T05:34:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3950000000000001e-06 2024-09-11T05:34:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889650+0000", 2024-09-11T05:34:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:34:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890570+0000", 2024-09-11T05:34:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092007999999999999 2024-09-11T05:34:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890577+0000", 2024-09-11T05:34:03.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.764e-06 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829261+0000", 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93868468500000002 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829268+0000", 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857004+0000", 2024-09-11T05:34:03.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027736043 2024-09-11T05:34:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857102+0000", 2024-09-11T05:34:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8066999999999995e-05 2024-09-11T05:34:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857253+0000", 2024-09-11T05:34:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015050400000000001 2024-09-11T05:34:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116629 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13625344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.255091798999999, 2024-09-11T05:34:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967906154, 2024-09-11T05:34:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116629 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-07 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889660+0000", 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5650000000000001e-06 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889664+0000", 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4000000000000001e-06 2024-09-11T05:34:03.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889666+0000", 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890614+0000", 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00094762999999999998 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890621+0000", 2024-09-11T05:34:03.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.379e-06 2024-09-11T05:34:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829291+0000", 2024-09-11T05:34:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866938499999997 2024-09-11T05:34:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829298+0000", 2024-09-11T05:34:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6610000000000003e-06 2024-09-11T05:34:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857284+0000", 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027986522 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857393+0000", 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109054 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857565+0000", 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017160999999999999 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.189 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116843 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12595200~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.255080577000001, 2024-09-11T05:34:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9682605290000001, 2024-09-11T05:34:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116843 2024-09-11T05:34:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889671+0000", 2024-09-11T05:34:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-11T05:34:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889674+0000", 2024-09-11T05:34:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.005e-06 2024-09-11T05:34:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889677+0000", 2024-09-11T05:34:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T05:34:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890648+0000", 2024-09-11T05:34:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097103399999999996 2024-09-11T05:34:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890652+0000", 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0790000000000002e-06 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829320+0000", 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866793199999998 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829327+0000", 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5529999999999998e-06 2024-09-11T05:34:03.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857596+0000", 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028269125 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857834+0000", 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023784300000000001 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857930+0000", 2024-09-11T05:34:03.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6704000000000001e-05 2024-09-11T05:34:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116844 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12619776~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.255070386, 2024-09-11T05:34:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9685250679999999, 2024-09-11T05:34:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116844 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889681+0000", 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.229e-06 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889684+0000", 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0130000000000002e-06 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889687+0000", 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7259999999999998e-06 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890685+0000", 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099783399999999996 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890695+0000", 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829349+0000", 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865456300000005 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829356+0000", 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5130000000000002e-06 2024-09-11T05:34:03.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857959+0000", 2024-09-11T05:34:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0286034959999999 2024-09-11T05:34:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858057+0000", 2024-09-11T05:34:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8097999999999995e-05 2024-09-11T05:34:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858205+0000", 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147732 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116845 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12644352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.255060152999999, 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968783033, 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116845 2024-09-11T05:34:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889692+0000", 2024-09-11T05:34:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2330000000000001e-06 2024-09-11T05:34:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889695+0000", 2024-09-11T05:34:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9249999999999999e-06 2024-09-11T05:34:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889697+0000", 2024-09-11T05:34:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:34:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890719+0000", 2024-09-11T05:34:03.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010218429999999999 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890723+0000", 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829378+0000", 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865562000000002 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829385+0000", 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4579999999999998e-06 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858234+0000", 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028849288 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858337+0000", 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102371 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858473+0000", 2024-09-11T05:34:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013669299999999999 2024-09-11T05:34:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116846 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12668928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.255037227999999, 2024-09-11T05:34:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.969056522, 2024-09-11T05:34:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116846 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-07 2024-09-11T05:34:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889715+0000", 2024-09-11T05:34:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.482e-06 2024-09-11T05:34:03.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889718+0000", 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889721+0000", 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890762+0000", 2024-09-11T05:34:03.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010413659999999999 2024-09-11T05:34:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890772+0000", 2024-09-11T05:34:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5750000000000007e-06 2024-09-11T05:34:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829407+0000", 2024-09-11T05:34:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93863550699999998 2024-09-11T05:34:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829414+0000", 2024-09-11T05:34:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5640000000000002e-06 2024-09-11T05:34:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858502+0000", 2024-09-11T05:34:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0290880099999999 2024-09-11T05:34:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858634+0000", 2024-09-11T05:34:03.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013173199999999999 2024-09-11T05:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858770+0000", 2024-09-11T05:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135943 2024-09-11T05:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116847 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12693504~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.255007540000001, 2024-09-11T05:34:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9692923329999998, 2024-09-11T05:34:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116847 2024-09-11T05:34:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889747+0000", 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.501e-06 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889753+0000", 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1360000000000002e-06 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889756+0000", 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3110000000000001e-06 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890808+0000", 2024-09-11T05:34:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010523240000000001 2024-09-11T05:34:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890813+0000", 2024-09-11T05:34:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5650000000000003e-06 2024-09-11T05:34:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829436+0000", 2024-09-11T05:34:03.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93862351799999999 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829443+0000", 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5220000000000004e-06 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858798+0000", 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029354903 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858899+0000", 2024-09-11T05:34:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101414 2024-09-11T05:34:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859035+0000", 2024-09-11T05:34:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013589 2024-09-11T05:34:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116848 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12718080~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.220 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.254990854999999, 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9695514759999999, 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116848 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889760+0000", 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889761+0000", 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.189e-06 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889764+0000", 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889766+0000", 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890850+0000", 2024-09-11T05:34:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010835479999999999 2024-09-11T05:34:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890857+0000", 2024-09-11T05:34:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6299999999999998e-06 2024-09-11T05:34:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829465+0000", 2024-09-11T05:34:03.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860787000000001 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829472+0000", 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4420000000000003e-06 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859062+0000", 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0295903360000001 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859169+0000", 2024-09-11T05:34:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010674400000000001 2024-09-11T05:34:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859311+0000", 2024-09-11T05:34:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014209499999999999 2024-09-11T05:34:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116849 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12742656~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.226 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.254981068999999, 2024-09-11T05:34:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9698160310000001, 2024-09-11T05:34:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116849 2024-09-11T05:34:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:03.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889771+0000", 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889774+0000", 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889776+0000", 2024-09-11T05:34:03.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.638e-06 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890886+0000", 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011102519999999999 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890891+0000", 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2200000000000003e-06 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829494+0000", 2024-09-11T05:34:03.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860342500000005 2024-09-11T05:34:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829501+0000", 2024-09-11T05:34:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4829999999999996e-06 2024-09-11T05:34:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859339+0000", 2024-09-11T05:34:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0298381320000001 2024-09-11T05:34:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859440+0000", 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010145 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859585+0000", 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014513300000000001 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116850 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12767232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.232 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.254960043000001, 2024-09-11T05:34:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970125645, 2024-09-11T05:34:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116850 2024-09-11T05:34:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889791+0000", 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889792+0000", 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4899999999999999e-06 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889795+0000", 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889798+0000", 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7089999999999998e-06 2024-09-11T05:34:03.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890924+0000", 2024-09-11T05:34:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001125685 2024-09-11T05:34:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890933+0000", 2024-09-11T05:34:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3340000000000008e-06 2024-09-11T05:34:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829523+0000", 2024-09-11T05:34:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858966099999996 2024-09-11T05:34:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829529+0000", 2024-09-11T05:34:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5740000000000001e-06 2024-09-11T05:34:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859614+0000", 2024-09-11T05:34:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0300843289999999 2024-09-11T05:34:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859743+0000", 2024-09-11T05:34:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129407 2024-09-11T05:34:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859916+0000", 2024-09-11T05:34:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017282500000000001 2024-09-11T05:34:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116851 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12791808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.254920172999999, 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970347268, 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116851 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:34:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889832+0000", 2024-09-11T05:34:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6819999999999999e-06 2024-09-11T05:34:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889838+0000", 2024-09-11T05:34:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:34:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889841+0000", 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890957+0000", 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001115956 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890961+0000", 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7050000000000001e-06 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829552+0000", 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93859101499999997 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829558+0000", 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5429999999999999e-06 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859947+0000", 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030388248 2024-09-11T05:34:03.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860043+0000", 2024-09-11T05:34:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5847999999999994e-05 2024-09-11T05:34:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860177+0000", 2024-09-11T05:34:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013484400000000001 2024-09-11T05:34:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116852 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12816384~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.254905562000001, 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970594859, 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116852 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:03.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889846+0000", 2024-09-11T05:34:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.204e-06 2024-09-11T05:34:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889849+0000", 2024-09-11T05:34:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.931e-06 2024-09-11T05:34:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889852+0000", 2024-09-11T05:34:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:34:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890993+0000", 2024-09-11T05:34:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001141176 2024-09-11T05:34:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891001+0000", 2024-09-11T05:34:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5259999999999996e-06 2024-09-11T05:34:03.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829582+0000", 2024-09-11T05:34:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858050800000004 2024-09-11T05:34:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829588+0000", 2024-09-11T05:34:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4980000000000003e-06 2024-09-11T05:34:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860207+0000", 2024-09-11T05:34:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030618713 2024-09-11T05:34:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860305+0000", 2024-09-11T05:34:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8209999999999997e-05 2024-09-11T05:34:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860440+0000", 2024-09-11T05:34:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134692 2024-09-11T05:34:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116853 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12840960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.254894843999999, 2024-09-11T05:34:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.97084075, 2024-09-11T05:34:03.252 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116853 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889856+0000", 2024-09-11T05:34:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:34:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889857+0000", 2024-09-11T05:34:03.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.435e-06 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889860+0000", 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9620000000000002e-06 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889863+0000", 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891036+0000", 2024-09-11T05:34:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011734580000000001 2024-09-11T05:34:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891042+0000", 2024-09-11T05:34:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3290000000000001e-06 2024-09-11T05:34:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829611+0000", 2024-09-11T05:34:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856954299999995 2024-09-11T05:34:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829618+0000", 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860465+0000", 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0308472500000001 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860558+0000", 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3253999999999999e-05 2024-09-11T05:34:03.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860696+0000", 2024-09-11T05:34:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138169 2024-09-11T05:34:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116854 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12865536~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.254884653000001, 2024-09-11T05:34:03.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9710979320000002, 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116854 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889867+0000", 2024-09-11T05:34:03.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.155e-06 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889871+0000", 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9260000000000002e-06 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889875+0000", 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.262e-06 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891070+0000", 2024-09-11T05:34:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011945160000000001 2024-09-11T05:34:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891079+0000", 2024-09-11T05:34:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3759999999999997e-06 2024-09-11T05:34:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829642+0000", 2024-09-11T05:34:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856325900000004 2024-09-11T05:34:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829649+0000", 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860726+0000", 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.031076791 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860831+0000", 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105003 2024-09-11T05:34:03.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860964+0000", 2024-09-11T05:34:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013285700000000001 2024-09-11T05:34:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116855 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12890112~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.254869873000001, 2024-09-11T05:34:03.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.971277814, 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116855 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817809+0000", 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.92792850999999998 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817815+0000", 2024-09-11T05:34:03.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4110000000000001e-06 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817827+0000", 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2031000000000001e-05 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817837+0000", 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2159999999999995e-06 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829673+0000", 2024-09-11T05:34:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011836197 2024-09-11T05:34:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829679+0000", 2024-09-11T05:34:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5390000000000004e-06 2024-09-11T05:34:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861000+0000", 2024-09-11T05:34:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0313209539999999 2024-09-11T05:34:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861080+0000", 2024-09-11T05:34:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9606999999999999e-05 2024-09-11T05:34:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861158+0000", 2024-09-11T05:34:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8349000000000005e-05 2024-09-11T05:34:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.269 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.270 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:03.271 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:03.271 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:03.271+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:03.372 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:03.372+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:03.414 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:03.414 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:03.414 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:03.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:03.473 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:03.473+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:03.525 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:03.525 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:03.525 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:03.534 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:03.574 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:03.574+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:03.638 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:34:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.046672693000005, 2024-09-11T05:34:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:34:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:34:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:34:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:34:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:34:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:34:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:34:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:34:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:34:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:34:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:34:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:34:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:34:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:34:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:34:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:34:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:34:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:34:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:34:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:34:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.469737432999999, 2024-09-11T05:34:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:34:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:34:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:34:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:34:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:34:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:34:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:34:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:34:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:34:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:34:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:34:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:34:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:34:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:34:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:34:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:34:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.469718634000003, 2024-09-11T05:34:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:34:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:34:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:34:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:34:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:34:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:34:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:34:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:34:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:34:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:34:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:34:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:34:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:34:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:34:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:34:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.469694603000001, 2024-09-11T05:34:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:34:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:34:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:34:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:34:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:34:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:34:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:34:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:34:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:34:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:34:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:34:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:34:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:34:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:34:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:34:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.469617814999999, 2024-09-11T05:34:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:34:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:34:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:34:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:34:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:34:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:34:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:34:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:34:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:34:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:34:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:34:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:34:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:34:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:34:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.469590492000002, 2024-09-11T05:34:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:34:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:34:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:34:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:34:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:34:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:34:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:34:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:34:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:34:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:34:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:34:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:34:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:34:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:34:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:34:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.469571944000002, 2024-09-11T05:34:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:34:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:34:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:34:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:34:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:34:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:34:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:34:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:34:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:34:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:34:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:34:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:34:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:34:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:34:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.469553873000002, 2024-09-11T05:34:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:34:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:34:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:34:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:34:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:34:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:34:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:34:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:34:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:34:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:34:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:34:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:34:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:34:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:34:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.467956229999999, 2024-09-11T05:34:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:34:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:34:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:34:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:34:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:34:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:34:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:34:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:34:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:34:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:34:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:34:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:34:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:34:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:34:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:34:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:34:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.467935904000001, 2024-09-11T05:34:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:34:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:34:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:34:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:34:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:34:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:34:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:34:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:34:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:34:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:34:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:34:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:34:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:34:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.467896906, 2024-09-11T05:34:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:34:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:34:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:34:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:34:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:34:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:34:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:34:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:34:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:34:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:34:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:34:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:34:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:34:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:34:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:34:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.467876263999997, 2024-09-11T05:34:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:34:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:34:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:34:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:34:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:34:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:34:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:34:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:34:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:34:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:34:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:34:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:34:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:34:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:34:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:34:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.467753401000003, 2024-09-11T05:34:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:34:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:34:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:34:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:34:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:34:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:34:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:34:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:34:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:34:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:34:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:34:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:34:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:34:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:34:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:34:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:34:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.467593844, 2024-09-11T05:34:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:34:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:34:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:34:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:34:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:34:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:34:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:34:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:34:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:34:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:34:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:34:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:34:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:34:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.465909177, 2024-09-11T05:34:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:34:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:34:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:34:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:34:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:34:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:34:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:34:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:34:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:34:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:34:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:34:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:34:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:34:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:34:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:34:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:34:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.465881172000003, 2024-09-11T05:34:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:34:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:34:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:34:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:34:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:34:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:34:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:34:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:34:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:34:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:34:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:34:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:34:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:34:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:34:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:34:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:34:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44388 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8118272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.464489839000002, 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044546074999999997, 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44388 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172487+0000", 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172490+0000", 2024-09-11T05:34:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5090000000000002e-06 2024-09-11T05:34:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172497+0000", 2024-09-11T05:34:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:34:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172502+0000", 2024-09-11T05:34:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2000000000000002e-06 2024-09-11T05:34:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216878+0000", 2024-09-11T05:34:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044375900000000003 2024-09-11T05:34:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216925+0000", 2024-09-11T05:34:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7058999999999998e-05 2024-09-11T05:34:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216982+0000", 2024-09-11T05:34:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6932000000000003e-05 2024-09-11T05:34:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.464414709000003, 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:34:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:34:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:34:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:34:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:34:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:34:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:34:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:34:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:34:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:34:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:34:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:34:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:34:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:34:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.464229408000001, 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:34:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:34:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:34:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:34:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:34:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:34:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:34:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:34:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:34:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:34:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:34:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:34:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:34:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:34:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.464057953000001, 2024-09-11T05:34:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:34:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:34:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:34:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:34:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:34:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:34:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:34:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:34:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:34:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:34:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:03.750 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:03.751 INFO:tasks.thrashosds.thrasher:No PGs found for osd.4 2024-09-11T05:34:03.752 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:03.751+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:03.752 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:03.852 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:03.852+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:03.898 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:03.898 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:03.899 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:03.899 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:03.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:03.923 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:34:03.973 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone35 from 0x73ace6b (overlap 0x2b3288d) to 0x0 2024-09-11T05:34:03.991 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:03.991+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:04.030 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-11T05:34:04.031 INFO:teuthology.orchestra.run.smithi070.stdout:5370 punch from 0x529fb66 to 0x52a20b9, (0x2553 bytes) 2024-09-11T05:34:04.038 INFO:teuthology.orchestra.run.smithi070.stdout:5371 trunc from 0x73ace6b to 0x9ccee4b 2024-09-11T05:34:04.048 INFO:teuthology.orchestra.run.smithi070.stdout:5372 trunc from 0x9ccee4b to 0xd36f25d 2024-09-11T05:34:04.054 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:04.053+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:04.055 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:04.055 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:04.055 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:04.055 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:04.055 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:04.059 INFO:teuthology.orchestra.run.smithi070.stdout:5373 writesame 0xdb753f5 thru 0xdb79796 data_size 0xb(0x43a2 bytes) 2024-09-11T05:34:04.059 INFO:teuthology.orchestra.run.smithi070.stdout:5376 read 0x536399d thru 0x536cf72 (0x95d6 bytes) 2024-09-11T05:34:04.059 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:04.059 INFO:teuthology.orchestra.run.smithi070.stdout:5378 punch from 0x33e74e1 to 0x33f44b7, (0xcfd6 bytes) 2024-09-11T05:34:04.059 INFO:teuthology.orchestra.run.smithi070.stdout:5379 read 0xb476ccd thru 0xb4781b9 (0x14ed bytes) 2024-09-11T05:34:04.059 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:04.059 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:04.064 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:04.070 INFO:teuthology.orchestra.run.smithi070.stdout:5382 trunc from 0xdb79797 to 0x5e70de1 2024-09-11T05:34:04.083 INFO:teuthology.orchestra.run.smithi070.stdout:5384 writesame 0x24317f9 thru 0x243d63e data_size 0x5(0xbe46 bytes) 2024-09-11T05:34:04.092 INFO:teuthology.orchestra.run.smithi070.stdout:5385 read 0x347d08e thru 0x34839ca (0x693d bytes) 2024-09-11T05:34:04.092 INFO:teuthology.orchestra.run.smithi070.stdout:5386 read 0x547e4aa thru 0x548c879 (0xe3d0 bytes) 2024-09-11T05:34:04.097 INFO:teuthology.orchestra.run.smithi070.stdout:5387 trunc from 0x5e70de1 to 0x963943f 2024-09-11T05:34:04.103 INFO:teuthology.orchestra.run.smithi070.stdout:5388 read 0x6519f9f thru 0x651e582 (0x45e4 bytes) 2024-09-11T05:34:04.109 INFO:teuthology.orchestra.run.smithi070.stdout:5390 trunc from 0x963943f to 0x3de30c3 2024-09-11T05:34:04.125 INFO:teuthology.orchestra.run.smithi070.stdout:5392 punch from 0x170eb9c to 0x17102e8, (0x174c bytes) 2024-09-11T05:34:04.125 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:04.134 INFO:teuthology.orchestra.run.smithi070.stdout:5394 write 0x538bbd6 thru 0x5396b71 (0xaf9c bytes) 2024-09-11T05:34:04.137 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:04.143 INFO:teuthology.orchestra.run.smithi070.stdout:5397 write 0x575c563 thru 0x576b2e2 (0xed80 bytes) 2024-09-11T05:34:04.155 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:04.155+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:04.156 INFO:teuthology.orchestra.run.smithi070.stdout:5398 write 0x7ffd7a5 thru 0x800228d (0x4ae9 bytes) 2024-09-11T05:34:04.160 INFO:teuthology.orchestra.run.smithi070.stdout:5399 writesame 0x16e5646 thru 0x16f20aa data_size 0x39(0xca65 bytes) 2024-09-11T05:34:04.165 INFO:teuthology.orchestra.run.smithi070.stdout:5400 punch from 0x3b7823f to 0x3b7be1d, (0x3bde bytes) 2024-09-11T05:34:04.165 INFO:teuthology.orchestra.run.smithi070.stdout:5401 write 0x6d9705a thru 0x6d9e956 (0x78fd bytes) 2024-09-11T05:34:04.168 INFO:teuthology.orchestra.run.smithi070.stdout:5402 writesame 0x6737b78 thru 0x673f3f5 data_size 0x35(0x787e bytes) 2024-09-11T05:34:04.172 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:04.172 INFO:teuthology.orchestra.run.smithi070.stdout:5407 read 0x5cfad35 thru 0x5cfed1b (0x3fe7 bytes) 2024-09-11T05:34:04.172 INFO:teuthology.orchestra.run.smithi070.stdout:5408 punch from 0x1acdd70 to 0x1adaafe, (0xcd8e bytes) 2024-09-11T05:34:04.172 INFO:teuthology.orchestra.run.smithi070.stdout:5409 writesame 0x7e9d51a thru 0x7ea51a4 data_size 0x1(0x7c8b bytes) 2024-09-11T05:34:04.197 INFO:teuthology.orchestra.run.smithi070.stdout:5411 trunc from 0x800228e to 0x2ac1ac2 2024-09-11T05:34:04.218 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45829 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 6995968~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:34:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.849578352999998, 2024-09-11T05:34:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031286190999999998, 2024-09-11T05:34:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45829 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:34:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366836+0000", 2024-09-11T05:34:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4199999999999996e-07 2024-09-11T05:34:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366838+0000", 2024-09-11T05:34:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9929999999999998e-06 2024-09-11T05:34:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366844+0000", 2024-09-11T05:34:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0430000000000004e-06 2024-09-11T05:34:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366848+0000", 2024-09-11T05:34:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6040000000000003e-06 2024-09-11T05:34:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398029+0000", 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031180349 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398070+0000", 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1421999999999997e-05 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398121+0000", 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1238e-05 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45830 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7045120~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.849558782000003, 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031383187999999999, 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45830 2024-09-11T05:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:34:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:34:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.51e-07 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366857+0000", 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9259999999999999e-06 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366863+0000", 2024-09-11T05:34:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7069999999999997e-06 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366868+0000", 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7380000000000002e-06 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398147+0000", 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031279757999999998 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398189+0000", 2024-09-11T05:34:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1597999999999997e-05 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398238+0000", 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.901e-05 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45831 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7094272~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.849539655000001, 2024-09-11T05:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031481960000000003, 2024-09-11T05:34:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45831 2024-09-11T05:34:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:34:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:34:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:34:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4200000000000002e-07 2024-09-11T05:34:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366876+0000", 2024-09-11T05:34:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0020000000000001e-06 2024-09-11T05:34:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366882+0000", 2024-09-11T05:34:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7690000000000002e-06 2024-09-11T05:34:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366887+0000", 2024-09-11T05:34:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119999999999999e-06 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398263+0000", 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031376023000000003 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398306+0000", 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3220999999999998e-05 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398356+0000", 2024-09-11T05:34:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:34:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45832 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7143424~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:34:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.849521035000002, 2024-09-11T05:34:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031581625000000002, 2024-09-11T05:34:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45832 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:34:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367199+0000", 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00030624 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367205+0000", 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1090000000000003e-06 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367213+0000", 2024-09-11T05:34:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8979999999999996e-06 2024-09-11T05:34:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367219+0000", 2024-09-11T05:34:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:34:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398380+0000", 2024-09-11T05:34:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031160931999999999 2024-09-11T05:34:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398425+0000", 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4548000000000001e-05 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398474+0000", 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9298000000000001e-05 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45833 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7192576~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:34:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.849179749999998, 2024-09-11T05:34:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031369229999999998, 2024-09-11T05:34:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45833 2024-09-11T05:34:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9400000000000005e-07 2024-09-11T05:34:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367237+0000", 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4439999999999998e-06 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367243+0000", 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367249+0000", 2024-09-11T05:34:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2240000000000003e-06 2024-09-11T05:34:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398507+0000", 2024-09-11T05:34:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031257994999999997 2024-09-11T05:34:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398551+0000", 2024-09-11T05:34:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4178000000000003e-05 2024-09-11T05:34:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398603+0000", 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2178000000000001e-05 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45834 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7241728~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.849158019000001, 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031466477, 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45834 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:34:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:34:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5200000000000002e-07 2024-09-11T05:34:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367258+0000", 2024-09-11T05:34:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1110000000000002e-06 2024-09-11T05:34:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367264+0000", 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0290000000000002e-06 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367269+0000", 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398628+0000", 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031358587 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398671+0000", 2024-09-11T05:34:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3035999999999999e-05 2024-09-11T05:34:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398722+0000", 2024-09-11T05:34:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1511000000000002e-05 2024-09-11T05:34:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45835 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7290880~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:34:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.849138445000001, 2024-09-11T05:34:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031565589999999998, 2024-09-11T05:34:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45835 2024-09-11T05:34:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:34:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:34:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367276+0000", 2024-09-11T05:34:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.96e-07 2024-09-11T05:34:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367278+0000", 2024-09-11T05:34:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0279999999999999e-06 2024-09-11T05:34:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367283+0000", 2024-09-11T05:34:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8340000000000004e-06 2024-09-11T05:34:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367289+0000", 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398747+0000", 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031458211999999999 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398788+0000", 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0998999999999998e-05 2024-09-11T05:34:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398841+0000", 2024-09-11T05:34:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2465e-05 2024-09-11T05:34:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45836 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7340032~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:34:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.849118369000003, 2024-09-11T05:34:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031663635000000002, 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45836 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368490+0000", 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0011952410000000001 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368494+0000", 2024-09-11T05:34:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4649999999999999e-06 2024-09-11T05:34:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368503+0000", 2024-09-11T05:34:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0920000000000004e-06 2024-09-11T05:34:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368509+0000", 2024-09-11T05:34:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4130000000000003e-06 2024-09-11T05:34:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398865+0000", 2024-09-11T05:34:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030355473000000001 2024-09-11T05:34:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398907+0000", 2024-09-11T05:34:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1882999999999999e-05 2024-09-11T05:34:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398959+0000", 2024-09-11T05:34:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2067999999999997e-05 2024-09-11T05:34:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45844 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7733248~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:34:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.847739226000002, 2024-09-11T05:34:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031248306, 2024-09-11T05:34:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45844 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368675+0000", 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4700000000000001e-07 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368680+0000", 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3750000000000002e-06 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368687+0000", 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3080000000000004e-06 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368692+0000", 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2329999999999997e-06 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399832+0000", 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031139723000000001 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399872+0000", 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0880000000000002e-05 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399923+0000", 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.024e-05 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45845 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7782400~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.847715391999998, 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031339210999999999, 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45845 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:34:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:34:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368699+0000", 2024-09-11T05:34:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:34:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368701+0000", 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0389999999999999e-06 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368706+0000", 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5570000000000003e-06 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368711+0000", 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0930000000000002e-06 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399947+0000", 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031235810999999999 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399989+0000", 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1430000000000001e-05 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400037+0000", 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8838999999999998e-05 2024-09-11T05:34:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45846 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7831552~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.847696292000002, 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031434484999999998, 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45846 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368718+0000", 2024-09-11T05:34:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6600000000000002e-07 2024-09-11T05:34:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368720+0000", 2024-09-11T05:34:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0140000000000001e-06 2024-09-11T05:34:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368726+0000", 2024-09-11T05:34:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8719999999999999e-06 2024-09-11T05:34:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368730+0000", 2024-09-11T05:34:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:34:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400061+0000", 2024-09-11T05:34:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031331141 2024-09-11T05:34:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400102+0000", 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0419e-05 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400152+0000", 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9926000000000003e-05 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45847 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7880704~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:34:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.847677181000002, 2024-09-11T05:34:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031531412000000002, 2024-09-11T05:34:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45847 2024-09-11T05:34:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368737+0000", 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368739+0000", 2024-09-11T05:34:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.81e-06 2024-09-11T05:34:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368744+0000", 2024-09-11T05:34:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8919999999999997e-06 2024-09-11T05:34:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368749+0000", 2024-09-11T05:34:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7149999999999997e-06 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400176+0000", 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031426740000000002 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400218+0000", 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2338e-05 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400268+0000", 2024-09-11T05:34:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9580000000000003e-05 2024-09-11T05:34:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45848 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7929856~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:34:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.847658385000003, 2024-09-11T05:34:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031629162000000002, 2024-09-11T05:34:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45848 2024-09-11T05:34:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368756+0000", 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368758+0000", 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.951e-06 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368763+0000", 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.801e-06 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368768+0000", 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1100000000000002e-06 2024-09-11T05:34:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400292+0000", 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031524033 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400336+0000", 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3272999999999997e-05 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400384+0000", 2024-09-11T05:34:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8634999999999998e-05 2024-09-11T05:34:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45849 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7979008~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:34:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.847638992999997, 2024-09-11T05:34:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031732415, 2024-09-11T05:34:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45849 2024-09-11T05:34:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:34:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:34:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:34:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0100000000000005e-07 2024-09-11T05:34:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368777+0000", 2024-09-11T05:34:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0260000000000002e-06 2024-09-11T05:34:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368783+0000", 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7089999999999999e-06 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368788+0000", 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4029999999999998e-06 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400409+0000", 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031620663 2024-09-11T05:34:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400453+0000", 2024-09-11T05:34:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4376999999999999e-05 2024-09-11T05:34:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400507+0000", 2024-09-11T05:34:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3736000000000002e-05 2024-09-11T05:34:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45850 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8028160~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.847619530999999, 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031830000999999997, 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45850 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368795+0000", 2024-09-11T05:34:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0399999999999996e-07 2024-09-11T05:34:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368796+0000", 2024-09-11T05:34:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.933e-06 2024-09-11T05:34:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368803+0000", 2024-09-11T05:34:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0619999999999997e-06 2024-09-11T05:34:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368807+0000", 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.685e-06 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400531+0000", 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031723784999999997 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400573+0000", 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2079999999999997e-05 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400624+0000", 2024-09-11T05:34:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0952000000000003e-05 2024-09-11T05:34:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45851 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8077312~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:34:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 38.847600538000002, 2024-09-11T05:34:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031929358999999997, 2024-09-11T05:34:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45851 2024-09-11T05:34:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:34:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:34:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370488+0000", 2024-09-11T05:34:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.001674743 2024-09-11T05:34:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370491+0000", 2024-09-11T05:34:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.444e-06 2024-09-11T05:34:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370500+0000", 2024-09-11T05:34:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0650000000000005e-06 2024-09-11T05:34:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370507+0000", 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400648+0000", 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030141889000000002 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400691+0000", 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2290999999999999e-05 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400742+0000", 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1717e-05 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145920 3.18 3:1a554328:::rbd_data.112d9958e8ce.000000000000000a:1b [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.741591028999999, 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031231273, 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145920 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:34:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:34:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:34:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474824+0000", 2024-09-11T05:34:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.046e-06 2024-09-11T05:34:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474827+0000", 2024-09-11T05:34:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3859999999999999e-06 2024-09-11T05:34:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474830+0000", 2024-09-11T05:34:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5790000000000002e-06 2024-09-11T05:34:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.505951+0000", 2024-09-11T05:34:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031121328 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.505995+0000", 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4175000000000003e-05 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506054+0000", 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8553e-05 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145921 3.18 3:1a554328:::rbd_data.112d9958e8ce.000000000000000a:1b [read 180224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.741580913, 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031340051000000001, 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145921 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:34:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.16e-07 2024-09-11T05:34:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474834+0000", 2024-09-11T05:34:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.08e-06 2024-09-11T05:34:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474837+0000", 2024-09-11T05:34:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.954e-06 2024-09-11T05:34:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474839+0000", 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506080+0000", 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031240232 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506119+0000", 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9065e-05 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506173+0000", 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4054000000000001e-05 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145922 3.18 3:1a554328:::rbd_data.112d9958e8ce.000000000000000a:1b [read 200704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474842+0000", 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.741571292, 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031453192999999997, 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145922 2024-09-11T05:34:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474842+0000", 2024-09-11T05:34:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474842+0000", 2024-09-11T05:34:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474843+0000", 2024-09-11T05:34:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.03e-07 2024-09-11T05:34:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474844+0000", 2024-09-11T05:34:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0589999999999999e-06 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474847+0000", 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3160000000000001e-06 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474849+0000", 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4549999999999998e-06 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506196+0000", 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031346442000000002 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506239+0000", 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3027e-05 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506295+0000", 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6691000000000003e-05 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145933 3.18 3:1952fba0:::rbd_data.112d55d87bfc.0000000000000007:head [stat,truncate 155648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.741561488999999, 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.03262636, 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145933 2024-09-11T05:34:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:34:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:34:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:34:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:34:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474853+0000", 2024-09-11T05:34:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.17e-06 2024-09-11T05:34:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474857+0000", 2024-09-11T05:34:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1039999999999998e-06 2024-09-11T05:34:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474860+0000", 2024-09-11T05:34:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8670000000000004e-06 2024-09-11T05:34:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506326+0000", 2024-09-11T05:34:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031465323000000003 2024-09-11T05:34:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506367+0000", 2024-09-11T05:34:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1155000000000002e-05 2024-09-11T05:34:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 6", 2024-09-11T05:34:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506445+0000", 2024-09-11T05:34:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8347000000000001e-05 2024-09-11T05:34:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507206+0000", 2024-09-11T05:34:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00076036099999999998 2024-09-11T05:34:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507390+0000", 2024-09-11T05:34:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00018462799999999999 2024-09-11T05:34:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507440+0000", 2024-09-11T05:34:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9604999999999997e-05 2024-09-11T05:34:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507478+0000", 2024-09-11T05:34:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8593999999999997e-05 2024-09-11T05:34:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:04.314 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:04.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:04.317 INFO:teuthology.orchestra.run.smithi070.stdout:5412 read 0x2111e20 thru 0x2117151 (0x5332 bytes) 2024-09-11T05:34:04.317 INFO:teuthology.orchestra.run.smithi070.stdout:5413 write 0x1540ff7 thru 0x1541fc0 (0xfca bytes) 2024-09-11T05:34:04.317 INFO:teuthology.orchestra.run.smithi070.stdout:5414 punch from 0x21ceb8f to 0x21d3f62, (0x53d3 bytes) 2024-09-11T05:34:04.317 INFO:teuthology.orchestra.run.smithi070.stdout:5416 write 0x1e9d8d4 thru 0x1ea136a (0x3a97 bytes) 2024-09-11T05:34:04.317 INFO:teuthology.orchestra.run.smithi070.stdout:5417 trunc from 0x2ac1ac2 to 0x83c55d9 2024-09-11T05:34:04.317 INFO:teuthology.orchestra.run.smithi070.stdout:5418 write 0xb66b347 thru 0xb66bcd2 (0x98c bytes) 2024-09-11T05:34:04.317 INFO:teuthology.orchestra.run.smithi070.stdout:5419 write 0x76914af thru 0x769d8de (0xc430 bytes) 2024-09-11T05:34:04.317 INFO:teuthology.orchestra.run.smithi070.stdout:5422 clone 37 order 25 su 8388608 sc 4 2024-09-11T05:34:04.317 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:04.315+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:04.325 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:34:04.416 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:04.416+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:04.420 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:04.421 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:04.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:04.444 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:04.444 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:04.460 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:04.476 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:04.477 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:04.492 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:04.492 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:04.493 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-11T05:34:04.509 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:04.509 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:04.517 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:04.516+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:04.526 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:04.526 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:04.542 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:04.542 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:04.546 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:34:04.546 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:34:04.573 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:04.573 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:04.581 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:04.618 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:04.618+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:04.719 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:04.719+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:04.724 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:04.725 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:04.734 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:04.820 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:04.820+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:04.876 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:04.877 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:04.886 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:04.918 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T05:34:04.921 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:04.921+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:04.984 INFO:teuthology.orchestra.run.smithi070.stdout:flattening image image_client.0-clone36 2024-09-11T05:34:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:05.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:05.021 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:05.021+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:05.112 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:05.112 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:05.121 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:05.122 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:05.122+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:05.144 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-11T05:34:05.145 INFO:teuthology.orchestra.run.smithi070.stdout:5423 writesame 0x33a478e thru 0x33b407f data_size 0x5(0xf8f2 bytes) 2024-09-11T05:34:05.158 INFO:teuthology.orchestra.run.smithi070.stdout:5425 punch from 0x51f43b8 to 0x51f6e4d, (0x2a95 bytes) 2024-09-11T05:34:05.165 INFO:teuthology.orchestra.run.smithi070.stdout:5427 writesame 0xc35194b thru 0xc359eb9 data_size 0x1(0x856f bytes) 2024-09-11T05:34:05.169 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.169 INFO:teuthology.orchestra.run.smithi070.stdout:5429 read 0x548c848 thru 0x54931eb (0x69a4 bytes) 2024-09-11T05:34:05.169 INFO:teuthology.orchestra.run.smithi070.stdout:5430 read 0x8833746 thru 0x88425d3 (0xee8e bytes) 2024-09-11T05:34:05.169 INFO:teuthology.orchestra.run.smithi070.stdout:5432 write 0xaccb27c thru 0xacd62e4 (0xb069 bytes) 2024-09-11T05:34:05.184 INFO:teuthology.orchestra.run.smithi070.stdout:5433 trunc from 0xc359eba to 0x2266f98 2024-09-11T05:34:05.205 INFO:teuthology.orchestra.run.smithi070.stdout:5434 punch from 0x1d1ab4c to 0x1d1b1c9, (0x67d bytes) 2024-09-11T05:34:05.219 INFO:teuthology.orchestra.run.smithi070.stdout:5436 write 0xa10ae3d thru 0xa116f01 (0xc0c5 bytes) 2024-09-11T05:34:05.222 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:05.222+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:05.223 INFO:teuthology.orchestra.run.smithi070.stdout:5438 trunc from 0xa116f02 to 0xaf76d09 2024-09-11T05:34:05.228 INFO:teuthology.orchestra.run.smithi070.stdout:5439 punch from 0x305c9dd to 0x306a28e, (0xd8b1 bytes) 2024-09-11T05:34:05.228 INFO:teuthology.orchestra.run.smithi070.stdout:5440 punch from 0x6a061b2 to 0x6a146b4, (0xe502 bytes) 2024-09-11T05:34:05.228 INFO:teuthology.orchestra.run.smithi070.stdout:5442 writesame 0x891249e thru 0x8912b33 data_size 0x3(0x696 bytes) 2024-09-11T05:34:05.234 INFO:teuthology.orchestra.run.smithi070.stdout:5444 trunc from 0xaf76d09 to 0x887db3c 2024-09-11T05:34:05.239 INFO:teuthology.orchestra.run.smithi070.stdout:5445 write 0x56d915 thru 0x570223 (0x290f bytes) 2024-09-11T05:34:05.241 INFO:teuthology.orchestra.run.smithi070.stdout:5446 writesame 0x3e51861 thru 0x3e5b8a4 data_size 0x4e(0xa044 bytes) 2024-09-11T05:34:05.241 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:05.241 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:05.243 INFO:teuthology.orchestra.run.smithi070.stdout:5447 writesame 0x35e8e07 thru 0x35e90b2 data_size 0x6(0x2ac bytes) 2024-09-11T05:34:05.244 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.252 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:05.253 INFO:teuthology.orchestra.run.smithi070.stdout:5449 write 0xb24fc14 thru 0xb255163 (0x5550 bytes) 2024-09-11T05:34:05.256 INFO:teuthology.orchestra.run.smithi070.stdout:5450 read 0x17592ed thru 0x1763de6 (0xaafa bytes) 2024-09-11T05:34:05.256 INFO:teuthology.orchestra.run.smithi070.stdout:5451 read 0x8da94e thru 0x8e4971 (0xa024 bytes) 2024-09-11T05:34:05.257 INFO:teuthology.orchestra.run.smithi070.stdout:5452 writesame 0x5d4769a thru 0x5d4bc88 data_size 0x1(0x45ef bytes) 2024-09-11T05:34:05.274 INFO:teuthology.orchestra.run.smithi070.stdout:5453 writesame 0xc6120f5 thru 0xc612d79 data_size 0x1(0xc85 bytes) 2024-09-11T05:34:05.275 INFO:teuthology.orchestra.run.smithi070.stdout:5454 read 0x7911593 thru 0x7915681 (0x40ef bytes) 2024-09-11T05:34:05.276 INFO:teuthology.orchestra.run.smithi070.stdout:5455 punch from 0x9c57917 to 0x9c5f4ce, (0x7bb7 bytes) 2024-09-11T05:34:05.276 INFO:teuthology.orchestra.run.smithi070.stdout:5456 read 0xa52048 thru 0xa52d8c (0xd45 bytes) 2024-09-11T05:34:05.277 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.277 INFO:teuthology.orchestra.run.smithi070.stdout:5459 punch from 0x3feb47b to 0x3ff37dc, (0x8361 bytes) 2024-09-11T05:34:05.277 INFO:teuthology.orchestra.run.smithi070.stdout:5460 punch from 0x50f228b to 0x50f35da, (0x134f bytes) 2024-09-11T05:34:05.277 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.284 INFO:teuthology.orchestra.run.smithi070.stdout:5462 write 0xe8d7ef8 thru 0xe8db93f (0x3a48 bytes) 2024-09-11T05:34:05.300 INFO:teuthology.orchestra.run.smithi070.stdout:5463 trunc from 0xe8db940 to 0x2ee7717 2024-09-11T05:34:05.311 INFO:teuthology.orchestra.run.smithi070.stdout:5464 punch from 0x28be168 to 0x28c29be, (0x4856 bytes) 2024-09-11T05:34:05.311 INFO:teuthology.orchestra.run.smithi070.stdout:5467 read 0x2dc47af thru 0x2dc5435 (0xc87 bytes) 2024-09-11T05:34:05.317 INFO:teuthology.orchestra.run.smithi070.stdout:5470 write 0x369727f thru 0x369da6c (0x67ee bytes) 2024-09-11T05:34:05.318 INFO:teuthology.orchestra.run.smithi070.stdout:5471 read 0x1bf3c39 thru 0x1bfdc27 (0x9fef bytes) 2024-09-11T05:34:05.323 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:05.323+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:05.335 INFO:teuthology.orchestra.run.smithi070.stdout:5473 write 0xcfafc7e thru 0xcfb74a9 (0x782c bytes) 2024-09-11T05:34:05.338 INFO:teuthology.orchestra.run.smithi070.stdout:5474 writesame 0x1f1b445 thru 0x1f2b438 data_size 0x2(0xfff4 bytes) 2024-09-11T05:34:05.355 INFO:teuthology.orchestra.run.smithi070.stdout:5476 punch from 0x668f1d8 to 0x66902c8, (0x10f0 bytes) 2024-09-11T05:34:05.356 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.357 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.357 INFO:teuthology.orchestra.run.smithi070.stdout:5480 write 0x279bb46 thru 0x27aa62e (0xeae9 bytes) 2024-09-11T05:34:05.358 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.358 INFO:teuthology.orchestra.run.smithi070.stdout:5482 write 0xab8bbaa thru 0xab92f63 (0x73ba bytes) 2024-09-11T05:34:05.369 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:05.369 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:05.374 INFO:teuthology.orchestra.run.smithi070.stdout:5483 trunc from 0xcfb74aa to 0x84f673 2024-09-11T05:34:05.382 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:05.389 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.398 INFO:teuthology.orchestra.run.smithi070.stdout:5486 trunc from 0x84f673 to 0x86057d2 2024-09-11T05:34:05.403 INFO:teuthology.orchestra.run.smithi070.stdout:5487 read 0x4740339 thru 0x4749652 (0x931a bytes) 2024-09-11T05:34:05.413 INFO:teuthology.orchestra.run.smithi070.stdout:5488 writesame 0xb9c88e8 thru 0xb9cbe18 data_size 0x33(0x3531 bytes) 2024-09-11T05:34:05.413 INFO:teuthology.orchestra.run.smithi070.stdout:5490 read 0x518b17 thru 0x520807 (0x7cf1 bytes) 2024-09-11T05:34:05.414 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.414 INFO:teuthology.orchestra.run.smithi070.stdout:5492 writesame 0x41488f thru 0x4246b0 data_size 0x15(0xfe22 bytes) 2024-09-11T05:34:05.418 INFO:teuthology.orchestra.run.smithi070.stdout:5493 read 0x5e75c6b thru 0x5e80670 (0xaa06 bytes) 2024-09-11T05:34:05.424 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:05.424+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:05.425 INFO:teuthology.orchestra.run.smithi070.stdout:5494 writesame 0xc916ff3 thru 0xc9177d2 data_size 0x8(0x7e0 bytes) 2024-09-11T05:34:05.425 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.425 INFO:teuthology.orchestra.run.smithi070.stdout:5497 read 0x86a8c5a thru 0x86abdce (0x3175 bytes) 2024-09-11T05:34:05.425 INFO:teuthology.orchestra.run.smithi070.stdout:5498 read 0x44bd934 thru 0x44c774b (0x9e18 bytes) 2024-09-11T05:34:05.425 INFO:teuthology.orchestra.run.smithi070.stdout:5500 write 0x8369269 thru 0x8371698 (0x8430 bytes) 2024-09-11T05:34:05.428 INFO:teuthology.orchestra.run.smithi070.stdout:5501 read 0x9eef00b thru 0x9ef6583 (0x7579 bytes) 2024-09-11T05:34:05.428 INFO:teuthology.orchestra.run.smithi070.stdout:5502 writesame 0x85e96a2 thru 0x85f72cd data_size 0xb(0xdc2c bytes) 2024-09-11T05:34:05.432 INFO:teuthology.orchestra.run.smithi070.stdout:5506 writesame 0x301c0de thru 0x301ccf8 data_size 0x1(0xc1b bytes) 2024-09-11T05:34:05.437 INFO:teuthology.orchestra.run.smithi070.stdout:5507 read 0xc9a606 thru 0xca9fc9 (0xf9c4 bytes) 2024-09-11T05:34:05.450 INFO:teuthology.orchestra.run.smithi070.stdout:5508 trunc from 0xc9177d3 to 0x23a454e 2024-09-11T05:34:05.460 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.460 INFO:teuthology.orchestra.run.smithi070.stdout:5511 punch from 0x2be0ba to 0x2cccba, (0xec00 bytes) 2024-09-11T05:34:05.460 INFO:teuthology.orchestra.run.smithi070.stdout:5512 read 0x1366d52 thru 0x136ed88 (0x8037 bytes) 2024-09-11T05:34:05.464 INFO:teuthology.orchestra.run.smithi070.stdout:5514 trunc from 0x23a454e to 0x5165b38 2024-09-11T05:34:05.469 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.469 INFO:teuthology.orchestra.run.smithi070.stdout:5516 write 0x3a79f3f thru 0x3a7baab (0x1b6d bytes) 2024-09-11T05:34:05.481 INFO:teuthology.orchestra.run.smithi070.stdout:5518 write 0x853a664 thru 0x853a8da (0x277 bytes) 2024-09-11T05:34:05.483 INFO:teuthology.orchestra.run.smithi070.stdout:5519 read 0x57ee3e5 thru 0x57fa725 (0xc341 bytes) 2024-09-11T05:34:05.484 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.491 INFO:teuthology.orchestra.run.smithi070.stdout:5523 writesame 0xa50b929 thru 0xa516db7 data_size 0x1(0xb48f bytes) 2024-09-11T05:34:05.493 INFO:teuthology.orchestra.run.smithi070.stdout:5525 read 0x4639a51 thru 0x46472ca (0xd87a bytes) 2024-09-11T05:34:05.493 INFO:teuthology.orchestra.run.smithi070.stdout:5526 read 0x6d0f4a8 thru 0x6d117b4 (0x230d bytes) 2024-09-11T05:34:05.500 INFO:teuthology.orchestra.run.smithi070.stdout:5527 write 0xbe50474 thru 0xbe52ebf (0x2a4c bytes) 2024-09-11T05:34:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:5528 trunc from 0xbe52ec0 to 0x94b8213 2024-09-11T05:34:05.511 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:05.511 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:05.515 INFO:teuthology.orchestra.run.smithi070.stdout:5529 read 0x57b1a02 thru 0x57b2a78 (0x1077 bytes) 2024-09-11T05:34:05.516 INFO:teuthology.orchestra.run.smithi070.stdout:5530 trunc from 0x94b8213 to 0xa01eb18 2024-09-11T05:34:05.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:05.524 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:05.524+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:05.530 INFO:teuthology.orchestra.run.smithi070.stdout:5531 write 0xdaeb0a6 thru 0xdaf30c9 (0x8024 bytes) 2024-09-11T05:34:05.533 INFO:teuthology.orchestra.run.smithi070.stdout:5532 write 0x5822b9e thru 0x582dd90 (0xb1f3 bytes) 2024-09-11T05:34:05.539 INFO:teuthology.orchestra.run.smithi070.stdout:5533 trunc from 0xdaf30ca to 0x9b037a1 2024-09-11T05:34:05.553 INFO:teuthology.orchestra.run.smithi070.stdout:5534 write 0xce341e6 thru 0xce42e40 (0xec5b bytes) 2024-09-11T05:34:05.556 INFO:teuthology.orchestra.run.smithi070.stdout:5535 read 0xabd564b thru 0xabda289 (0x4c3f bytes) 2024-09-11T05:34:05.557 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.557 INFO:teuthology.orchestra.run.smithi070.stdout:5537 writesame 0xb8f539c thru 0xb8f9664 data_size 0x29(0x42c9 bytes) 2024-09-11T05:34:05.565 INFO:teuthology.orchestra.run.smithi070.stdout:5538 write 0xde92647 thru 0xde97be4 (0x559e bytes) 2024-09-11T05:34:05.566 INFO:teuthology.orchestra.run.smithi070.stdout:5540 punch from 0x400f3ee to 0x401770f, (0x8321 bytes) 2024-09-11T05:34:05.566 INFO:teuthology.orchestra.run.smithi070.stdout:5542 write 0xa2c8bf4 thru 0xa2d6b8c (0xdf99 bytes) 2024-09-11T05:34:05.567 INFO:teuthology.orchestra.run.smithi070.stdout:5543 read 0x50c191e thru 0x50c5f6d (0x4650 bytes) 2024-09-11T05:34:05.567 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.572 INFO:teuthology.orchestra.run.smithi070.stdout:5545 trunc from 0xde97be5 to 0xa5b2dd0 2024-09-11T05:34:05.585 INFO:teuthology.orchestra.run.smithi070.stdout:5546 write 0xd474fe7 thru 0xd47e83e (0x9858 bytes) 2024-09-11T05:34:05.588 INFO:teuthology.orchestra.run.smithi070.stdout:5548 write 0xc29102f thru 0xc29e843 (0xd815 bytes) 2024-09-11T05:34:05.589 INFO:teuthology.orchestra.run.smithi070.stdout:5549 writesame 0xd385dc2 thru 0xd3887ee data_size 0x3b(0x2a2d bytes) 2024-09-11T05:34:05.591 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.591 INFO:teuthology.orchestra.run.smithi070.stdout:5553 read 0xa4f41b8 thru 0xa4fb9d2 (0x781b bytes) 2024-09-11T05:34:05.591 INFO:teuthology.orchestra.run.smithi070.stdout:5554 write 0xae8a927 thru 0xae9894f (0xe029 bytes) 2024-09-11T05:34:05.593 INFO:teuthology.orchestra.run.smithi070.stdout:5555 punch from 0x20cd33f to 0x20d1f22, (0x4be3 bytes) 2024-09-11T05:34:05.595 INFO:teuthology.orchestra.run.smithi070.stdout:5556 trunc from 0xd47e83f to 0xeb44699 2024-09-11T05:34:05.599 INFO:teuthology.orchestra.run.smithi070.stdout:5557 writesame 0x9f093f3 thru 0x9f0b345 data_size 0xb(0x1f53 bytes) 2024-09-11T05:34:05.601 INFO:teuthology.orchestra.run.smithi070.stdout:5560 writesame 0xc3c7b28 thru 0xc3d5f47 data_size 0xa(0xe420 bytes) 2024-09-11T05:34:05.606 INFO:teuthology.orchestra.run.smithi070.stdout:5561 punch from 0x42cfe63 to 0x42dd66d, (0xd80a bytes) 2024-09-11T05:34:05.607 INFO:teuthology.orchestra.run.smithi070.stdout:5562 read 0x31e8939 thru 0x31f24c6 (0x9b8e bytes) 2024-09-11T05:34:05.607 INFO:teuthology.orchestra.run.smithi070.stdout:5564 read 0x5f16c24 thru 0x5f1f231 (0x860e bytes) 2024-09-11T05:34:05.607 INFO:teuthology.orchestra.run.smithi070.stdout:5565 read 0x57b78ae thru 0x57b882e (0xf81 bytes) 2024-09-11T05:34:05.615 INFO:teuthology.orchestra.run.smithi070.stdout:5567 trunc from 0xeb44699 to 0x86c35cc 2024-09-11T05:34:05.626 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:05.626+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:05.626 INFO:teuthology.orchestra.run.smithi070.stdout:5568 writesame 0x2fe896f thru 0x2ff554f data_size 0x29(0xcbe1 bytes) 2024-09-11T05:34:05.637 INFO:teuthology.orchestra.run.smithi070.stdout:5569 writesame 0xb40a710 thru 0xb40c07d data_size 0x3e(0x196e bytes) 2024-09-11T05:34:05.637 INFO:teuthology.orchestra.run.smithi070.stdout:5570 read 0x7c88467 thru 0x7c88b56 (0x6f0 bytes) 2024-09-11T05:34:05.637 INFO:teuthology.orchestra.run.smithi070.stdout:5571 punch from 0x46942db to 0x469d5d8, (0x92fd bytes) 2024-09-11T05:34:05.637 INFO:teuthology.orchestra.run.smithi070.stdout:5572 write 0x628deb2 thru 0x628ec9f (0xdee bytes) 2024-09-11T05:34:05.638 INFO:teuthology.orchestra.run.smithi070.stdout:5574 writesame 0x9370e2c thru 0x937d0c6 data_size 0xb(0xc29b bytes) 2024-09-11T05:34:05.643 INFO:teuthology.orchestra.run.smithi070.stdout:5576 read 0x3a36418 thru 0x3a440a1 (0xdc8a bytes) 2024-09-11T05:34:05.643 INFO:teuthology.orchestra.run.smithi070.stdout:5577 punch from 0x6ff8bd6 to 0x7001025, (0x844f bytes) 2024-09-11T05:34:05.644 INFO:teuthology.orchestra.run.smithi070.stdout:5578 read 0x24e0d81 thru 0x24ee78e (0xda0e bytes) 2024-09-11T05:34:05.644 INFO:teuthology.orchestra.run.smithi070.stdout:5580 read 0xbdf228 thru 0xbdf5ed (0x3c6 bytes) 2024-09-11T05:34:05.651 INFO:teuthology.orchestra.run.smithi070.stdout:5581 write 0xcd79484 thru 0xcd84e0e (0xb98b bytes) 2024-09-11T05:34:05.655 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.655 INFO:teuthology.orchestra.run.smithi070.stdout:5584 write 0x795ebcb thru 0x79647a4 (0x5bda bytes) 2024-09-11T05:34:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:5585 read 0x2b28393 thru 0x2b36f4c (0xebba bytes) 2024-09-11T05:34:05.656 INFO:teuthology.orchestra.run.smithi070.stdout:5587 read 0x147eaf1 thru 0x1482ebd (0x43cd bytes) 2024-09-11T05:34:05.657 INFO:teuthology.orchestra.run.smithi070.stdout:5588 read 0x6f98610 thru 0x6fa80d8 (0xfac9 bytes) 2024-09-11T05:34:05.657 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.657 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:05.658 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:05.663 INFO:teuthology.orchestra.run.smithi070.stdout:5591 writesame 0xe3efccd thru 0xe3f0998 data_size 0x1a(0xccc bytes) 2024-09-11T05:34:05.665 INFO:teuthology.orchestra.run.smithi070.stdout:5592 read 0x7d224bd thru 0x7d23842 (0x1386 bytes) 2024-09-11T05:34:05.665 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.665 INFO:teuthology.orchestra.run.smithi070.stdout:5594 write 0x5b2b0b2 thru 0x5b2d8de (0x282d bytes) 2024-09-11T05:34:05.667 INFO:teuthology.orchestra.run.smithi070.stdout:5595 punch from 0xb48cff2 to 0xb499dfa, (0xce08 bytes) 2024-09-11T05:34:05.667 INFO:teuthology.orchestra.run.smithi070.stdout:5596 write 0xb835298 thru 0xb835fc4 (0xd2d bytes) 2024-09-11T05:34:05.668 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:05.670 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.670 INFO:teuthology.orchestra.run.smithi070.stdout:5598 punch from 0xb5f7051 to 0xb6012d7, (0xa286 bytes) 2024-09-11T05:34:05.670 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.670 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.670 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.675 INFO:teuthology.orchestra.run.smithi070.stdout:5604 trunc from 0xe3f0999 to 0x96dfa3d 2024-09-11T05:34:05.684 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.684 INFO:teuthology.orchestra.run.smithi070.stdout:5606 read 0x49961e5 thru 0x49a2bcf (0xc9eb bytes) 2024-09-11T05:34:05.684 INFO:teuthology.orchestra.run.smithi070.stdout:5608 writesame 0x8bc708b thru 0x8bd090e data_size 0x56(0x9884 bytes) 2024-09-11T05:34:05.686 INFO:teuthology.orchestra.run.smithi070.stdout:5609 punch from 0x4047cd8 to 0x404a727, (0x2a4f bytes) 2024-09-11T05:34:05.698 INFO:teuthology.orchestra.run.smithi070.stdout:5610 write 0xe041bfc thru 0xe04fb8d (0xdf92 bytes) 2024-09-11T05:34:05.699 INFO:teuthology.orchestra.run.smithi070.stdout:5611 read 0xaf5ad30 thru 0xaf62a94 (0x7d65 bytes) 2024-09-11T05:34:05.700 INFO:teuthology.orchestra.run.smithi070.stdout:5612 writesame 0xc65d00d thru 0xc66b3cf data_size 0x1(0xe3c3 bytes) 2024-09-11T05:34:05.727 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:05.726+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:05.738 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.739 INFO:teuthology.orchestra.run.smithi070.stdout:5614 read 0x7e6530d thru 0x7e6fb11 (0xa805 bytes) 2024-09-11T05:34:05.739 INFO:teuthology.orchestra.run.smithi070.stdout:5615 write 0xc09d027 thru 0xc0abec9 (0xeea3 bytes) 2024-09-11T05:34:05.747 INFO:teuthology.orchestra.run.smithi070.stdout:5617 trunc from 0xe04fb8e to 0xa168f1d 2024-09-11T05:34:05.755 INFO:teuthology.orchestra.run.smithi070.stdout:5618 writesame 0x908803c thru 0x908b570 data_size 0x1(0x3535 bytes) 2024-09-11T05:34:05.764 INFO:teuthology.orchestra.run.smithi070.stdout:5621 punch from 0x1cab4d9 to 0x1cb4156, (0x8c7d bytes) 2024-09-11T05:34:05.764 INFO:teuthology.orchestra.run.smithi070.stdout:5622 punch from 0x41bd49c to 0x41c2380, (0x4ee4 bytes) 2024-09-11T05:34:05.764 INFO:teuthology.orchestra.run.smithi070.stdout:5623 write 0x968fd85 thru 0x9690874 (0xaf0 bytes) 2024-09-11T05:34:05.771 INFO:teuthology.orchestra.run.smithi070.stdout:5627 writesame 0xac0f976 thru 0xac1a35e data_size 0x1b(0xa9e9 bytes) 2024-09-11T05:34:05.772 INFO:teuthology.orchestra.run.smithi070.stdout:5628 write 0x1511270 thru 0x151c573 (0xb304 bytes) 2024-09-11T05:34:05.774 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.774 INFO:teuthology.orchestra.run.smithi070.stdout:5630 punch from 0x28c9943 to 0x28c9ee9, (0x5a6 bytes) 2024-09-11T05:34:05.781 INFO:teuthology.orchestra.run.smithi070.stdout:5633 trunc from 0xac1a35f to 0x4eab6f1 2024-09-11T05:34:05.791 INFO:teuthology.orchestra.run.smithi070.stdout:5634 read 0x30ddc7e thru 0x30e6e27 (0x91aa bytes) 2024-09-11T05:34:05.791 INFO:teuthology.orchestra.run.smithi070.stdout:5635 read 0x2fd6b59 thru 0x2fdeb76 (0x801e bytes) 2024-09-11T05:34:05.792 INFO:teuthology.orchestra.run.smithi070.stdout:5636 read 0xf49d71 thru 0xf4c16d (0x23fd bytes) 2024-09-11T05:34:05.796 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:05.796 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:05.804 INFO:teuthology.orchestra.run.smithi070.stdout:5637 write 0xad9b243 thru 0xada98ee (0xe6ac bytes) 2024-09-11T05:34:05.808 INFO:teuthology.orchestra.run.smithi070.stdout:5638 punch from 0x48998f5 to 0x48a6dc2, (0xd4cd bytes) 2024-09-11T05:34:05.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:05.813 INFO:teuthology.orchestra.run.smithi070.stdout:5641 trunc from 0xada98ef to 0x5ed2c4a 2024-09-11T05:34:05.824 INFO:teuthology.orchestra.run.smithi070.stdout:5643 punch from 0x349df24 to 0x34a3924, (0x5a00 bytes) 2024-09-11T05:34:05.828 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:05.828+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:05.832 INFO:teuthology.orchestra.run.smithi070.stdout:5644 write 0x8a7a4f8 thru 0x8a83695 (0x919e bytes) 2024-09-11T05:34:05.835 INFO:teuthology.orchestra.run.smithi070.stdout:5645 read 0x46273f thru 0x462b52 (0x414 bytes) 2024-09-11T05:34:05.841 INFO:teuthology.orchestra.run.smithi070.stdout:5647 write 0x965c057 thru 0x966beb2 (0xfe5c bytes) 2024-09-11T05:34:05.844 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.847 INFO:teuthology.orchestra.run.smithi070.stdout:5650 trunc from 0x966beb3 to 0x724b418 2024-09-11T05:34:05.857 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.857 INFO:teuthology.orchestra.run.smithi070.stdout:5652 read 0x4a5e797 thru 0x4a6816a (0x99d4 bytes) 2024-09-11T05:34:05.862 INFO:teuthology.orchestra.run.smithi070.stdout:5654 trunc from 0x724b418 to 0x3371be2 2024-09-11T05:34:05.878 INFO:teuthology.orchestra.run.smithi070.stdout:5655 trunc from 0x3371be2 to 0xb7c9b1d 2024-09-11T05:34:05.882 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.883 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:05.883 INFO:teuthology.orchestra.run.smithi070.stdout:5660 clone 38 order 25 su 8388608 sc 13 2024-09-11T05:34:05.928 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:05.928 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:05.928 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:05.928+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:05.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:05.976 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone37 from 0xb7c9b1d (overlap 0x84f673) to 0x77aa9a 2024-09-11T05:34:06.025 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-11T05:34:06.028 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:06.028+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:06.097 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:06.097 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:06.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:06.152 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:06.151+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:06.231 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:06.230+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:06.262 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:06.262 INFO:teuthology.orchestra.run.smithi070.stdout:5664 punch from 0xb0f2694 to 0xb100b9a, (0xe506 bytes) 2024-09-11T05:34:06.266 INFO:teuthology.orchestra.run.smithi070.stdout:5665 write 0x59934f6 thru 0x5997c5a (0x4765 bytes) 2024-09-11T05:34:06.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:06.270 INFO:teuthology.orchestra.run.smithi070.stdout:5666 writesame 0x52fe622 thru 0x530aac4 data_size 0x1(0xc4a3 bytes) 2024-09-11T05:34:06.305 INFO:teuthology.orchestra.run.smithi070.stdout:5667 trunc from 0xb7c9b1d to 0x4f39135 2024-09-11T05:34:06.329 INFO:teuthology.orchestra.run.smithi070.stdout:5668 read 0x20d84e1 thru 0x20e1f79 (0x9a99 bytes) 2024-09-11T05:34:06.330 INFO:teuthology.orchestra.run.smithi070.stdout:5670 writesame 0x11c65b thru 0x129720 data_size 0x1(0xd0c6 bytes) 2024-09-11T05:34:06.331 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:06.331+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:06.365 INFO:teuthology.orchestra.run.smithi070.stdout:5672 trunc from 0x4f39135 to 0x7272eb8 2024-09-11T05:34:06.373 INFO:teuthology.orchestra.run.smithi070.stdout:5673 trunc from 0x7272eb8 to 0x8d37368 2024-09-11T05:34:06.378 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:06.378 INFO:teuthology.orchestra.run.smithi070.stdout:5675 read 0x1fe55e3 thru 0x1ff3c74 (0xe692 bytes) 2024-09-11T05:34:06.378 INFO:teuthology.orchestra.run.smithi070.stdout:5676 clone 39 order 20 su 4096 sc 10 2024-09-11T05:34:06.385 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:06.386 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:06.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:06.432 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:06.432+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:06.533 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:06.533+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:06.538 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:06.538 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:06.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:34:06.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:06.634 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:06.634+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:06.694 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:06.694 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:06.703 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:06.709 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:06.709 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:06.727 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:06.735 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:06.735+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:06.742 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:06.743 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:06.760 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:06.760 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:06.761 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-11T05:34:06.777 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:06.778 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:06.794 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:06.794 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:06.810 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:06.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:34:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.218580212000006, 2024-09-11T05:34:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:34:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:34:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:34:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:34:06.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:34:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:34:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:34:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:34:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:34:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:34:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:34:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:34:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:34:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:34:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:34:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:34:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:34:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:34:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:34:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:34:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.641644952, 2024-09-11T05:34:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:34:06.816 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:34:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:34:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:34:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:34:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:34:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:34:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:34:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:34:06.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:34:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.641626152999997, 2024-09-11T05:34:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:34:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:34:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:34:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:34:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:34:06.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:34:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:34:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:34:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:34:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:34:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:34:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:34:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:34:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:34:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:34:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.641602122000002, 2024-09-11T05:34:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:34:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:34:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:06.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:34:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:34:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:34:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:34:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:34:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:34:06.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.641525334000001, 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:34:06.831 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:34:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:34:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:34:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:34:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:34:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:34:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:34:06.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:34:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:34:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:34:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:34:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:34:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:34:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.641498011000003, 2024-09-11T05:34:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:34:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.836 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:34:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:34:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:34:06.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:34:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:34:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:34:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:34:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:34:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:34:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.840 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.641479463000003, 2024-09-11T05:34:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:34:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:34:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:34:06.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:34:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:34:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:34:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:34:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:34:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:34:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:34:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:34:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:34:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:34:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.845 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.641461391999997, 2024-09-11T05:34:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:34:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:34:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:34:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:34:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:34:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:34:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:34:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:34:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:34:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:34:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:34:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:34:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:34:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:34:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:34:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:34:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.639863749, 2024-09-11T05:34:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:34:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:34:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.851 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:06.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:06.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:34:06.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:34:06.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:34:06.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:34:06.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:34:06.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:34:06.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:34:06.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:34:06.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:34:06.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:34:06.855 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.855 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.855 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.855 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.855 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:06.855 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.639843423000002, 2024-09-11T05:34:06.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:34:06.856 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.856 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.856 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.856 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.856 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.856 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.856 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:34:06.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.856 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:06.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:06.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:06.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:06.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:34:06.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:34:06.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:34:06.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:34:06.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:34:06.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:34:06.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:34:06.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.860 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.860 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.860 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:06.860 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.639804425000001, 2024-09-11T05:34:06.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:34:06.860 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.860 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.860 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:34:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:34:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:34:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:34:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:34:06.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:34:06.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:34:06.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:34:06.864 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.864 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.864 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.865 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.865 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:06.865 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.639783782999999, 2024-09-11T05:34:06.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:34:06.865 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.865 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.865 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.865 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.865 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.865 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.865 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:34:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:34:06.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:34:06.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:34:06.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:34:06.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:34:06.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:34:06.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:34:06.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:06.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:34:06.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:34:06.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:34:06.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:34:06.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:34:06.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:34:06.869 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.869 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.869 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.869 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.639660919999997, 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:34:06.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:34:06.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:34:06.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:34:06.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:34:06.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:34:06.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:34:06.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:34:06.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:34:06.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:34:06.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:34:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:34:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.639501363000001, 2024-09-11T05:34:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:34:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:06.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:34:06.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:34:06.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:34:06.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:34:06.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:34:06.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.879 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.879 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:06.879 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.637816696000002, 2024-09-11T05:34:06.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:34:06.879 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.879 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:34:06.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.879 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:06.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:06.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:34:06.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:34:06.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:34:06.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:34:06.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:34:06.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:34:06.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:34:06.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:34:06.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:34:06.883 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.883 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.883 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.883 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.883 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:06.883 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.637788690999997, 2024-09-11T05:34:06.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:34:06.884 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.884 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.884 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.884 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.884 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.884 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.884 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:34:06.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.884 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:06.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:06.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:34:06.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:34:06.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:34:06.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:34:06.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:34:06.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:34:06.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:34:06.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:34:06.888 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.888 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.888 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.889 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44388 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8118272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.889 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:06.889 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.636397357999996, 2024-09-11T05:34:06.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044546074999999997, 2024-09-11T05:34:06.889 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.889 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.889 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.889 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.889 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.889 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.889 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44388 2024-09-11T05:34:06.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.890 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:06.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:06.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172487+0000", 2024-09-11T05:34:06.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-11T05:34:06.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172490+0000", 2024-09-11T05:34:06.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5090000000000002e-06 2024-09-11T05:34:06.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172497+0000", 2024-09-11T05:34:06.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:34:06.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172502+0000", 2024-09-11T05:34:06.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2000000000000002e-06 2024-09-11T05:34:06.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216878+0000", 2024-09-11T05:34:06.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044375900000000003 2024-09-11T05:34:06.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216925+0000", 2024-09-11T05:34:06.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7058999999999998e-05 2024-09-11T05:34:06.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216982+0000", 2024-09-11T05:34:06.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6932000000000003e-05 2024-09-11T05:34:06.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.893 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.894 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.894 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:06.894 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.636322227999997, 2024-09-11T05:34:06.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:34:06.894 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.894 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.894 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.894 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.894 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.894 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.894 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:34:06.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:34:06.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:34:06.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:34:06.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:34:06.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:34:06.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:34:06.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:34:06.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:34:06.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:34:06.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:34:06.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:34:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:34:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:34:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:34:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.636136927000003, 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:06.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:06.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:34:06.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:34:06.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:34:06.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:34:06.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:34:06.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:34:06.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:34:06.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:34:06.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:34:06.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:34:06.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:34:06.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:34:06.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.635965472000002, 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:06.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:06.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:06.907 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:06.908 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:06.909 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:34:06.909 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:06.909 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:34:06.910 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:06.911 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:06.909+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:06.931 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:34:06.982 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone38 from 0x8d37368 (overlap 0x4f39135) to 0x17c4529 2024-09-11T05:34:07.010 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:07.009+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:07.023 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:07.023 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:07.023 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:07.023 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:07.032 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:07.073 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-11T05:34:07.090 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:07.090 INFO:teuthology.orchestra.run.smithi070.stdout:5678 writesame 0x4ab8a2a thru 0x4ac373b data_size 0x1(0xad12 bytes) 2024-09-11T05:34:07.110 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:07.110+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:07.155 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:07.155 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:07.155 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:07.155 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:07.156 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:07.166 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:07.211 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:07.211+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:07.310 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45829 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 6995968~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:34:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.942390027000002, 2024-09-11T05:34:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031286190999999998, 2024-09-11T05:34:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.311 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45829 2024-09-11T05:34:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:34:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.312 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366835+0000", 2024-09-11T05:34:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366836+0000", 2024-09-11T05:34:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4199999999999996e-07 2024-09-11T05:34:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366838+0000", 2024-09-11T05:34:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9929999999999998e-06 2024-09-11T05:34:07.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366844+0000", 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0430000000000004e-06 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366848+0000", 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6040000000000003e-06 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398029+0000", 2024-09-11T05:34:07.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031180349 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398070+0000", 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1421999999999997e-05 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398121+0000", 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1238e-05 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45830 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7045120~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:34:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.942370455999999, 2024-09-11T05:34:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031383187999999999, 2024-09-11T05:34:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45830 2024-09-11T05:34:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:34:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:34:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366855+0000", 2024-09-11T05:34:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.51e-07 2024-09-11T05:34:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366857+0000", 2024-09-11T05:34:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9259999999999999e-06 2024-09-11T05:34:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366863+0000", 2024-09-11T05:34:07.318 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7069999999999997e-06 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366868+0000", 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7380000000000002e-06 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398147+0000", 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031279757999999998 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.319 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398189+0000", 2024-09-11T05:34:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1597999999999997e-05 2024-09-11T05:34:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398238+0000", 2024-09-11T05:34:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.901e-05 2024-09-11T05:34:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45831 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7094272~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:34:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.942351328999997, 2024-09-11T05:34:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031481960000000003, 2024-09-11T05:34:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45831 2024-09-11T05:34:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.321 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:34:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:34:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366874+0000", 2024-09-11T05:34:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4200000000000002e-07 2024-09-11T05:34:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366876+0000", 2024-09-11T05:34:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0020000000000001e-06 2024-09-11T05:34:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.323 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366882+0000", 2024-09-11T05:34:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7690000000000002e-06 2024-09-11T05:34:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366887+0000", 2024-09-11T05:34:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119999999999999e-06 2024-09-11T05:34:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398263+0000", 2024-09-11T05:34:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031376023000000003 2024-09-11T05:34:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.324 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398306+0000", 2024-09-11T05:34:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3220999999999998e-05 2024-09-11T05:34:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398356+0000", 2024-09-11T05:34:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9891000000000001e-05 2024-09-11T05:34:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45832 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7143424~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:34:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.942332708999999, 2024-09-11T05:34:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031581625000000002, 2024-09-11T05:34:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45832 2024-09-11T05:34:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.326 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:34:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.366893+0000", 2024-09-11T05:34:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.327 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367199+0000", 2024-09-11T05:34:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00030624 2024-09-11T05:34:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367205+0000", 2024-09-11T05:34:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1090000000000003e-06 2024-09-11T05:34:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367213+0000", 2024-09-11T05:34:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8979999999999996e-06 2024-09-11T05:34:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367219+0000", 2024-09-11T05:34:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6000000000000003e-06 2024-09-11T05:34:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398380+0000", 2024-09-11T05:34:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031160931999999999 2024-09-11T05:34:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398425+0000", 2024-09-11T05:34:07.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4548000000000001e-05 2024-09-11T05:34:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398474+0000", 2024-09-11T05:34:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9298000000000001e-05 2024-09-11T05:34:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45833 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7192576~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.330 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.941991424000001, 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031369229999999998, 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45833 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:34:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:34:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367234+0000", 2024-09-11T05:34:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9400000000000005e-07 2024-09-11T05:34:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367237+0000", 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4439999999999998e-06 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367243+0000", 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.6170000000000003e-06 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367249+0000", 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2240000000000003e-06 2024-09-11T05:34:07.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398507+0000", 2024-09-11T05:34:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031257994999999997 2024-09-11T05:34:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398551+0000", 2024-09-11T05:34:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4178000000000003e-05 2024-09-11T05:34:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398603+0000", 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2178000000000001e-05 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45834 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7241728~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.941969692999997, 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031466477, 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.335 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45834 2024-09-11T05:34:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:34:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:34:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367256+0000", 2024-09-11T05:34:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5200000000000002e-07 2024-09-11T05:34:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367258+0000", 2024-09-11T05:34:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1110000000000002e-06 2024-09-11T05:34:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367264+0000", 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0290000000000002e-06 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367269+0000", 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398628+0000", 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031358587 2024-09-11T05:34:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398671+0000", 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3035999999999999e-05 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398722+0000", 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1511000000000002e-05 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.339 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45835 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7290880~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:34:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.941950118999998, 2024-09-11T05:34:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031565589999999998, 2024-09-11T05:34:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45835 2024-09-11T05:34:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.340 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367275+0000", 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367276+0000", 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.96e-07 2024-09-11T05:34:07.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367278+0000", 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0279999999999999e-06 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367283+0000", 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8340000000000004e-06 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367289+0000", 2024-09-11T05:34:07.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6559999999999997e-06 2024-09-11T05:34:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398747+0000", 2024-09-11T05:34:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031458211999999999 2024-09-11T05:34:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398788+0000", 2024-09-11T05:34:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0998999999999998e-05 2024-09-11T05:34:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398841+0000", 2024-09-11T05:34:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2465e-05 2024-09-11T05:34:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45836 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7340032~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:34:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.941930042999999, 2024-09-11T05:34:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031663635000000002, 2024-09-11T05:34:07.344 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45836 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.345 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.367295+0000", 2024-09-11T05:34:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368490+0000", 2024-09-11T05:34:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0011952410000000001 2024-09-11T05:34:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368494+0000", 2024-09-11T05:34:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4649999999999999e-06 2024-09-11T05:34:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368503+0000", 2024-09-11T05:34:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0920000000000004e-06 2024-09-11T05:34:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368509+0000", 2024-09-11T05:34:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4130000000000003e-06 2024-09-11T05:34:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398865+0000", 2024-09-11T05:34:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030355473000000001 2024-09-11T05:34:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398907+0000", 2024-09-11T05:34:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1882999999999999e-05 2024-09-11T05:34:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.398959+0000", 2024-09-11T05:34:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2067999999999997e-05 2024-09-11T05:34:07.348 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45844 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7733248~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.940550899999998, 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031248306, 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.349 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45844 2024-09-11T05:34:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:34:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368674+0000", 2024-09-11T05:34:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368675+0000", 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4700000000000001e-07 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368680+0000", 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3750000000000002e-06 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368687+0000", 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3080000000000004e-06 2024-09-11T05:34:07.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368692+0000", 2024-09-11T05:34:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2329999999999997e-06 2024-09-11T05:34:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399832+0000", 2024-09-11T05:34:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031139723000000001 2024-09-11T05:34:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.352 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399872+0000", 2024-09-11T05:34:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0880000000000002e-05 2024-09-11T05:34:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399923+0000", 2024-09-11T05:34:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.024e-05 2024-09-11T05:34:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45845 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7782400~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:34:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.940527066000001, 2024-09-11T05:34:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031339210999999999, 2024-09-11T05:34:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.354 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45845 2024-09-11T05:34:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:34:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368698+0000", 2024-09-11T05:34:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368699+0000", 2024-09-11T05:34:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4200000000000001e-07 2024-09-11T05:34:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368701+0000", 2024-09-11T05:34:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0389999999999999e-06 2024-09-11T05:34:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368706+0000", 2024-09-11T05:34:07.356 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5570000000000003e-06 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368711+0000", 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0930000000000002e-06 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399947+0000", 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031235810999999999 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.357 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.399989+0000", 2024-09-11T05:34:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1430000000000001e-05 2024-09-11T05:34:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400037+0000", 2024-09-11T05:34:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8838999999999998e-05 2024-09-11T05:34:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45846 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7831552~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.358 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:34:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.940507965999998, 2024-09-11T05:34:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031434484999999998, 2024-09-11T05:34:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45846 2024-09-11T05:34:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.359 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:34:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368717+0000", 2024-09-11T05:34:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368718+0000", 2024-09-11T05:34:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6600000000000002e-07 2024-09-11T05:34:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368720+0000", 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0140000000000001e-06 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368726+0000", 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8719999999999999e-06 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368730+0000", 2024-09-11T05:34:07.361 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:34:07.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.362 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.362 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.362 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400061+0000", 2024-09-11T05:34:07.362 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031331141 2024-09-11T05:34:07.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.362 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.362 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.362 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400102+0000", 2024-09-11T05:34:07.362 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0419e-05 2024-09-11T05:34:07.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.362 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.362 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400152+0000", 2024-09-11T05:34:07.363 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9926000000000003e-05 2024-09-11T05:34:07.363 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.363 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.363 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.363 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45847 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7880704~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.363 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:34:07.363 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.940488854999998, 2024-09-11T05:34:07.363 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031531412000000002, 2024-09-11T05:34:07.363 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.363 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45847 2024-09-11T05:34:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:34:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368736+0000", 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368737+0000", 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3700000000000001e-07 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368739+0000", 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.81e-06 2024-09-11T05:34:07.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368744+0000", 2024-09-11T05:34:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8919999999999997e-06 2024-09-11T05:34:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368749+0000", 2024-09-11T05:34:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7149999999999997e-06 2024-09-11T05:34:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400176+0000", 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031426740000000002 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400218+0000", 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2338e-05 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400268+0000", 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9580000000000003e-05 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.367 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45848 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7929856~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:34:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.940470058999999, 2024-09-11T05:34:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031629162000000002, 2024-09-11T05:34:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.368 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45848 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368755+0000", 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368756+0000", 2024-09-11T05:34:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5900000000000003e-07 2024-09-11T05:34:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368758+0000", 2024-09-11T05:34:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.951e-06 2024-09-11T05:34:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368763+0000", 2024-09-11T05:34:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.801e-06 2024-09-11T05:34:07.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368768+0000", 2024-09-11T05:34:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1100000000000002e-06 2024-09-11T05:34:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400292+0000", 2024-09-11T05:34:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031524033 2024-09-11T05:34:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.371 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400336+0000", 2024-09-11T05:34:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3272999999999997e-05 2024-09-11T05:34:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400384+0000", 2024-09-11T05:34:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8634999999999998e-05 2024-09-11T05:34:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45849 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 7979008~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.372 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.940450667, 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031732415, 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45849 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.373 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:34:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:34:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368775+0000", 2024-09-11T05:34:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0100000000000005e-07 2024-09-11T05:34:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.374 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368777+0000", 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0260000000000002e-06 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368783+0000", 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7089999999999999e-06 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368788+0000", 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4029999999999998e-06 2024-09-11T05:34:07.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400409+0000", 2024-09-11T05:34:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031620663 2024-09-11T05:34:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400453+0000", 2024-09-11T05:34:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4376999999999999e-05 2024-09-11T05:34:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400507+0000", 2024-09-11T05:34:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3736000000000002e-05 2024-09-11T05:34:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45850 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8028160~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:34:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.940431205000003, 2024-09-11T05:34:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031830000999999997, 2024-09-11T05:34:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45850 2024-09-11T05:34:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:34:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.378 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368794+0000", 2024-09-11T05:34:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368795+0000", 2024-09-11T05:34:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0399999999999996e-07 2024-09-11T05:34:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368796+0000", 2024-09-11T05:34:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.933e-06 2024-09-11T05:34:07.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368803+0000", 2024-09-11T05:34:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0619999999999997e-06 2024-09-11T05:34:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368807+0000", 2024-09-11T05:34:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.685e-06 2024-09-11T05:34:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400531+0000", 2024-09-11T05:34:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031723784999999997 2024-09-11T05:34:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400573+0000", 2024-09-11T05:34:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2079999999999997e-05 2024-09-11T05:34:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400624+0000", 2024-09-11T05:34:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0952000000000003e-05 2024-09-11T05:34:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.381 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:45851 3.1e 3:795fc858:::rbd_data.112dcdbd4c7c.0000000000000002:14 [read 8077312~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:34:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.940412211999998, 2024-09-11T05:34:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031929358999999997, 2024-09-11T05:34:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.382 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 45851 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.368813+0000", 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370488+0000", 2024-09-11T05:34:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.001674743 2024-09-11T05:34:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370491+0000", 2024-09-11T05:34:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.444e-06 2024-09-11T05:34:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370500+0000", 2024-09-11T05:34:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0650000000000005e-06 2024-09-11T05:34:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.370507+0000", 2024-09-11T05:34:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:34:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400648+0000", 2024-09-11T05:34:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.030141889000000002 2024-09-11T05:34:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400691+0000", 2024-09-11T05:34:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2290999999999999e-05 2024-09-11T05:34:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:25.400742+0000", 2024-09-11T05:34:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1717e-05 2024-09-11T05:34:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.386 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145920 3.18 3:1a554328:::rbd_data.112d9958e8ce.000000000000000a:1b [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:34:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:34:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 21.834402702999999, 2024-09-11T05:34:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031231273, 2024-09-11T05:34:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145920 2024-09-11T05:34:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.387 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:34:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:34:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474823+0000", 2024-09-11T05:34:07.388 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:34:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474824+0000", 2024-09-11T05:34:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.046e-06 2024-09-11T05:34:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474827+0000", 2024-09-11T05:34:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3859999999999999e-06 2024-09-11T05:34:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.389 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474830+0000", 2024-09-11T05:34:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5790000000000002e-06 2024-09-11T05:34:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.505951+0000", 2024-09-11T05:34:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031121328 2024-09-11T05:34:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.505995+0000", 2024-09-11T05:34:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4175000000000003e-05 2024-09-11T05:34:07.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506054+0000", 2024-09-11T05:34:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8553e-05 2024-09-11T05:34:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145921 3.18 3:1a554328:::rbd_data.112d9958e8ce.000000000000000a:1b [read 180224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:34:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:34:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 21.834392587, 2024-09-11T05:34:07.391 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031340051000000001, 2024-09-11T05:34:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145921 2024-09-11T05:34:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:34:07.392 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:34:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474833+0000", 2024-09-11T05:34:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.16e-07 2024-09-11T05:34:07.393 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474834+0000", 2024-09-11T05:34:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.08e-06 2024-09-11T05:34:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474837+0000", 2024-09-11T05:34:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.954e-06 2024-09-11T05:34:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.394 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474839+0000", 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506080+0000", 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031240232 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506119+0000", 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9065e-05 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506173+0000", 2024-09-11T05:34:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4054000000000001e-05 2024-09-11T05:34:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145922 3.18 3:1a554328:::rbd_data.112d9958e8ce.000000000000000a:1b [read 200704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:34:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474842+0000", 2024-09-11T05:34:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 21.834382966, 2024-09-11T05:34:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031453192999999997, 2024-09-11T05:34:07.396 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145922 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474842+0000", 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.397 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474842+0000", 2024-09-11T05:34:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474843+0000", 2024-09-11T05:34:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.03e-07 2024-09-11T05:34:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.398 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474844+0000", 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0589999999999999e-06 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474847+0000", 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3160000000000001e-06 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474849+0000", 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4549999999999998e-06 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.399 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506196+0000", 2024-09-11T05:34:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031346442000000002 2024-09-11T05:34:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506239+0000", 2024-09-11T05:34:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3027e-05 2024-09-11T05:34:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506295+0000", 2024-09-11T05:34:07.400 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6691000000000003e-05 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:145933 3.18 3:1952fba0:::rbd_data.112d55d87bfc.0000000000000007:head [stat,truncate 155648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 21.834373162999999, 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.03262636, 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.401 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 145933 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474852+0000", 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474853+0000", 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.17e-06 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474857+0000", 2024-09-11T05:34:07.403 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1039999999999998e-06 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.474860+0000", 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8670000000000004e-06 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506326+0000", 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.031465323000000003 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506367+0000", 2024-09-11T05:34:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1155000000000002e-05 2024-09-11T05:34:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 6", 2024-09-11T05:34:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.506445+0000", 2024-09-11T05:34:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8347000000000001e-05 2024-09-11T05:34:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507206+0000", 2024-09-11T05:34:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00076036099999999998 2024-09-11T05:34:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507390+0000", 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00018462799999999999 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507440+0000", 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9604999999999997e-05 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.507478+0000", 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8593999999999997e-05 2024-09-11T05:34:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.407 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.407 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:07.408 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:07.409 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:07.408+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:07.412 INFO:teuthology.orchestra.run.smithi070.stdout:5679 writesame 0xb1db48f thru 0xb1ea2b6 data_size 0x4(0xee28 bytes) 2024-09-11T05:34:07.421 INFO:teuthology.orchestra.run.smithi070.stdout:5682 trunc from 0xb1ea2b7 to 0x3e3dcb6 2024-09-11T05:34:07.509 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:07.509+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:07.552 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:07.552 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:07.552 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:07.552 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:07.561 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:07.646 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:07.646+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:07.708 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:07.708 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:07.708 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:07.708 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:07.709 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:07.709 INFO:teuthology.orchestra.run.smithi070.stdout:5684 writesame 0x45d2431 thru 0x45d2cb1 data_size 0x1(0x881 bytes) 2024-09-11T05:34:07.710 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:07.709+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:07.711 INFO:teuthology.orchestra.run.smithi070.stdout:5685 read 0x22f9d2c thru 0x22fbffd (0x22d2 bytes) 2024-09-11T05:34:07.711 INFO:teuthology.orchestra.run.smithi070.stdout:5686 read 0x34c0261 thru 0x34cae2f (0xabcf bytes) 2024-09-11T05:34:07.713 INFO:teuthology.orchestra.run.smithi070.stdout:5688 read 0x18cb832 thru 0x18db268 (0xfa37 bytes) 2024-09-11T05:34:07.716 INFO:teuthology.orchestra.run.smithi070.stdout:5690 read 0x3a32b21 thru 0x3a3fdff (0xd2df bytes) 2024-09-11T05:34:07.718 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:07.732 INFO:teuthology.orchestra.run.smithi070.stdout:5691 write 0xb42a24a thru 0xb430712 (0x64c9 bytes) 2024-09-11T05:34:07.739 INFO:teuthology.orchestra.run.smithi070.stdout:5692 punch from 0x9184d80 to 0x918fe0f, (0xb08f bytes) 2024-09-11T05:34:07.740 INFO:teuthology.orchestra.run.smithi070.stdout:5693 write 0x45ead89 thru 0x45f9951 (0xebc9 bytes) 2024-09-11T05:34:07.742 INFO:teuthology.orchestra.run.smithi070.stdout:5694 punch from 0x5387cb7 to 0x538e62f, (0x6978 bytes) 2024-09-11T05:34:07.749 INFO:teuthology.orchestra.run.smithi070.stdout:5695 trunc from 0xb430713 to 0x5c62960 2024-09-11T05:34:07.760 INFO:teuthology.orchestra.run.smithi070.stdout:5697 read 0xb7c651 thru 0xb895c3 (0xcf73 bytes) 2024-09-11T05:34:07.766 INFO:teuthology.orchestra.run.smithi070.stdout:5698 trunc from 0x5c62960 to 0x9783e9a 2024-09-11T05:34:07.772 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:07.772 INFO:teuthology.orchestra.run.smithi070.stdout:5701 read 0x60e6faf thru 0x60e95f8 (0x264a bytes) 2024-09-11T05:34:07.780 INFO:teuthology.orchestra.run.smithi070.stdout:5704 writesame 0xbf8f32e thru 0xbf911eb data_size 0x5(0x1ebe bytes) 2024-09-11T05:34:07.780 INFO:teuthology.orchestra.run.smithi070.stdout:5705 write 0x26ebcdd thru 0x26fbb98 (0xfebc bytes) 2024-09-11T05:34:07.810 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:07.810+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:07.866 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:07.867 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:07.867 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:07.867 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:07.867 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.867 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116713 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13060096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.867 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:07.867 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.051511049999998, 2024-09-11T05:34:07.867 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599235, 2024-09-11T05:34:07.867 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.867 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.867 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.867 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.868 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.868 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.868 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116713 2024-09-11T05:34:07.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.868 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.868 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.868 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.868 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:07.868 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.868 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.868 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.868 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:07.869 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.869 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.869 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813321+0000", 2024-09-11T05:34:07.869 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000005e-07 2024-09-11T05:34:07.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.869 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.869 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813323+0000", 2024-09-11T05:34:07.869 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.667e-06 2024-09-11T05:34:07.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.870 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.870 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813331+0000", 2024-09-11T05:34:07.870 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6529999999999994e-06 2024-09-11T05:34:07.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.870 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.870 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.870 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813336+0000", 2024-09-11T05:34:07.870 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:34:07.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.870 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.870 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.870 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813688+0000", 2024-09-11T05:34:07.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035143199999999999 2024-09-11T05:34:07.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.871 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:07.871 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813692+0000", 2024-09-11T05:34:07.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5120000000000002e-06 2024-09-11T05:34:07.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.871 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.871 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816304+0000", 2024-09-11T05:34:07.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026115449999999998 2024-09-11T05:34:07.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.872 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.872 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816308+0000", 2024-09-11T05:34:07.872 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2370000000000003e-06 2024-09-11T05:34:07.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.872 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.872 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.872 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821720+0000", 2024-09-11T05:34:07.872 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0054114869999999 2024-09-11T05:34:07.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.872 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.872 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.872 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821724+0000", 2024-09-11T05:34:07.872 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873101+0000", 2024-09-11T05:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0513774279999999 2024-09-11T05:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873159+0000", 2024-09-11T05:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819000000000003e-05 2024-09-11T05:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.874 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873244+0000", 2024-09-11T05:34:07.874 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4300000000000003e-05 2024-09-11T05:34:07.874 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.874 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.874 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.874 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.874 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116714 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.874 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:07.874 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.051468414999999, 2024-09-11T05:34:07.874 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600505999999998, 2024-09-11T05:34:07.874 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.874 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.875 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.875 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.875 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.875 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.875 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116714 2024-09-11T05:34:07.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.875 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.875 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.875 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:07.875 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:07.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.876 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:07.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:34:07.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.876 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813366+0000", 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6919999999999998e-06 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813373+0000", 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8689999999999998e-06 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813378+0000", 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2159999999999997e-06 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.878 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813733+0000", 2024-09-11T05:34:07.878 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035530300000000001 2024-09-11T05:34:07.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.878 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.878 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:07.878 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813739+0000", 2024-09-11T05:34:07.878 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8819999999999998e-06 2024-09-11T05:34:07.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.878 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.878 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.878 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816340+0000", 2024-09-11T05:34:07.878 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002600598 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816349+0000", 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9169999999999995e-06 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821745+0000", 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005396416 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821750+0000", 2024-09-11T05:34:07.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:34:07.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873269+0000", 2024-09-11T05:34:07.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0515195159999999 2024-09-11T05:34:07.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873328+0000", 2024-09-11T05:34:07.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9222999999999999e-05 2024-09-11T05:34:07.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873413+0000", 2024-09-11T05:34:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4983999999999998e-05 2024-09-11T05:34:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116715 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13109248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.051426933999998, 2024-09-11T05:34:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0602519180000001, 2024-09-11T05:34:07.882 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.882 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.882 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.882 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.882 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.882 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.882 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116715 2024-09-11T05:34:07.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.882 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.882 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.882 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:07.883 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.883 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.883 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:07.883 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.883 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.883 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813405+0000", 2024-09-11T05:34:07.883 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.51e-07 2024-09-11T05:34:07.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.884 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.884 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813407+0000", 2024-09-11T05:34:07.884 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:34:07.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.884 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.884 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.884 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813414+0000", 2024-09-11T05:34:07.884 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.686e-06 2024-09-11T05:34:07.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.884 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.884 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.884 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813419+0000", 2024-09-11T05:34:07.884 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4249999999999997e-06 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813774+0000", 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035460800000000002 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813778+0000", 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816375+0000", 2024-09-11T05:34:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025967730000000001 2024-09-11T05:34:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816379+0000", 2024-09-11T05:34:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3780000000000003e-06 2024-09-11T05:34:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821770+0000", 2024-09-11T05:34:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053903040000001 2024-09-11T05:34:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821774+0000", 2024-09-11T05:34:07.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:34:07.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873437+0000", 2024-09-11T05:34:07.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051663155 2024-09-11T05:34:07.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873500+0000", 2024-09-11T05:34:07.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3027000000000005e-05 2024-09-11T05:34:07.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.888 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.888 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.888 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873656+0000", 2024-09-11T05:34:07.888 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015580800000000001 2024-09-11T05:34:07.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.888 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.888 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.888 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116716 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13133824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.888 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:07.888 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.051384476999999, 2024-09-11T05:34:07.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0605170350000002, 2024-09-11T05:34:07.889 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.889 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.889 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.889 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.889 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.889 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.889 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116716 2024-09-11T05:34:07.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.889 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:07.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:07.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:07.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5799999999999999e-07 2024-09-11T05:34:07.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.891 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813450+0000", 2024-09-11T05:34:07.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7659999999999999e-06 2024-09-11T05:34:07.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.891 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813458+0000", 2024-09-11T05:34:07.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7430000000000002e-06 2024-09-11T05:34:07.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813464+0000", 2024-09-11T05:34:07.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:34:07.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813814+0000", 2024-09-11T05:34:07.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035073199999999998 2024-09-11T05:34:07.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:07.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813819+0000", 2024-09-11T05:34:07.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:34:07.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816410+0000", 2024-09-11T05:34:07.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025904349999999999 2024-09-11T05:34:07.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816418+0000", 2024-09-11T05:34:07.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1610000000000003e-06 2024-09-11T05:34:07.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821794+0000", 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005376391 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821799+0000", 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4870000000000004e-06 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873697+0000", 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051898843 2024-09-11T05:34:07.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873810+0000", 2024-09-11T05:34:07.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112187 2024-09-11T05:34:07.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873964+0000", 2024-09-11T05:34:07.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015412800000000001 2024-09-11T05:34:07.895 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.895 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.895 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.896 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116717 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13158400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.896 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:07.896 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.051359392999998, 2024-09-11T05:34:07.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606806560000002, 2024-09-11T05:34:07.896 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.896 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.896 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.896 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.896 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.896 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.896 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116717 2024-09-11T05:34:07.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.897 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.897 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:07.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.897 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:07.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:07.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:34:07.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813474+0000", 2024-09-11T05:34:07.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1830000000000001e-06 2024-09-11T05:34:07.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813481+0000", 2024-09-11T05:34:07.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5540000000000003e-06 2024-09-11T05:34:07.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813491+0000", 2024-09-11T05:34:07.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0472000000000001e-05 2024-09-11T05:34:07.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813867+0000", 2024-09-11T05:34:07.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00037606 2024-09-11T05:34:07.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:07.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813873+0000", 2024-09-11T05:34:07.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.254e-06 2024-09-11T05:34:07.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816443+0000", 2024-09-11T05:34:07.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025701769999999999 2024-09-11T05:34:07.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816446+0000", 2024-09-11T05:34:07.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:34:07.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.901 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821818+0000", 2024-09-11T05:34:07.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053719830000001 2024-09-11T05:34:07.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821823+0000", 2024-09-11T05:34:07.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5560000000000001e-06 2024-09-11T05:34:07.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874006+0000", 2024-09-11T05:34:07.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05218342 2024-09-11T05:34:07.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874071+0000", 2024-09-11T05:34:07.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4369999999999995e-05 2024-09-11T05:34:07.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.905 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.905 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874152+0000", 2024-09-11T05:34:07.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1658999999999999e-05 2024-09-11T05:34:07.905 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.905 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.905 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.905 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116718 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13182976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.905 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:07.905 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.051327874999998, 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0609185380000001, 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116718 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:07.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813504+0000", 2024-09-11T05:34:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7999999999999996e-07 2024-09-11T05:34:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813506+0000", 2024-09-11T05:34:07.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2989999999999999e-06 2024-09-11T05:34:07.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813513+0000", 2024-09-11T05:34:07.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8020000000000003e-06 2024-09-11T05:34:07.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813517+0000", 2024-09-11T05:34:07.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5639999999999998e-06 2024-09-11T05:34:07.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813916+0000", 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039859800000000001 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813922+0000", 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816476+0000", 2024-09-11T05:34:07.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025538359999999999 2024-09-11T05:34:07.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816481+0000", 2024-09-11T05:34:07.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819999999999999e-06 2024-09-11T05:34:07.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821843+0000", 2024-09-11T05:34:07.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053620299999999 2024-09-11T05:34:07.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821848+0000", 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874191+0000", 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052342935 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874300+0000", 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000108764 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.912 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.912 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874422+0000", 2024-09-11T05:34:07.912 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012221399999999999 2024-09-11T05:34:07.912 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.912 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.912 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.912 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.912 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116719 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13207552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.912 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:07.912 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.051287077000001, 2024-09-11T05:34:07.912 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0611734350000002, 2024-09-11T05:34:07.912 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.913 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.913 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.913 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.913 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.913 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.913 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116719 2024-09-11T05:34:07.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.913 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:07.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813545+0000", 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2600000000000002e-07 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813547+0000", 2024-09-11T05:34:07.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3329999999999999e-06 2024-09-11T05:34:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813553+0000", 2024-09-11T05:34:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4640000000000003e-06 2024-09-11T05:34:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813558+0000", 2024-09-11T05:34:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:34:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813952+0000", 2024-09-11T05:34:07.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039390999999999997 2024-09-11T05:34:07.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.916 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:07.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813955+0000", 2024-09-11T05:34:07.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.858e-06 2024-09-11T05:34:07.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.916 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816524+0000", 2024-09-11T05:34:07.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002568847 2024-09-11T05:34:07.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.917 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.917 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816533+0000", 2024-09-11T05:34:07.917 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1749999999999994e-06 2024-09-11T05:34:07.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.917 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.917 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821869+0000", 2024-09-11T05:34:07.917 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053358939999999 2024-09-11T05:34:07.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.917 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.917 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821876+0000", 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874454+0000", 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052577621 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874546+0000", 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2151999999999995e-05 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874718+0000", 2024-09-11T05:34:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017183399999999999 2024-09-11T05:34:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116720 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13232128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.051265190999999, 2024-09-11T05:34:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0614845590000002, 2024-09-11T05:34:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116720 2024-09-11T05:34:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5600000000000002e-07 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813568+0000", 2024-09-11T05:34:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9089999999999998e-06 2024-09-11T05:34:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813573+0000", 2024-09-11T05:34:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2059999999999998e-06 2024-09-11T05:34:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813577+0000", 2024-09-11T05:34:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1489999999999996e-06 2024-09-11T05:34:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.923 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813987+0000", 2024-09-11T05:34:07.923 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040977800000000002 2024-09-11T05:34:07.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.923 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:07.923 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813992+0000", 2024-09-11T05:34:07.923 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1540000000000001e-06 2024-09-11T05:34:07.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.923 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.923 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816560+0000", 2024-09-11T05:34:07.923 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025680389999999998 2024-09-11T05:34:07.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816566+0000", 2024-09-11T05:34:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0679999999999996e-06 2024-09-11T05:34:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821907+0000", 2024-09-11T05:34:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005341735 2024-09-11T05:34:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821916+0000", 2024-09-11T05:34:07.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3659999999999992e-06 2024-09-11T05:34:07.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.925 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874760+0000", 2024-09-11T05:34:07.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052844713 2024-09-11T05:34:07.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.925 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874878+0000", 2024-09-11T05:34:07.925 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000117321 2024-09-11T05:34:07.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.926 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.926 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875051+0000", 2024-09-11T05:34:07.926 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017286499999999999 2024-09-11T05:34:07.926 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.926 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.926 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.926 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.926 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116721 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13256704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.927 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:07.927 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.051247836999998, 2024-09-11T05:34:07.927 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0616932019999998, 2024-09-11T05:34:07.927 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.927 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.927 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.927 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.927 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.927 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.927 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116721 2024-09-11T05:34:07.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.927 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.927 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:07.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:07.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813584+0000", 2024-09-11T05:34:07.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2e-07 2024-09-11T05:34:07.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813586+0000", 2024-09-11T05:34:07.929 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.277e-06 2024-09-11T05:34:07.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813592+0000", 2024-09-11T05:34:07.929 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5840000000000002e-06 2024-09-11T05:34:07.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813597+0000", 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2839999999999997e-06 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814028+0000", 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000430689 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814032+0000", 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3850000000000004e-06 2024-09-11T05:34:07.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.931 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.931 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.931 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816597+0000", 2024-09-11T05:34:07.931 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00256485 2024-09-11T05:34:07.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.931 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.931 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.931 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816606+0000", 2024-09-11T05:34:07.931 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:34:07.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.931 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.931 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.931 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821949+0000", 2024-09-11T05:34:07.932 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005342752 2024-09-11T05:34:07.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.932 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.932 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.932 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821954+0000", 2024-09-11T05:34:07.932 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2270000000000001e-06 2024-09-11T05:34:07.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.932 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.932 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.932 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875095+0000", 2024-09-11T05:34:07.932 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.053140669 2024-09-11T05:34:07.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.933 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.933 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.933 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875186+0000", 2024-09-11T05:34:07.933 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1391999999999995e-05 2024-09-11T05:34:07.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.933 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.933 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.933 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875277+0000", 2024-09-11T05:34:07.933 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0556000000000005e-05 2024-09-11T05:34:07.933 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.933 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.933 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116722 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13281280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.051210837999999, 2024-09-11T05:34:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.061825491, 2024-09-11T05:34:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116722 2024-09-11T05:34:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813621+0000", 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813625+0000", 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.228e-06 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813635+0000", 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5179999999999993e-06 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.937 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.937 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813641+0000", 2024-09-11T05:34:07.937 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4710000000000004e-06 2024-09-11T05:34:07.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.937 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.937 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.937 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814057+0000", 2024-09-11T05:34:07.937 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00041530099999999997 2024-09-11T05:34:07.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.937 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.937 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:07.937 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814060+0000", 2024-09-11T05:34:07.937 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-06 2024-09-11T05:34:07.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816632+0000", 2024-09-11T05:34:07.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00257186 2024-09-11T05:34:07.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.938 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816636+0000", 2024-09-11T05:34:07.938 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2150000000000003e-06 2024-09-11T05:34:07.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.938 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.939 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821977+0000", 2024-09-11T05:34:07.939 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053407110000001 2024-09-11T05:34:07.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.939 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.939 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821982+0000", 2024-09-11T05:34:07.939 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:34:07.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.939 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.939 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875307+0000", 2024-09-11T05:34:07.939 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0533247000000001 2024-09-11T05:34:07.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875366+0000", 2024-09-11T05:34:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8628999999999997e-05 2024-09-11T05:34:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875446+0000", 2024-09-11T05:34:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0026999999999998e-05 2024-09-11T05:34:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116723 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13305856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.051177859999999, 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0619630779999998, 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116723 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.941 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.942 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.942 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.942 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:07.942 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.942 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.942 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.942 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:07.942 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.942 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.942 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.942 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813654+0000", 2024-09-11T05:34:07.943 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:34:07.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.943 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.943 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.943 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813661+0000", 2024-09-11T05:34:07.943 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1890000000000001e-06 2024-09-11T05:34:07.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.943 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.943 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.943 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813675+0000", 2024-09-11T05:34:07.943 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3878e-05 2024-09-11T05:34:07.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.943 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.944 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.944 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813682+0000", 2024-09-11T05:34:07.944 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.063e-06 2024-09-11T05:34:07.944 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.944 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.944 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.944 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816666+0000", 2024-09-11T05:34:07.944 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029845679999999999 2024-09-11T05:34:07.944 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.944 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.944 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.944 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816671+0000", 2024-09-11T05:34:07.944 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:34:07.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.945 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.945 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822024+0000", 2024-09-11T05:34:07.945 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053534660000001 2024-09-11T05:34:07.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.945 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.945 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822028+0000", 2024-09-11T05:34:07.945 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7799999999999998e-06 2024-09-11T05:34:07.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.945 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.946 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875471+0000", 2024-09-11T05:34:07.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05344306 2024-09-11T05:34:07.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.946 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.946 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.946 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875531+0000", 2024-09-11T05:34:07.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0019000000000003e-05 2024-09-11T05:34:07.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.946 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.946 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.946 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875616+0000", 2024-09-11T05:34:07.946 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5304999999999997e-05 2024-09-11T05:34:07.946 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.947 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.947 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.947 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.947 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116724 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13330432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.947 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:07.947 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.051138371, 2024-09-11T05:34:07.947 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0620902609999998, 2024-09-11T05:34:07.947 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.947 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.947 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.947 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.947 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.948 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.948 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116724 2024-09-11T05:34:07.948 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.948 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.948 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.948 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.948 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:07.948 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.948 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.948 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.948 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.948 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:07.948 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.949 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.949 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.949 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:07.949 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.99e-07 2024-09-11T05:34:07.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.949 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.949 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.949 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813697+0000", 2024-09-11T05:34:07.949 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2430000000000001e-06 2024-09-11T05:34:07.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.949 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.949 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.950 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813704+0000", 2024-09-11T05:34:07.950 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2980000000000003e-06 2024-09-11T05:34:07.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.950 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.950 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.950 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813709+0000", 2024-09-11T05:34:07.950 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8130000000000003e-06 2024-09-11T05:34:07.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.950 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.950 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.950 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816702+0000", 2024-09-11T05:34:07.950 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002992864 2024-09-11T05:34:07.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.951 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.951 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.951 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816711+0000", 2024-09-11T05:34:07.951 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1840000000000005e-06 2024-09-11T05:34:07.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.951 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.951 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.951 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822050+0000", 2024-09-11T05:34:07.951 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.00533864 2024-09-11T05:34:07.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.951 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.951 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.951 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822055+0000", 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875642+0000", 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0535874220000001 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875698+0000", 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5707e-05 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.952 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.953 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875783+0000", 2024-09-11T05:34:07.953 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5362e-05 2024-09-11T05:34:07.953 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.953 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.953 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.953 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.953 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.953 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116725 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13355008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.953 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:07.953 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.051104183, 2024-09-11T05:34:07.953 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.06220984, 2024-09-11T05:34:07.953 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.953 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.954 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.954 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.954 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.954 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.954 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116725 2024-09-11T05:34:07.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.954 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.954 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.954 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.954 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:07.954 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.954 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.955 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:07.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.955 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.955 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813728+0000", 2024-09-11T05:34:07.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:34:07.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.955 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.955 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.955 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813730+0000", 2024-09-11T05:34:07.955 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6730000000000001e-06 2024-09-11T05:34:07.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.956 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.956 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813743+0000", 2024-09-11T05:34:07.956 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2833000000000001e-05 2024-09-11T05:34:07.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.956 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.956 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813749+0000", 2024-09-11T05:34:07.956 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:34:07.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.956 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.956 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.957 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816726+0000", 2024-09-11T05:34:07.957 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029772090000000002 2024-09-11T05:34:07.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.957 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.957 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.957 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816730+0000", 2024-09-11T05:34:07.957 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.518e-06 2024-09-11T05:34:07.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.957 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.957 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.957 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822074+0000", 2024-09-11T05:34:07.957 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053444030000001 2024-09-11T05:34:07.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.958 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.958 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.958 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822079+0000", 2024-09-11T05:34:07.958 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:34:07.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.958 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.958 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.958 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875807+0000", 2024-09-11T05:34:07.958 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0537284410000001 2024-09-11T05:34:07.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.958 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.958 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.958 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875858+0000", 2024-09-11T05:34:07.959 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0574000000000001e-05 2024-09-11T05:34:07.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.959 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.959 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875937+0000", 2024-09-11T05:34:07.959 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9268000000000001e-05 2024-09-11T05:34:07.959 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.959 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.959 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.959 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116974 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13185024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.959 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:07.960 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.043160347000001, 2024-09-11T05:34:07.960 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598649249999998, 2024-09-11T05:34:07.960 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.960 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.960 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.960 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.960 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.960 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.960 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116974 2024-09-11T05:34:07.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.960 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.960 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.960 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.961 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.962 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.962 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821673+0000", 2024-09-11T05:34:07.962 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.722e-06 2024-09-11T05:34:07.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.962 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.962 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.962 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821686+0000", 2024-09-11T05:34:07.962 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2974e-05 2024-09-11T05:34:07.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.962 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.962 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.962 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821692+0000", 2024-09-11T05:34:07.962 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:34:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822089+0000", 2024-09-11T05:34:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039611699999999998 2024-09-11T05:34:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822099+0000", 2024-09-11T05:34:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0029e-05 2024-09-11T05:34:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.964 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822803+0000", 2024-09-11T05:34:07.964 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000704507 2024-09-11T05:34:07.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.964 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.964 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.964 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822808+0000", 2024-09-11T05:34:07.964 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6460000000000001e-06 2024-09-11T05:34:07.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.964 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.964 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.964 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881361+0000", 2024-09-11T05:34:07.964 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0585529680000001 2024-09-11T05:34:07.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881432+0000", 2024-09-11T05:34:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:34:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881536+0000", 2024-09-11T05:34:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000103243 2024-09-11T05:34:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116975 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13209600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.043132013000001, 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.060124761, 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116975 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821700+0000", 2024-09-11T05:34:07.968 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:34:07.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.968 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.968 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821701+0000", 2024-09-11T05:34:07.968 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8369999999999999e-06 2024-09-11T05:34:07.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.968 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.968 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821708+0000", 2024-09-11T05:34:07.968 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5520000000000001e-06 2024-09-11T05:34:07.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821713+0000", 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.091e-06 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822135+0000", 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00042166399999999998 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822143+0000", 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3089999999999996e-06 2024-09-11T05:34:07.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.970 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.970 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.970 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822820+0000", 2024-09-11T05:34:07.970 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000677145 2024-09-11T05:34:07.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.970 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.970 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.970 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822824+0000", 2024-09-11T05:34:07.970 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.641e-06 2024-09-11T05:34:07.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.970 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.970 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.970 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881569+0000", 2024-09-11T05:34:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.058744785 2024-09-11T05:34:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881674+0000", 2024-09-11T05:34:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000105111 2024-09-11T05:34:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881824+0000", 2024-09-11T05:34:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000150197 2024-09-11T05:34:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.971 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116976 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13234176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.043103034000001, 2024-09-11T05:34:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0603909900000001, 2024-09-11T05:34:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.972 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.973 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116976 2024-09-11T05:34:07.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.973 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.973 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.973 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.973 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:07.973 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.973 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.973 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.973 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:07.973 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.974 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.974 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.974 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821729+0000", 2024-09-11T05:34:07.974 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:34:07.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.974 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.974 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.974 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821731+0000", 2024-09-11T05:34:07.974 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0250000000000001e-06 2024-09-11T05:34:07.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.974 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.974 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.975 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821737+0000", 2024-09-11T05:34:07.975 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8839999999999997e-06 2024-09-11T05:34:07.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.975 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.975 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.975 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821743+0000", 2024-09-11T05:34:07.975 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1050000000000003e-06 2024-09-11T05:34:07.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.975 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.975 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.975 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822194+0000", 2024-09-11T05:34:07.975 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000451574 2024-09-11T05:34:07.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.976 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.976 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.976 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822203+0000", 2024-09-11T05:34:07.976 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9449999999999999e-06 2024-09-11T05:34:07.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.976 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.976 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.976 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822835+0000", 2024-09-11T05:34:07.976 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000632019 2024-09-11T05:34:07.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.976 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.976 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.977 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822839+0000", 2024-09-11T05:34:07.977 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8229999999999997e-06 2024-09-11T05:34:07.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.977 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.977 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.977 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881861+0000", 2024-09-11T05:34:07.977 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.059021776 2024-09-11T05:34:07.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.977 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.977 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.977 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881976+0000", 2024-09-11T05:34:07.977 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00011531699999999999 2024-09-11T05:34:07.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.978 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.978 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.978 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882119+0000", 2024-09-11T05:34:07.978 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000143077 2024-09-11T05:34:07.978 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.978 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.978 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.978 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.978 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.978 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116977 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13258752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.978 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:07.978 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.043051800000001, 2024-09-11T05:34:07.978 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606236920000001, 2024-09-11T05:34:07.979 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.979 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.979 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.979 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.979 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.979 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.979 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116977 2024-09-11T05:34:07.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.979 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.979 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.979 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.979 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:07.979 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.980 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.980 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.980 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:07.980 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.980 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.980 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.980 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821782+0000", 2024-09-11T05:34:07.980 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7719999999999999e-06 2024-09-11T05:34:07.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.980 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.980 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821785+0000", 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9409999999999999e-06 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821793+0000", 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821799+0000", 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4609999999999999e-06 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.981 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.982 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.982 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822246+0000", 2024-09-11T05:34:07.982 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044669000000000002 2024-09-11T05:34:07.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.982 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.982 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.982 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822254+0000", 2024-09-11T05:34:07.982 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1859999999999992e-06 2024-09-11T05:34:07.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.982 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.982 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.982 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822850+0000", 2024-09-11T05:34:07.982 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005962340000001 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822854+0000", 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5310000000000002e-06 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882149+0000", 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0592958729999999 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.983 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882253+0000", 2024-09-11T05:34:07.984 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104058 2024-09-11T05:34:07.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.984 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.984 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.984 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882403+0000", 2024-09-11T05:34:07.984 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014958800000000001 2024-09-11T05:34:07.984 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.984 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.984 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.984 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.984 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116978 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13283328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.984 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.043021577000001, 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0608297769999999, 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116978 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.985 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.986 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.987 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821813+0000", 2024-09-11T05:34:07.987 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:34:07.987 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.987 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.987 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.987 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821820+0000", 2024-09-11T05:34:07.987 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3669999999999999e-06 2024-09-11T05:34:07.987 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.987 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.987 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.987 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821825+0000", 2024-09-11T05:34:07.987 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5119999999999999e-06 2024-09-11T05:34:07.987 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.988 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.988 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.988 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822273+0000", 2024-09-11T05:34:07.988 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044727900000000003 2024-09-11T05:34:07.988 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.988 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.988 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.988 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822278+0000", 2024-09-11T05:34:07.988 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7529999999999998e-06 2024-09-11T05:34:07.988 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.988 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.988 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.988 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822865+0000", 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005861579999999 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822868+0000", 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4659999999999999e-06 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882434+0000", 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0595660170000001 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.989 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.990 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882502+0000", 2024-09-11T05:34:07.990 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7442999999999998e-05 2024-09-11T05:34:07.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.990 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.990 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.990 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882639+0000", 2024-09-11T05:34:07.990 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013779999999999999 2024-09-11T05:34:07.990 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.990 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.990 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.990 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.990 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116980 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13332480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.991 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:07.991 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.041482054999999, 2024-09-11T05:34:07.991 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598269180000002, 2024-09-11T05:34:07.991 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.991 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.991 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.991 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.991 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.991 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.991 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116980 2024-09-11T05:34:07.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.991 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.991 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.992 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.992 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:07.992 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.992 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.992 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.992 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:07.992 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823350+0000", 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823352+0000", 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5459999999999998e-06 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823360+0000", 2024-09-11T05:34:07.993 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4359999999999996e-06 2024-09-11T05:34:07.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.994 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.994 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:07.994 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823365+0000", 2024-09-11T05:34:07.994 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3079999999999998e-06 2024-09-11T05:34:07.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.994 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.994 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.994 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823418+0000", 2024-09-11T05:34:07.994 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2735999999999998e-05 2024-09-11T05:34:07.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.994 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.994 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.995 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823423+0000", 2024-09-11T05:34:07.995 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3410000000000002e-06 2024-09-11T05:34:07.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.995 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.995 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.995 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822895+0000", 2024-09-11T05:34:07.995 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99947249000000005 2024-09-11T05:34:07.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.995 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.995 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:07.995 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822899+0000", 2024-09-11T05:34:07.995 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6169999999999998e-06 2024-09-11T05:34:07.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882964+0000", 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0600650840000001 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883020+0000", 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5563000000000003e-05 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883176+0000", 2024-09-11T05:34:07.996 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015629500000000001 2024-09-11T05:34:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116981 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13357056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 29.041458075000001, 2024-09-11T05:34:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600075910000002, 2024-09-11T05:34:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:07.998 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:07.998 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:07.998 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116981 2024-09-11T05:34:07.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.998 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:07.998 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.998 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:07.998 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:07.998 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.998 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.998 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:07.998 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:07.999 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:07.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.999 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.999 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:07.999 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:07.999 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.01e-07 2024-09-11T05:34:07.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.999 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:07.999 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:07.999 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823376+0000", 2024-09-11T05:34:07.999 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:34:07.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:07.999 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.000 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.000 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823381+0000", 2024-09-11T05:34:08.000 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000001e-06 2024-09-11T05:34:08.000 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.000 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.000 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.000 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823386+0000", 2024-09-11T05:34:08.000 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5349999999999998e-06 2024-09-11T05:34:08.000 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.000 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.000 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.000 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823447+0000", 2024-09-11T05:34:08.000 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1277000000000003e-05 2024-09-11T05:34:08.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.001 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.001 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:08.001 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823456+0000", 2024-09-11T05:34:08.001 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8859999999999993e-06 2024-09-11T05:34:08.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.001 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.001 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.001 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822914+0000", 2024-09-11T05:34:08.001 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99945797999999997 2024-09-11T05:34:08.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.001 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.001 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:08.002 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822918+0000", 2024-09-11T05:34:08.002 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5810000000000001e-06 2024-09-11T05:34:08.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.002 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.002 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.002 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883209+0000", 2024-09-11T05:34:08.002 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0602916899999999 2024-09-11T05:34:08.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.002 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.002 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.002 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883292+0000", 2024-09-11T05:34:08.002 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2849000000000006e-05 2024-09-11T05:34:08.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.003 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.003 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.003 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883381+0000", 2024-09-11T05:34:08.003 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8585000000000007e-05 2024-09-11T05:34:08.003 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.003 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.003 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.003 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.003 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.003 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:08.005 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T05:34:08.006 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:08.006 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:08.004+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:08.084 INFO:teuthology.orchestra.run.smithi070.stdout:5706 read 0x4692bb0 thru 0x46a1dba (0xf20b bytes) 2024-09-11T05:34:08.089 INFO:teuthology.orchestra.run.smithi070.stdout:5709 trunc from 0xbf911ec to 0x7a1b2b1 2024-09-11T05:34:08.097 INFO:teuthology.orchestra.run.smithi070.stdout:5710 write 0x2a083dd thru 0x2a0d8c4 (0x54e8 bytes) 2024-09-11T05:34:08.105 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:08.105+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:08.165 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:08.165 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:08.165 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:08.165 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:08.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:08.218 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:08.218+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:08.307 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:08.307+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:08.329 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:08.337 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:08.337 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:08.337 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:08.337 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:08.337 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:08.339 INFO:teuthology.orchestra.run.smithi070.stdout:5712 write 0xa5f3bb8 thru 0xa5fc159 (0x85a2 bytes) 2024-09-11T05:34:08.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:08.355 INFO:teuthology.orchestra.run.smithi070.stdout:5715 write 0xb37f7da thru 0xb386e2c (0x7653 bytes) 2024-09-11T05:34:08.364 INFO:teuthology.orchestra.run.smithi070.stdout:5716 punch from 0x9139cd9 to 0x9142664, (0x898b bytes) 2024-09-11T05:34:08.364 INFO:teuthology.orchestra.run.smithi070.stdout:5717 punch from 0xaf7be59 to 0xaf86aa6, (0xac4d bytes) 2024-09-11T05:34:08.364 INFO:teuthology.orchestra.run.smithi070.stdout:5719 write 0x9aa2db8 thru 0x9aab653 (0x889c bytes) 2024-09-11T05:34:08.378 INFO:teuthology.orchestra.run.smithi070.stdout:5721 trunc from 0xb386e2d to 0xe1acad4 2024-09-11T05:34:08.383 INFO:teuthology.orchestra.run.smithi070.stdout:5722 read 0x6d3e85 thru 0x6dd52b (0x96a7 bytes) 2024-09-11T05:34:08.384 INFO:teuthology.orchestra.run.smithi070.stdout:5723 read 0xbee5dd6 thru 0xbeef739 (0x9964 bytes) 2024-09-11T05:34:08.384 INFO:teuthology.orchestra.run.smithi070.stdout:5725 read 0x2380a03 thru 0x238ad8a (0xa388 bytes) 2024-09-11T05:34:08.385 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:08.385 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:08.390 INFO:teuthology.orchestra.run.smithi070.stdout:5730 write 0xe1e1e33 thru 0xe1ef136 (0xd304 bytes) 2024-09-11T05:34:08.402 INFO:teuthology.orchestra.run.smithi070.stdout:5732 trunc from 0xe1ef137 to 0xd0ca741 2024-09-11T05:34:08.408 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:08.407+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:08.412 INFO:teuthology.orchestra.run.smithi070.stdout:5734 writesame 0x9f8e401 thru 0x9f9827b data_size 0x1(0x9e7b bytes) 2024-09-11T05:34:08.452 INFO:teuthology.orchestra.run.smithi070.stdout:5735 trunc from 0xd0ca741 to 0x9bff1e6 2024-09-11T05:34:08.469 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:08.469 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:08.469 INFO:teuthology.orchestra.run.smithi070.stdout:5738 writesame 0x4486e25 thru 0x4488e30 data_size 0x7(0x200c bytes) 2024-09-11T05:34:08.476 INFO:teuthology.orchestra.run.smithi070.stdout:5739 write 0x9f8e553 thru 0x9f992ac (0xad5a bytes) 2024-09-11T05:34:08.479 INFO:teuthology.orchestra.run.smithi070.stdout:5741 writesame 0x424885f thru 0x42525a7 data_size 0x1(0x9d49 bytes) 2024-09-11T05:34:08.501 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:08.501 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 57.851861225, 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.502 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.503 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.504 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:34:08.504 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:34:08.504 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.504 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.504 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.504 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:34:08.504 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:34:08.504 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.504 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.504 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.504 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:34:08.504 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:34:08.504 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.505 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.505 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.505 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:34:08.505 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:34:08.505 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.505 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.505 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.505 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:34:08.505 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:34:08.505 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.505 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.505 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.505 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.506 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.507 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:146253 3.6 3:64dbadcf:::rbd_data.112d55d87bfc.0000000000000332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-11T05:34:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 22.663046316999999, 2024-09-11T05:34:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4166483809999999, 2024-09-11T05:34:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.509 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 146253 2024-09-11T05:34:08.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.509 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.509 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.509 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.509 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:08.509 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.509 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.509 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.509 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:08.509 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.510 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.510 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.510 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837090+0000", 2024-09-11T05:34:08.510 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.73e-06 2024-09-11T05:34:08.510 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.510 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.510 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.510 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837096+0000", 2024-09-11T05:34:08.510 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3500000000000002e-06 2024-09-11T05:34:08.510 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.510 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.510 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.510 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837115+0000", 2024-09-11T05:34:08.511 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8556e-05 2024-09-11T05:34:08.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.511 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.511 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.511 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837124+0000", 2024-09-11T05:34:08.511 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6739999999999992e-06 2024-09-11T05:34:08.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.511 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.511 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.511 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837184+0000", 2024-09-11T05:34:08.511 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9960000000000002e-05 2024-09-11T05:34:08.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.512 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.512 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:34:08.512 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837188+0000", 2024-09-11T05:34:08.512 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:08.512 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.512 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.512 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.512 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840481+0000", 2024-09-11T05:34:08.512 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032924080000000001 2024-09-11T05:34:08.512 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.512 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.512 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:08.512 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840497+0000", 2024-09-11T05:34:08.513 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6140000000000001e-05 2024-09-11T05:34:08.513 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.513 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.513 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.513 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850737+0000", 2024-09-11T05:34:08.513 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0102404119999999 2024-09-11T05:34:08.513 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.513 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.513 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:08.513 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850747+0000", 2024-09-11T05:34:08.513 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7969999999999995e-06 2024-09-11T05:34:08.513 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.513 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.514 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.514 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252495+0000", 2024-09-11T05:34:08.514 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.401748131 2024-09-11T05:34:08.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.514 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.514 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.514 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252636+0000", 2024-09-11T05:34:08.514 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014118900000000001 2024-09-11T05:34:08.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.514 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.514 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:08.514 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252737+0000", 2024-09-11T05:34:08.514 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00010058 2024-09-11T05:34:08.515 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.515 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.515 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:08.515 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253433+0000", 2024-09-11T05:34:08.515 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00069601999999999999 2024-09-11T05:34:08.515 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.515 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.515 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:08.515 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253604+0000", 2024-09-11T05:34:08.515 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000170824 2024-09-11T05:34:08.515 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.515 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.515 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253649+0000", 2024-09-11T05:34:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5050999999999999e-05 2024-09-11T05:34:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253736+0000", 2024-09-11T05:34:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7509000000000005e-05 2024-09-11T05:34:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:147298 3.6 3:652e51de:::rbd_data.112d55d87bfc.0000000000000377:head [set-alloc-hint object_size 262144 write_size 262144,write 122880~2839] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-11T05:34:08.517 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:08.517 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 19.266505741, 2024-09-11T05:34:08.517 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62981612099999995, 2024-09-11T05:34:08.517 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.517 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.517 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:08.517 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.517 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.517 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.517 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 147298 2024-09-11T05:34:08.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.517 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.517 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233630+0000", 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5489999999999999e-06 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.519 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.519 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233637+0000", 2024-09-11T05:34:08.519 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.272e-06 2024-09-11T05:34:08.519 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.519 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.519 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.519 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233654+0000", 2024-09-11T05:34:08.519 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6283999999999999e-05 2024-09-11T05:34:08.519 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.519 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.519 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.519 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233662+0000", 2024-09-11T05:34:08.519 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.875e-06 2024-09-11T05:34:08.520 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.520 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.520 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.520 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233723+0000", 2024-09-11T05:34:08.520 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1501000000000006e-05 2024-09-11T05:34:08.520 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.520 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.520 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:08.521 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233732+0000", 2024-09-11T05:34:08.521 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0699999999999996e-06 2024-09-11T05:34:08.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.521 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.521 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.521 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862055+0000", 2024-09-11T05:34:08.521 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62832274799999999 2024-09-11T05:34:08.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.521 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.521 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.521 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862219+0000", 2024-09-11T05:34:08.521 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016404899999999999 2024-09-11T05:34:08.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.522 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.522 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:08.522 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862313+0000", 2024-09-11T05:34:08.522 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4105999999999997e-05 2024-09-11T05:34:08.522 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.522 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.522 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:08.522 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862981+0000", 2024-09-11T05:34:08.522 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00066744199999999997 2024-09-11T05:34:08.522 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.522 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.522 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863382+0000", 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040111200000000002 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863419+0000", 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6974000000000002e-05 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863445+0000", 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6139000000000002e-05 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.523 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151292 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543854346, 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054346481000000002, 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151292 2024-09-11T05:34:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.525 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.525 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.525 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.525 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:08.525 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.525 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.525 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.525 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.525 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:08.525 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.525 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.525 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.525 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956283+0000", 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2450000000000001e-06 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956290+0000", 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0910000000000004e-06 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.526 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956296+0000", 2024-09-11T05:34:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.947e-06 2024-09-11T05:34:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010460+0000", 2024-09-11T05:34:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054164165 2024-09-11T05:34:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010537+0000", 2024-09-11T05:34:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6965000000000006e-05 2024-09-11T05:34:08.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.528 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.528 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.528 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010626+0000", 2024-09-11T05:34:08.528 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9628000000000003e-05 2024-09-11T05:34:08.528 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.528 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.528 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151293 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1933312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543831503, 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054563858999999999, 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151293 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.529 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.530 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.530 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.530 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:08.530 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.530 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.530 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.530 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:08.530 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.530 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.530 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.530 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:08.531 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.46e-07 2024-09-11T05:34:08.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.531 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.531 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.531 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956306+0000", 2024-09-11T05:34:08.531 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2259999999999999e-06 2024-09-11T05:34:08.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.531 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.531 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.531 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956312+0000", 2024-09-11T05:34:08.531 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:34:08.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.531 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.532 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.532 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956317+0000", 2024-09-11T05:34:08.532 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:34:08.532 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.532 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.532 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.532 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010671+0000", 2024-09-11T05:34:08.532 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054353830999999998 2024-09-11T05:34:08.532 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.532 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.532 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.532 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010757+0000", 2024-09-11T05:34:08.532 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6120999999999998e-05 2024-09-11T05:34:08.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.533 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.533 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.533 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010867+0000", 2024-09-11T05:34:08.533 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000109687 2024-09-11T05:34:08.533 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.533 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.533 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.533 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.533 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151294 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2179072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.533 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:08.534 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543809640999999, 2024-09-11T05:34:08.534 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054741825000000001, 2024-09-11T05:34:08.534 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.534 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.534 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.534 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.534 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.534 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.534 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151294 2024-09-11T05:34:08.534 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.534 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.534 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.535 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.535 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:08.535 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.535 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.535 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.535 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:08.535 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.535 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.535 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.535 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.84e-07 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956326+0000", 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.483e-06 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956330+0000", 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8519999999999997e-06 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.536 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.537 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956334+0000", 2024-09-11T05:34:08.537 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4139999999999998e-06 2024-09-11T05:34:08.537 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.537 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.537 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.537 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010894+0000", 2024-09-11T05:34:08.537 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054560243000000001 2024-09-11T05:34:08.537 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.537 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.537 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.537 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010970+0000", 2024-09-11T05:34:08.537 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6138999999999997e-05 2024-09-11T05:34:08.537 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.538 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.538 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.538 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011067+0000", 2024-09-11T05:34:08.538 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6409999999999993e-05 2024-09-11T05:34:08.538 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.538 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.538 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.538 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.538 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151295 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2392064~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.538 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:08.538 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543796970000001, 2024-09-11T05:34:08.538 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054949748999999999, 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151295 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.540 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.540 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.540 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:08.540 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.540 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.540 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.540 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956338+0000", 2024-09-11T05:34:08.540 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.23e-07 2024-09-11T05:34:08.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.540 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.540 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.541 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956339+0000", 2024-09-11T05:34:08.541 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.243e-06 2024-09-11T05:34:08.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.541 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.541 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.541 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956342+0000", 2024-09-11T05:34:08.541 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.473e-06 2024-09-11T05:34:08.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.541 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.541 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.541 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956345+0000", 2024-09-11T05:34:08.541 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:34:08.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.542 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.542 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.542 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011109+0000", 2024-09-11T05:34:08.542 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054763698999999999 2024-09-11T05:34:08.542 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.542 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.542 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.542 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011188+0000", 2024-09-11T05:34:08.542 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8887999999999994e-05 2024-09-11T05:34:08.542 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.542 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.542 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011287+0000", 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9504000000000001e-05 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151296 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.54378586, 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055045187000000002, 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.543 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151296 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.544 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:08.545 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.545 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.545 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.545 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956349+0000", 2024-09-11T05:34:08.545 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:08.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.545 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.545 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.545 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956350+0000", 2024-09-11T05:34:08.545 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:34:08.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.545 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.546 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.546 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956353+0000", 2024-09-11T05:34:08.546 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.016e-06 2024-09-11T05:34:08.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.546 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.546 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.546 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956355+0000", 2024-09-11T05:34:08.546 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5509999999999998e-06 2024-09-11T05:34:08.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.546 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.546 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.546 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011303+0000", 2024-09-11T05:34:08.546 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054947306000000001 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011342+0000", 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9057999999999998e-05 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011394+0000", 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1925999999999997e-05 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.548 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.548 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151297 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2818048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.548 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:08.548 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543775929000001, 2024-09-11T05:34:08.548 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055238158000000002, 2024-09-11T05:34:08.548 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.548 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.548 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.548 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.548 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.548 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.548 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151297 2024-09-11T05:34:08.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.549 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.549 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.549 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.549 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:08.549 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.549 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.549 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.549 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.549 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:08.549 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.549 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.549 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.549 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.550 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956359+0000", 2024-09-11T05:34:08.550 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:08.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.550 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.550 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.550 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956360+0000", 2024-09-11T05:34:08.550 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1030000000000001e-06 2024-09-11T05:34:08.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.550 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.550 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.550 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956363+0000", 2024-09-11T05:34:08.550 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.021e-06 2024-09-11T05:34:08.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956365+0000", 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4770000000000002e-06 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011425+0000", 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055059967000000001 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011506+0000", 2024-09-11T05:34:08.551 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1063000000000006e-05 2024-09-11T05:34:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011597+0000", 2024-09-11T05:34:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0299999999999999e-05 2024-09-11T05:34:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151298 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3031040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543765963, 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055425825999999997, 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151298 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956369+0000", 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4400000000000001e-07 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956370+0000", 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.068e-06 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956373+0000", 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0419999999999998e-06 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956375+0000", 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011631+0000", 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055255116999999999 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011703+0000", 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2554999999999999e-05 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011794+0000", 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1119999999999995e-05 2024-09-11T05:34:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151299 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3276800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543754660999999, 2024-09-11T05:34:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055567477999999997, 2024-09-11T05:34:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151299 2024-09-11T05:34:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956382+0000", 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.72e-06 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956386+0000", 2024-09-11T05:34:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0990000000000001e-06 2024-09-11T05:34:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956390+0000", 2024-09-11T05:34:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.318e-06 2024-09-11T05:34:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011823+0000", 2024-09-11T05:34:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055432976000000002 2024-09-11T05:34:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011882+0000", 2024-09-11T05:34:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8656999999999998e-05 2024-09-11T05:34:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011947+0000", 2024-09-11T05:34:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5177000000000003e-05 2024-09-11T05:34:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151300 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3489792~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543738193999999, 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055745232999999998, 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151300 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956397+0000", 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:34:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956398+0000", 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.869e-06 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956404+0000", 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956407+0000", 2024-09-11T05:34:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.191e-06 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011981+0000", 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055573553999999997 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012051+0000", 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9542999999999995e-05 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012141+0000", 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0845000000000002e-05 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151301 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3702784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543723265000001, 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055834747999999997, 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151301 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:34:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956413+0000", 2024-09-11T05:34:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2810000000000001e-06 2024-09-11T05:34:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956416+0000", 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1559999999999999e-06 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956418+0000", 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012155+0000", 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055736651999999998 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012193+0000", 2024-09-11T05:34:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7848000000000001e-05 2024-09-11T05:34:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012246+0000", 2024-09-11T05:34:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3041000000000003e-05 2024-09-11T05:34:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151302 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3915776~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543713162, 2024-09-11T05:34:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056035532999999998, 2024-09-11T05:34:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151302 2024-09-11T05:34:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956426+0000", 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.853e-06 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956430+0000", 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3699999999999999e-06 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956432+0000", 2024-09-11T05:34:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5979999999999999e-06 2024-09-11T05:34:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012281+0000", 2024-09-11T05:34:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055848644000000003 2024-09-11T05:34:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012358+0000", 2024-09-11T05:34:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6662000000000006e-05 2024-09-11T05:34:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012457+0000", 2024-09-11T05:34:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9197999999999995e-05 2024-09-11T05:34:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151303 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4128768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543698580000001, 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056186709000000001, 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151303 2024-09-11T05:34:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956437+0000", 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.201e-06 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956440+0000", 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-06 2024-09-11T05:34:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956443+0000", 2024-09-11T05:34:08.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5909999999999998e-06 2024-09-11T05:34:08.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012494+0000", 2024-09-11T05:34:08.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056051541000000003 2024-09-11T05:34:08.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012558+0000", 2024-09-11T05:34:08.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3347000000000002e-05 2024-09-11T05:34:08.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012622+0000", 2024-09-11T05:34:08.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4760999999999999e-05 2024-09-11T05:34:08.581 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.581 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.581 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.581 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151304 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.581 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543688523, 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056360149999999998, 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151304 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.582 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:08.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.583 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.583 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.583 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:08.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.583 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.583 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.583 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:08.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:08.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.583 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956447+0000", 2024-09-11T05:34:08.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.153e-06 2024-09-11T05:34:08.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956450+0000", 2024-09-11T05:34:08.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9909999999999998e-06 2024-09-11T05:34:08.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956453+0000", 2024-09-11T05:34:08.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.447e-06 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012660+0000", 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056207510000000002 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012741+0000", 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0734000000000003e-05 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012806+0000", 2024-09-11T05:34:08.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5087999999999998e-05 2024-09-11T05:34:08.586 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.586 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.586 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.586 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151305 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4587520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.586 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:08.586 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543678762000001, 2024-09-11T05:34:08.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056476407999999999, 2024-09-11T05:34:08.586 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.586 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.586 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151305 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:08.587 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.588 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.588 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.588 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:08.588 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:08.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.588 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.588 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.588 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956457+0000", 2024-09-11T05:34:08.588 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.353e-06 2024-09-11T05:34:08.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.588 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956460+0000", 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0060000000000001e-06 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956463+0000", 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.452e-06 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012834+0000", 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056370917999999999 2024-09-11T05:34:08.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012877+0000", 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000999999999997e-05 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012932+0000", 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5470000000000003e-05 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.591 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151306 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4800512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.591 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:08.591 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543668781999999, 2024-09-11T05:34:08.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056579203000000002, 2024-09-11T05:34:08.591 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.591 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.591 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.591 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.591 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.591 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.591 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151306 2024-09-11T05:34:08.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.591 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:08.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.28e-07 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956467+0000", 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.088e-06 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956470+0000", 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0240000000000002e-06 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956472+0000", 2024-09-11T05:34:08.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4609999999999998e-06 2024-09-11T05:34:08.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012953+0000", 2024-09-11T05:34:08.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056480524999999997 2024-09-11T05:34:08.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012994+0000", 2024-09-11T05:34:08.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1394999999999999e-05 2024-09-11T05:34:08.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013045+0000", 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0482000000000002e-05 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151307 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5013504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543659113, 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056680525000000002, 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.595 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151307 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.597 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:08.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.597 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.597 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:08.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:34:08.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.597 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.597 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956476+0000", 2024-09-11T05:34:08.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0359999999999999e-06 2024-09-11T05:34:08.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956479+0000", 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8899999999999999e-06 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956482+0000", 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5380000000000001e-06 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013065+0000", 2024-09-11T05:34:08.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056582983000000003 2024-09-11T05:34:08.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013104+0000", 2024-09-11T05:34:08.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9119999999999998e-05 2024-09-11T05:34:08.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013156+0000", 2024-09-11T05:34:08.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1743999999999998e-05 2024-09-11T05:34:08.599 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.599 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.599 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151308 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5226496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 14.543641782, 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056772738000000003, 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151308 2024-09-11T05:34:08.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.601 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:08.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:08.601 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:08.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:08.601 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:08.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:08.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2599999999999998e-07 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956495+0000", 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9750000000000001e-06 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956499+0000", 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5179999999999998e-06 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956502+0000", 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7530000000000002e-06 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013177+0000", 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056674536999999997 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013215+0000", 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8578999999999998e-05 2024-09-11T05:34:08.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:08.604 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:08.604 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:08.604 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013265+0000", 2024-09-11T05:34:08.604 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0049999999999997e-05 2024-09-11T05:34:08.604 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.604 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.604 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.604 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:08.604 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:08.604 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:08.606 INFO:teuthology.orchestra.run.smithi070.stdout:5742 writesame 0xb4bffe0 thru 0xb4c7b4e data_size 0x3(0x7b6f bytes) 2024-09-11T05:34:08.606 INFO:teuthology.orchestra.run.smithi070.stdout:5743 read 0x5685670 thru 0x5694a23 (0xf3b4 bytes) 2024-09-11T05:34:08.606 INFO:teuthology.orchestra.run.smithi070.stdout:5748 read 0xb214a6c thru 0xb222819 (0xddae bytes) 2024-09-11T05:34:08.606 INFO:teuthology.orchestra.run.smithi070.stdout:5750 write 0x36cc532 thru 0x36cf279 (0x2d48 bytes) 2024-09-11T05:34:08.606 INFO:teuthology.orchestra.run.smithi070.stdout:5751 write 0xb0babd0 thru 0xb0bc738 (0x1b69 bytes) 2024-09-11T05:34:08.606 INFO:teuthology.orchestra.run.smithi070.stdout:5752 read 0x40905d4 thru 0x4096749 (0x6176 bytes) 2024-09-11T05:34:08.607 INFO:teuthology.orchestra.run.smithi070.stdout:5755 writesame 0x749a61a thru 0x749eedb data_size 0x2(0x48c2 bytes) 2024-09-11T05:34:08.607 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:08.607 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:08.605+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:08.609 INFO:teuthology.orchestra.run.smithi070.stdout:5756 writesame 0xbc470cc thru 0xbc53b2e data_size 0x1(0xca63 bytes) 2024-09-11T05:34:08.609 INFO:teuthology.orchestra.run.smithi070.stdout:5761 clone 40 order 23 su 4194304 sc 15 2024-09-11T05:34:08.706 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:08.706+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:08.709 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:08.709 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:08.718 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:08.752 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 5, 6, 7] out_osds: [4, 3] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-11T05:34:08.753 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:34:08.753 INFO:tasks.thrashosds.thrasher:Removing osd 7, in_osds are: [0, 1, 2, 5, 6, 7] 2024-09-11T05:34:08.753 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 7 2024-09-11T05:34:08.807 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:08.806+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:08.823 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:08.823 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:08.823 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:08.824 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:08.824 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:08.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:08.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:34:08.917 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:08.917+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:08.989 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116524 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175449403999998, 2024-09-11T05:34:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344630100000001, 2024-09-11T05:34:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116524 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811270+0000", 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811272+0000", 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811278+0000", 2024-09-11T05:34:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1970000000000001e-06 2024-09-11T05:34:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811283+0000", 2024-09-11T05:34:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-09-11T05:34:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813113+0000", 2024-09-11T05:34:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001830302 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813117+0000", 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0810000000000004e-06 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814661+0000", 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015436969999999999 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814667+0000", 2024-09-11T05:34:08.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6370000000000002e-06 2024-09-11T05:34:08.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:08.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826115+0000", 2024-09-11T05:34:08.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114479059999999 2024-09-11T05:34:08.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826123+0000", 2024-09-11T05:34:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000004e-06 2024-09-11T05:34:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845722+0000", 2024-09-11T05:34:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195993000000001 2024-09-11T05:34:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845732+0000", 2024-09-11T05:34:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T05:34:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116525 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175429522000002, 2024-09-11T05:34:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344747700000001, 2024-09-11T05:34:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116525 2024-09-11T05:34:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811290+0000", 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:34:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811295+0000", 2024-09-11T05:34:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8969999999999999e-06 2024-09-11T05:34:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811301+0000", 2024-09-11T05:34:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4919999999999998e-06 2024-09-11T05:34:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811306+0000", 2024-09-11T05:34:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999998e-06 2024-09-11T05:34:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813138+0000", 2024-09-11T05:34:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001832078 2024-09-11T05:34:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813142+0000", 2024-09-11T05:34:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0380000000000001e-06 2024-09-11T05:34:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814689+0000", 2024-09-11T05:34:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546799 2024-09-11T05:34:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814695+0000", 2024-09-11T05:34:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8739999999999997e-06 2024-09-11T05:34:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826148+0000", 2024-09-11T05:34:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114527259999999 2024-09-11T05:34:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826166+0000", 2024-09-11T05:34:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7484999999999999e-05 2024-09-11T05:34:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845756+0000", 2024-09-11T05:34:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019590609 2024-09-11T05:34:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845764+0000", 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7020000000000001e-06 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116526 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175406723999998, 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344863210000002, 2024-09-11T05:34:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116526 2024-09-11T05:34:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:34:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811315+0000", 2024-09-11T05:34:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079999999999999e-06 2024-09-11T05:34:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811320+0000", 2024-09-11T05:34:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8619999999999999e-06 2024-09-11T05:34:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811325+0000", 2024-09-11T05:34:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T05:34:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814736+0000", 2024-09-11T05:34:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034115780000000002 2024-09-11T05:34:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814744+0000", 2024-09-11T05:34:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5340000000000002e-06 2024-09-11T05:34:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826212+0000", 2024-09-11T05:34:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114682749999999 2024-09-11T05:34:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826225+0000", 2024-09-11T05:34:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:34:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845789+0000", 2024-09-11T05:34:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195649200000001 2024-09-11T05:34:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845798+0000", 2024-09-11T05:34:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9269999999999994e-06 2024-09-11T05:34:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116527 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175387791999999, 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345095849999999, 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116527 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:34:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811334+0000", 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811340+0000", 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.691e-06 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811345+0000", 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5480000000000003e-06 2024-09-11T05:34:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814767+0000", 2024-09-11T05:34:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034223190000000001 2024-09-11T05:34:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814774+0000", 2024-09-11T05:34:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:34:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826265+0000", 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114912460000001 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826274+0000", 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3909999999999998e-06 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845831+0000", 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195574080000001 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845841+0000", 2024-09-11T05:34:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3610000000000007e-06 2024-09-11T05:34:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116528 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175368353, 2024-09-11T05:34:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345287679999999, 2024-09-11T05:34:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116528 2024-09-11T05:34:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811351+0000", 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811353+0000", 2024-09-11T05:34:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:34:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811359+0000", 2024-09-11T05:34:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T05:34:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811364+0000", 2024-09-11T05:34:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000001e-06 2024-09-11T05:34:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814795+0000", 2024-09-11T05:34:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034316569999999998 2024-09-11T05:34:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814826+0000", 2024-09-11T05:34:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0587999999999999e-05 2024-09-11T05:34:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826309+0000", 2024-09-11T05:34:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011483444 2024-09-11T05:34:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826319+0000", 2024-09-11T05:34:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6849999999999996e-06 2024-09-11T05:34:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845868+0000", 2024-09-11T05:34:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195487110000001 2024-09-11T05:34:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845879+0000", 2024-09-11T05:34:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1428e-05 2024-09-11T05:34:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116529 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175349719, 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034542531, 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116529 2024-09-11T05:34:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:34:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811371+0000", 2024-09-11T05:34:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T05:34:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811377+0000", 2024-09-11T05:34:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1580000000000002e-06 2024-09-11T05:34:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811383+0000", 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.135e-06 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814851+0000", 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034684690000000001 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814858+0000", 2024-09-11T05:34:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6969999999999996e-06 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826354+0000", 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114962359999999 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826364+0000", 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0047999999999999e-05 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845903+0000", 2024-09-11T05:34:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195393610000001 2024-09-11T05:34:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845912+0000", 2024-09-11T05:34:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2269999999999993e-06 2024-09-11T05:34:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116530 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175330807000002, 2024-09-11T05:34:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345557429999999, 2024-09-11T05:34:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116530 2024-09-11T05:34:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:34:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811390+0000", 2024-09-11T05:34:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:34:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811396+0000", 2024-09-11T05:34:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:34:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811402+0000", 2024-09-11T05:34:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:34:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814879+0000", 2024-09-11T05:34:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034769290000000001 2024-09-11T05:34:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814885+0000", 2024-09-11T05:34:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.156e-06 2024-09-11T05:34:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826389+0000", 2024-09-11T05:34:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115041140000001 2024-09-11T05:34:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826397+0000", 2024-09-11T05:34:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:34:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845935+0000", 2024-09-11T05:34:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195381370000001 2024-09-11T05:34:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845944+0000", 2024-09-11T05:34:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4540000000000007e-06 2024-09-11T05:34:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116531 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175310748000001, 2024-09-11T05:34:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345764630000001, 2024-09-11T05:34:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116531 2024-09-11T05:34:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:34:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811411+0000", 2024-09-11T05:34:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811417+0000", 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811422+0000", 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3229999999999997e-06 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814906+0000", 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034835389999999999 2024-09-11T05:34:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814913+0000", 2024-09-11T05:34:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309999999999996e-06 2024-09-11T05:34:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826423+0000", 2024-09-11T05:34:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115109019999999 2024-09-11T05:34:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826431+0000", 2024-09-11T05:34:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9410000000000007e-06 2024-09-11T05:34:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845975+0000", 2024-09-11T05:34:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019543767 2024-09-11T05:34:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845984+0000", 2024-09-11T05:34:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3530000000000001e-06 2024-09-11T05:34:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116532 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.17529055, 2024-09-11T05:34:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034588131, 2024-09-11T05:34:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116532 2024-09-11T05:34:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811429+0000", 2024-09-11T05:34:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:34:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811431+0000", 2024-09-11T05:34:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9910000000000001e-06 2024-09-11T05:34:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811437+0000", 2024-09-11T05:34:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.049e-06 2024-09-11T05:34:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811441+0000", 2024-09-11T05:34:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8289999999999998e-06 2024-09-11T05:34:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814934+0000", 2024-09-11T05:34:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034927220000000002 2024-09-11T05:34:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814941+0000", 2024-09-11T05:34:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.844e-06 2024-09-11T05:34:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826480+0000", 2024-09-11T05:34:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115393260000001 2024-09-11T05:34:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826496+0000", 2024-09-11T05:34:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5406000000000001e-05 2024-09-11T05:34:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846008+0000", 2024-09-11T05:34:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.01951214 2024-09-11T05:34:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846016+0000", 2024-09-11T05:34:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4440000000000008e-06 2024-09-11T05:34:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116533 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175270995999998, 2024-09-11T05:34:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345994049999998, 2024-09-11T05:34:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116533 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811450+0000", 2024-09-11T05:34:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0940000000000002e-06 2024-09-11T05:34:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811457+0000", 2024-09-11T05:34:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2729999999999999e-06 2024-09-11T05:34:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811461+0000", 2024-09-11T05:34:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.673e-06 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814962+0000", 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035012530000000002 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814970+0000", 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0539999999999997e-06 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826536+0000", 2024-09-11T05:34:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011566049 2024-09-11T05:34:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826542+0000", 2024-09-11T05:34:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1709999999999999e-06 2024-09-11T05:34:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846039+0000", 2024-09-11T05:34:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019497168 2024-09-11T05:34:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846047+0000", 2024-09-11T05:34:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-11T05:34:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116534 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175252089000001, 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034610979, 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116534 2024-09-11T05:34:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811469+0000", 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.871e-06 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811475+0000", 2024-09-11T05:34:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1689999999999997e-06 2024-09-11T05:34:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811480+0000", 2024-09-11T05:34:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5990000000000004e-06 2024-09-11T05:34:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814990+0000", 2024-09-11T05:34:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003510876 2024-09-11T05:34:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814997+0000", 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826571+0000", 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115740230000001 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826576+0000", 2024-09-11T05:34:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-11T05:34:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846070+0000", 2024-09-11T05:34:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194937660000001 2024-09-11T05:34:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846078+0000", 2024-09-11T05:34:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.038e-06 2024-09-11T05:34:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116535 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.17523293, 2024-09-11T05:34:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346218060000001, 2024-09-11T05:34:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116535 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:34:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811488+0000", 2024-09-11T05:34:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:34:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811495+0000", 2024-09-11T05:34:09.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3960000000000003e-06 2024-09-11T05:34:09.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811500+0000", 2024-09-11T05:34:09.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9910000000000002e-06 2024-09-11T05:34:09.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815019+0000", 2024-09-11T05:34:09.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035190479999999999 2024-09-11T05:34:09.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815025+0000", 2024-09-11T05:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2550000000000003e-06 2024-09-11T05:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826604+0000", 2024-09-11T05:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115789959999999 2024-09-11T05:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826611+0000", 2024-09-11T05:34:09.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:34:09.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846100+0000", 2024-09-11T05:34:09.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194890569999999 2024-09-11T05:34:09.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846108+0000", 2024-09-11T05:34:09.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4089999999999997e-06 2024-09-11T05:34:09.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.067 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.067 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116536 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.067 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:09.067 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175213409000001, 2024-09-11T05:34:09.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034634724, 2024-09-11T05:34:09.068 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.068 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116536 2024-09-11T05:34:09.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.069 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:09.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:09.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811506+0000", 2024-09-11T05:34:09.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:09.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811508+0000", 2024-09-11T05:34:09.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T05:34:09.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811514+0000", 2024-09-11T05:34:09.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0610000000000001e-06 2024-09-11T05:34:09.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811519+0000", 2024-09-11T05:34:09.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0340000000000004e-06 2024-09-11T05:34:09.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815049+0000", 2024-09-11T05:34:09.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035296440000000002 2024-09-11T05:34:09.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815055+0000", 2024-09-11T05:34:09.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:34:09.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826642+0000", 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011586375 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826649+0000", 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846131+0000", 2024-09-11T05:34:09.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194814569999999 2024-09-11T05:34:09.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846140+0000", 2024-09-11T05:34:09.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2240000000000001e-06 2024-09-11T05:34:09.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.074 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.074 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116537 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.074 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:09.074 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175193839999999, 2024-09-11T05:34:09.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346492180000002, 2024-09-11T05:34:09.075 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.075 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.075 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.075 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116537 2024-09-11T05:34:09.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.075 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:09.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:09.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:09.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:09.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811532+0000", 2024-09-11T05:34:09.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:34:09.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811538+0000", 2024-09-11T05:34:09.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7259999999999996e-06 2024-09-11T05:34:09.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811543+0000", 2024-09-11T05:34:09.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.164e-06 2024-09-11T05:34:09.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815078+0000", 2024-09-11T05:34:09.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003534428 2024-09-11T05:34:09.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815086+0000", 2024-09-11T05:34:09.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8210000000000002e-06 2024-09-11T05:34:09.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826736+0000", 2024-09-11T05:34:09.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116503429999999 2024-09-11T05:34:09.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826751+0000", 2024-09-11T05:34:09.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4895999999999999e-05 2024-09-11T05:34:09.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846165+0000", 2024-09-11T05:34:09.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019413854 2024-09-11T05:34:09.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846174+0000", 2024-09-11T05:34:09.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3149999999999998e-06 2024-09-11T05:34:09.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.080 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.080 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116538 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.080 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:09.080 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175169150999999, 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346557729999999, 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116538 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:09.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811552+0000", 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2869999999999999e-06 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811559+0000", 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3820000000000001e-06 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811564+0000", 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815109+0000", 2024-09-11T05:34:09.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035450989999999999 2024-09-11T05:34:09.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815115+0000", 2024-09-11T05:34:09.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:09.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826780+0000", 2024-09-11T05:34:09.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116645799999999 2024-09-11T05:34:09.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826787+0000", 2024-09-11T05:34:09.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3880000000000002e-06 2024-09-11T05:34:09.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846196+0000", 2024-09-11T05:34:09.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194094069999999 2024-09-11T05:34:09.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846205+0000", 2024-09-11T05:34:09.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.884e-06 2024-09-11T05:34:09.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.086 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.086 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116539 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.086 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:09.086 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175149104999999, 2024-09-11T05:34:09.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346668399999999, 2024-09-11T05:34:09.087 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.087 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.087 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116539 2024-09-11T05:34:09.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.087 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:09.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:09.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:09.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:34:09.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811572+0000", 2024-09-11T05:34:09.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:34:09.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811578+0000", 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811583+0000", 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815137+0000", 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035540210000000001 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815144+0000", 2024-09-11T05:34:09.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5969999999999997e-06 2024-09-11T05:34:09.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826851+0000", 2024-09-11T05:34:09.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117072149999999 2024-09-11T05:34:09.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826860+0000", 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4200000000000007e-06 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846228+0000", 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019368287 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846236+0000", 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.541e-06 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.092 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.093 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116540 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.093 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:09.093 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175129681000001, 2024-09-11T05:34:09.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346767830000001, 2024-09-11T05:34:09.093 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116540 2024-09-11T05:34:09.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.094 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:09.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:09.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811591+0000", 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811598+0000", 2024-09-11T05:34:09.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T05:34:09.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811603+0000", 2024-09-11T05:34:09.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9470000000000002e-06 2024-09-11T05:34:09.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815168+0000", 2024-09-11T05:34:09.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035651810000000002 2024-09-11T05:34:09.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815174+0000", 2024-09-11T05:34:09.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T05:34:09.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826883+0000", 2024-09-11T05:34:09.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117088830000001 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826891+0000", 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7179999999999996e-06 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846258+0000", 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019367328 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846266+0000", 2024-09-11T05:34:09.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4880000000000001e-06 2024-09-11T05:34:09.099 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.099 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.099 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.099 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116541 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.099 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:09.099 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175110387, 2024-09-11T05:34:09.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346837, 2024-09-11T05:34:09.100 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.100 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.100 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.100 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.100 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.100 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.100 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116541 2024-09-11T05:34:09.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.101 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:09.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:09.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811609+0000", 2024-09-11T05:34:09.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:34:09.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811611+0000", 2024-09-11T05:34:09.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8679999999999999e-06 2024-09-11T05:34:09.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811617+0000", 2024-09-11T05:34:09.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:09.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811622+0000", 2024-09-11T05:34:09.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9370000000000003e-06 2024-09-11T05:34:09.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815201+0000", 2024-09-11T05:34:09.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035788679999999998 2024-09-11T05:34:09.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815207+0000", 2024-09-11T05:34:09.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7530000000000004e-06 2024-09-11T05:34:09.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826988+0000", 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117802300000001 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826996+0000", 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.259e-06 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846285+0000", 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192892090000001 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846292+0000", 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9399999999999996e-06 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116542 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175091476999999, 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034697618, 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.107 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.107 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116542 2024-09-11T05:34:09.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.107 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:09.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:09.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811628+0000", 2024-09-11T05:34:09.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811629+0000", 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8059999999999999e-06 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811636+0000", 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0990000000000004e-06 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811640+0000", 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6630000000000001e-06 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815230+0000", 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035897009999999998 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815237+0000", 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6590000000000001e-06 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827019+0000", 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011782261 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827026+0000", 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.605e-06 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846317+0000", 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192904270000001 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846325+0000", 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0530000000000007e-06 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116543 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.175072802999999, 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0347097559999998, 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:09.112 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116543 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811648+0000", 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:09.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811654+0000", 2024-09-11T05:34:09.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T05:34:09.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:09.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811659+0000", 2024-09-11T05:34:09.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9409999999999998e-06 2024-09-11T05:34:09.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815259+0000", 2024-09-11T05:34:09.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035993980000000002 2024-09-11T05:34:09.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815265+0000", 2024-09-11T05:34:09.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-11T05:34:09.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827049+0000", 2024-09-11T05:34:09.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117836019999999 2024-09-11T05:34:09.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:09.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827056+0000", 2024-09-11T05:34:09.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3919999999999997e-06 2024-09-11T05:34:09.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:09.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846348+0000", 2024-09-11T05:34:09.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192919039999999 2024-09-11T05:34:09.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:09.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:09.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:09.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846356+0000", 2024-09-11T05:34:09.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7449999999999995e-06 2024-09-11T05:34:09.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.118 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:09.118 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:09.118 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:09.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:09.120 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone39 from 0xbc53b2f (overlap 0x3e3dcb6) to 0x0 2024-09-11T05:34:09.120 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:09.121 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:09.121 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:09.121 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:09.122 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-11T05:34:09.099+0000 7fc03b8fe640 -1 mon.a@0(leader).osd e83 definitely_dead 0 2024-09-11T05:34:09.122 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:09.122 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:09.123 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:09.119+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:09.131 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:09.131 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:09.131 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-11T05:34:09.147 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:09.148 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:09.167 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:09.168 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:09.196 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:09.197 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:09.202 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:34:09.202 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:34:09.220 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:09.220+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:09.294 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:09.294 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:09.306 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:09.321 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:09.321+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:09.422 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:09.422+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:09.458 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:09.459 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:09.471 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:09.555 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:09.555+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:09.624 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:09.624+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:09.653 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:09.653 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:09.665 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:09.725 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:09.725+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:09.825 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:09.825+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:09.862 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:09.862 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:09.873 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:09.926 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:09.926+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:09.939 INFO:teuthology.orchestra.run.smithi070.stderr:marked out osd.7. 2024-09-11T05:34:09.995 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:09.995 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:10.004 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:10.012 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:34:10.027 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:10.027+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:10.128 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:10.128+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:10.150 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:10.150 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:10.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:10.243 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:10.243+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:10.305 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:10.305 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:10.314 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:10.355 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:10.355+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:10.430 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:10.430+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:10.457 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:10.457 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:10.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:10.531 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:10.531+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:10.570 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:10.570 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:10.578 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:10.612 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T05:34:10.669 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:10.669+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:10.691 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:10.692 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:10.700 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:10.733 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:10.733+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:10.802 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:10.802 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:10.811 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:10.834 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:10.833+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:10.914 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:10.914 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:10.923 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:10.934 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:10.934+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:11.026 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:11.026 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:11.034 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:11.035 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:11.035+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:11.136 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:11.136+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:11.136 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:11.137 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:11.145 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:11.204 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:34:11.238 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:11.237+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:11.248 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:11.249 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:11.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:11.336 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:11.336 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:11.338 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:11.338+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:11.354 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:11.354 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:11.370 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:11.370 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:11.386 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:11.387 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:11.387 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-11T05:34:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:11.400 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:11.403 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:11.403 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:11.409 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:11.420 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:11.436 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:11.436 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:11.439 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:34:11.440 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:34:11.440 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:11.439+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:11.511 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:11.511 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:11.511 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:11.512 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:11.512 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:11.520 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:11.564 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:11.564+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:11.634 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:34:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 60.983747133999998, 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:34:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:34:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:34:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:34:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:34:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:34:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:34:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:34:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:34:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:34:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:34:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:34:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:146253 3.6 3:64dbadcf:::rbd_data.112d55d87bfc.0000000000000332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 25.794932226, 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4166483809999999, 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 146253 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837090+0000", 2024-09-11T05:34:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.73e-06 2024-09-11T05:34:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837096+0000", 2024-09-11T05:34:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3500000000000002e-06 2024-09-11T05:34:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837115+0000", 2024-09-11T05:34:11.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8556e-05 2024-09-11T05:34:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837124+0000", 2024-09-11T05:34:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6739999999999992e-06 2024-09-11T05:34:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837184+0000", 2024-09-11T05:34:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9960000000000002e-05 2024-09-11T05:34:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:34:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837188+0000", 2024-09-11T05:34:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840481+0000", 2024-09-11T05:34:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032924080000000001 2024-09-11T05:34:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840497+0000", 2024-09-11T05:34:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6140000000000001e-05 2024-09-11T05:34:11.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850737+0000", 2024-09-11T05:34:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0102404119999999 2024-09-11T05:34:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850747+0000", 2024-09-11T05:34:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7969999999999995e-06 2024-09-11T05:34:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252495+0000", 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.401748131 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252636+0000", 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014118900000000001 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252737+0000", 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00010058 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253433+0000", 2024-09-11T05:34:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00069601999999999999 2024-09-11T05:34:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253604+0000", 2024-09-11T05:34:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000170824 2024-09-11T05:34:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253649+0000", 2024-09-11T05:34:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5050999999999999e-05 2024-09-11T05:34:11.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253736+0000", 2024-09-11T05:34:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7509000000000005e-05 2024-09-11T05:34:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:147298 3.6 3:652e51de:::rbd_data.112d55d87bfc.0000000000000377:head [set-alloc-hint object_size 262144 write_size 262144,write 122880~2839] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-11T05:34:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 22.398391650000001, 2024-09-11T05:34:11.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62981612099999995, 2024-09-11T05:34:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 147298 2024-09-11T05:34:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233630+0000", 2024-09-11T05:34:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5489999999999999e-06 2024-09-11T05:34:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233637+0000", 2024-09-11T05:34:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.272e-06 2024-09-11T05:34:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233654+0000", 2024-09-11T05:34:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6283999999999999e-05 2024-09-11T05:34:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233662+0000", 2024-09-11T05:34:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.875e-06 2024-09-11T05:34:11.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.654 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.654 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233723+0000", 2024-09-11T05:34:11.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1501000000000006e-05 2024-09-11T05:34:11.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.654 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:11.654 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233732+0000", 2024-09-11T05:34:11.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0699999999999996e-06 2024-09-11T05:34:11.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.654 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.654 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862055+0000", 2024-09-11T05:34:11.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62832274799999999 2024-09-11T05:34:11.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.655 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.655 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862219+0000", 2024-09-11T05:34:11.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016404899999999999 2024-09-11T05:34:11.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.655 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:11.655 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862313+0000", 2024-09-11T05:34:11.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4105999999999997e-05 2024-09-11T05:34:11.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:11.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862981+0000", 2024-09-11T05:34:11.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00066744199999999997 2024-09-11T05:34:11.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:11.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863382+0000", 2024-09-11T05:34:11.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040111200000000002 2024-09-11T05:34:11.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:11.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863419+0000", 2024-09-11T05:34:11.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6974000000000002e-05 2024-09-11T05:34:11.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863445+0000", 2024-09-11T05:34:11.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6139000000000002e-05 2024-09-11T05:34:11.657 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.657 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.657 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151292 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675740255000001, 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054346481000000002, 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151292 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.658 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:11.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:11.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:11.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:34:11.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956283+0000", 2024-09-11T05:34:11.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2450000000000001e-06 2024-09-11T05:34:11.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956290+0000", 2024-09-11T05:34:11.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0910000000000004e-06 2024-09-11T05:34:11.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956296+0000", 2024-09-11T05:34:11.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.947e-06 2024-09-11T05:34:11.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010460+0000", 2024-09-11T05:34:11.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054164165 2024-09-11T05:34:11.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010537+0000", 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6965000000000006e-05 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010626+0000", 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9628000000000003e-05 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151293 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1933312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:11.662 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675717412000001, 2024-09-11T05:34:11.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054563858999999999, 2024-09-11T05:34:11.663 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.663 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.663 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.663 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.663 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.663 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.663 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151293 2024-09-11T05:34:11.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.663 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.46e-07 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956306+0000", 2024-09-11T05:34:11.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2259999999999999e-06 2024-09-11T05:34:11.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956312+0000", 2024-09-11T05:34:11.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:34:11.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.666 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956317+0000", 2024-09-11T05:34:11.666 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:34:11.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.666 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.666 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.666 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010671+0000", 2024-09-11T05:34:11.666 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054353830999999998 2024-09-11T05:34:11.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.666 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.666 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.666 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010757+0000", 2024-09-11T05:34:11.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6120999999999998e-05 2024-09-11T05:34:11.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.667 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.667 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010867+0000", 2024-09-11T05:34:11.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000109687 2024-09-11T05:34:11.667 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.667 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.667 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.667 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151294 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2179072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.67569555, 2024-09-11T05:34:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054741825000000001, 2024-09-11T05:34:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151294 2024-09-11T05:34:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.84e-07 2024-09-11T05:34:11.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956326+0000", 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.483e-06 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956330+0000", 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8519999999999997e-06 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956334+0000", 2024-09-11T05:34:11.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4139999999999998e-06 2024-09-11T05:34:11.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010894+0000", 2024-09-11T05:34:11.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054560243000000001 2024-09-11T05:34:11.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010970+0000", 2024-09-11T05:34:11.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6138999999999997e-05 2024-09-11T05:34:11.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011067+0000", 2024-09-11T05:34:11.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6409999999999993e-05 2024-09-11T05:34:11.672 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.672 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.672 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.672 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151295 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2392064~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.672 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:11.672 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675682879, 2024-09-11T05:34:11.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054949748999999999, 2024-09-11T05:34:11.672 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.673 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.673 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.673 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.673 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.673 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.673 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151295 2024-09-11T05:34:11.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.673 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:11.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:11.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956338+0000", 2024-09-11T05:34:11.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.23e-07 2024-09-11T05:34:11.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956339+0000", 2024-09-11T05:34:11.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.243e-06 2024-09-11T05:34:11.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956342+0000", 2024-09-11T05:34:11.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.473e-06 2024-09-11T05:34:11.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956345+0000", 2024-09-11T05:34:11.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:34:11.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011109+0000", 2024-09-11T05:34:11.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054763698999999999 2024-09-11T05:34:11.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011188+0000", 2024-09-11T05:34:11.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8887999999999994e-05 2024-09-11T05:34:11.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011287+0000", 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9504000000000001e-05 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151296 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675671769000001, 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055045187000000002, 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.678 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.678 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.678 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.678 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151296 2024-09-11T05:34:11.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.678 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:11.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956349+0000", 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956350+0000", 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:34:11.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956353+0000", 2024-09-11T05:34:11.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.016e-06 2024-09-11T05:34:11.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956355+0000", 2024-09-11T05:34:11.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5509999999999998e-06 2024-09-11T05:34:11.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011303+0000", 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054947306000000001 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011342+0000", 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9057999999999998e-05 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011394+0000", 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1925999999999997e-05 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.681 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151297 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2818048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675661838, 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055238158000000002, 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.682 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151297 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956359+0000", 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956360+0000", 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1030000000000001e-06 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956363+0000", 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.021e-06 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956365+0000", 2024-09-11T05:34:11.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4770000000000002e-06 2024-09-11T05:34:11.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011425+0000", 2024-09-11T05:34:11.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055059967000000001 2024-09-11T05:34:11.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011506+0000", 2024-09-11T05:34:11.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1063000000000006e-05 2024-09-11T05:34:11.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011597+0000", 2024-09-11T05:34:11.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0299999999999999e-05 2024-09-11T05:34:11.686 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.686 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.686 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.686 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151298 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3031040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.686 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:11.686 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675651872, 2024-09-11T05:34:11.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055425825999999997, 2024-09-11T05:34:11.687 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.687 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.687 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.687 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.687 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.687 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.687 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151298 2024-09-11T05:34:11.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.687 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:11.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:11.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956369+0000", 2024-09-11T05:34:11.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4400000000000001e-07 2024-09-11T05:34:11.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956370+0000", 2024-09-11T05:34:11.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.068e-06 2024-09-11T05:34:11.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956373+0000", 2024-09-11T05:34:11.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0419999999999998e-06 2024-09-11T05:34:11.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956375+0000", 2024-09-11T05:34:11.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:11.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.690 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011631+0000", 2024-09-11T05:34:11.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055255116999999999 2024-09-11T05:34:11.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.690 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011703+0000", 2024-09-11T05:34:11.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2554999999999999e-05 2024-09-11T05:34:11.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.691 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.691 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.691 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011794+0000", 2024-09-11T05:34:11.691 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1119999999999995e-05 2024-09-11T05:34:11.691 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.691 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.691 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.691 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.691 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151299 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3276800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.691 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:11.691 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675640569999999, 2024-09-11T05:34:11.692 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055567477999999997, 2024-09-11T05:34:11.692 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.692 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.692 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.692 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.692 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.692 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.692 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151299 2024-09-11T05:34:11.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.692 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.692 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.692 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.692 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956382+0000", 2024-09-11T05:34:11.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.72e-06 2024-09-11T05:34:11.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956386+0000", 2024-09-11T05:34:11.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0990000000000001e-06 2024-09-11T05:34:11.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956390+0000", 2024-09-11T05:34:11.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.318e-06 2024-09-11T05:34:11.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.695 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.695 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.695 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011823+0000", 2024-09-11T05:34:11.695 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055432976000000002 2024-09-11T05:34:11.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.695 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.695 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.695 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011882+0000", 2024-09-11T05:34:11.695 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8656999999999998e-05 2024-09-11T05:34:11.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.695 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.695 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011947+0000", 2024-09-11T05:34:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5177000000000003e-05 2024-09-11T05:34:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151300 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3489792~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675624103000001, 2024-09-11T05:34:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055745232999999998, 2024-09-11T05:34:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151300 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.697 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956397+0000", 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956398+0000", 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.869e-06 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956404+0000", 2024-09-11T05:34:11.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:34:11.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956407+0000", 2024-09-11T05:34:11.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.191e-06 2024-09-11T05:34:11.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011981+0000", 2024-09-11T05:34:11.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055573553999999997 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012051+0000", 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9542999999999995e-05 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012141+0000", 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0845000000000002e-05 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151301 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3702784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675609174000002, 2024-09-11T05:34:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055834747999999997, 2024-09-11T05:34:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151301 2024-09-11T05:34:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:11.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:34:11.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.703 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956413+0000", 2024-09-11T05:34:11.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2810000000000001e-06 2024-09-11T05:34:11.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.703 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956416+0000", 2024-09-11T05:34:11.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1559999999999999e-06 2024-09-11T05:34:11.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956418+0000", 2024-09-11T05:34:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:34:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012155+0000", 2024-09-11T05:34:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055736651999999998 2024-09-11T05:34:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012193+0000", 2024-09-11T05:34:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7848000000000001e-05 2024-09-11T05:34:11.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.705 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012246+0000", 2024-09-11T05:34:11.705 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3041000000000003e-05 2024-09-11T05:34:11.705 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.705 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.705 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.705 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151302 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3915776~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.705 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:11.705 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675599071000001, 2024-09-11T05:34:11.706 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056035532999999998, 2024-09-11T05:34:11.706 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.706 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.706 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.706 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.706 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.706 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.706 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151302 2024-09-11T05:34:11.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.706 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.706 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.706 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.707 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956426+0000", 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.853e-06 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956430+0000", 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3699999999999999e-06 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956432+0000", 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5979999999999999e-06 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.709 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012281+0000", 2024-09-11T05:34:11.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055848644000000003 2024-09-11T05:34:11.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.709 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012358+0000", 2024-09-11T05:34:11.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6662000000000006e-05 2024-09-11T05:34:11.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.709 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012457+0000", 2024-09-11T05:34:11.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9197999999999995e-05 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151303 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4128768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675584488999998, 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056186709000000001, 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.710 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151303 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.712 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.712 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.712 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:11.712 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:11.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.712 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.712 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.712 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956437+0000", 2024-09-11T05:34:11.712 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.201e-06 2024-09-11T05:34:11.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.712 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.712 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956440+0000", 2024-09-11T05:34:11.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-06 2024-09-11T05:34:11.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956443+0000", 2024-09-11T05:34:11.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5909999999999998e-06 2024-09-11T05:34:11.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012494+0000", 2024-09-11T05:34:11.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056051541000000003 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012558+0000", 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3347000000000002e-05 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012622+0000", 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4760999999999999e-05 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.715 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151304 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.715 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:11.715 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675574432000001, 2024-09-11T05:34:11.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056360149999999998, 2024-09-11T05:34:11.715 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.715 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.715 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.715 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.715 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.715 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.715 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151304 2024-09-11T05:34:11.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:11.717 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:11.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.717 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.717 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956447+0000", 2024-09-11T05:34:11.717 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.153e-06 2024-09-11T05:34:11.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.717 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.717 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956450+0000", 2024-09-11T05:34:11.717 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9909999999999998e-06 2024-09-11T05:34:11.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956453+0000", 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.447e-06 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012660+0000", 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056207510000000002 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012741+0000", 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0734000000000003e-05 2024-09-11T05:34:11.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012806+0000", 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5087999999999998e-05 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151305 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4587520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675564671, 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056476407999999999, 2024-09-11T05:34:11.719 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.720 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.720 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.720 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.720 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.720 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.720 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151305 2024-09-11T05:34:11.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.720 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.720 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.720 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:11.720 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.721 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.721 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:11.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.721 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.721 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:11.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:11.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.721 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.721 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956457+0000", 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.353e-06 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956460+0000", 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0060000000000001e-06 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956463+0000", 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.452e-06 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.722 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012834+0000", 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056370917999999999 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012877+0000", 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000999999999997e-05 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012932+0000", 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5470000000000003e-05 2024-09-11T05:34:11.723 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.724 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.724 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.724 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151306 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4800512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.724 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:11.724 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675554690999999, 2024-09-11T05:34:11.724 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056579203000000002, 2024-09-11T05:34:11.724 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.724 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.724 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.724 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.724 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.725 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.725 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151306 2024-09-11T05:34:11.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.725 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.725 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.725 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:11.725 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.725 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.725 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:11.725 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.28e-07 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956467+0000", 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.088e-06 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.726 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956470+0000", 2024-09-11T05:34:11.727 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0240000000000002e-06 2024-09-11T05:34:11.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.727 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.727 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.727 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956472+0000", 2024-09-11T05:34:11.727 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4609999999999998e-06 2024-09-11T05:34:11.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.727 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.727 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.727 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012953+0000", 2024-09-11T05:34:11.727 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056480524999999997 2024-09-11T05:34:11.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.727 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012994+0000", 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1394999999999999e-05 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013045+0000", 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0482000000000002e-05 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.728 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151307 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5013504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.729 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:11.729 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675545022000001, 2024-09-11T05:34:11.729 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056680525000000002, 2024-09-11T05:34:11.729 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.729 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.729 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.729 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.729 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.729 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.729 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151307 2024-09-11T05:34:11.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.730 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.730 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:11.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.730 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:11.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.731 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.731 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:11.731 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:34:11.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.731 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.731 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956476+0000", 2024-09-11T05:34:11.731 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0359999999999999e-06 2024-09-11T05:34:11.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.731 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956479+0000", 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8899999999999999e-06 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956482+0000", 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5380000000000001e-06 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013065+0000", 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056582983000000003 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.732 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013104+0000", 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9119999999999998e-05 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013156+0000", 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1743999999999998e-05 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.733 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151308 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5226496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:11.734 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:11.734 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 17.675527690999999, 2024-09-11T05:34:11.734 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056772738000000003, 2024-09-11T05:34:11.734 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:11.734 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:11.734 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:11.734 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:11.734 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:11.734 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:11.734 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151308 2024-09-11T05:34:11.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.734 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:11.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2599999999999998e-07 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956495+0000", 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9750000000000001e-06 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956499+0000", 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5179999999999998e-06 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:11.736 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956502+0000", 2024-09-11T05:34:11.737 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7530000000000002e-06 2024-09-11T05:34:11.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.737 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.737 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:11.737 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013177+0000", 2024-09-11T05:34:11.737 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056674536999999997 2024-09-11T05:34:11.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.737 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.737 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:11.737 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013215+0000", 2024-09-11T05:34:11.737 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8578999999999998e-05 2024-09-11T05:34:11.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:11.737 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:11.738 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:11.738 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013265+0000", 2024-09-11T05:34:11.738 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0049999999999997e-05 2024-09-11T05:34:11.738 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.738 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.738 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.738 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:11.738 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:11.738 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:11.740 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-11T05:34:11.740 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:11.740 INFO:teuthology.orchestra.run.smithi070.stdout:5763 write 0x7365f2a thru 0x7375c60 (0xfd37 bytes) 2024-09-11T05:34:11.740 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:11.739+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:11.741 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:11.825 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:11.825 INFO:teuthology.orchestra.run.smithi070.stdout:5765 write 0x14f6db1 thru 0x15047c8 (0xda18 bytes) 2024-09-11T05:34:11.840 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:11.840+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:11.848 INFO:teuthology.orchestra.run.smithi070.stdout:5766 write 0xebfcc8f thru 0xec035e8 (0x695a bytes) 2024-09-11T05:34:11.852 INFO:teuthology.orchestra.run.smithi070.stdout:5768 writesame 0x3eb0e73 thru 0x3eb72ac data_size 0x1(0x643a bytes) 2024-09-11T05:34:11.889 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:11.890 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:11.890 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:11.890 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:11.893 INFO:teuthology.orchestra.run.smithi070.stdout:5769 write 0x49aa695 thru 0x49aa6fc (0x68 bytes) 2024-09-11T05:34:11.901 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:11.942 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:11.942+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:12.042 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:12.042+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:12.048 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:12.048 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:12.048 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:12.048 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:12.048 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:12.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:12.081 INFO:teuthology.orchestra.run.smithi070.stdout:5770 punch from 0x6b9f0a2 to 0x6badd6b, (0xecc9 bytes) 2024-09-11T05:34:12.081 INFO:teuthology.orchestra.run.smithi070.stdout:5771 write 0x1b61d8c thru 0x1b6c1fd (0xa472 bytes) 2024-09-11T05:34:12.084 INFO:teuthology.orchestra.run.smithi070.stdout:5773 read 0xc278797 thru 0xc280449 (0x7cb3 bytes) 2024-09-11T05:34:12.086 INFO:teuthology.orchestra.run.smithi070.stdout:5774 trunc from 0xec035e9 to 0xd3bf180 2024-09-11T05:34:12.100 INFO:teuthology.orchestra.run.smithi070.stdout:5777 writesame 0x5c8eaca thru 0x5c93d22 data_size 0x1(0x5259 bytes) 2024-09-11T05:34:12.114 INFO:teuthology.orchestra.run.smithi070.stdout:5778 read 0x2c4d157 thru 0x2c56d7b (0x9c25 bytes) 2024-09-11T05:34:12.114 INFO:teuthology.orchestra.run.smithi070.stdout:5779 writesame 0x2bfca88 thru 0x2c088c9 data_size 0x31(0xbe42 bytes) 2024-09-11T05:34:12.144 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:12.144+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:12.144 INFO:teuthology.orchestra.run.smithi070.stdout:5780 read 0xc45aaa0 thru 0xc469c9f (0xf200 bytes) 2024-09-11T05:34:12.151 INFO:teuthology.orchestra.run.smithi070.stdout:5781 writesame 0xdf31e27 thru 0xdf3d84b data_size 0x1(0xba25 bytes) 2024-09-11T05:34:12.153 INFO:teuthology.orchestra.run.smithi070.stdout:5783 read 0x8f8f6cc thru 0x8f9394a (0x427f bytes) 2024-09-11T05:34:12.153 INFO:teuthology.orchestra.run.smithi070.stdout:5785 writesame 0x32300d4 thru 0x323c200 data_size 0x1(0xc12d bytes) 2024-09-11T05:34:12.200 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116524 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387778760000003, 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344630100000001, 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116524 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811270+0000", 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811272+0000", 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811278+0000", 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1970000000000001e-06 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811283+0000", 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813113+0000", 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001830302 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813117+0000", 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0810000000000004e-06 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814661+0000", 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015436969999999999 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814667+0000", 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6370000000000002e-06 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826115+0000", 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114479059999999 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826123+0000", 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000004e-06 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845722+0000", 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195993000000001 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845732+0000", 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116525 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387758878, 2024-09-11T05:34:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344747700000001, 2024-09-11T05:34:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116525 2024-09-11T05:34:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811290+0000", 2024-09-11T05:34:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:34:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811295+0000", 2024-09-11T05:34:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8969999999999999e-06 2024-09-11T05:34:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811301+0000", 2024-09-11T05:34:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4919999999999998e-06 2024-09-11T05:34:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811306+0000", 2024-09-11T05:34:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999998e-06 2024-09-11T05:34:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813138+0000", 2024-09-11T05:34:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001832078 2024-09-11T05:34:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813142+0000", 2024-09-11T05:34:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0380000000000001e-06 2024-09-11T05:34:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814689+0000", 2024-09-11T05:34:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546799 2024-09-11T05:34:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814695+0000", 2024-09-11T05:34:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8739999999999997e-06 2024-09-11T05:34:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826148+0000", 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114527259999999 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826166+0000", 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7484999999999999e-05 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845756+0000", 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019590609 2024-09-11T05:34:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845764+0000", 2024-09-11T05:34:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7020000000000001e-06 2024-09-11T05:34:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116526 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387736080000003, 2024-09-11T05:34:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344863210000002, 2024-09-11T05:34:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116526 2024-09-11T05:34:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:34:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811315+0000", 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079999999999999e-06 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811320+0000", 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8619999999999999e-06 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811325+0000", 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T05:34:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814736+0000", 2024-09-11T05:34:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034115780000000002 2024-09-11T05:34:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814744+0000", 2024-09-11T05:34:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5340000000000002e-06 2024-09-11T05:34:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826212+0000", 2024-09-11T05:34:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114682749999999 2024-09-11T05:34:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826225+0000", 2024-09-11T05:34:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:34:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845789+0000", 2024-09-11T05:34:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195649200000001 2024-09-11T05:34:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845798+0000", 2024-09-11T05:34:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9269999999999994e-06 2024-09-11T05:34:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116527 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387717148, 2024-09-11T05:34:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345095849999999, 2024-09-11T05:34:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116527 2024-09-11T05:34:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:34:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811334+0000", 2024-09-11T05:34:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:34:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811340+0000", 2024-09-11T05:34:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.691e-06 2024-09-11T05:34:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811345+0000", 2024-09-11T05:34:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5480000000000003e-06 2024-09-11T05:34:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814767+0000", 2024-09-11T05:34:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034223190000000001 2024-09-11T05:34:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814774+0000", 2024-09-11T05:34:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:34:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826265+0000", 2024-09-11T05:34:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114912460000001 2024-09-11T05:34:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826274+0000", 2024-09-11T05:34:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3909999999999998e-06 2024-09-11T05:34:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845831+0000", 2024-09-11T05:34:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195574080000001 2024-09-11T05:34:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845841+0000", 2024-09-11T05:34:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3610000000000007e-06 2024-09-11T05:34:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116528 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387697709000001, 2024-09-11T05:34:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345287679999999, 2024-09-11T05:34:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116528 2024-09-11T05:34:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811351+0000", 2024-09-11T05:34:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T05:34:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811353+0000", 2024-09-11T05:34:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:34:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811359+0000", 2024-09-11T05:34:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T05:34:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811364+0000", 2024-09-11T05:34:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000001e-06 2024-09-11T05:34:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814795+0000", 2024-09-11T05:34:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034316569999999998 2024-09-11T05:34:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814826+0000", 2024-09-11T05:34:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0587999999999999e-05 2024-09-11T05:34:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826309+0000", 2024-09-11T05:34:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011483444 2024-09-11T05:34:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826319+0000", 2024-09-11T05:34:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6849999999999996e-06 2024-09-11T05:34:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845868+0000", 2024-09-11T05:34:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195487110000001 2024-09-11T05:34:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845879+0000", 2024-09-11T05:34:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1428e-05 2024-09-11T05:34:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116529 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387679075000001, 2024-09-11T05:34:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034542531, 2024-09-11T05:34:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116529 2024-09-11T05:34:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:34:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811371+0000", 2024-09-11T05:34:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T05:34:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811377+0000", 2024-09-11T05:34:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1580000000000002e-06 2024-09-11T05:34:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811383+0000", 2024-09-11T05:34:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.135e-06 2024-09-11T05:34:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814851+0000", 2024-09-11T05:34:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034684690000000001 2024-09-11T05:34:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814858+0000", 2024-09-11T05:34:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6969999999999996e-06 2024-09-11T05:34:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826354+0000", 2024-09-11T05:34:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114962359999999 2024-09-11T05:34:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826364+0000", 2024-09-11T05:34:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0047999999999999e-05 2024-09-11T05:34:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845903+0000", 2024-09-11T05:34:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195393610000001 2024-09-11T05:34:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845912+0000", 2024-09-11T05:34:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2269999999999993e-06 2024-09-11T05:34:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116530 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387660163, 2024-09-11T05:34:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345557429999999, 2024-09-11T05:34:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116530 2024-09-11T05:34:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:34:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811390+0000", 2024-09-11T05:34:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:34:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811396+0000", 2024-09-11T05:34:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:34:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811402+0000", 2024-09-11T05:34:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:34:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814879+0000", 2024-09-11T05:34:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034769290000000001 2024-09-11T05:34:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814885+0000", 2024-09-11T05:34:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.156e-06 2024-09-11T05:34:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826389+0000", 2024-09-11T05:34:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115041140000001 2024-09-11T05:34:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826397+0000", 2024-09-11T05:34:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:34:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845935+0000", 2024-09-11T05:34:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195381370000001 2024-09-11T05:34:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845944+0000", 2024-09-11T05:34:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4540000000000007e-06 2024-09-11T05:34:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116531 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387640103999999, 2024-09-11T05:34:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345764630000001, 2024-09-11T05:34:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116531 2024-09-11T05:34:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:34:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811411+0000", 2024-09-11T05:34:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811417+0000", 2024-09-11T05:34:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:34:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811422+0000", 2024-09-11T05:34:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3229999999999997e-06 2024-09-11T05:34:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814906+0000", 2024-09-11T05:34:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034835389999999999 2024-09-11T05:34:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814913+0000", 2024-09-11T05:34:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309999999999996e-06 2024-09-11T05:34:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826423+0000", 2024-09-11T05:34:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115109019999999 2024-09-11T05:34:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826431+0000", 2024-09-11T05:34:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9410000000000007e-06 2024-09-11T05:34:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845975+0000", 2024-09-11T05:34:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019543767 2024-09-11T05:34:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845984+0000", 2024-09-11T05:34:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3530000000000001e-06 2024-09-11T05:34:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116532 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387619905999998, 2024-09-11T05:34:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034588131, 2024-09-11T05:34:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116532 2024-09-11T05:34:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811429+0000", 2024-09-11T05:34:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:34:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811431+0000", 2024-09-11T05:34:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9910000000000001e-06 2024-09-11T05:34:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811437+0000", 2024-09-11T05:34:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.049e-06 2024-09-11T05:34:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811441+0000", 2024-09-11T05:34:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8289999999999998e-06 2024-09-11T05:34:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814934+0000", 2024-09-11T05:34:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034927220000000002 2024-09-11T05:34:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814941+0000", 2024-09-11T05:34:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.844e-06 2024-09-11T05:34:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826480+0000", 2024-09-11T05:34:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115393260000001 2024-09-11T05:34:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826496+0000", 2024-09-11T05:34:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5406000000000001e-05 2024-09-11T05:34:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846008+0000", 2024-09-11T05:34:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.01951214 2024-09-11T05:34:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846016+0000", 2024-09-11T05:34:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4440000000000008e-06 2024-09-11T05:34:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116533 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387600352, 2024-09-11T05:34:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345994049999998, 2024-09-11T05:34:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116533 2024-09-11T05:34:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811450+0000", 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0940000000000002e-06 2024-09-11T05:34:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811457+0000", 2024-09-11T05:34:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2729999999999999e-06 2024-09-11T05:34:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811461+0000", 2024-09-11T05:34:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.673e-06 2024-09-11T05:34:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814962+0000", 2024-09-11T05:34:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035012530000000002 2024-09-11T05:34:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814970+0000", 2024-09-11T05:34:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0539999999999997e-06 2024-09-11T05:34:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826536+0000", 2024-09-11T05:34:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011566049 2024-09-11T05:34:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826542+0000", 2024-09-11T05:34:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1709999999999999e-06 2024-09-11T05:34:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846039+0000", 2024-09-11T05:34:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019497168 2024-09-11T05:34:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846047+0000", 2024-09-11T05:34:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-11T05:34:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116534 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387581445000002, 2024-09-11T05:34:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034610979, 2024-09-11T05:34:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116534 2024-09-11T05:34:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:34:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811469+0000", 2024-09-11T05:34:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.871e-06 2024-09-11T05:34:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811475+0000", 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1689999999999997e-06 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811480+0000", 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5990000000000004e-06 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814990+0000", 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003510876 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814997+0000", 2024-09-11T05:34:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T05:34:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826571+0000", 2024-09-11T05:34:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115740230000001 2024-09-11T05:34:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826576+0000", 2024-09-11T05:34:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-11T05:34:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846070+0000", 2024-09-11T05:34:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194937660000001 2024-09-11T05:34:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846078+0000", 2024-09-11T05:34:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.038e-06 2024-09-11T05:34:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116535 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387562285999998, 2024-09-11T05:34:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346218060000001, 2024-09-11T05:34:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116535 2024-09-11T05:34:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:34:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811488+0000", 2024-09-11T05:34:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:34:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811495+0000", 2024-09-11T05:34:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3960000000000003e-06 2024-09-11T05:34:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811500+0000", 2024-09-11T05:34:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9910000000000002e-06 2024-09-11T05:34:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815019+0000", 2024-09-11T05:34:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035190479999999999 2024-09-11T05:34:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815025+0000", 2024-09-11T05:34:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2550000000000003e-06 2024-09-11T05:34:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826604+0000", 2024-09-11T05:34:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115789959999999 2024-09-11T05:34:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826611+0000", 2024-09-11T05:34:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:34:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846100+0000", 2024-09-11T05:34:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194890569999999 2024-09-11T05:34:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846108+0000", 2024-09-11T05:34:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4089999999999997e-06 2024-09-11T05:34:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116536 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387542764999999, 2024-09-11T05:34:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034634724, 2024-09-11T05:34:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116536 2024-09-11T05:34:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811506+0000", 2024-09-11T05:34:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811508+0000", 2024-09-11T05:34:12.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T05:34:12.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811514+0000", 2024-09-11T05:34:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0610000000000001e-06 2024-09-11T05:34:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811519+0000", 2024-09-11T05:34:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0340000000000004e-06 2024-09-11T05:34:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815049+0000", 2024-09-11T05:34:12.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035296440000000002 2024-09-11T05:34:12.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815055+0000", 2024-09-11T05:34:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:34:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826642+0000", 2024-09-11T05:34:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011586375 2024-09-11T05:34:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826649+0000", 2024-09-11T05:34:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-09-11T05:34:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846131+0000", 2024-09-11T05:34:12.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194814569999999 2024-09-11T05:34:12.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846140+0000", 2024-09-11T05:34:12.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2240000000000001e-06 2024-09-11T05:34:12.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.322 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116537 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387523195999997, 2024-09-11T05:34:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346492180000002, 2024-09-11T05:34:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116537 2024-09-11T05:34:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811532+0000", 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811538+0000", 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7259999999999996e-06 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811543+0000", 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.164e-06 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815078+0000", 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003534428 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815086+0000", 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8210000000000002e-06 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826736+0000", 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116503429999999 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826751+0000", 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4895999999999999e-05 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846165+0000", 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019413854 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846174+0000", 2024-09-11T05:34:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3149999999999998e-06 2024-09-11T05:34:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116538 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387498506999997, 2024-09-11T05:34:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346557729999999, 2024-09-11T05:34:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116538 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811552+0000", 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2869999999999999e-06 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811559+0000", 2024-09-11T05:34:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3820000000000001e-06 2024-09-11T05:34:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811564+0000", 2024-09-11T05:34:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:34:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815109+0000", 2024-09-11T05:34:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035450989999999999 2024-09-11T05:34:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815115+0000", 2024-09-11T05:34:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826780+0000", 2024-09-11T05:34:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116645799999999 2024-09-11T05:34:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826787+0000", 2024-09-11T05:34:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3880000000000002e-06 2024-09-11T05:34:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846196+0000", 2024-09-11T05:34:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194094069999999 2024-09-11T05:34:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846205+0000", 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.884e-06 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116539 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387478461000001, 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346668399999999, 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116539 2024-09-11T05:34:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:12.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:12.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:34:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811572+0000", 2024-09-11T05:34:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:34:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811578+0000", 2024-09-11T05:34:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T05:34:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811583+0000", 2024-09-11T05:34:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:34:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815137+0000", 2024-09-11T05:34:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035540210000000001 2024-09-11T05:34:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815144+0000", 2024-09-11T05:34:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5969999999999997e-06 2024-09-11T05:34:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826851+0000", 2024-09-11T05:34:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117072149999999 2024-09-11T05:34:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826860+0000", 2024-09-11T05:34:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4200000000000007e-06 2024-09-11T05:34:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846228+0000", 2024-09-11T05:34:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019368287 2024-09-11T05:34:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846236+0000", 2024-09-11T05:34:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.541e-06 2024-09-11T05:34:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116540 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387459036999999, 2024-09-11T05:34:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346767830000001, 2024-09-11T05:34:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116540 2024-09-11T05:34:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811591+0000", 2024-09-11T05:34:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:34:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811598+0000", 2024-09-11T05:34:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T05:34:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811603+0000", 2024-09-11T05:34:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9470000000000002e-06 2024-09-11T05:34:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815168+0000", 2024-09-11T05:34:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035651810000000002 2024-09-11T05:34:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815174+0000", 2024-09-11T05:34:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T05:34:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826883+0000", 2024-09-11T05:34:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117088830000001 2024-09-11T05:34:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826891+0000", 2024-09-11T05:34:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7179999999999996e-06 2024-09-11T05:34:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846258+0000", 2024-09-11T05:34:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019367328 2024-09-11T05:34:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846266+0000", 2024-09-11T05:34:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4880000000000001e-06 2024-09-11T05:34:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116541 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387439743000002, 2024-09-11T05:34:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346837, 2024-09-11T05:34:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116541 2024-09-11T05:34:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811609+0000", 2024-09-11T05:34:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:34:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811611+0000", 2024-09-11T05:34:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8679999999999999e-06 2024-09-11T05:34:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811617+0000", 2024-09-11T05:34:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811622+0000", 2024-09-11T05:34:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9370000000000003e-06 2024-09-11T05:34:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815201+0000", 2024-09-11T05:34:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035788679999999998 2024-09-11T05:34:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815207+0000", 2024-09-11T05:34:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7530000000000004e-06 2024-09-11T05:34:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826988+0000", 2024-09-11T05:34:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117802300000001 2024-09-11T05:34:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826996+0000", 2024-09-11T05:34:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.259e-06 2024-09-11T05:34:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846285+0000", 2024-09-11T05:34:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192892090000001 2024-09-11T05:34:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846292+0000", 2024-09-11T05:34:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9399999999999996e-06 2024-09-11T05:34:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116542 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387420833, 2024-09-11T05:34:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034697618, 2024-09-11T05:34:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116542 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811628+0000", 2024-09-11T05:34:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:34:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811629+0000", 2024-09-11T05:34:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8059999999999999e-06 2024-09-11T05:34:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811636+0000", 2024-09-11T05:34:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0990000000000004e-06 2024-09-11T05:34:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811640+0000", 2024-09-11T05:34:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6630000000000001e-06 2024-09-11T05:34:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815230+0000", 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035897009999999998 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815237+0000", 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6590000000000001e-06 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827019+0000", 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011782261 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827026+0000", 2024-09-11T05:34:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.605e-06 2024-09-11T05:34:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846317+0000", 2024-09-11T05:34:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192904270000001 2024-09-11T05:34:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846325+0000", 2024-09-11T05:34:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0530000000000007e-06 2024-09-11T05:34:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116543 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387402158999997, 2024-09-11T05:34:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0347097559999998, 2024-09-11T05:34:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116543 2024-09-11T05:34:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:34:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811648+0000", 2024-09-11T05:34:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:34:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811654+0000", 2024-09-11T05:34:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T05:34:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811659+0000", 2024-09-11T05:34:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9409999999999998e-06 2024-09-11T05:34:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815259+0000", 2024-09-11T05:34:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035993980000000002 2024-09-11T05:34:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815265+0000", 2024-09-11T05:34:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-11T05:34:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827049+0000", 2024-09-11T05:34:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117836019999999 2024-09-11T05:34:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827056+0000", 2024-09-11T05:34:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3919999999999997e-06 2024-09-11T05:34:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846348+0000", 2024-09-11T05:34:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192919039999999 2024-09-11T05:34:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846356+0000", 2024-09-11T05:34:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7449999999999995e-06 2024-09-11T05:34:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.368 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.368 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:12.370 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:12.370 INFO:teuthology.orchestra.run.smithi070.stdout:5786 write 0xd020a68 thru 0xd02e301 (0xd89a bytes) 2024-09-11T05:34:12.371 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:12.371 INFO:teuthology.orchestra.run.smithi070.stdout:5789 trunc from 0xdf3d84c to 0x791d8d4 2024-09-11T05:34:12.371 INFO:teuthology.orchestra.run.smithi070.stdout:5791 read 0x73c1ea5 thru 0x73cf667 (0xd7c3 bytes) 2024-09-11T05:34:12.371 INFO:teuthology.orchestra.run.smithi070.stdout:5792 trunc from 0x791d8d4 to 0x1f582ea 2024-09-11T05:34:12.371 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:12.369+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:12.470 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:12.470+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:12.514 INFO:teuthology.orchestra.run.smithi070.stdout:5794 read 0xa88ecf thru 0xa91bee (0x8d20 bytes) 2024-09-11T05:34:12.514 INFO:teuthology.orchestra.run.smithi070.stdout:5795 read 0x17cddf2 thru 0x17d318c (0x539b bytes) 2024-09-11T05:34:12.515 INFO:teuthology.orchestra.run.smithi070.stdout:5796 punch from 0x1041f55 to 0x1044ce9, (0x2d94 bytes) 2024-09-11T05:34:12.515 INFO:teuthology.orchestra.run.smithi070.stdout:5797 write 0xe03809 thru 0xe0d467 (0x9c5f bytes) 2024-09-11T05:34:12.522 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:12.522 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:12.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.523 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4397.0:186965 3.17 e86/60 3:ed260800:::rbd_object_map.112d1936a4ef:head v 86'974, mlcod=86'972)", 2024-09-11T05:34:12.523 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.522311+0000", 2024-09-11T05:34:12.523 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00032941900000000001, 2024-09-11T05:34:12.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034668299999999997, 2024-09-11T05:34:12.523 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.523 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.523 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.522311+0000", 2024-09-11T05:34:12.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.522311+0000", 2024-09-11T05:34:12.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.522313+0000", 2024-09-11T05:34:12.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.61e-06 2024-09-11T05:34:12.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.522324+0000", 2024-09-11T05:34:12.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.099e-05 2024-09-11T05:34:12.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.522343+0000", 2024-09-11T05:34:12.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9656999999999998e-05 2024-09-11T05:34:12.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.522353+0000", 2024-09-11T05:34:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2930000000000006e-06 2024-09-11T05:34:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.522411+0000", 2024-09-11T05:34:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8653000000000002e-05 2024-09-11T05:34:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.522430+0000", 2024-09-11T05:34:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9069999999999999e-05 2024-09-11T05:34:12.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.527 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.527 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:34:12.527 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 1 2024-09-11T05:34:12.527 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:12.527 INFO:teuthology.orchestra.run.smithi070.stdout:5798 write 0x5de0980 thru 0x5deb934 (0xafb5 bytes) 2024-09-11T05:34:12.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:12.536 INFO:teuthology.orchestra.run.smithi070.stdout:5799 writesame 0x71291f7 thru 0x7135046 data_size 0x8(0xbe50 bytes) 2024-09-11T05:34:12.537 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:12.540 INFO:teuthology.orchestra.run.smithi070.stdout:5804 trunc from 0x7135047 to 0xa08c55b 2024-09-11T05:34:12.545 INFO:teuthology.orchestra.run.smithi070.stdout:5805 writesame 0x98758fa thru 0x987c22a data_size 0x1(0x6931 bytes) 2024-09-11T05:34:12.561 INFO:teuthology.orchestra.run.smithi070.stdout:5807 punch from 0x41f8f4e to 0x420421d, (0xb2cf bytes) 2024-09-11T05:34:12.562 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:12.562 INFO:teuthology.orchestra.run.smithi070.stdout:5812 read 0x1f6b2e8 thru 0x1f6c90a (0x1623 bytes) 2024-09-11T05:34:12.563 INFO:teuthology.orchestra.run.smithi070.stdout:5815 write 0x93c0177 thru 0x93c245e (0x22e8 bytes) 2024-09-11T05:34:12.566 INFO:teuthology.orchestra.run.smithi070.stdout:5816 punch from 0x8a2e96e to 0x8a32ac4, (0x4156 bytes) 2024-09-11T05:34:12.566 INFO:teuthology.orchestra.run.smithi070.stdout:5818 read 0x6bc2790 thru 0x6bca6a4 (0x7f15 bytes) 2024-09-11T05:34:12.567 INFO:teuthology.orchestra.run.smithi070.stdout:5819 write 0x948cfb6 thru 0x949a624 (0xd66f bytes) 2024-09-11T05:34:12.570 INFO:teuthology.orchestra.run.smithi070.stdout:5820 write 0x8775fad thru 0x8780b86 (0xabda bytes) 2024-09-11T05:34:12.570 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:12.570+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:12.578 INFO:teuthology.orchestra.run.smithi070.stdout:5821 trunc from 0xa08c55b to 0xe82d943 2024-09-11T05:34:12.583 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:12.584 INFO:teuthology.orchestra.run.smithi070.stdout:5823 trunc from 0xe82d943 to 0xd4ecd4c 2024-09-11T05:34:12.594 INFO:teuthology.orchestra.run.smithi070.stdout:5824 write 0x5cfec3f thru 0x5d08899 (0x9c5b bytes) 2024-09-11T05:34:12.596 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:12.596 INFO:teuthology.orchestra.run.smithi070.stdout:5826 write 0x2fac781 thru 0x2fbc477 (0xfcf7 bytes) 2024-09-11T05:34:12.599 INFO:teuthology.orchestra.run.smithi070.stdout:5828 write 0xc9e80c9 thru 0xc9eb114 (0x304c bytes) 2024-09-11T05:34:12.601 INFO:teuthology.orchestra.run.smithi070.stdout:5829 write 0x28a83ca thru 0x28b70a1 (0xecd8 bytes) 2024-09-11T05:34:12.613 INFO:teuthology.orchestra.run.smithi070.stdout:5830 trunc from 0xd4ecd4c to 0x5d722ea 2024-09-11T05:34:12.629 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:34:12.652 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:12.652 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:12.652 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:12.652 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:12.652 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:12.661 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:12.672 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:12.672+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:12.773 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:12.773+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:12.810 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:184170 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.88819486999999997, 2024-09-11T05:34:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047293133000000001, 2024-09-11T05:34:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 184170 2024-09-11T05:34:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921808+0000", 2024-09-11T05:34:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001805868 2024-09-11T05:34:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921819+0000", 2024-09-11T05:34:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0458e-05 2024-09-11T05:34:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921830+0000", 2024-09-11T05:34:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1482e-05 2024-09-11T05:34:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921837+0000", 2024-09-11T05:34:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3709999999999996e-06 2024-09-11T05:34:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967150+0000", 2024-09-11T05:34:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045313402000000003 2024-09-11T05:34:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967216+0000", 2024-09-11T05:34:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6322999999999995e-05 2024-09-11T05:34:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967296+0000", 2024-09-11T05:34:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9228999999999996e-05 2024-09-11T05:34:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185733 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3309568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.53416185800000004, 2024-09-11T05:34:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047365106999999997, 2024-09-11T05:34:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185733 2024-09-11T05:34:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275806+0000", 2024-09-11T05:34:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001769966 2024-09-11T05:34:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275810+0000", 2024-09-11T05:34:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5539999999999999e-06 2024-09-11T05:34:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275821+0000", 2024-09-11T05:34:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1253999999999999e-05 2024-09-11T05:34:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275828+0000", 2024-09-11T05:34:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321211+0000", 2024-09-11T05:34:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045383053999999999 2024-09-11T05:34:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321306+0000", 2024-09-11T05:34:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4712999999999999e-05 2024-09-11T05:34:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321401+0000", 2024-09-11T05:34:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4825000000000001e-05 2024-09-11T05:34:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185743 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3719168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.53215002199999994, 2024-09-11T05:34:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047361001999999999, 2024-09-11T05:34:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185743 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276048+0000", 2024-09-11T05:34:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:34:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276050+0000", 2024-09-11T05:34:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:34:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276056+0000", 2024-09-11T05:34:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:34:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276061+0000", 2024-09-11T05:34:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T05:34:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323215+0000", 2024-09-11T05:34:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047153977999999999 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323278+0000", 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3053999999999996e-05 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323408+0000", 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013012899999999999 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185744 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3760128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.53212934199999995, 2024-09-11T05:34:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047563095, 2024-09-11T05:34:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185744 2024-09-11T05:34:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277808+0000", 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001739652 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277816+0000", 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.208e-06 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277829+0000", 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2848e-05 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277837+0000", 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6379999999999993e-06 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323448+0000", 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045610604999999999 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323562+0000", 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113706 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323631+0000", 2024-09-11T05:34:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9437999999999995e-05 2024-09-11T05:34:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185753 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.53016629599999998, 2024-09-11T05:34:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047283944000000001, 2024-09-11T05:34:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185753 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278033+0000", 2024-09-11T05:34:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.237e-06 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278036+0000", 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278038+0000", 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5490000000000001e-06 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325140+0000", 2024-09-11T05:34:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047101845000000003 2024-09-11T05:34:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325219+0000", 2024-09-11T05:34:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9444999999999996e-05 2024-09-11T05:34:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325315+0000", 2024-09-11T05:34:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.569e-05 2024-09-11T05:34:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185754 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4169728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.53015639800000003, 2024-09-11T05:34:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047450697, 2024-09-11T05:34:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185754 2024-09-11T05:34:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278043+0000", 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278045+0000", 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278048+0000", 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5679999999999998e-06 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325359+0000", 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047311262 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325421+0000", 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1717999999999994e-05 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325492+0000", 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0716000000000005e-05 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185755 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2125824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.53014633099999997, 2024-09-11T05:34:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047669481999999999, 2024-09-11T05:34:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185755 2024-09-11T05:34:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278052+0000", 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278055+0000", 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8059999999999999e-06 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278058+0000", 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.503e-06 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325563+0000", 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047505316999999998 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325645+0000", 2024-09-11T05:34:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2439000000000001e-05 2024-09-11T05:34:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325721+0000", 2024-09-11T05:34:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5092999999999994e-05 2024-09-11T05:34:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185756 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2166784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.53013400099999997, 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047861556, 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185756 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279805+0000", 2024-09-11T05:34:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001741586 2024-09-11T05:34:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279809+0000", 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0890000000000002e-06 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279816+0000", 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2060000000000001e-06 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279821+0000", 2024-09-11T05:34:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6709999999999998e-06 2024-09-11T05:34:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325764+0000", 2024-09-11T05:34:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045942749999999997 2024-09-11T05:34:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325846+0000", 2024-09-11T05:34:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2470000000000002e-05 2024-09-11T05:34:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325925+0000", 2024-09-11T05:34:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8783999999999997e-05 2024-09-11T05:34:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185764 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2494464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52816994500000003, 2024-09-11T05:34:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308594000000002, 2024-09-11T05:34:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185764 2024-09-11T05:34:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280028+0000", 2024-09-11T05:34:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.27e-07 2024-09-11T05:34:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280030+0000", 2024-09-11T05:34:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3319999999999999e-06 2024-09-11T05:34:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280036+0000", 2024-09-11T05:34:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:34:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280041+0000", 2024-09-11T05:34:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7530000000000001e-06 2024-09-11T05:34:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327196+0000", 2024-09-11T05:34:12.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047154967999999998 2024-09-11T05:34:12.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327266+0000", 2024-09-11T05:34:12.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0427999999999997e-05 2024-09-11T05:34:12.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327336+0000", 2024-09-11T05:34:12.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9659000000000005e-05 2024-09-11T05:34:12.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.854 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.854 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185765 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2535424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.854 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:12.854 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52815002600000005, 2024-09-11T05:34:12.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047410790000000001, 2024-09-11T05:34:12.854 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185765 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:12.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280048+0000", 2024-09-11T05:34:12.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T05:34:12.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280050+0000", 2024-09-11T05:34:12.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-11T05:34:12.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280056+0000", 2024-09-11T05:34:12.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:34:12.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280061+0000", 2024-09-11T05:34:12.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T05:34:12.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327369+0000", 2024-09-11T05:34:12.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308416999999998 2024-09-11T05:34:12.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327413+0000", 2024-09-11T05:34:12.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070999999999999e-05 2024-09-11T05:34:12.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327458+0000", 2024-09-11T05:34:12.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4836000000000002e-05 2024-09-11T05:34:12.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.859 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.859 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.859 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185766 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2576384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.859 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:12.859 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52813003599999997, 2024-09-11T05:34:12.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047571239000000001, 2024-09-11T05:34:12.859 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.859 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.859 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.860 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.860 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185766 2024-09-11T05:34:12.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.860 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:12.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:12.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280068+0000", 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280070+0000", 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280081+0000", 2024-09-11T05:34:12.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0951999999999999e-05 2024-09-11T05:34:12.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280086+0000", 2024-09-11T05:34:12.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5029999999999997e-06 2024-09-11T05:34:12.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327495+0000", 2024-09-11T05:34:12.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047408497000000001 2024-09-11T05:34:12.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327568+0000", 2024-09-11T05:34:12.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3450999999999999e-05 2024-09-11T05:34:12.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327639+0000", 2024-09-11T05:34:12.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0309999999999996e-05 2024-09-11T05:34:12.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.863 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.864 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185767 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2617344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.864 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:12.864 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52808289900000005, 2024-09-11T05:34:12.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047672355, 2024-09-11T05:34:12.864 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.864 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.864 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.865 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.865 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185767 2024-09-11T05:34:12.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.865 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:12.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:12.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:12.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8999999999999996e-07 2024-09-11T05:34:12.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280121+0000", 2024-09-11T05:34:12.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0599999999999996e-06 2024-09-11T05:34:12.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280128+0000", 2024-09-11T05:34:12.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1029999999999996e-06 2024-09-11T05:34:12.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280133+0000", 2024-09-11T05:34:12.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T05:34:12.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327702+0000", 2024-09-11T05:34:12.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047568307999999997 2024-09-11T05:34:12.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327745+0000", 2024-09-11T05:34:12.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3407e-05 2024-09-11T05:34:12.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327787+0000", 2024-09-11T05:34:12.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1749000000000003e-05 2024-09-11T05:34:12.869 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.869 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.869 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.869 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185768 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2658304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.869 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:12.870 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52805554799999999, 2024-09-11T05:34:12.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047830091999999998, 2024-09-11T05:34:12.870 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.870 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.870 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.870 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185768 2024-09-11T05:34:12.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.870 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:12.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:12.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281805+0000", 2024-09-11T05:34:12.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016635809999999999 2024-09-11T05:34:12.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281810+0000", 2024-09-11T05:34:12.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3540000000000002e-06 2024-09-11T05:34:12.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281820+0000", 2024-09-11T05:34:12.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T05:34:12.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281828+0000", 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327826+0000", 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045998206999999999 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327902+0000", 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5761999999999997e-05 2024-09-11T05:34:12.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327972+0000", 2024-09-11T05:34:12.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0414999999999996e-05 2024-09-11T05:34:12.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.876 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.876 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185775 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2945024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.876 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:12.877 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52626148900000003, 2024-09-11T05:34:12.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047301277000000003, 2024-09-11T05:34:12.877 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.877 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.877 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.877 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.877 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.877 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.877 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185775 2024-09-11T05:34:12.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.877 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:12.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:12.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:12.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:34:12.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281938+0000", 2024-09-11T05:34:12.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5099999999999999e-06 2024-09-11T05:34:12.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281941+0000", 2024-09-11T05:34:12.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-06 2024-09-11T05:34:12.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281943+0000", 2024-09-11T05:34:12.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.751e-06 2024-09-11T05:34:12.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329092+0000", 2024-09-11T05:34:12.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047148177999999999 2024-09-11T05:34:12.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329166+0000", 2024-09-11T05:34:12.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4795000000000005e-05 2024-09-11T05:34:12.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329237+0000", 2024-09-11T05:34:12.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0864000000000005e-05 2024-09-11T05:34:12.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.881 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.882 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185777 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2985984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.882 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:12.882 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52625105999999999, 2024-09-11T05:34:12.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047500597999999998, 2024-09-11T05:34:12.882 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.882 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.882 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.882 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185777 2024-09-11T05:34:12.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281947+0000", 2024-09-11T05:34:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281948+0000", 2024-09-11T05:34:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1429999999999999e-06 2024-09-11T05:34:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281951+0000", 2024-09-11T05:34:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-11T05:34:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281953+0000", 2024-09-11T05:34:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6709999999999999e-06 2024-09-11T05:34:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329280+0000", 2024-09-11T05:34:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047326857999999999 2024-09-11T05:34:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329364+0000", 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3586999999999998e-05 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329447+0000", 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3314999999999998e-05 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185778 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3026944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52624124699999997, 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047668384000000001, 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185778 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283808+0000", 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018518919999999999 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283812+0000", 2024-09-11T05:34:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283820+0000", 2024-09-11T05:34:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3319999999999992e-06 2024-09-11T05:34:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283825+0000", 2024-09-11T05:34:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8729999999999998e-06 2024-09-11T05:34:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329484+0000", 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045658404999999999 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329554+0000", 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0099999999999996e-05 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329625+0000", 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0732e-05 2024-09-11T05:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185790 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2170880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52425629399999996, 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047276674999999997, 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185790 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283942+0000", 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283944+0000", 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9800000000000001e-06 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283948+0000", 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9729999999999999e-06 2024-09-11T05:34:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283950+0000", 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7020000000000001e-06 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331076+0000", 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047126016 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331147+0000", 2024-09-11T05:34:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0848999999999999e-05 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331218+0000", 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0621e-05 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185791 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3395584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52423024399999996, 2024-09-11T05:34:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047372307000000002, 2024-09-11T05:34:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185791 2024-09-11T05:34:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283968+0000", 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283970+0000", 2024-09-11T05:34:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.199e-06 2024-09-11T05:34:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283976+0000", 2024-09-11T05:34:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T05:34:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283981+0000", 2024-09-11T05:34:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:34:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331252+0000", 2024-09-11T05:34:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047270999000000001 2024-09-11T05:34:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331299+0000", 2024-09-11T05:34:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7376999999999997e-05 2024-09-11T05:34:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331339+0000", 2024-09-11T05:34:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0428e-05 2024-09-11T05:34:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185792 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2211840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52421034700000002, 2024-09-11T05:34:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047522035999999997, 2024-09-11T05:34:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185792 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283990+0000", 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283995+0000", 2024-09-11T05:34:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3329999999999996e-06 2024-09-11T05:34:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284002+0000", 2024-09-11T05:34:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6120000000000001e-06 2024-09-11T05:34:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331373+0000", 2024-09-11T05:34:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047370269999999999 2024-09-11T05:34:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331442+0000", 2024-09-11T05:34:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8794999999999994e-05 2024-09-11T05:34:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331509+0000", 2024-09-11T05:34:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7570000000000005e-05 2024-09-11T05:34:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185793 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3436544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52418824799999997, 2024-09-11T05:34:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047706692000000002, 2024-09-11T05:34:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185793 2024-09-11T05:34:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285808+0000", 2024-09-11T05:34:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001798352 2024-09-11T05:34:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285812+0000", 2024-09-11T05:34:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6399999999999996e-06 2024-09-11T05:34:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285823+0000", 2024-09-11T05:34:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0783e-05 2024-09-11T05:34:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285831+0000", 2024-09-11T05:34:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:34:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331550+0000", 2024-09-11T05:34:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045719518000000001 2024-09-11T05:34:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331633+0000", 2024-09-11T05:34:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2992999999999996e-05 2024-09-11T05:34:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331716+0000", 2024-09-11T05:34:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2455999999999998e-05 2024-09-11T05:34:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:12.909 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:12.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:12.911 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:12.910+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:13.011 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:13.011+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:13.057 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:13.058 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:13.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:13.113 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:13.112+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:13.209 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:13.210 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:13.210 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:13.213 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:13.213+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:13.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:13.314 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:13.314+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:13.363 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:13.363 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:13.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:13.364 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:13.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.364 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116623 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13477888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.364 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:13.364 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.472195188999997, 2024-09-11T05:34:13.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9661491070000001, 2024-09-11T05:34:13.364 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116623 2024-09-11T05:34:13.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.365 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:13.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:13.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889573+0000", 2024-09-11T05:34:13.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:13.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889574+0000", 2024-09-11T05:34:13.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4810000000000001e-06 2024-09-11T05:34:13.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889578+0000", 2024-09-11T05:34:13.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T05:34:13.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889581+0000", 2024-09-11T05:34:13.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2380000000000002e-06 2024-09-11T05:34:13.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890367+0000", 2024-09-11T05:34:13.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078646599999999999 2024-09-11T05:34:13.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890377+0000", 2024-09-11T05:34:13.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5789999999999993e-06 2024-09-11T05:34:13.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829092+0000", 2024-09-11T05:34:13.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871527899999996 2024-09-11T05:34:13.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829101+0000", 2024-09-11T05:34:13.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:34:13.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854695+0000", 2024-09-11T05:34:13.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0255937369999999 2024-09-11T05:34:13.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854786+0000", 2024-09-11T05:34:13.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1831999999999998e-05 2024-09-11T05:34:13.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855721+0000", 2024-09-11T05:34:13.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093499800000000004 2024-09-11T05:34:13.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.370 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.370 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116624 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13502464~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.370 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:13.370 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.472181341999999, 2024-09-11T05:34:13.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9664307189999999, 2024-09-11T05:34:13.370 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116624 2024-09-11T05:34:13.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.371 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:13.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:13.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889587+0000", 2024-09-11T05:34:13.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:34:13.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889588+0000", 2024-09-11T05:34:13.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T05:34:13.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889592+0000", 2024-09-11T05:34:13.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.472e-06 2024-09-11T05:34:13.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889594+0000", 2024-09-11T05:34:13.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T05:34:13.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890405+0000", 2024-09-11T05:34:13.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00081088199999999997 2024-09-11T05:34:13.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890410+0000", 2024-09-11T05:34:13.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999996e-06 2024-09-11T05:34:13.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829131+0000", 2024-09-11T05:34:13.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93872118999999998 2024-09-11T05:34:13.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829138+0000", 2024-09-11T05:34:13.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1760000000000004e-06 2024-09-11T05:34:13.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855755+0000", 2024-09-11T05:34:13.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026616722 2024-09-11T05:34:13.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855872+0000", 2024-09-11T05:34:13.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116927 2024-09-11T05:34:13.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856017+0000", 2024-09-11T05:34:13.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145313 2024-09-11T05:34:13.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.376 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.376 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116625 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13527040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.377 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:13.377 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.472170122999998, 2024-09-11T05:34:13.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9666986180000001, 2024-09-11T05:34:13.377 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.377 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116625 2024-09-11T05:34:13.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.377 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:13.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:13.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889598+0000", 2024-09-11T05:34:13.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:34:13.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889599+0000", 2024-09-11T05:34:13.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.144e-06 2024-09-11T05:34:13.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889602+0000", 2024-09-11T05:34:13.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:13.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889604+0000", 2024-09-11T05:34:13.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7640000000000001e-06 2024-09-11T05:34:13.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890442+0000", 2024-09-11T05:34:13.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083777099999999996 2024-09-11T05:34:13.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890452+0000", 2024-09-11T05:34:13.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5559999999999996e-06 2024-09-11T05:34:13.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829170+0000", 2024-09-11T05:34:13.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871818900000004 2024-09-11T05:34:13.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829177+0000", 2024-09-11T05:34:13.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7220000000000002e-06 2024-09-11T05:34:13.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856046+0000", 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026868943 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856144+0000", 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8684999999999995e-05 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856296+0000", 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151667 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.382 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116626 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13551616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.472159353000002, 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.96707056, 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116626 2024-09-11T05:34:13.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.384 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:13.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:13.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:13.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:13.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889610+0000", 2024-09-11T05:34:13.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.186e-06 2024-09-11T05:34:13.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889613+0000", 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889615+0000", 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890487+0000", 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087202600000000003 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890492+0000", 2024-09-11T05:34:13.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:34:13.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829202+0000", 2024-09-11T05:34:13.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871036299999999 2024-09-11T05:34:13.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829209+0000", 2024-09-11T05:34:13.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7669999999999998e-06 2024-09-11T05:34:13.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856327+0000", 2024-09-11T05:34:13.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027118465 2024-09-11T05:34:13.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856525+0000", 2024-09-11T05:34:13.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019825499999999999 2024-09-11T05:34:13.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856679+0000", 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015328 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116627 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13576192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.472149467999998, 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9673406419999999, 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116627 2024-09-11T05:34:13.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.390 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:13.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:13.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:13.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:34:13.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889619+0000", 2024-09-11T05:34:13.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.093e-06 2024-09-11T05:34:13.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889622+0000", 2024-09-11T05:34:13.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T05:34:13.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889625+0000", 2024-09-11T05:34:13.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:34:13.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890528+0000", 2024-09-11T05:34:13.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000902804 2024-09-11T05:34:13.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890537+0000", 2024-09-11T05:34:13.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2029999999999998e-06 2024-09-11T05:34:13.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829232+0000", 2024-09-11T05:34:13.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93869459799999999 2024-09-11T05:34:13.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829238+0000", 2024-09-11T05:34:13.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6699999999999997e-06 2024-09-11T05:34:13.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856709+0000", 2024-09-11T05:34:13.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027470925 2024-09-11T05:34:13.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856815+0000", 2024-09-11T05:34:13.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010566899999999999 2024-09-11T05:34:13.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856959+0000", 2024-09-11T05:34:13.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000143752 2024-09-11T05:34:13.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.395 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.395 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116628 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13600768~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.395 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:13.395 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.472125472999998, 2024-09-11T05:34:13.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9676105420000001, 2024-09-11T05:34:13.396 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116628 2024-09-11T05:34:13.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.396 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:13.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889644+0000", 2024-09-11T05:34:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:34:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889647+0000", 2024-09-11T05:34:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3950000000000001e-06 2024-09-11T05:34:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889650+0000", 2024-09-11T05:34:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:34:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890570+0000", 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092007999999999999 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890577+0000", 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.764e-06 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829261+0000", 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93868468500000002 2024-09-11T05:34:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829268+0000", 2024-09-11T05:34:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T05:34:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857004+0000", 2024-09-11T05:34:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027736043 2024-09-11T05:34:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857102+0000", 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8066999999999995e-05 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857253+0000", 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015050400000000001 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116629 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13625344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.472108962, 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967906154, 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116629 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:13.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:13.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:13.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-07 2024-09-11T05:34:13.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889660+0000", 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5650000000000001e-06 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889664+0000", 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4000000000000001e-06 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889666+0000", 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890614+0000", 2024-09-11T05:34:13.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00094762999999999998 2024-09-11T05:34:13.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890621+0000", 2024-09-11T05:34:13.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.379e-06 2024-09-11T05:34:13.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829291+0000", 2024-09-11T05:34:13.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866938499999997 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829298+0000", 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6610000000000003e-06 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857284+0000", 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027986522 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857393+0000", 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109054 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857565+0000", 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017160999999999999 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116843 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12595200~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:13.407 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.472097740000002, 2024-09-11T05:34:13.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9682605290000001, 2024-09-11T05:34:13.408 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116843 2024-09-11T05:34:13.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:13.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:13.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:13.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:13.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889671+0000", 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889674+0000", 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.005e-06 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889677+0000", 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T05:34:13.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890648+0000", 2024-09-11T05:34:13.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097103399999999996 2024-09-11T05:34:13.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890652+0000", 2024-09-11T05:34:13.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0790000000000002e-06 2024-09-11T05:34:13.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829320+0000", 2024-09-11T05:34:13.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866793199999998 2024-09-11T05:34:13.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829327+0000", 2024-09-11T05:34:13.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5529999999999998e-06 2024-09-11T05:34:13.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857596+0000", 2024-09-11T05:34:13.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028269125 2024-09-11T05:34:13.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857834+0000", 2024-09-11T05:34:13.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023784300000000001 2024-09-11T05:34:13.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857930+0000", 2024-09-11T05:34:13.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6704000000000001e-05 2024-09-11T05:34:13.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.413 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.414 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116844 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12619776~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.414 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:13.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.472087549000001, 2024-09-11T05:34:13.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9685250679999999, 2024-09-11T05:34:13.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116844 2024-09-11T05:34:13.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.414 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:13.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:13.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:13.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:13.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889681+0000", 2024-09-11T05:34:13.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.229e-06 2024-09-11T05:34:13.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889684+0000", 2024-09-11T05:34:13.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0130000000000002e-06 2024-09-11T05:34:13.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889687+0000", 2024-09-11T05:34:13.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7259999999999998e-06 2024-09-11T05:34:13.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890685+0000", 2024-09-11T05:34:13.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099783399999999996 2024-09-11T05:34:13.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890695+0000", 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829349+0000", 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865456300000005 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829356+0000", 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5130000000000002e-06 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857959+0000", 2024-09-11T05:34:13.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0286034959999999 2024-09-11T05:34:13.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858057+0000", 2024-09-11T05:34:13.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8097999999999995e-05 2024-09-11T05:34:13.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858205+0000", 2024-09-11T05:34:13.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147732 2024-09-11T05:34:13.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.420 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.420 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116845 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12644352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.420 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:13.420 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.472077315999996, 2024-09-11T05:34:13.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968783033, 2024-09-11T05:34:13.420 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116845 2024-09-11T05:34:13.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.421 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:13.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:13.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:13.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:13.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889692+0000", 2024-09-11T05:34:13.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2330000000000001e-06 2024-09-11T05:34:13.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889695+0000", 2024-09-11T05:34:13.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9249999999999999e-06 2024-09-11T05:34:13.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889697+0000", 2024-09-11T05:34:13.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:34:13.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890719+0000", 2024-09-11T05:34:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010218429999999999 2024-09-11T05:34:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890723+0000", 2024-09-11T05:34:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:34:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829378+0000", 2024-09-11T05:34:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865562000000002 2024-09-11T05:34:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829385+0000", 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4579999999999998e-06 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858234+0000", 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028849288 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858337+0000", 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102371 2024-09-11T05:34:13.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858473+0000", 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013669299999999999 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116846 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12668928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.472054391, 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.969056522, 2024-09-11T05:34:13.426 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116846 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:13.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:13.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-07 2024-09-11T05:34:13.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889715+0000", 2024-09-11T05:34:13.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.482e-06 2024-09-11T05:34:13.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889718+0000", 2024-09-11T05:34:13.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:13.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889721+0000", 2024-09-11T05:34:13.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-11T05:34:13.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890762+0000", 2024-09-11T05:34:13.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010413659999999999 2024-09-11T05:34:13.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890772+0000", 2024-09-11T05:34:13.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5750000000000007e-06 2024-09-11T05:34:13.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829407+0000", 2024-09-11T05:34:13.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93863550699999998 2024-09-11T05:34:13.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829414+0000", 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5640000000000002e-06 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858502+0000", 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0290880099999999 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858634+0000", 2024-09-11T05:34:13.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013173199999999999 2024-09-11T05:34:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858770+0000", 2024-09-11T05:34:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135943 2024-09-11T05:34:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116847 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12693504~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.472024703000002, 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9692923329999998, 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116847 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T05:34:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889747+0000", 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.501e-06 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889753+0000", 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1360000000000002e-06 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889756+0000", 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3110000000000001e-06 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890808+0000", 2024-09-11T05:34:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010523240000000001 2024-09-11T05:34:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890813+0000", 2024-09-11T05:34:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5650000000000003e-06 2024-09-11T05:34:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829436+0000", 2024-09-11T05:34:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93862351799999999 2024-09-11T05:34:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829443+0000", 2024-09-11T05:34:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5220000000000004e-06 2024-09-11T05:34:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858798+0000", 2024-09-11T05:34:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029354903 2024-09-11T05:34:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858899+0000", 2024-09-11T05:34:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101414 2024-09-11T05:34:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859035+0000", 2024-09-11T05:34:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013589 2024-09-11T05:34:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116848 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12718080~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.472008017999997, 2024-09-11T05:34:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9695514759999999, 2024-09-11T05:34:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116848 2024-09-11T05:34:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889760+0000", 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889761+0000", 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.189e-06 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889764+0000", 2024-09-11T05:34:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889766+0000", 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890850+0000", 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010835479999999999 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890857+0000", 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6299999999999998e-06 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829465+0000", 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860787000000001 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829472+0000", 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4420000000000003e-06 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859062+0000", 2024-09-11T05:34:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0295903360000001 2024-09-11T05:34:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859169+0000", 2024-09-11T05:34:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010674400000000001 2024-09-11T05:34:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859311+0000", 2024-09-11T05:34:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014209499999999999 2024-09-11T05:34:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116849 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12742656~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.471998231999997, 2024-09-11T05:34:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9698160310000001, 2024-09-11T05:34:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116849 2024-09-11T05:34:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889771+0000", 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889774+0000", 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889776+0000", 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.638e-06 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890886+0000", 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011102519999999999 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890891+0000", 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2200000000000003e-06 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829494+0000", 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860342500000005 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829501+0000", 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4829999999999996e-06 2024-09-11T05:34:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859339+0000", 2024-09-11T05:34:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0298381320000001 2024-09-11T05:34:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859440+0000", 2024-09-11T05:34:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010145 2024-09-11T05:34:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859585+0000", 2024-09-11T05:34:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014513300000000001 2024-09-11T05:34:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116850 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12767232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.471977205999998, 2024-09-11T05:34:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970125645, 2024-09-11T05:34:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116850 2024-09-11T05:34:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889791+0000", 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889792+0000", 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4899999999999999e-06 2024-09-11T05:34:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889795+0000", 2024-09-11T05:34:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889798+0000", 2024-09-11T05:34:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7089999999999998e-06 2024-09-11T05:34:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890924+0000", 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001125685 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890933+0000", 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3340000000000008e-06 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829523+0000", 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858966099999996 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829529+0000", 2024-09-11T05:34:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5740000000000001e-06 2024-09-11T05:34:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859614+0000", 2024-09-11T05:34:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0300843289999999 2024-09-11T05:34:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859743+0000", 2024-09-11T05:34:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129407 2024-09-11T05:34:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859916+0000", 2024-09-11T05:34:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017282500000000001 2024-09-11T05:34:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116851 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12791808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.471937336000003, 2024-09-11T05:34:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970347268, 2024-09-11T05:34:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116851 2024-09-11T05:34:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:34:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889832+0000", 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6819999999999999e-06 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889838+0000", 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889841+0000", 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890957+0000", 2024-09-11T05:34:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001115956 2024-09-11T05:34:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890961+0000", 2024-09-11T05:34:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7050000000000001e-06 2024-09-11T05:34:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829552+0000", 2024-09-11T05:34:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93859101499999997 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829558+0000", 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5429999999999999e-06 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859947+0000", 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030388248 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860043+0000", 2024-09-11T05:34:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5847999999999994e-05 2024-09-11T05:34:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860177+0000", 2024-09-11T05:34:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013484400000000001 2024-09-11T05:34:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116852 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12816384~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.471922724999999, 2024-09-11T05:34:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970594859, 2024-09-11T05:34:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116852 2024-09-11T05:34:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889846+0000", 2024-09-11T05:34:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.204e-06 2024-09-11T05:34:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889849+0000", 2024-09-11T05:34:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.931e-06 2024-09-11T05:34:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889852+0000", 2024-09-11T05:34:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:34:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890993+0000", 2024-09-11T05:34:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001141176 2024-09-11T05:34:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891001+0000", 2024-09-11T05:34:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5259999999999996e-06 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829582+0000", 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858050800000004 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829588+0000", 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4980000000000003e-06 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860207+0000", 2024-09-11T05:34:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030618713 2024-09-11T05:34:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860305+0000", 2024-09-11T05:34:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8209999999999997e-05 2024-09-11T05:34:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860440+0000", 2024-09-11T05:34:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134692 2024-09-11T05:34:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116853 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12840960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.471912007, 2024-09-11T05:34:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.97084075, 2024-09-11T05:34:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116853 2024-09-11T05:34:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889856+0000", 2024-09-11T05:34:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:34:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889857+0000", 2024-09-11T05:34:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.435e-06 2024-09-11T05:34:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889860+0000", 2024-09-11T05:34:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9620000000000002e-06 2024-09-11T05:34:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889863+0000", 2024-09-11T05:34:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T05:34:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891036+0000", 2024-09-11T05:34:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011734580000000001 2024-09-11T05:34:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891042+0000", 2024-09-11T05:34:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3290000000000001e-06 2024-09-11T05:34:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829611+0000", 2024-09-11T05:34:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856954299999995 2024-09-11T05:34:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829618+0000", 2024-09-11T05:34:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T05:34:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860465+0000", 2024-09-11T05:34:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0308472500000001 2024-09-11T05:34:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860558+0000", 2024-09-11T05:34:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3253999999999999e-05 2024-09-11T05:34:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860696+0000", 2024-09-11T05:34:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138169 2024-09-11T05:34:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116854 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12865536~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.471901815999999, 2024-09-11T05:34:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9710979320000002, 2024-09-11T05:34:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116854 2024-09-11T05:34:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889867+0000", 2024-09-11T05:34:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.155e-06 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889871+0000", 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9260000000000002e-06 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889875+0000", 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.262e-06 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891070+0000", 2024-09-11T05:34:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011945160000000001 2024-09-11T05:34:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891079+0000", 2024-09-11T05:34:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3759999999999997e-06 2024-09-11T05:34:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829642+0000", 2024-09-11T05:34:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856325900000004 2024-09-11T05:34:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829649+0000", 2024-09-11T05:34:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:34:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860726+0000", 2024-09-11T05:34:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.031076791 2024-09-11T05:34:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860831+0000", 2024-09-11T05:34:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105003 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860964+0000", 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013285700000000001 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116855 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12890112~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.471887035999998, 2024-09-11T05:34:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.971277814, 2024-09-11T05:34:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116855 2024-09-11T05:34:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817809+0000", 2024-09-11T05:34:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.92792850999999998 2024-09-11T05:34:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817815+0000", 2024-09-11T05:34:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4110000000000001e-06 2024-09-11T05:34:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817827+0000", 2024-09-11T05:34:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2031000000000001e-05 2024-09-11T05:34:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817837+0000", 2024-09-11T05:34:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2159999999999995e-06 2024-09-11T05:34:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829673+0000", 2024-09-11T05:34:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011836197 2024-09-11T05:34:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829679+0000", 2024-09-11T05:34:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5390000000000004e-06 2024-09-11T05:34:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861000+0000", 2024-09-11T05:34:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0313209539999999 2024-09-11T05:34:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861080+0000", 2024-09-11T05:34:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9606999999999999e-05 2024-09-11T05:34:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861158+0000", 2024-09-11T05:34:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8349000000000005e-05 2024-09-11T05:34:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:13.488 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:13.488 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:34:13.489 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:13.489+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:13.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:13.590 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:13.590+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:13.616 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T05:34:13.650 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:13.650 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:13.651 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:13.651 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:13.652 INFO:teuthology.orchestra.run.smithi070.stdout:5831 writesame 0x6076d4a thru 0x60797f9 data_size 0x1(0x2ab0 bytes) 2024-09-11T05:34:13.652 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:13.660 INFO:teuthology.orchestra.run.smithi070.stdout:5833 writesame 0x7c6fb75 thru 0x7c7630f data_size 0x1(0x679b bytes) 2024-09-11T05:34:13.660 INFO:teuthology.orchestra.run.smithi070.stdout:5835 read 0x5720448 thru 0x572378a (0x3343 bytes) 2024-09-11T05:34:13.663 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:13.663 INFO:teuthology.orchestra.run.smithi070.stdout:5836 trunc from 0x7c76310 to 0x5437600 2024-09-11T05:34:13.668 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:13.669 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:13.671 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:13.671 INFO:teuthology.orchestra.run.smithi070.stdout:5838 punch from 0x623495 to 0x6297ac, (0x6317 bytes) 2024-09-11T05:34:13.671 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:13.675 INFO:teuthology.orchestra.run.smithi070.stdout:5840 trunc from 0x5437600 to 0x8e6032b 2024-09-11T05:34:13.680 INFO:teuthology.orchestra.run.smithi070.stdout:5843 read 0x8d34da2 thru 0x8d448a4 (0xfb03 bytes) 2024-09-11T05:34:13.680 INFO:teuthology.orchestra.run.smithi070.stdout:5845 punch from 0x6c1f076 to 0x6c222c2, (0x324c bytes) 2024-09-11T05:34:13.689 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:13.689 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:13.691 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:13.690+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:13.692 INFO:teuthology.orchestra.run.smithi070.stdout:5846 writesame 0xde2f58f thru 0xde35de4 data_size 0x5(0x6856 bytes) 2024-09-11T05:34:13.694 INFO:teuthology.orchestra.run.smithi070.stdout:5847 trunc from 0xde35de5 to 0xc926fb2 2024-09-11T05:34:13.699 INFO:teuthology.orchestra.run.smithi070.stdout:5852 read 0xbe8d8a2 thru 0xbe9c47e (0xebdd bytes) 2024-09-11T05:34:13.700 INFO:teuthology.orchestra.run.smithi070.stdout:5853 write 0x81568 thru 0x85107 (0x3ba0 bytes) 2024-09-11T05:34:13.701 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:13.701 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:13.706 INFO:teuthology.orchestra.run.smithi070.stdout:5856 trunc from 0xc926fb2 to 0x84bec1a 2024-09-11T05:34:13.710 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:13.711 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:13.712 INFO:teuthology.orchestra.run.smithi070.stdout:5858 read 0x69897cb thru 0x698d83b (0x4071 bytes) 2024-09-11T05:34:13.713 INFO:teuthology.orchestra.run.smithi070.stdout:5859 read 0xf9d37 thru 0xf9e83 (0x14d bytes) 2024-09-11T05:34:13.713 INFO:teuthology.orchestra.run.smithi070.stdout:5860 clone 41 order 25 su 131072 sc 2 2024-09-11T05:34:13.727 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:13.727 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:13.727 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-11T05:34:13.745 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:13.762 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:13.762 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:13.776 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:13.776 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:13.778 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:13.779 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:13.781 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:34:13.782 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:34:13.785 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:13.827 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:13.827+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:13.893 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:13.893+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:13.929 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:13.930 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:13.938 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:13.994 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:13.994+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:14.049 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:14.049 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:14.058 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:14.095 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:14.095+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:14.161 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:14.161 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:14.170 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:14.196 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:14.196+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:14.272 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:14.272 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:14.281 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:14.324 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:14.324+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:14.383 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:14.384 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:14.392 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:14.434 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:14.433+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:14.499 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:14.499+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:14.535 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:14.536 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:14.544 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:14.600 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:14.600+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:14.649 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:14.649 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:14.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:14.701 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:14.700+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:14.702 INFO:teuthology.orchestra.run.smithi070.stdout:truncating image image_client.0-clone40 from 0x84bec1a (overlap 0x1f582ea) to 0x967413 2024-09-11T05:34:14.783 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-11T05:34:14.790 INFO:teuthology.orchestra.run.smithi070.stdout:5861 trunc from 0x84bec1a to 0x3aec749 2024-09-11T05:34:14.804 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:14.803+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:14.809 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:14.810 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:14.820 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:14.839 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:14.839 INFO:teuthology.orchestra.run.smithi070.stdout:5863 read 0x360f141 thru 0x361106d (0x1f2d bytes) 2024-09-11T05:34:14.850 INFO:teuthology.orchestra.run.smithi070.stdout:5864 write 0x9443ced thru 0x944de4a (0xa15e bytes) 2024-09-11T05:34:14.858 INFO:teuthology.orchestra.run.smithi070.stdout:5865 write 0x9964f02 thru 0x99681ef (0x32ee bytes) 2024-09-11T05:34:14.861 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:14.861 INFO:teuthology.orchestra.run.smithi070.stdout:5867 read 0x4575364 thru 0x4577c84 (0x2921 bytes) 2024-09-11T05:34:14.861 INFO:teuthology.orchestra.run.smithi070.stdout:5869 read 0x616ef4 thru 0x625ffd (0xf10a bytes) 2024-09-11T05:34:14.861 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:14.861 INFO:teuthology.orchestra.run.smithi070.stdout:5871 punch from 0x577cbf to 0x5816bc, (0x99fd bytes) 2024-09-11T05:34:14.867 INFO:teuthology.orchestra.run.smithi070.stdout:5872 trunc from 0x99681f0 to 0x4e7bc1f 2024-09-11T05:34:14.889 INFO:teuthology.orchestra.run.smithi070.stdout:5873 writesame 0xc1978e4 thru 0xc19c170 data_size 0x3(0x488d bytes) 2024-09-11T05:34:14.889 INFO:teuthology.orchestra.run.smithi070.stdout:5874 write 0x78b96b1 thru 0x78bbda0 (0x26f0 bytes) 2024-09-11T05:34:14.891 INFO:teuthology.orchestra.run.smithi070.stdout:5875 writesame 0x4d8e8f1 thru 0x4d98d12 data_size 0x6(0xa422 bytes) 2024-09-11T05:34:14.897 INFO:teuthology.orchestra.run.smithi070.stdout:5880 write 0x8fab777 thru 0x8fac75f (0xfe9 bytes) 2024-09-11T05:34:14.900 INFO:teuthology.orchestra.run.smithi070.stdout:5883 read 0xa52be11 thru 0xa52ff2a (0x411a bytes) 2024-09-11T05:34:14.901 INFO:teuthology.orchestra.run.smithi070.stdout:5884 writesame 0xb095532 thru 0xb09956e data_size 0xd(0x403d bytes) 2024-09-11T05:34:14.902 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:14.901+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:14.904 INFO:teuthology.orchestra.run.smithi070.stdout:5885 punch from 0x1130fa4 to 0x1140d78, (0xfdd4 bytes) 2024-09-11T05:34:14.913 INFO:teuthology.orchestra.run.smithi070.stdout:5886 trunc from 0xc19c171 to 0x44558c3 2024-09-11T05:34:14.925 INFO:teuthology.orchestra.run.smithi070.stdout:5887 punch from 0x840781 to 0x8457c2, (0x5041 bytes) 2024-09-11T05:34:14.925 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:14.925 INFO:teuthology.orchestra.run.smithi070.stdout:5889 write 0x9c5039 thru 0x9ca9c5 (0x598d bytes) 2024-09-11T05:34:14.927 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:14.927 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:14.933 INFO:teuthology.orchestra.run.smithi070.stdout:5891 trunc from 0x44558c3 to 0xc42506f 2024-09-11T05:34:14.936 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:14.944 INFO:teuthology.orchestra.run.smithi070.stdout:5892 write 0xcf65457 thru 0xcf6710e (0x1cb8 bytes) 2024-09-11T05:34:14.946 INFO:teuthology.orchestra.run.smithi070.stdout:5893 read 0x2b1017d thru 0x2b18690 (0x8514 bytes) 2024-09-11T05:34:14.947 INFO:teuthology.orchestra.run.smithi070.stdout:5895 read 0xaa60d09 thru 0xaa68d62 (0x805a bytes) 2024-09-11T05:34:14.947 INFO:teuthology.orchestra.run.smithi070.stdout:5896 writesame 0x909a972 thru 0x909d814 data_size 0x1(0x2ea3 bytes) 2024-09-11T05:34:14.957 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 5, 6] out_osds: [4, 3, 7] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-11T05:34:14.957 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:34:14.958 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T05:34:14.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T05:34:14.962 INFO:teuthology.orchestra.run.smithi070.stdout:5897 write 0xe6c2ca5 thru 0xe6ce3b4 (0xb710 bytes) 2024-09-11T05:34:14.975 INFO:teuthology.orchestra.run.smithi070.stdout:5898 trunc from 0xe6ce3b5 to 0x5d1d6bd 2024-09-11T05:34:14.990 INFO:teuthology.orchestra.run.smithi070.stdout:5899 trunc from 0x5d1d6bd to 0xa4a5dbe 2024-09-11T05:34:15.002 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:15.002+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:15.004 INFO:teuthology.orchestra.run.smithi070.stdout:5900 writesame 0xcc70281 thru 0xcc7b255 data_size 0x1(0xafd5 bytes) 2024-09-11T05:34:15.004 INFO:teuthology.orchestra.run.smithi070.stdout:5901 read 0xa58a0a5 thru 0xa5998a9 (0xf805 bytes) 2024-09-11T05:34:15.004 INFO:teuthology.orchestra.run.smithi070.stdout:5902 read 0xa883cd6 thru 0xa886007 (0x2332 bytes) 2024-09-11T05:34:15.011 INFO:teuthology.orchestra.run.smithi070.stdout:5904 write 0xe26e3d2 thru 0xe27585d (0x748c bytes) 2024-09-11T05:34:15.013 INFO:teuthology.orchestra.run.smithi070.stdout:5905 read 0x215fa66 thru 0x216e61d (0xebb8 bytes) 2024-09-11T05:34:15.014 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:15.014 INFO:teuthology.orchestra.run.smithi070.stdout:5910 writesame 0x7808006 thru 0x781414f data_size 0x9(0xc14a bytes) 2024-09-11T05:34:15.018 INFO:teuthology.orchestra.run.smithi070.stdout:5911 punch from 0x4cee8c9 to 0x4cfca75, (0xe1ac bytes) 2024-09-11T05:34:15.019 INFO:teuthology.orchestra.run.smithi070.stdout:5912 read 0xb79b7e8 thru 0xb7a9c3f (0xe458 bytes) 2024-09-11T05:34:15.019 INFO:teuthology.orchestra.run.smithi070.stdout:5913 punch from 0xdcb9fda to 0xdcc2f72, (0x8f98 bytes) 2024-09-11T05:34:15.019 INFO:teuthology.orchestra.run.smithi070.stdout:5915 clone 42 order 25 su 2097152 sc 15 2024-09-11T05:34:15.041 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:15.041 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:15.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:15.104 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:15.104+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:15.155 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:15.155 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:15.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:15.205 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:15.205+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:34:15.254 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 89, 2024-09-11T05:34:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "eb5ff116-0384-4170-94d3-d3ddcb9c254f", 2024-09-11T05:34:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T05:32:25.817911+0000", 2024-09-11T05:34:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T05:34:14.622199+0000", 2024-09-11T05:34:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T05:34:01.899582+0000", 2024-09-11T05:34:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T05:34:09.933891+0000", 2024-09-11T05:34:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T05:34:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5804032, 2024-09-11T05:34:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T05:34:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2024-09-11T05:34:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T05:34:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T05:34:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T05:34:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T05:34:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:34:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 5, 2024-09-11T05:34:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T05:34:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T05:34:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T05:34:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:37.977484+0000", 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T05:34:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:34:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:34:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:34:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:34:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:34:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:34:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:34:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:34:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:34:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:34:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:34:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T05:34:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T05:34:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T05:34:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T05:34:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T05:34:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:34:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:34:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:34:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:34:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:34:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:34:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:34:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "17", 2024-09-11T05:34:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:34:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:34:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:34:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:34:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:34:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T05:34:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T05:34:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:34:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:34:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:34:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:34:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:34:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:34:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:34:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:34:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:34:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:34:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:34:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:34:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:34:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:34:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:34:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:34:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:34:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:34:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:34:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:34:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:34:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:34:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:34:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:34:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:34:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:34:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:34:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:34:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:34:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:34:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T05:34:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T05:34:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T05:34:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:34:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T05:34:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:34:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:34:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-11T05:34:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.88737106323242188, 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:43.780723+0000", 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T05:34:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:34:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:34:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:34:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:34:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:34:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:34:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:34:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:34:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:34:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:34:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:34:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:34:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T05:34:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T05:34:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T05:34:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T05:34:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T05:34:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:34:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:34:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:34:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:34:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:34:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:34:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:34:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "21", 2024-09-11T05:34:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:34:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:34:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:34:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:34:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:34:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T05:34:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 21, 2024-09-11T05:34:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:34:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:34:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:34:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:34:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:34:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:34:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:34:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:34:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:34:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:34:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:34:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:34:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:34:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:34:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:34:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:34:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:34:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:34:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:34:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:34:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:34:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:34:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:34:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:34:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:34:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:34:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:34:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:34:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:34:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:34:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T05:34:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:34:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T05:34:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:34:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:34:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 2.9800000190734863, 2024-09-11T05:34:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 2.9800000190734863, 2024-09-11T05:34:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.62999999523162842, 2024-09-11T05:34:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-11T05:34:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-11T05:34:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.88737106323242188, 2024-09-11T05:34:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-11T05:34:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-11T05:34:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T05:34:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T05:34:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:53.728195+0000", 2024-09-11T05:34:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T05:34:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:34:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:34:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:34:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:34:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:34:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:34:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:34:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:34:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:34:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:34:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:34:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:34:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T05:34:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T05:34:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T05:34:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T05:34:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T05:34:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:34:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:34:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:34:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:34:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:34:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:34:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:34:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "89", 2024-09-11T05:34:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:34:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:34:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:34:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:34:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:34:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 43, 2024-09-11T05:34:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 89, 2024-09-11T05:34:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:34:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:34:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:34:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:34:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:34:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:34:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:34:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:34:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:34:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:34:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:34:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:34:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:34:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:34:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:34:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:34:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:34:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:34:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T05:34:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:34:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T05:34:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:34:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:34:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.9800000190734863, 2024-09-11T05:34:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.9800000190734863, 2024-09-11T05:34:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.62999999523162842, 2024-09-11T05:34:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.25, 2024-09-11T05:34:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.25, 2024-09-11T05:34:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.88737106323242188, 2024-09-11T05:34:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-11T05:34:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-11T05:34:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:34:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T05:34:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T05:34:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "6ef7487b-9326-4062-8fe4-ef39030252bd", 2024-09-11T05:34:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:34:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:34:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:34:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:34:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:34:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:34:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:34:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 87, 2024-09-11T05:34:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:34:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:34:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:34:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T05:34:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:34:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T05:34:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:34:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:34:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T05:34:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:34:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T05:34:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:34:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:34:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T05:34:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:34:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T05:34:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:34:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6819/4108497907", 2024-09-11T05:34:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6821/4108497907", 2024-09-11T05:34:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6825/4108497907", 2024-09-11T05:34:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6823/4108497907", 2024-09-11T05:34:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:34:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:34:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:34:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T05:34:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "3e0d8348-6e1b-4d63-b0f1-c20d90d73760", 2024-09-11T05:34:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:34:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:34:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:34:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:34:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:34:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:34:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:34:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 87, 2024-09-11T05:34:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:34:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:34:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:34:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T05:34:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:34:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T05:34:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:34:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:34:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T05:34:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:34:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T05:34:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:34:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:34:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T05:34:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:34:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T05:34:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:34:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/3979396531", 2024-09-11T05:34:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/3979396531", 2024-09-11T05:34:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/3979396531", 2024-09-11T05:34:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/3979396531", 2024-09-11T05:34:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:34:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:34:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:34:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T05:34:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "38bbb42f-85e2-4064-8f55-e0385aff07d4", 2024-09-11T05:34:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:34:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:34:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:34:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:34:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:34:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:34:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:34:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 87, 2024-09-11T05:34:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:34:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:34:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:34:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T05:34:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:34:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T05:34:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:34:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:34:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:34:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.292 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T05:34:15.292 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:34:15.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.292 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T05:34:15.292 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:34:15.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.292 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.292 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:34:15.293 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.293 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T05:34:15.293 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:34:15.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.293 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T05:34:15.293 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:34:15.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.293 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6811/4053894977", 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6813/4053894977", 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6817/4053894977", 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6815/4053894977", 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "e96ca529-f3b3-4f7e-bd59-1e9872a5efab", 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:34:15.294 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 0, 2024-09-11T05:34:15.295 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0, 2024-09-11T05:34:15.295 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.098968505859375, 2024-09-11T05:34:15.295 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:34:15.295 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:34:15.295 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:34:15.295 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 22, 2024-09-11T05:34:15.295 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:34:15.295 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:34:15.295 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:34:15.295 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.295 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T05:34:15.296 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:34:15.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.296 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T05:34:15.296 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:34:15.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.296 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.296 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:34:15.296 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.298 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6832", 2024-09-11T05:34:15.298 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:34:15.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.298 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6833", 2024-09-11T05:34:15.298 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:34:15.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.298 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.298 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:34:15.298 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.299 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T05:34:15.299 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:34:15.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.299 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T05:34:15.299 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:34:15.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.299 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.299 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6827/2067624829", 2024-09-11T05:34:15.300 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6829/2067624829", 2024-09-11T05:34:15.300 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6833/2067624829", 2024-09-11T05:34:15.300 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6831/2067624829", 2024-09-11T05:34:15.300 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:34:15.300 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:34:15.300 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:34:15.300 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.300 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T05:34:15.300 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dbbde660-d90e-4e02-9a01-16b0f76aa2b8", 2024-09-11T05:34:15.300 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 0, 2024-09-11T05:34:15.300 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 0, 2024-09-11T05:34:15.301 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0, 2024-09-11T05:34:15.301 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:34:15.301 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:34:15.301 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:34:15.301 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:34:15.301 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 18, 2024-09-11T05:34:15.301 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 76, 2024-09-11T05:34:15.301 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:34:15.301 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:34:15.301 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.301 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6816", 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6817", 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.302 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6818", 2024-09-11T05:34:15.303 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:34:15.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.303 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6819", 2024-09-11T05:34:15.303 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:34:15.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.303 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.303 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:34:15.303 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.304 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6822", 2024-09-11T05:34:15.304 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:34:15.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.304 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6823", 2024-09-11T05:34:15.304 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:34:15.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.304 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:34:15.304 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.305 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6820", 2024-09-11T05:34:15.305 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:34:15.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.305 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6821", 2024-09-11T05:34:15.305 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1743986256 2024-09-11T05:34:15.305 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.305 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6817/1743986256", 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6819/1743986256", 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6823/1743986256", 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6821/1743986256", 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: "exists" 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "2dc1a002-3ec0-4b4d-b84d-e684fa8a9131", 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:34:15.306 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:34:15.307 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:34:15.307 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:34:15.307 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:34:15.307 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:34:15.307 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 87, 2024-09-11T05:34:15.307 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:34:15.307 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:34:15.307 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:34:15.307 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.307 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6824", 2024-09-11T05:34:15.308 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:34:15.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.308 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6825", 2024-09-11T05:34:15.308 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:34:15.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.308 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.308 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:34:15.308 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.309 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6826", 2024-09-11T05:34:15.309 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:34:15.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.309 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6827", 2024-09-11T05:34:15.309 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:34:15.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.309 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.309 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:34:15.309 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.310 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6830", 2024-09-11T05:34:15.310 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:34:15.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.310 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6831", 2024-09-11T05:34:15.310 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:34:15.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.310 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.310 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:34:15.311 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.311 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6828", 2024-09-11T05:34:15.311 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:34:15.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.311 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6829", 2024-09-11T05:34:15.311 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:34:15.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.312 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.312 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6825/2732588656", 2024-09-11T05:34:15.312 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6827/2732588656", 2024-09-11T05:34:15.312 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6831/2732588656", 2024-09-11T05:34:15.312 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6829/2732588656", 2024-09-11T05:34:15.312 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:34:15.312 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:34:15.312 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:34:15.312 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T05:34:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a", 2024-09-11T05:34:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:34:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:34:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:34:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:34:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:34:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:34:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:34:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 87, 2024-09-11T05:34:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:34:15.313 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:34:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:34:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6800", 2024-09-11T05:34:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:34:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6801", 2024-09-11T05:34:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:34:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.314 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:34:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6802", 2024-09-11T05:34:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:34:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6803", 2024-09-11T05:34:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:34:15.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:34:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6806", 2024-09-11T05:34:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:34:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6807", 2024-09-11T05:34:15.316 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:34:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:34:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6804", 2024-09-11T05:34:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:34:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6805", 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6801/372011645", 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6803/372011645", 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6807/372011645", 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6805/372011645", 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:34:15.318 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "5fef4450-317c-4e1f-b05b-80740b9538f1", 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 0, 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0, 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 66, 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:34:15.319 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:34:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:34:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6808", 2024-09-11T05:34:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:34:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6809", 2024-09-11T05:34:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:34:15.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:34:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6810", 2024-09-11T05:34:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:34:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6811", 2024-09-11T05:34:15.321 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:34:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:34:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6814", 2024-09-11T05:34:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:34:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6815", 2024-09-11T05:34:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:34:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:34:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:34:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:34:15.323 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6812", 2024-09-11T05:34:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:34:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:34:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6813", 2024-09-11T05:34:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:34:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6809/583221652", 2024-09-11T05:34:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6811/583221652", 2024-09-11T05:34:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6815/583221652", 2024-09-11T05:34:15.324 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6813/583221652", 2024-09-11T05:34:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:34:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:34:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:34:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:34:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T05:34:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T05:34:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:34:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:34:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:34:15.325 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:34:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:34:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.130019+0000", 2024-09-11T05:34:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:34:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T05:34:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:34:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:34:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:34:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:34:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:34:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.339373+0000", 2024-09-11T05:34:15.326 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.204705+0000", 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T05:34:15.327 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:34:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:34:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:34:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:34:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 65536, 2024-09-11T05:34:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.075490+0000", 2024-09-11T05:34:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:34:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T05:34:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:34:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:34:15.328 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:34:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:34:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 65536, 2024-09-11T05:34:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.279790+0000", 2024-09-11T05:34:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 76 2024-09-11T05:34:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.329 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T05:34:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:34:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:34:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:34:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:34:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:34:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.287168+0000", 2024-09-11T05:34:15.332 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:34:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T05:34:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:34:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:34:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:34:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:34:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:34:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:34.320448+0000", 2024-09-11T05:34:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:34:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.333 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 65536, 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:34.838001+0000", 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [], 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [ 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "2.4", 2024-09-11T05:34:15.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T05:34:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 6, 2024-09-11T05:34:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 1 2024-09-11T05:34:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.6", 2024-09-11T05:34:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T05:34:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 1, 2024-09-11T05:34:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 2 2024-09-11T05:34:15.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:34:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T05:34:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T05:34:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T05:34:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T05:34:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T05:34:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T05:34:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T05:34:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T05:34:15.336 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T05:34:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T05:34:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T05:34:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T05:34:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [], 2024-09-11T05:34:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-11T05:34:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-11T05:34:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T05:34:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T05:34:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T05:34:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T05:34:15.337 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T05:34:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T05:34:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T05:34:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T05:34:15.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:15.338 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:15.340 INFO:tasks.thrashosds.thrasher:j is {'epoch': 89, 'fsid': 'eb5ff116-0384-4170-94d3-d3ddcb9c254f', 'created': '2024-09-11T05:32:25.817911+0000', 'modified': '2024-09-11T05:34:14.622199+0000', 'last_up_change': '2024-09-11T05:34:01.899582+0000', 'last_in_change': '2024-09-11T05:34:09.933891+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T05:32:37.977484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8873710632324219, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T05:32:43.780723+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.9800000190734863, 'score_stable': 2.9800000190734863, 'optimal_score': 0.6299999952316284, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8873710632324219, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T05:32:53.728195+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 43, 'snap_epoch': 89, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9800000190734863, 'score_stable': 1.9800000190734863, 'optimal_score': 0.6299999952316284, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 0.8873710632324219, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}], 'osds': [{'osd': 0, 'uuid': '6ef7487b-9326-4062-8fe4-ef39030252bd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 4108497907}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 4108497907}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 4108497907}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 4108497907}]}, 'public_addr': '172.21.15.70:6819/4108497907', 'cluster_addr': '172.21.15.70:6821/4108497907', 'heartbeat_back_addr': '172.21.15.70:6825/4108497907', 'heartbeat_front_addr': '172.21.15.70:6823/4108497907', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3e0d8348-6e1b-4d63-b0f1-c20d90d73760', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 3979396531}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 3979396531}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 3979396531}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 3979396531}]}, 'public_addr': '172.21.15.70:6801/3979396531', 'cluster_addr': '172.21.15.70:6803/3979396531', 'heartbeat_back_addr': '172.21.15.70:6807/3979396531', 'heartbeat_front_addr': '172.21.15.70:6805/3979396531', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '38bbb42f-85e2-4064-8f55-e0385aff07d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 4053894977}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 4053894977}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 4053894977}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 4053894977}]}, 'public_addr': '172.21.15.70:6811/4053894977', 'cluster_addr': '172.21.15.70:6813/4053894977', 'heartbeat_back_addr': '172.21.15.70:6817/4053894977', 'heartbeat_front_addr': '172.21.15.70:6815/4053894977', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e96ca529-f3b3-4f7e-bd59-1e9872a5efab', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0.098968505859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2067624829}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2067624829}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6832', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6833', 'nonce': 2067624829}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2067624829}]}, 'public_addr': '172.21.15.70:6827/2067624829', 'cluster_addr': '172.21.15.70:6829/2067624829', 'heartbeat_back_addr': '172.21.15.70:6833/2067624829', 'heartbeat_front_addr': '172.21.15.70:6831/2067624829', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'dbbde660-d90e-4e02-9a01-16b0f76aa2b8', 'up': 0, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 76, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6816', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6817', 'nonce': 1743986256}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6818', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6819', 'nonce': 1743986256}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6822', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6823', 'nonce': 1743986256}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6820', 'nonce': 1743986256}, {'type': 'v1', 'addr': '172.21.15.84:6821', 'nonce': 1743986256}]}, 'public_addr': '172.21.15.84:6817/1743986256', 'cluster_addr': '172.21.15.84:6819/1743986256', 'heartbeat_back_addr': '172.21.15.84:6823/1743986256', 'heartbeat_front_addr': '172.21.15.84:6821/1743986256', 'state': ['exists']}, {'osd': 5, 'uuid': '2dc1a002-3ec0-4b4d-b84d-e684fa8a9131', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6824', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6825', 'nonce': 2732588656}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6826', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6827', 'nonce': 2732588656}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6830', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6831', 'nonce': 2732588656}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6828', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6829', 'nonce': 2732588656}]}, 'public_addr': '172.21.15.84:6825/2732588656', 'cluster_addr': '172.21.15.84:6827/2732588656', 'heartbeat_back_addr': '172.21.15.84:6831/2732588656', 'heartbeat_front_addr': '172.21.15.84:6829/2732588656', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6800', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6801', 'nonce': 372011645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6802', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6803', 'nonce': 372011645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6806', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6807', 'nonce': 372011645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6804', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6805', 'nonce': 372011645}]}, 'public_addr': '172.21.15.84:6801/372011645', 'cluster_addr': '172.21.15.84:6803/372011645', 'heartbeat_back_addr': '172.21.15.84:6807/372011645', 'heartbeat_front_addr': '172.21.15.84:6805/372011645', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '5fef4450-317c-4e1f-b05b-80740b9538f1', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6808', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6809', 'nonce': 583221652}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6810', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6811', 'nonce': 583221652}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6814', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6815', 'nonce': 583221652}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6812', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6813', 'nonce': 583221652}]}, 'public_addr': '172.21.15.84:6809/583221652', 'cluster_addr': '172.21.15.84:6811/583221652', 'heartbeat_back_addr': '172.21.15.84:6815/583221652', 'heartbeat_front_addr': '172.21.15.84:6813/583221652', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.130019+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.339373+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.204705+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.075490+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.279790+0000', 'dead_epoch': 76}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.287168+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:34.320448+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T05:32:34.838001+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.4', 'mappings': [{'from': 6, 'to': 1}]}, {'pgid': '3.6', 'mappings': [{'from': 1, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T05:34:15.340 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.6 2024-09-11T05:34:15.340 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap-items 3.6 2024-09-11T05:34:15.341 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:15.341 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:15.342 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:15.342 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:15.339+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:15.440 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:15.440+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:15.487 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:15.487 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:15.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:15.580 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:15.580+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:15.638 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:34:15.642 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:15.642+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:15.648 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:15.648 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:15.662 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:15.723 INFO:teuthology.orchestra.run.smithi070.stdout:leaving image image_client.0-clone41 intact 2024-09-11T05:34:15.742 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:15.742+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:15.783 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:34:15.815 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:15.815 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:15.825 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:15.844 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:15.844+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:15.920 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:15.920 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:15.938 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:15.938 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:15.945 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:15.945+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:15.945 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-11T05:34:15.957 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:15.957 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:15.968 INFO:teuthology.orchestra.run.smithi070.stdout:5917 read 0xdef04e6 thru 0xdefd0c2 (0xcbdd bytes) 2024-09-11T05:34:15.969 INFO:teuthology.orchestra.run.smithi070.stdout:5920 punch from 0x994c989 to 0x994f4a1, (0x2b18 bytes) 2024-09-11T05:34:15.974 INFO:teuthology.orchestra.run.smithi070.stdout:5922 punch from 0x7eb20f3 to 0x7ec1675, (0xf582 bytes) 2024-09-11T05:34:15.974 INFO:teuthology.orchestra.run.smithi070.stdout:5923 read 0x20dbfe thru 0x2183af (0xa7b2 bytes) 2024-09-11T05:34:15.975 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:15.975 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:15.975 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-11T05:34:15.980 INFO:teuthology.orchestra.run.smithi070.stdout:5924 trunc from 0xe27585e to 0x9cdc72a 2024-09-11T05:34:15.994 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:15.994 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:184170 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0723428559999997, 2024-09-11T05:34:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047293133000000001, 2024-09-11T05:34:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:15.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 184170 2024-09-11T05:34:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:15.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921808+0000", 2024-09-11T05:34:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001805868 2024-09-11T05:34:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921819+0000", 2024-09-11T05:34:15.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0458e-05 2024-09-11T05:34:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921830+0000", 2024-09-11T05:34:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1482e-05 2024-09-11T05:34:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921837+0000", 2024-09-11T05:34:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3709999999999996e-06 2024-09-11T05:34:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967150+0000", 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045313402000000003 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967216+0000", 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6322999999999995e-05 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967296+0000", 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9228999999999996e-05 2024-09-11T05:34:15.999 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185733 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3309568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7183098440000002, 2024-09-11T05:34:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047365106999999997, 2024-09-11T05:34:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185733 2024-09-11T05:34:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:16.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275806+0000", 2024-09-11T05:34:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001769966 2024-09-11T05:34:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275810+0000", 2024-09-11T05:34:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5539999999999999e-06 2024-09-11T05:34:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275821+0000", 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1253999999999999e-05 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275828+0000", 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321211+0000", 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045383053999999999 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321306+0000", 2024-09-11T05:34:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4712999999999999e-05 2024-09-11T05:34:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321401+0000", 2024-09-11T05:34:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4825000000000001e-05 2024-09-11T05:34:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185743 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3719168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7162980079999999, 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047361001999999999, 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185743 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276048+0000", 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276050+0000", 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276056+0000", 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276061+0000", 2024-09-11T05:34:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T05:34:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323215+0000", 2024-09-11T05:34:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047153977999999999 2024-09-11T05:34:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323278+0000", 2024-09-11T05:34:16.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3053999999999996e-05 2024-09-11T05:34:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323408+0000", 2024-09-11T05:34:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013012899999999999 2024-09-11T05:34:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.009 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185744 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3760128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7162773279999999, 2024-09-11T05:34:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047563095, 2024-09-11T05:34:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185744 2024-09-11T05:34:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277808+0000", 2024-09-11T05:34:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001739652 2024-09-11T05:34:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277816+0000", 2024-09-11T05:34:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.208e-06 2024-09-11T05:34:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277829+0000", 2024-09-11T05:34:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2848e-05 2024-09-11T05:34:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277837+0000", 2024-09-11T05:34:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6379999999999993e-06 2024-09-11T05:34:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323448+0000", 2024-09-11T05:34:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045610604999999999 2024-09-11T05:34:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323562+0000", 2024-09-11T05:34:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113706 2024-09-11T05:34:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323631+0000", 2024-09-11T05:34:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9437999999999995e-05 2024-09-11T05:34:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.015 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185753 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7143142820000001, 2024-09-11T05:34:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047283944000000001, 2024-09-11T05:34:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185753 2024-09-11T05:34:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278033+0000", 2024-09-11T05:34:16.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.237e-06 2024-09-11T05:34:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278036+0000", 2024-09-11T05:34:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:34:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278038+0000", 2024-09-11T05:34:16.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5490000000000001e-06 2024-09-11T05:34:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325140+0000", 2024-09-11T05:34:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047101845000000003 2024-09-11T05:34:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325219+0000", 2024-09-11T05:34:16.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9444999999999996e-05 2024-09-11T05:34:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325315+0000", 2024-09-11T05:34:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.569e-05 2024-09-11T05:34:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.021 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185754 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4169728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7143043840000001, 2024-09-11T05:34:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047450697, 2024-09-11T05:34:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.022 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185754 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:16.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278043+0000", 2024-09-11T05:34:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:34:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278045+0000", 2024-09-11T05:34:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278048+0000", 2024-09-11T05:34:16.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5679999999999998e-06 2024-09-11T05:34:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325359+0000", 2024-09-11T05:34:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047311262 2024-09-11T05:34:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325421+0000", 2024-09-11T05:34:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1717999999999994e-05 2024-09-11T05:34:16.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325492+0000", 2024-09-11T05:34:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0716000000000005e-05 2024-09-11T05:34:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185755 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2125824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.027 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7142943170000002, 2024-09-11T05:34:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047669481999999999, 2024-09-11T05:34:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185755 2024-09-11T05:34:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:16.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:34:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278052+0000", 2024-09-11T05:34:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-11T05:34:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278055+0000", 2024-09-11T05:34:16.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8059999999999999e-06 2024-09-11T05:34:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278058+0000", 2024-09-11T05:34:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.503e-06 2024-09-11T05:34:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325563+0000", 2024-09-11T05:34:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047505316999999998 2024-09-11T05:34:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325645+0000", 2024-09-11T05:34:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2439000000000001e-05 2024-09-11T05:34:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325721+0000", 2024-09-11T05:34:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5092999999999994e-05 2024-09-11T05:34:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185756 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2166784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7142819870000001, 2024-09-11T05:34:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047861556, 2024-09-11T05:34:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185756 2024-09-11T05:34:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.033 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279805+0000", 2024-09-11T05:34:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001741586 2024-09-11T05:34:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279809+0000", 2024-09-11T05:34:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0890000000000002e-06 2024-09-11T05:34:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279816+0000", 2024-09-11T05:34:16.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2060000000000001e-06 2024-09-11T05:34:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279821+0000", 2024-09-11T05:34:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6709999999999998e-06 2024-09-11T05:34:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325764+0000", 2024-09-11T05:34:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045942749999999997 2024-09-11T05:34:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325846+0000", 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2470000000000002e-05 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325925+0000", 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8783999999999997e-05 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185764 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2494464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.037 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7123179309999998, 2024-09-11T05:34:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308594000000002, 2024-09-11T05:34:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185764 2024-09-11T05:34:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280028+0000", 2024-09-11T05:34:16.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.27e-07 2024-09-11T05:34:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280030+0000", 2024-09-11T05:34:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3319999999999999e-06 2024-09-11T05:34:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280036+0000", 2024-09-11T05:34:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:34:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280041+0000", 2024-09-11T05:34:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7530000000000001e-06 2024-09-11T05:34:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327196+0000", 2024-09-11T05:34:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047154967999999998 2024-09-11T05:34:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327266+0000", 2024-09-11T05:34:16.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0427999999999997e-05 2024-09-11T05:34:16.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327336+0000", 2024-09-11T05:34:16.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9659000000000005e-05 2024-09-11T05:34:16.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.042 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.042 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185765 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2535424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.043 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:16.043 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7122980119999998, 2024-09-11T05:34:16.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047410790000000001, 2024-09-11T05:34:16.043 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.043 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.043 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185765 2024-09-11T05:34:16.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.043 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:16.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:16.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280048+0000", 2024-09-11T05:34:16.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T05:34:16.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280050+0000", 2024-09-11T05:34:16.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-11T05:34:16.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280056+0000", 2024-09-11T05:34:16.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:34:16.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280061+0000", 2024-09-11T05:34:16.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T05:34:16.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327369+0000", 2024-09-11T05:34:16.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308416999999998 2024-09-11T05:34:16.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327413+0000", 2024-09-11T05:34:16.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070999999999999e-05 2024-09-11T05:34:16.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327458+0000", 2024-09-11T05:34:16.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4836000000000002e-05 2024-09-11T05:34:16.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.047 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.047 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185766 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2576384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.047 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:16.047 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.712278022, 2024-09-11T05:34:16.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047571239000000001, 2024-09-11T05:34:16.048 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.048 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.048 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185766 2024-09-11T05:34:16.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.049 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:16.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:16.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280068+0000", 2024-09-11T05:34:16.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:34:16.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280070+0000", 2024-09-11T05:34:16.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:16.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280081+0000", 2024-09-11T05:34:16.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0951999999999999e-05 2024-09-11T05:34:16.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280086+0000", 2024-09-11T05:34:16.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5029999999999997e-06 2024-09-11T05:34:16.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327495+0000", 2024-09-11T05:34:16.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047408497000000001 2024-09-11T05:34:16.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327568+0000", 2024-09-11T05:34:16.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3450999999999999e-05 2024-09-11T05:34:16.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327639+0000", 2024-09-11T05:34:16.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0309999999999996e-05 2024-09-11T05:34:16.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.052 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.053 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185767 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2617344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.053 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:16.053 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7122308849999999, 2024-09-11T05:34:16.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047672355, 2024-09-11T05:34:16.053 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.053 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.053 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185767 2024-09-11T05:34:16.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.054 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:16.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:16.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:16.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8999999999999996e-07 2024-09-11T05:34:16.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280121+0000", 2024-09-11T05:34:16.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0599999999999996e-06 2024-09-11T05:34:16.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280128+0000", 2024-09-11T05:34:16.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1029999999999996e-06 2024-09-11T05:34:16.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280133+0000", 2024-09-11T05:34:16.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T05:34:16.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327702+0000", 2024-09-11T05:34:16.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047568307999999997 2024-09-11T05:34:16.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327745+0000", 2024-09-11T05:34:16.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3407e-05 2024-09-11T05:34:16.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327787+0000", 2024-09-11T05:34:16.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1749000000000003e-05 2024-09-11T05:34:16.057 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.057 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.057 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.058 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185768 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2658304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.058 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:16.058 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7122035339999999, 2024-09-11T05:34:16.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047830091999999998, 2024-09-11T05:34:16.058 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.059 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185768 2024-09-11T05:34:16.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.059 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:16.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:16.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281805+0000", 2024-09-11T05:34:16.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016635809999999999 2024-09-11T05:34:16.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281810+0000", 2024-09-11T05:34:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3540000000000002e-06 2024-09-11T05:34:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281820+0000", 2024-09-11T05:34:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T05:34:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281828+0000", 2024-09-11T05:34:16.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:16.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327826+0000", 2024-09-11T05:34:16.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045998206999999999 2024-09-11T05:34:16.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327902+0000", 2024-09-11T05:34:16.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5761999999999997e-05 2024-09-11T05:34:16.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327972+0000", 2024-09-11T05:34:16.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0414999999999996e-05 2024-09-11T05:34:16.063 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.063 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.063 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.064 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185775 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2945024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.064 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:16.064 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7104094750000001, 2024-09-11T05:34:16.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047301277000000003, 2024-09-11T05:34:16.064 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.064 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185775 2024-09-11T05:34:16.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:16.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:34:16.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281938+0000", 2024-09-11T05:34:16.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5099999999999999e-06 2024-09-11T05:34:16.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281941+0000", 2024-09-11T05:34:16.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-06 2024-09-11T05:34:16.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281943+0000", 2024-09-11T05:34:16.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.751e-06 2024-09-11T05:34:16.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329092+0000", 2024-09-11T05:34:16.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047148177999999999 2024-09-11T05:34:16.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329166+0000", 2024-09-11T05:34:16.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4795000000000005e-05 2024-09-11T05:34:16.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329237+0000", 2024-09-11T05:34:16.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0864000000000005e-05 2024-09-11T05:34:16.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.068 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.069 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185777 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2985984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.069 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:16.069 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.710399046, 2024-09-11T05:34:16.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047500597999999998, 2024-09-11T05:34:16.069 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.069 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.069 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.069 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.069 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185777 2024-09-11T05:34:16.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.070 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:16.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:16.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281947+0000", 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281948+0000", 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1429999999999999e-06 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281951+0000", 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281953+0000", 2024-09-11T05:34:16.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6709999999999999e-06 2024-09-11T05:34:16.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329280+0000", 2024-09-11T05:34:16.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047326857999999999 2024-09-11T05:34:16.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329364+0000", 2024-09-11T05:34:16.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3586999999999998e-05 2024-09-11T05:34:16.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329447+0000", 2024-09-11T05:34:16.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3314999999999998e-05 2024-09-11T05:34:16.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.073 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.073 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185778 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3026944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.073 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:16.073 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7103892329999999, 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047668384000000001, 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185778 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:16.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:16.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283808+0000", 2024-09-11T05:34:16.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018518919999999999 2024-09-11T05:34:16.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283812+0000", 2024-09-11T05:34:16.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:16.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283820+0000", 2024-09-11T05:34:16.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3319999999999992e-06 2024-09-11T05:34:16.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283825+0000", 2024-09-11T05:34:16.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8729999999999998e-06 2024-09-11T05:34:16.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329484+0000", 2024-09-11T05:34:16.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045658404999999999 2024-09-11T05:34:16.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329554+0000", 2024-09-11T05:34:16.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0099999999999996e-05 2024-09-11T05:34:16.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329625+0000", 2024-09-11T05:34:16.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0732e-05 2024-09-11T05:34:16.079 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.079 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.079 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.079 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185790 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2170880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.079 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:16.079 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7084042799999999, 2024-09-11T05:34:16.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047276674999999997, 2024-09-11T05:34:16.079 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.079 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.080 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.080 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.080 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.080 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185790 2024-09-11T05:34:16.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.080 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:16.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:16.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283942+0000", 2024-09-11T05:34:16.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:16.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283944+0000", 2024-09-11T05:34:16.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9800000000000001e-06 2024-09-11T05:34:16.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283948+0000", 2024-09-11T05:34:16.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9729999999999999e-06 2024-09-11T05:34:16.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283950+0000", 2024-09-11T05:34:16.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7020000000000001e-06 2024-09-11T05:34:16.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331076+0000", 2024-09-11T05:34:16.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047126016 2024-09-11T05:34:16.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331147+0000", 2024-09-11T05:34:16.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0848999999999999e-05 2024-09-11T05:34:16.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331218+0000", 2024-09-11T05:34:16.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0621e-05 2024-09-11T05:34:16.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.084 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.084 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185791 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3395584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.084 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:16.084 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7083782300000001, 2024-09-11T05:34:16.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047372307000000002, 2024-09-11T05:34:16.084 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.084 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.085 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185791 2024-09-11T05:34:16.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.085 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:16.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:16.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283968+0000", 2024-09-11T05:34:16.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:16.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283970+0000", 2024-09-11T05:34:16.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.199e-06 2024-09-11T05:34:16.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283976+0000", 2024-09-11T05:34:16.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T05:34:16.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283981+0000", 2024-09-11T05:34:16.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:34:16.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331252+0000", 2024-09-11T05:34:16.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047270999000000001 2024-09-11T05:34:16.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331299+0000", 2024-09-11T05:34:16.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7376999999999997e-05 2024-09-11T05:34:16.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331339+0000", 2024-09-11T05:34:16.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0428e-05 2024-09-11T05:34:16.089 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.089 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.089 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.089 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185792 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2211840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.089 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:16.089 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7083583330000001, 2024-09-11T05:34:16.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047522035999999997, 2024-09-11T05:34:16.089 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185792 2024-09-11T05:34:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T05:34:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283990+0000", 2024-09-11T05:34:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:34:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283995+0000", 2024-09-11T05:34:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3329999999999996e-06 2024-09-11T05:34:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284002+0000", 2024-09-11T05:34:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6120000000000001e-06 2024-09-11T05:34:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331373+0000", 2024-09-11T05:34:16.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047370269999999999 2024-09-11T05:34:16.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331442+0000", 2024-09-11T05:34:16.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8794999999999994e-05 2024-09-11T05:34:16.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331509+0000", 2024-09-11T05:34:16.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7570000000000005e-05 2024-09-11T05:34:16.094 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.094 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.094 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.094 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185793 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3436544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:16.094 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:16.094 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7083362339999999, 2024-09-11T05:34:16.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047706692000000002, 2024-09-11T05:34:16.094 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.094 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.094 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.095 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.095 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.095 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.095 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185793 2024-09-11T05:34:16.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.095 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:16.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285808+0000", 2024-09-11T05:34:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001798352 2024-09-11T05:34:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285812+0000", 2024-09-11T05:34:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6399999999999996e-06 2024-09-11T05:34:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285823+0000", 2024-09-11T05:34:16.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0783e-05 2024-09-11T05:34:16.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285831+0000", 2024-09-11T05:34:16.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:34:16.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331550+0000", 2024-09-11T05:34:16.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045719518000000001 2024-09-11T05:34:16.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331633+0000", 2024-09-11T05:34:16.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2992999999999996e-05 2024-09-11T05:34:16.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331716+0000", 2024-09-11T05:34:16.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2455999999999998e-05 2024-09-11T05:34:16.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.099 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.099 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.099 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.099 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.099 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:16.100 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:16.100 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:16.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:16.102 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:16.102 INFO:teuthology.orchestra.run.smithi070.stdout:5926 trunc from 0x9cdc72a to 0x173e4fa 2024-09-11T05:34:16.102 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:16.102 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:16.102 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:16.103 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:16.103 INFO:teuthology.orchestra.run.smithi070.stdout:5927 writesame 0xac8ef1e thru 0xac98186 data_size 0x1(0x9269 bytes) 2024-09-11T05:34:16.103 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:34:16.104 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:34:16.105 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:16.105 INFO:teuthology.orchestra.run.smithi070.stdout:5932 read 0x3536fe thru 0x35757e (0x3e81 bytes) 2024-09-11T05:34:16.105 INFO:teuthology.orchestra.run.smithi070.stdout:5933 read 0x4bb1124 thru 0x4bb78bc (0x6799 bytes) 2024-09-11T05:34:16.105 INFO:teuthology.orchestra.run.smithi070.stdout:5934 write 0x8752b5f thru 0x875e6eb (0xbb8d bytes) 2024-09-11T05:34:16.105 INFO:teuthology.orchestra.run.smithi070.stdout:5935 write 0x42691b6 thru 0x4273663 (0xa4ae bytes) 2024-09-11T05:34:16.105 INFO:teuthology.orchestra.run.smithi070.stdout:5936 read 0x3513ee6 thru 0x351fef9 (0xc014 bytes) 2024-09-11T05:34:16.105 INFO:teuthology.orchestra.run.smithi070.stdout:5937 trunc from 0xac98187 to 0xd95368b 2024-09-11T05:34:16.105 INFO:teuthology.orchestra.run.smithi070.stdout:5938 write 0x2946372 thru 0x294b103 (0x4d92 bytes) 2024-09-11T05:34:16.105 INFO:teuthology.orchestra.run.smithi070.stdout:5939 punch from 0xc0af379 to 0xc0b802b, (0x8cb2 bytes) 2024-09-11T05:34:16.106 INFO:teuthology.orchestra.run.smithi070.stdout:5940 read 0x989253d thru 0x98a1860 (0xf324 bytes) 2024-09-11T05:34:16.106 INFO:teuthology.orchestra.run.smithi070.stdout:5941 trunc from 0xd95368b to 0x3c781e2 2024-09-11T05:34:16.106 INFO:teuthology.orchestra.run.smithi070.stdout:5942 write 0x8737d15 thru 0x873eec4 (0x71b0 bytes) 2024-09-11T05:34:16.106 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:16.099+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:16.106 INFO:teuthology.orchestra.run.smithi070.stdout:5943 punch from 0x5c9a032 to 0x5ca84d7, (0xe4a5 bytes) 2024-09-11T05:34:16.106 INFO:teuthology.orchestra.run.smithi070.stdout:5944 flatten 2024-09-11T05:34:16.114 INFO:teuthology.orchestra.run.smithi070.stdout:5946 trunc from 0x873eec5 to 0x238694a 2024-09-11T05:34:16.125 INFO:teuthology.orchestra.run.smithi070.stdout:5947 trunc from 0x238694a to 0x558653 2024-09-11T05:34:16.148 INFO:teuthology.orchestra.run.smithi070.stdout:5949 read 0x1bf77e thru 0x1c5deb (0x666e bytes) 2024-09-11T05:34:16.148 INFO:teuthology.orchestra.run.smithi070.stdout:5951 punch from 0x530143 to 0x53617c, (0x6039 bytes) 2024-09-11T05:34:16.161 INFO:teuthology.orchestra.run.smithi070.stdout:5952 write 0x613d0ec thru 0x6141f52 (0x4e67 bytes) 2024-09-11T05:34:16.177 INFO:teuthology.orchestra.run.smithi070.stdout:5953 write 0xc39fe6b thru 0xc3a61b1 (0x6347 bytes) 2024-09-11T05:34:16.180 INFO:teuthology.orchestra.run.smithi070.stdout:5955 write 0x84b2026 thru 0x84be557 (0xc532 bytes) 2024-09-11T05:34:16.196 INFO:teuthology.orchestra.run.smithi070.stdout:5956 trunc from 0xc3a61b2 to 0x14fb755 2024-09-11T05:34:16.201 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:16.200+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:16.210 INFO:teuthology.orchestra.run.smithi070.stdout:5958 writesame 0x26fcbfc thru 0x27036e6 data_size 0x1(0x6aeb bytes) 2024-09-11T05:34:16.226 INFO:teuthology.orchestra.run.smithi070.stdout:5961 write 0xb0e2c19 thru 0xb0e9840 (0x6c28 bytes) 2024-09-11T05:34:16.229 INFO:teuthology.orchestra.run.smithi070.stdout:5962 write 0x7d60ab5 thru 0x7d6511c (0x4668 bytes) 2024-09-11T05:34:16.230 INFO:teuthology.orchestra.run.smithi070.stdout:5963 write 0x9dce8f8 thru 0x9dd9f63 (0xb66c bytes) 2024-09-11T05:34:16.232 INFO:teuthology.orchestra.run.smithi070.stdout:5964 writesame 0x845f32 thru 0x850545 data_size 0x12(0xa614 bytes) 2024-09-11T05:34:16.233 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:16.233 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:16.236 INFO:teuthology.orchestra.run.smithi070.stdout:5965 writesame 0x6615571 thru 0x66159f8 data_size 0xa(0x488 bytes) 2024-09-11T05:34:16.243 INFO:teuthology.orchestra.run.smithi070.stdout:5966 write 0xb65e531 thru 0xb6608d4 (0x23a4 bytes) 2024-09-11T05:34:16.244 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:16.253 INFO:teuthology.orchestra.run.smithi070.stdout:5968 write 0xe69acb2 thru 0xe6a1014 (0x6363 bytes) 2024-09-11T05:34:16.256 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:16.256 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:16.256 INFO:teuthology.orchestra.run.smithi070.stdout:5972 writesame 0x28c9571 thru 0x28d2ff2 data_size 0x1(0x9a82 bytes) 2024-09-11T05:34:16.280 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:16.280 INFO:teuthology.orchestra.run.smithi070.stdout:5974 write 0xb895047 thru 0xb89795d (0x2917 bytes) 2024-09-11T05:34:16.299 INFO:teuthology.orchestra.run.smithi070.stdout:5976 trunc from 0xe6a1015 to 0x13e4e29 2024-09-11T05:34:16.301 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:16.301+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:16.311 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:16.319 INFO:teuthology.orchestra.run.smithi070.stdout:5979 write 0x30fd107 thru 0x310a571 (0xd46b bytes) 2024-09-11T05:34:16.333 INFO:teuthology.orchestra.run.smithi070.stdout:5981 write 0x751e137 thru 0x75255c3 (0x748d bytes) 2024-09-11T05:34:16.343 INFO:teuthology.orchestra.run.smithi070.stdout:5983 write 0x8ad27e4 thru 0x8ad88a4 (0x60c1 bytes) 2024-09-11T05:34:16.344 INFO:teuthology.orchestra.run.smithi070.stdout:5984 read 0x5a35839 thru 0x5a37aee (0x22b6 bytes) 2024-09-11T05:34:16.345 INFO:teuthology.orchestra.run.smithi070.stdout:5985 read 0x7f0c4ee thru 0x7f1aebb (0xe9ce bytes) 2024-09-11T05:34:16.345 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:16.345 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:16.345 INFO:teuthology.orchestra.run.smithi070.stdout:5989 punch from 0x7796b40 to 0x77a0c89, (0xa149 bytes) 2024-09-11T05:34:16.346 INFO:teuthology.orchestra.run.smithi070.stdout:5990 trunc from 0x8ad88a5 to 0x9df25f4 2024-09-11T05:34:16.360 INFO:teuthology.orchestra.run.smithi070.stdout:5991 write 0xc7e9729 thru 0xc7ec282 (0x2b5a bytes) 2024-09-11T05:34:16.362 INFO:teuthology.orchestra.run.smithi070.stdout:5992 write 0x565e7b6 thru 0x566688a (0x80d5 bytes) 2024-09-11T05:34:16.363 INFO:teuthology.orchestra.run.smithi070.stdout:5994 punch from 0x4f05924 to 0x4f06899, (0xf75 bytes) 2024-09-11T05:34:16.371 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:16.371 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:16.371 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:16.371 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:16.371 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:16.376 INFO:teuthology.orchestra.run.smithi070.stdout:5997 trunc from 0xc7ec283 to 0x20630e9 2024-09-11T05:34:16.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:16.402 INFO:teuthology.orchestra.run.smithi070.stdout:5999 writesame 0xc8caade thru 0xc8d460c data_size 0x1(0x9b2f bytes) 2024-09-11T05:34:16.402 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T05:34:16.403 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:16.402+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:16.446 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #41, image image_client.0-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent42 2024-09-11T05:34:16.503 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:16.503+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:16.519 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116623 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13477888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.627096881, 2024-09-11T05:34:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9661491070000001, 2024-09-11T05:34:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116623 2024-09-11T05:34:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889573+0000", 2024-09-11T05:34:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889574+0000", 2024-09-11T05:34:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4810000000000001e-06 2024-09-11T05:34:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889578+0000", 2024-09-11T05:34:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T05:34:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889581+0000", 2024-09-11T05:34:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2380000000000002e-06 2024-09-11T05:34:16.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890367+0000", 2024-09-11T05:34:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078646599999999999 2024-09-11T05:34:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890377+0000", 2024-09-11T05:34:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5789999999999993e-06 2024-09-11T05:34:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829092+0000", 2024-09-11T05:34:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871527899999996 2024-09-11T05:34:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829101+0000", 2024-09-11T05:34:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:34:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854695+0000", 2024-09-11T05:34:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0255937369999999 2024-09-11T05:34:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854786+0000", 2024-09-11T05:34:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1831999999999998e-05 2024-09-11T05:34:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855721+0000", 2024-09-11T05:34:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093499800000000004 2024-09-11T05:34:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116624 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13502464~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.627083034000002, 2024-09-11T05:34:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9664307189999999, 2024-09-11T05:34:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116624 2024-09-11T05:34:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:16.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889587+0000", 2024-09-11T05:34:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:34:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889588+0000", 2024-09-11T05:34:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T05:34:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889592+0000", 2024-09-11T05:34:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.472e-06 2024-09-11T05:34:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889594+0000", 2024-09-11T05:34:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T05:34:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890405+0000", 2024-09-11T05:34:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00081088199999999997 2024-09-11T05:34:16.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890410+0000", 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999996e-06 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829131+0000", 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93872118999999998 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829138+0000", 2024-09-11T05:34:16.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1760000000000004e-06 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855755+0000", 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026616722 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855872+0000", 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116927 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856017+0000", 2024-09-11T05:34:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145313 2024-09-11T05:34:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116625 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13527040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.627071815000001, 2024-09-11T05:34:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9666986180000001, 2024-09-11T05:34:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116625 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889598+0000", 2024-09-11T05:34:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:34:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889599+0000", 2024-09-11T05:34:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.144e-06 2024-09-11T05:34:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889602+0000", 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889604+0000", 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7640000000000001e-06 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890442+0000", 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083777099999999996 2024-09-11T05:34:16.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890452+0000", 2024-09-11T05:34:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5559999999999996e-06 2024-09-11T05:34:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829170+0000", 2024-09-11T05:34:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871818900000004 2024-09-11T05:34:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829177+0000", 2024-09-11T05:34:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7220000000000002e-06 2024-09-11T05:34:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856046+0000", 2024-09-11T05:34:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026868943 2024-09-11T05:34:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856144+0000", 2024-09-11T05:34:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8684999999999995e-05 2024-09-11T05:34:16.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856296+0000", 2024-09-11T05:34:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151667 2024-09-11T05:34:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116626 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13551616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.627061044999998, 2024-09-11T05:34:16.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.96707056, 2024-09-11T05:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116626 2024-09-11T05:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889610+0000", 2024-09-11T05:34:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.186e-06 2024-09-11T05:34:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889613+0000", 2024-09-11T05:34:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T05:34:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889615+0000", 2024-09-11T05:34:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:34:16.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890487+0000", 2024-09-11T05:34:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087202600000000003 2024-09-11T05:34:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890492+0000", 2024-09-11T05:34:16.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:34:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829202+0000", 2024-09-11T05:34:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871036299999999 2024-09-11T05:34:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829209+0000", 2024-09-11T05:34:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7669999999999998e-06 2024-09-11T05:34:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856327+0000", 2024-09-11T05:34:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027118465 2024-09-11T05:34:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856525+0000", 2024-09-11T05:34:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019825499999999999 2024-09-11T05:34:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856679+0000", 2024-09-11T05:34:16.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015328 2024-09-11T05:34:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116627 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13576192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.627051160000001, 2024-09-11T05:34:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9673406419999999, 2024-09-11T05:34:16.545 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116627 2024-09-11T05:34:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:34:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889619+0000", 2024-09-11T05:34:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.093e-06 2024-09-11T05:34:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889622+0000", 2024-09-11T05:34:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T05:34:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889625+0000", 2024-09-11T05:34:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:34:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890528+0000", 2024-09-11T05:34:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000902804 2024-09-11T05:34:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890537+0000", 2024-09-11T05:34:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2029999999999998e-06 2024-09-11T05:34:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829232+0000", 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93869459799999999 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829238+0000", 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6699999999999997e-06 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856709+0000", 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027470925 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856815+0000", 2024-09-11T05:34:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010566899999999999 2024-09-11T05:34:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856959+0000", 2024-09-11T05:34:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000143752 2024-09-11T05:34:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.551 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116628 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13600768~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.627027165000001, 2024-09-11T05:34:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9676105420000001, 2024-09-11T05:34:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116628 2024-09-11T05:34:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:34:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889644+0000", 2024-09-11T05:34:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:34:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889647+0000", 2024-09-11T05:34:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3950000000000001e-06 2024-09-11T05:34:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889650+0000", 2024-09-11T05:34:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:34:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890570+0000", 2024-09-11T05:34:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092007999999999999 2024-09-11T05:34:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890577+0000", 2024-09-11T05:34:16.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.764e-06 2024-09-11T05:34:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829261+0000", 2024-09-11T05:34:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93868468500000002 2024-09-11T05:34:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829268+0000", 2024-09-11T05:34:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T05:34:16.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857004+0000", 2024-09-11T05:34:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027736043 2024-09-11T05:34:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857102+0000", 2024-09-11T05:34:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8066999999999995e-05 2024-09-11T05:34:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857253+0000", 2024-09-11T05:34:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015050400000000001 2024-09-11T05:34:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116629 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13625344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.627010654000003, 2024-09-11T05:34:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967906154, 2024-09-11T05:34:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116629 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:16.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:16.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-07 2024-09-11T05:34:16.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889660+0000", 2024-09-11T05:34:16.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5650000000000001e-06 2024-09-11T05:34:16.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889664+0000", 2024-09-11T05:34:16.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4000000000000001e-06 2024-09-11T05:34:16.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889666+0000", 2024-09-11T05:34:16.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:16.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890614+0000", 2024-09-11T05:34:16.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00094762999999999998 2024-09-11T05:34:16.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890621+0000", 2024-09-11T05:34:16.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.379e-06 2024-09-11T05:34:16.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829291+0000", 2024-09-11T05:34:16.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866938499999997 2024-09-11T05:34:16.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829298+0000", 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6610000000000003e-06 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857284+0000", 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027986522 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857393+0000", 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109054 2024-09-11T05:34:16.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857565+0000", 2024-09-11T05:34:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017160999999999999 2024-09-11T05:34:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116843 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12595200~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:16.564 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.626999431999998, 2024-09-11T05:34:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9682605290000001, 2024-09-11T05:34:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116843 2024-09-11T05:34:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:16.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:16.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:16.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:16.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889671+0000", 2024-09-11T05:34:16.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-11T05:34:16.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889674+0000", 2024-09-11T05:34:16.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.005e-06 2024-09-11T05:34:16.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889677+0000", 2024-09-11T05:34:16.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T05:34:16.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890648+0000", 2024-09-11T05:34:16.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097103399999999996 2024-09-11T05:34:16.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890652+0000", 2024-09-11T05:34:16.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0790000000000002e-06 2024-09-11T05:34:16.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829320+0000", 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866793199999998 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829327+0000", 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5529999999999998e-06 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857596+0000", 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028269125 2024-09-11T05:34:16.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857834+0000", 2024-09-11T05:34:16.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023784300000000001 2024-09-11T05:34:16.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857930+0000", 2024-09-11T05:34:16.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6704000000000001e-05 2024-09-11T05:34:16.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.570 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116844 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12619776~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.626989240999997, 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9685250679999999, 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116844 2024-09-11T05:34:16.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:16.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:16.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889681+0000", 2024-09-11T05:34:16.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.229e-06 2024-09-11T05:34:16.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889684+0000", 2024-09-11T05:34:16.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0130000000000002e-06 2024-09-11T05:34:16.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889687+0000", 2024-09-11T05:34:16.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7259999999999998e-06 2024-09-11T05:34:16.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890685+0000", 2024-09-11T05:34:16.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099783399999999996 2024-09-11T05:34:16.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890695+0000", 2024-09-11T05:34:16.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829349+0000", 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865456300000005 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829356+0000", 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5130000000000002e-06 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857959+0000", 2024-09-11T05:34:16.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0286034959999999 2024-09-11T05:34:16.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858057+0000", 2024-09-11T05:34:16.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8097999999999995e-05 2024-09-11T05:34:16.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858205+0000", 2024-09-11T05:34:16.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147732 2024-09-11T05:34:16.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.576 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116845 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12644352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.626979007999999, 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968783033, 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116845 2024-09-11T05:34:16.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:16.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:16.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889692+0000", 2024-09-11T05:34:16.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2330000000000001e-06 2024-09-11T05:34:16.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889695+0000", 2024-09-11T05:34:16.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9249999999999999e-06 2024-09-11T05:34:16.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889697+0000", 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890719+0000", 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010218429999999999 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890723+0000", 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:34:16.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829378+0000", 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865562000000002 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829385+0000", 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4579999999999998e-06 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858234+0000", 2024-09-11T05:34:16.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028849288 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858337+0000", 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102371 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858473+0000", 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013669299999999999 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116846 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12668928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.626956083000003, 2024-09-11T05:34:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.969056522, 2024-09-11T05:34:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116846 2024-09-11T05:34:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:16.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:16.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:16.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-07 2024-09-11T05:34:16.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889715+0000", 2024-09-11T05:34:16.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.482e-06 2024-09-11T05:34:16.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889718+0000", 2024-09-11T05:34:16.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:16.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889721+0000", 2024-09-11T05:34:16.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-11T05:34:16.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890762+0000", 2024-09-11T05:34:16.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010413659999999999 2024-09-11T05:34:16.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890772+0000", 2024-09-11T05:34:16.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5750000000000007e-06 2024-09-11T05:34:16.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829407+0000", 2024-09-11T05:34:16.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93863550699999998 2024-09-11T05:34:16.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829414+0000", 2024-09-11T05:34:16.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5640000000000002e-06 2024-09-11T05:34:16.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858502+0000", 2024-09-11T05:34:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0290880099999999 2024-09-11T05:34:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858634+0000", 2024-09-11T05:34:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013173199999999999 2024-09-11T05:34:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858770+0000", 2024-09-11T05:34:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135943 2024-09-11T05:34:16.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.589 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.589 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116847 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12693504~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.589 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:16.589 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.626926394999998, 2024-09-11T05:34:16.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9692923329999998, 2024-09-11T05:34:16.589 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116847 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:16.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T05:34:16.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889747+0000", 2024-09-11T05:34:16.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.501e-06 2024-09-11T05:34:16.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889753+0000", 2024-09-11T05:34:16.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1360000000000002e-06 2024-09-11T05:34:16.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889756+0000", 2024-09-11T05:34:16.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3110000000000001e-06 2024-09-11T05:34:16.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890808+0000", 2024-09-11T05:34:16.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010523240000000001 2024-09-11T05:34:16.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890813+0000", 2024-09-11T05:34:16.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5650000000000003e-06 2024-09-11T05:34:16.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829436+0000", 2024-09-11T05:34:16.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93862351799999999 2024-09-11T05:34:16.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829443+0000", 2024-09-11T05:34:16.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5220000000000004e-06 2024-09-11T05:34:16.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858798+0000", 2024-09-11T05:34:16.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029354903 2024-09-11T05:34:16.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858899+0000", 2024-09-11T05:34:16.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101414 2024-09-11T05:34:16.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859035+0000", 2024-09-11T05:34:16.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013589 2024-09-11T05:34:16.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.595 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.595 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116848 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12718080~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.595 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:16.595 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.62690971, 2024-09-11T05:34:16.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9695514759999999, 2024-09-11T05:34:16.596 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.596 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116848 2024-09-11T05:34:16.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.596 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:16.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:16.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889760+0000", 2024-09-11T05:34:16.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:16.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889761+0000", 2024-09-11T05:34:16.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.189e-06 2024-09-11T05:34:16.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889764+0000", 2024-09-11T05:34:16.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:34:16.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889766+0000", 2024-09-11T05:34:16.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:34:16.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890850+0000", 2024-09-11T05:34:16.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010835479999999999 2024-09-11T05:34:16.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890857+0000", 2024-09-11T05:34:16.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6299999999999998e-06 2024-09-11T05:34:16.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829465+0000", 2024-09-11T05:34:16.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860787000000001 2024-09-11T05:34:16.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829472+0000", 2024-09-11T05:34:16.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4420000000000003e-06 2024-09-11T05:34:16.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859062+0000", 2024-09-11T05:34:16.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0295903360000001 2024-09-11T05:34:16.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859169+0000", 2024-09-11T05:34:16.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010674400000000001 2024-09-11T05:34:16.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859311+0000", 2024-09-11T05:34:16.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014209499999999999 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116849 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12742656~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.626899924, 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9698160310000001, 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116849 2024-09-11T05:34:16.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.603 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:16.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:16.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:16.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:16.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889771+0000", 2024-09-11T05:34:16.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:34:16.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889774+0000", 2024-09-11T05:34:16.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:34:16.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889776+0000", 2024-09-11T05:34:16.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.638e-06 2024-09-11T05:34:16.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890886+0000", 2024-09-11T05:34:16.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011102519999999999 2024-09-11T05:34:16.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890891+0000", 2024-09-11T05:34:16.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2200000000000003e-06 2024-09-11T05:34:16.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829494+0000", 2024-09-11T05:34:16.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860342500000005 2024-09-11T05:34:16.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829501+0000", 2024-09-11T05:34:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4829999999999996e-06 2024-09-11T05:34:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859339+0000", 2024-09-11T05:34:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0298381320000001 2024-09-11T05:34:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859440+0000", 2024-09-11T05:34:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010145 2024-09-11T05:34:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859585+0000", 2024-09-11T05:34:16.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014513300000000001 2024-09-11T05:34:16.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.608 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.608 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116850 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12767232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.608 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:16.608 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.626878898000001, 2024-09-11T05:34:16.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970125645, 2024-09-11T05:34:16.608 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.609 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116850 2024-09-11T05:34:16.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.609 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:16.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:16.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889791+0000", 2024-09-11T05:34:16.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:16.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889792+0000", 2024-09-11T05:34:16.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4899999999999999e-06 2024-09-11T05:34:16.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889795+0000", 2024-09-11T05:34:16.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:16.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889798+0000", 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7089999999999998e-06 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890924+0000", 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001125685 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890933+0000", 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3340000000000008e-06 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829523+0000", 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858966099999996 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829529+0000", 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5740000000000001e-06 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859614+0000", 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0300843289999999 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859743+0000", 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129407 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859916+0000", 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017282500000000001 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.614 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116851 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12791808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.626839027999999, 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970347268, 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116851 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:16.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:16.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:16.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:34:16.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889832+0000", 2024-09-11T05:34:16.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6819999999999999e-06 2024-09-11T05:34:16.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889838+0000", 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889841+0000", 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890957+0000", 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001115956 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890961+0000", 2024-09-11T05:34:16.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7050000000000001e-06 2024-09-11T05:34:16.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829552+0000", 2024-09-11T05:34:16.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93859101499999997 2024-09-11T05:34:16.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829558+0000", 2024-09-11T05:34:16.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5429999999999999e-06 2024-09-11T05:34:16.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859947+0000", 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030388248 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860043+0000", 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5847999999999994e-05 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860177+0000", 2024-09-11T05:34:16.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013484400000000001 2024-09-11T05:34:16.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.621 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.621 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116852 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12816384~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.621 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:16.621 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.626824417000002, 2024-09-11T05:34:16.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970594859, 2024-09-11T05:34:16.621 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.622 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.622 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.622 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116852 2024-09-11T05:34:16.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.622 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:16.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:16.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:16.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:16.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889846+0000", 2024-09-11T05:34:16.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.204e-06 2024-09-11T05:34:16.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889849+0000", 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.931e-06 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889852+0000", 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890993+0000", 2024-09-11T05:34:16.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001141176 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891001+0000", 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5259999999999996e-06 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829582+0000", 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858050800000004 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829588+0000", 2024-09-11T05:34:16.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4980000000000003e-06 2024-09-11T05:34:16.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860207+0000", 2024-09-11T05:34:16.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030618713 2024-09-11T05:34:16.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860305+0000", 2024-09-11T05:34:16.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8209999999999997e-05 2024-09-11T05:34:16.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860440+0000", 2024-09-11T05:34:16.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134692 2024-09-11T05:34:16.627 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.627 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.627 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.627 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116853 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12840960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.628 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:16.628 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.626813699000003, 2024-09-11T05:34:16.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.97084075, 2024-09-11T05:34:16.628 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.628 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.628 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116853 2024-09-11T05:34:16.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.628 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:16.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:16.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889856+0000", 2024-09-11T05:34:16.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889857+0000", 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.435e-06 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889860+0000", 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9620000000000002e-06 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889863+0000", 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891036+0000", 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011734580000000001 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891042+0000", 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3290000000000001e-06 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829611+0000", 2024-09-11T05:34:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856954299999995 2024-09-11T05:34:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829618+0000", 2024-09-11T05:34:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T05:34:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860465+0000", 2024-09-11T05:34:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0308472500000001 2024-09-11T05:34:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860558+0000", 2024-09-11T05:34:16.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3253999999999999e-05 2024-09-11T05:34:16.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860696+0000", 2024-09-11T05:34:16.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138169 2024-09-11T05:34:16.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.633 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.634 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116854 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12865536~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.634 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:16.634 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.626803508000002, 2024-09-11T05:34:16.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9710979320000002, 2024-09-11T05:34:16.634 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.634 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116854 2024-09-11T05:34:16.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.635 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:16.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:16.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:16.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:16.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889867+0000", 2024-09-11T05:34:16.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.155e-06 2024-09-11T05:34:16.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889871+0000", 2024-09-11T05:34:16.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9260000000000002e-06 2024-09-11T05:34:16.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889875+0000", 2024-09-11T05:34:16.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.262e-06 2024-09-11T05:34:16.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891070+0000", 2024-09-11T05:34:16.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011945160000000001 2024-09-11T05:34:16.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891079+0000", 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3759999999999997e-06 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829642+0000", 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856325900000004 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829649+0000", 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860726+0000", 2024-09-11T05:34:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.031076791 2024-09-11T05:34:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860831+0000", 2024-09-11T05:34:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105003 2024-09-11T05:34:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860964+0000", 2024-09-11T05:34:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013285700000000001 2024-09-11T05:34:16.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.640 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.640 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.640 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116855 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12890112~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:16.640 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:16.640 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.626788728000001, 2024-09-11T05:34:16.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.971277814, 2024-09-11T05:34:16.640 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:16.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:16.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:16.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:16.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:16.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:16.641 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116855 2024-09-11T05:34:16.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.641 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:16.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:16.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:16.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:16.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817809+0000", 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.92792850999999998 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817815+0000", 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4110000000000001e-06 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817827+0000", 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2031000000000001e-05 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817837+0000", 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2159999999999995e-06 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829673+0000", 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011836197 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829679+0000", 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5390000000000004e-06 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861000+0000", 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0313209539999999 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861080+0000", 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9606999999999999e-05 2024-09-11T05:34:16.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:16.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:16.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:16.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861158+0000", 2024-09-11T05:34:16.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8349000000000005e-05 2024-09-11T05:34:16.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.645 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:16.645 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:16.645 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:16.647 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:16.647 INFO:teuthology.orchestra.run.smithi070.stderr:clear 3.6 pg_upmap_items mapping 2024-09-11T05:34:16.648 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T05:34:16.648 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:16.646+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:16.748 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:16.747+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:16.799 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:16.799 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:16.799 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:16.799 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:16.810 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:16.851 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:16.851+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:16.950 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:16.950+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:17.056 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:17.056 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:17.057 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:17.057 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:17.057 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:17.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:17.057 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:17.056+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:17.157 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:17.157+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:17.201 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:17.201 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:17.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:17.201 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:17.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.201 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:34:17.201 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:17.201 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 91.609313033999996, 2024-09-11T05:34:17.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:34:17.201 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:34:17.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:34:17.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:34:17.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:34:17.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:34:17.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:34:17.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:34:17.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:17.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:34:17.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:34:17.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:34:17.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:34:17.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.032377773999997, 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:34:17.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.207 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:17.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:17.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:34:17.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:34:17.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:34:17.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:34:17.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:34:17.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:34:17.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:34:17.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:34:17.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:34:17.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:34:17.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:34:17.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:34:17.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:34:17.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:34:17.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.211 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.211 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:17.211 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.032358975000001, 2024-09-11T05:34:17.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:34:17.211 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:17.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:34:17.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:34:17.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:34:17.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:34:17.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:34:17.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:34:17.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:34:17.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:17.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.032334943999999, 2024-09-11T05:34:17.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:34:17.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:17.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:34:17.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:34:17.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:34:17.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:34:17.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:34:17.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:34:17.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:34:17.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:34:17.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:34:17.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:34:17.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:34:17.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:34:17.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:34:17.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.220 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.032258155999997, 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.221 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:34:17.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:34:17.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:34:17.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:34:17.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:17.225 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.032230833, 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:17.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:34:17.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:34:17.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:34:17.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:34:17.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:34:17.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:34:17.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:34:17.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.230 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.230 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.230 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:17.230 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.032212285, 2024-09-11T05:34:17.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:34:17.230 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:34:17.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.231 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:17.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:17.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:17.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:17.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:34:17.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:34:17.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:34:17.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:34:17.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:34:17.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:34:17.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:34:17.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:34:17.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.235 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.235 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:17.235 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.032194214, 2024-09-11T05:34:17.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:34:17.235 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.235 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:34:17.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.235 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:34:17.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:34:17.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:34:17.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:34:17.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:34:17.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:34:17.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:34:17.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.030596570999997, 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.239 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:34:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:17.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:34:17.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:34:17.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:34:17.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.243 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.030576244999999, 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:34:17.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.245 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:17.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:17.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:34:17.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:34:17.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:34:17.248 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.248 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.248 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.248 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.248 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:17.248 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.030537246999998, 2024-09-11T05:34:17.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:17.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:17.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:34:17.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:34:17.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:34:17.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:34:17.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:34:17.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:34:17.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:34:17.252 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.253 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.253 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.253 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:17.253 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.030516605000003, 2024-09-11T05:34:17.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:34:17.253 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.253 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.253 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:34:17.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.254 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:17.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:17.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:34:17.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:34:17.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:34:17.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:17.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:34:17.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:34:17.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.257 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.030393742000001, 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:17.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:17.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:34:17.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:34:17.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:34:17.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:34:17.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:34:17.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:34:17.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:34:17.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:34:17.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:34:17.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:34:17.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:17.262 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.030234184999998, 2024-09-11T05:34:17.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:34:17.263 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.263 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:34:17.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.263 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:34:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:34:17.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:34:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:34:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:34:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:34:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:34:17.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:17.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:34:17.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:34:17.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.267 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.268 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:17.268 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.028549517999998, 2024-09-11T05:34:17.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:34:17.268 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:34:17.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.268 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:17.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:17.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:34:17.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:34:17.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:34:17.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:34:17.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:34:17.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:34:17.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:34:17.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:34:17.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:34:17.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.272 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.272 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.272 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:17.272 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.028521513000001, 2024-09-11T05:34:17.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:34:17.273 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:34:17.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.273 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:17.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:17.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:34:17.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:34:17.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:34:17.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:34:17.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:34:17.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:34:17.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:34:17.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:34:17.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:34:17.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:34:17.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:34:17.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:34:17.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:34:17.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:34:17.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.277 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.277 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44388 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8118272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.277 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:17.277 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.02713018, 2024-09-11T05:34:17.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044546074999999997, 2024-09-11T05:34:17.277 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44388 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172487+0000", 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172490+0000", 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5090000000000002e-06 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172497+0000", 2024-09-11T05:34:17.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:34:17.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172502+0000", 2024-09-11T05:34:17.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2000000000000002e-06 2024-09-11T05:34:17.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216878+0000", 2024-09-11T05:34:17.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044375900000000003 2024-09-11T05:34:17.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216925+0000", 2024-09-11T05:34:17.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7058999999999998e-05 2024-09-11T05:34:17.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216982+0000", 2024-09-11T05:34:17.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6932000000000003e-05 2024-09-11T05:34:17.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.281 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.282 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.282 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:17.282 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.027055050000001, 2024-09-11T05:34:17.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:34:17.282 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.282 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.282 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:34:17.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:34:17.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:34:17.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:34:17.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:34:17.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:34:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:34:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:34:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:17.286 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.026869748999999, 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:17.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:34:17.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:34:17.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:34:17.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:34:17.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:34:17.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:34:17.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:34:17.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:34:17.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:34:17.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:34:17.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:34:17.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:34:17.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.026698293999999, 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:17.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:17.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:17.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:17.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:17.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:34:17.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.292 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:17.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:17.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:17.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:17.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:17.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:17.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:17.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:34:17.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:34:17.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:17.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:34:17.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:17.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:34:17.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:34:17.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:17.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:34:17.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:34:17.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:17.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:17.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:17.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:34:17.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:34:17.295 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.295 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:17.296 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:17.296 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:17.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:17.298 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:17.297+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:17.398 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:17.398+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:17.401 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:17.401 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:17.401 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:17.402 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:17.410 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:17.499 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:17.499+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:17.511 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:17.511 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:17.511 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:17.511 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:17.511 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:17.520 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:17.600 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:17.600+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:17.624 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:17.625 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:17.625 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:17.625 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:17.625 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.625 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183598 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8097792~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.625 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:17.625 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8810526269999999, 2024-09-11T05:34:17.625 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038436577999999999, 2024-09-11T05:34:17.625 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.625 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.625 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183598 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742042+0000", 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742044+0000", 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.119e-06 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742049+0000", 2024-09-11T05:34:17.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6710000000000004e-06 2024-09-11T05:34:17.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742054+0000", 2024-09-11T05:34:17.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:34:17.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780385+0000", 2024-09-11T05:34:17.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038330831000000003 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780435+0000", 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0018999999999997e-05 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780478+0000", 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2823e-05 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.630 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183599 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6750208~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.630 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:17.630 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8810338340000001, 2024-09-11T05:34:17.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038610453000000003, 2024-09-11T05:34:17.630 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.630 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.631 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.631 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.631 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.631 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.631 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183599 2024-09-11T05:34:17.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.631 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.631 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.631 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:17.631 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:17.632 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742061+0000", 2024-09-11T05:34:17.632 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2200000000000004e-07 2024-09-11T05:34:17.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742063+0000", 2024-09-11T05:34:17.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:34:17.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742068+0000", 2024-09-11T05:34:17.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6389999999999997e-06 2024-09-11T05:34:17.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742073+0000", 2024-09-11T05:34:17.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6990000000000002e-06 2024-09-11T05:34:17.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780516+0000", 2024-09-11T05:34:17.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038443428000000002 2024-09-11T05:34:17.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780601+0000", 2024-09-11T05:34:17.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4618999999999997e-05 2024-09-11T05:34:17.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780670+0000", 2024-09-11T05:34:17.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9593999999999998e-05 2024-09-11T05:34:17.635 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.635 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.635 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.635 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183600 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8138752~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.635 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:17.636 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8810150190000003, 2024-09-11T05:34:17.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038699900000000002, 2024-09-11T05:34:17.636 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.636 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.636 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.636 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.636 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.636 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.636 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183600 2024-09-11T05:34:17.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.636 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:17.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:17.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:17.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:34:17.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742081+0000", 2024-09-11T05:34:17.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.086e-06 2024-09-11T05:34:17.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742087+0000", 2024-09-11T05:34:17.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4770000000000002e-06 2024-09-11T05:34:17.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742092+0000", 2024-09-11T05:34:17.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7190000000000001e-06 2024-09-11T05:34:17.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780697+0000", 2024-09-11T05:34:17.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038605577000000002 2024-09-11T05:34:17.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.640 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.640 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780740+0000", 2024-09-11T05:34:17.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3139999999999997e-05 2024-09-11T05:34:17.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.640 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.640 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780779+0000", 2024-09-11T05:34:17.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8473000000000002e-05 2024-09-11T05:34:17.641 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.641 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.641 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.641 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183601 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6791168~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.641 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:17.641 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8809969899999999, 2024-09-11T05:34:17.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038869364000000003, 2024-09-11T05:34:17.641 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.642 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.642 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.642 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.642 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.642 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.642 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183601 2024-09-11T05:34:17.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.642 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:17.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:17.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:17.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9900000000000002e-07 2024-09-11T05:34:17.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.644 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742099+0000", 2024-09-11T05:34:17.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:34:17.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.644 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742105+0000", 2024-09-11T05:34:17.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0759999999999999e-06 2024-09-11T05:34:17.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742110+0000", 2024-09-11T05:34:17.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6600000000000003e-06 2024-09-11T05:34:17.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780809+0000", 2024-09-11T05:34:17.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038698681999999998 2024-09-11T05:34:17.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780886+0000", 2024-09-11T05:34:17.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7888999999999999e-05 2024-09-11T05:34:17.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780966+0000", 2024-09-11T05:34:17.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9797999999999997e-05 2024-09-11T05:34:17.646 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.646 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.647 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.647 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183602 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8179712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.647 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:17.647 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8809781709999998, 2024-09-11T05:34:17.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038955028000000003, 2024-09-11T05:34:17.647 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.647 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.647 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.647 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.648 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.648 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.648 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183602 2024-09-11T05:34:17.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.648 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:17.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:17.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:17.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:34:17.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742122+0000", 2024-09-11T05:34:17.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9880000000000001e-06 2024-09-11T05:34:17.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742128+0000", 2024-09-11T05:34:17.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2600000000000002e-06 2024-09-11T05:34:17.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742133+0000", 2024-09-11T05:34:17.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9010000000000002e-06 2024-09-11T05:34:17.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780981+0000", 2024-09-11T05:34:17.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038848102000000002 2024-09-11T05:34:17.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781024+0000", 2024-09-11T05:34:17.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2231000000000003e-05 2024-09-11T05:34:17.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781071+0000", 2024-09-11T05:34:17.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7215000000000001e-05 2024-09-11T05:34:17.651 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.652 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.652 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.652 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183603 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6832128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.652 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:17.652 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8809545449999998, 2024-09-11T05:34:17.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039121378999999998, 2024-09-11T05:34:17.652 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.652 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.652 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.652 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.652 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183603 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742215+0000", 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5419000000000004e-05 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742218+0000", 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0989999999999999e-06 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742225+0000", 2024-09-11T05:34:17.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4019999999999996e-06 2024-09-11T05:34:17.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.655 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.655 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742231+0000", 2024-09-11T05:34:17.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6969999999999998e-06 2024-09-11T05:34:17.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.655 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.655 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781102+0000", 2024-09-11T05:34:17.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038871348 2024-09-11T05:34:17.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781187+0000", 2024-09-11T05:34:17.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4719e-05 2024-09-11T05:34:17.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781261+0000", 2024-09-11T05:34:17.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3695000000000005e-05 2024-09-11T05:34:17.656 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.656 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.656 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.657 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183604 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8220672~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.657 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:17.657 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8808539849999999, 2024-09-11T05:34:17.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039154538000000003, 2024-09-11T05:34:17.657 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.657 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.657 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.657 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.657 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.657 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.657 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183604 2024-09-11T05:34:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743491+0000", 2024-09-11T05:34:17.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0012514620000000001 2024-09-11T05:34:17.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743496+0000", 2024-09-11T05:34:17.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2910000000000001e-06 2024-09-11T05:34:17.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743506+0000", 2024-09-11T05:34:17.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0039e-05 2024-09-11T05:34:17.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743513+0000", 2024-09-11T05:34:17.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:34:17.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781296+0000", 2024-09-11T05:34:17.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037783187000000003 2024-09-11T05:34:17.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781347+0000", 2024-09-11T05:34:17.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1375000000000002e-05 2024-09-11T05:34:17.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781394+0000", 2024-09-11T05:34:17.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119000000000001e-05 2024-09-11T05:34:17.661 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.661 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.662 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.662 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183609 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6955008~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.662 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:17.662 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8794591299999999, 2024-09-11T05:34:17.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038553630999999998, 2024-09-11T05:34:17.662 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.662 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.662 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.662 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.663 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.663 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.663 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183609 2024-09-11T05:34:17.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.663 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:17.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:17.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:17.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.15e-07 2024-09-11T05:34:17.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743637+0000", 2024-09-11T05:34:17.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.86e-06 2024-09-11T05:34:17.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743641+0000", 2024-09-11T05:34:17.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7000000000000002e-06 2024-09-11T05:34:17.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743645+0000", 2024-09-11T05:34:17.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9600000000000002e-06 2024-09-11T05:34:17.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.666 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.666 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.666 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782023+0000", 2024-09-11T05:34:17.666 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038378520999999999 2024-09-11T05:34:17.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.666 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.666 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.666 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782119+0000", 2024-09-11T05:34:17.666 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5665e-05 2024-09-11T05:34:17.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.667 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.667 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782188+0000", 2024-09-11T05:34:17.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9610000000000006e-05 2024-09-11T05:34:17.667 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.667 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.667 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.667 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183610 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8343552~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.667 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:17.668 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.879445552, 2024-09-11T05:34:17.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038675859, 2024-09-11T05:34:17.668 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.668 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.668 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.668 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.668 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.668 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.668 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183610 2024-09-11T05:34:17.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.669 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:17.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:17.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743649+0000", 2024-09-11T05:34:17.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-07 2024-09-11T05:34:17.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743650+0000", 2024-09-11T05:34:17.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5799999999999999e-06 2024-09-11T05:34:17.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743656+0000", 2024-09-11T05:34:17.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:17.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743660+0000", 2024-09-11T05:34:17.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4259999999999999e-06 2024-09-11T05:34:17.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782218+0000", 2024-09-11T05:34:17.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038558508999999998 2024-09-11T05:34:17.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782270+0000", 2024-09-11T05:34:17.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.168e-05 2024-09-11T05:34:17.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782324+0000", 2024-09-11T05:34:17.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4388999999999997e-05 2024-09-11T05:34:17.673 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.673 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.673 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.673 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183611 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6995968~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.673 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:17.673 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8794306599999997, 2024-09-11T05:34:17.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038861554999999999, 2024-09-11T05:34:17.674 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.674 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.674 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.674 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.674 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.674 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.674 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183611 2024-09-11T05:34:17.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.674 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:17.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:17.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:17.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4299999999999999e-07 2024-09-11T05:34:17.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743665+0000", 2024-09-11T05:34:17.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5060000000000001e-06 2024-09-11T05:34:17.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743668+0000", 2024-09-11T05:34:17.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1549999999999999e-06 2024-09-11T05:34:17.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743671+0000", 2024-09-11T05:34:17.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7599999999999998e-06 2024-09-11T05:34:17.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782359+0000", 2024-09-11T05:34:17.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038687946000000001 2024-09-11T05:34:17.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782437+0000", 2024-09-11T05:34:17.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8539000000000001e-05 2024-09-11T05:34:17.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782525+0000", 2024-09-11T05:34:17.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7405999999999996e-05 2024-09-11T05:34:17.678 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.679 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.679 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.679 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183612 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8384512~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.679 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:17.679 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8794194910000002, 2024-09-11T05:34:17.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039040111000000002, 2024-09-11T05:34:17.679 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.679 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.679 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.680 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.680 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.680 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.680 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183612 2024-09-11T05:34:17.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.680 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:17.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:17.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743675+0000", 2024-09-11T05:34:17.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2100000000000001e-07 2024-09-11T05:34:17.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743676+0000", 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.212e-06 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743679+0000", 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743681+0000", 2024-09-11T05:34:17.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.604e-06 2024-09-11T05:34:17.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782560+0000", 2024-09-11T05:34:17.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038878687000000002 2024-09-11T05:34:17.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782644+0000", 2024-09-11T05:34:17.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3733000000000006e-05 2024-09-11T05:34:17.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782714+0000", 2024-09-11T05:34:17.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0655999999999996e-05 2024-09-11T05:34:17.684 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.684 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.684 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.684 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183613 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7036928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.684 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:17.684 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8794094579999996, 2024-09-11T05:34:17.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039233924000000003, 2024-09-11T05:34:17.684 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.684 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.685 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.685 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.685 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.685 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.685 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183613 2024-09-11T05:34:17.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.685 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:17.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745489+0000", 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0018047549999999999 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745493+0000", 2024-09-11T05:34:17.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0439999999999997e-06 2024-09-11T05:34:17.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745501+0000", 2024-09-11T05:34:17.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:34:17.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745507+0000", 2024-09-11T05:34:17.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9490000000000001e-06 2024-09-11T05:34:17.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782756+0000", 2024-09-11T05:34:17.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037249522 2024-09-11T05:34:17.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782839+0000", 2024-09-11T05:34:17.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3133999999999994e-05 2024-09-11T05:34:17.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782918+0000", 2024-09-11T05:34:17.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9167999999999998e-05 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183622 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7323648~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8774510429999998, 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038618008000000002, 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.689 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.690 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.690 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183622 2024-09-11T05:34:17.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.690 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.690 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:17.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.690 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:17.691 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.691 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.691 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.691 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:17.691 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4900000000000001e-07 2024-09-11T05:34:17.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.691 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.691 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.691 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745645+0000", 2024-09-11T05:34:17.692 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9709999999999998e-06 2024-09-11T05:34:17.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.692 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.692 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.692 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745651+0000", 2024-09-11T05:34:17.692 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.251e-06 2024-09-11T05:34:17.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.692 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.692 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.692 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745657+0000", 2024-09-11T05:34:17.692 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:34:17.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784095+0000", 2024-09-11T05:34:17.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038437791999999998 2024-09-11T05:34:17.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784201+0000", 2024-09-11T05:34:17.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000106801 2024-09-11T05:34:17.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784261+0000", 2024-09-11T05:34:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9475999999999998e-05 2024-09-11T05:34:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183623 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4296704~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8774308590000004, 2024-09-11T05:34:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038730705999999997, 2024-09-11T05:34:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183623 2024-09-11T05:34:17.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.696 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.696 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.696 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:17.696 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.696 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.696 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:17.696 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.39e-07 2024-09-11T05:34:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745665+0000", 2024-09-11T05:34:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9860000000000001e-06 2024-09-11T05:34:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745671+0000", 2024-09-11T05:34:17.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.818e-06 2024-09-11T05:34:17.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745676+0000", 2024-09-11T05:34:17.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.972e-06 2024-09-11T05:34:17.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784296+0000", 2024-09-11T05:34:17.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038620131000000002 2024-09-11T05:34:17.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784353+0000", 2024-09-11T05:34:17.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6644999999999997e-05 2024-09-11T05:34:17.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784394+0000", 2024-09-11T05:34:17.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0815000000000001e-05 2024-09-11T05:34:17.700 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.700 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.700 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.700 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.700 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183624 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7364608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.700 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:17.700 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8774119819999999, 2024-09-11T05:34:17.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038826315, 2024-09-11T05:34:17.700 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.701 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.701 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.701 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.701 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.701 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.701 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183624 2024-09-11T05:34:17.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.701 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.701 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.701 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:17.702 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:17.702 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:17.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:34:17.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.703 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745684+0000", 2024-09-11T05:34:17.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0980000000000001e-06 2024-09-11T05:34:17.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.703 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745690+0000", 2024-09-11T05:34:17.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.733e-06 2024-09-11T05:34:17.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.704 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.704 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745695+0000", 2024-09-11T05:34:17.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:34:17.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.704 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.704 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784418+0000", 2024-09-11T05:34:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038722813000000002 2024-09-11T05:34:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784460+0000", 2024-09-11T05:34:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2222999999999999e-05 2024-09-11T05:34:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784508+0000", 2024-09-11T05:34:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8349000000000001e-05 2024-09-11T05:34:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183625 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4337664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.877392274, 2024-09-11T05:34:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923776, 2024-09-11T05:34:17.707 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.707 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.707 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:17.707 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.707 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.707 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.707 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183625 2024-09-11T05:34:17.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.707 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.707 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.707 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.708 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:17.708 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.708 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.708 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:17.708 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.708 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:17.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.41e-07 2024-09-11T05:34:17.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.709 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745713+0000", 2024-09-11T05:34:17.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0579e-05 2024-09-11T05:34:17.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.709 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745719+0000", 2024-09-11T05:34:17.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4540000000000004e-06 2024-09-11T05:34:17.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.710 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.710 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745724+0000", 2024-09-11T05:34:17.710 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1170000000000003e-06 2024-09-11T05:34:17.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.710 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.710 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784532+0000", 2024-09-11T05:34:17.710 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038807618000000002 2024-09-11T05:34:17.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.711 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:17.711 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784586+0000", 2024-09-11T05:34:17.711 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4432999999999999e-05 2024-09-11T05:34:17.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.711 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.711 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.711 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784625+0000", 2024-09-11T05:34:17.711 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9233999999999997e-05 2024-09-11T05:34:17.711 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.711 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.711 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.711 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.712 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183626 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.712 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:17.712 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8773626119999998, 2024-09-11T05:34:17.712 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038934147000000002, 2024-09-11T05:34:17.712 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.712 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.712 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:17.712 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.712 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.712 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.712 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183626 2024-09-11T05:34:17.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.712 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:17.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:17.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745732+0000", 2024-09-11T05:34:17.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:34:17.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.714 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745734+0000", 2024-09-11T05:34:17.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9649999999999998e-06 2024-09-11T05:34:17.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.714 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745739+0000", 2024-09-11T05:34:17.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.806e-06 2024-09-11T05:34:17.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.715 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745744+0000", 2024-09-11T05:34:17.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5210000000000004e-06 2024-09-11T05:34:17.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.715 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784660+0000", 2024-09-11T05:34:17.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038916077 2024-09-11T05:34:17.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.715 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784665+0000", 2024-09-11T05:34:17.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3929999999999999e-06 2024-09-11T05:34:17.716 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.716 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.716 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.716 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183627 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.716 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:17.716 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8773440939999997, 2024-09-11T05:34:17.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038942282000000002, 2024-09-11T05:34:17.716 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.716 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.716 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:17.717 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.717 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.717 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.717 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183627 2024-09-11T05:34:17.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.717 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.717 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.717 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:17.717 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.718 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.718 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:17.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.718 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.718 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.718 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:17.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:17.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.718 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.718 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.719 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745752+0000", 2024-09-11T05:34:17.719 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9e-06 2024-09-11T05:34:17.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.719 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.719 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745758+0000", 2024-09-11T05:34:17.719 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6899999999999997e-06 2024-09-11T05:34:17.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.719 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.719 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745763+0000", 2024-09-11T05:34:17.720 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9169999999999997e-06 2024-09-11T05:34:17.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.720 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.720 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784686+0000", 2024-09-11T05:34:17.720 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923874999999997 2024-09-11T05:34:17.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.720 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784692+0000", 2024-09-11T05:34:17.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5600000000000001e-06 2024-09-11T05:34:17.721 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.721 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.721 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.721 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.721 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183628 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.721 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:17.721 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8773054829999998, 2024-09-11T05:34:17.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038927438000000002, 2024-09-11T05:34:17.721 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183628 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.722 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745789+0000", 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3000000000000002e-07 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745791+0000", 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0209999999999998e-06 2024-09-11T05:34:17.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.724 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.724 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745802+0000", 2024-09-11T05:34:17.724 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0886e-05 2024-09-11T05:34:17.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.724 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.724 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745806+0000", 2024-09-11T05:34:17.724 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0289999999999999e-06 2024-09-11T05:34:17.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.724 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784712+0000", 2024-09-11T05:34:17.725 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038905922000000003 2024-09-11T05:34:17.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.725 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.725 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784716+0000", 2024-09-11T05:34:17.725 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.25e-06 2024-09-11T05:34:17.725 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.725 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.725 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.726 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.726 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183629 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:17.726 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:17.726 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 5.8772837659999997, 2024-09-11T05:34:17.726 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038954874, 2024-09-11T05:34:17.726 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:17.726 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:17.726 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:17.726 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:17.726 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:17.726 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:17.727 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183629 2024-09-11T05:34:17.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.727 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:17.727 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.727 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:17.727 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:17.727 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.727 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.727 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:17.727 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:17.728 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:17.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:17.728 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747489+0000", 2024-09-11T05:34:17.728 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0016785529999999999 2024-09-11T05:34:17.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:17.728 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747493+0000", 2024-09-11T05:34:17.728 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0600000000000001e-06 2024-09-11T05:34:17.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.729 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.729 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:17.729 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747501+0000", 2024-09-11T05:34:17.729 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9109999999999993e-06 2024-09-11T05:34:17.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.729 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.729 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:17.729 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747507+0000", 2024-09-11T05:34:17.729 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3899999999999998e-06 2024-09-11T05:34:17.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.730 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:17.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784760+0000", 2024-09-11T05:34:17.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037253197000000002 2024-09-11T05:34:17.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:17.730 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:17.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:17.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784765+0000", 2024-09-11T05:34:17.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.763e-06 2024-09-11T05:34:17.730 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.731 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.731 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.731 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:17.731 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:17.731 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:17.732 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:17.733 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:17.732+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:17.833 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:17.833+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:17.877 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:17.877 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:17.877 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:17.877 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:17.886 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:17.934 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:17.934+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:17.989 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:17.989 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:17.990 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:17.990 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:17.990 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:17.998 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:18.035 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:18.034+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:18.102 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:18.102 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:18.102 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:18.102 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:18.103 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.103 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116713 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13060096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.103 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:18.103 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.287284028000002, 2024-09-11T05:34:18.103 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599235, 2024-09-11T05:34:18.103 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.103 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.103 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.103 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.103 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.103 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.103 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116713 2024-09-11T05:34:18.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.104 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.104 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.104 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:18.104 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.104 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.104 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:18.104 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.104 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813321+0000", 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000005e-07 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813323+0000", 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.667e-06 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813331+0000", 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6529999999999994e-06 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.105 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813336+0000", 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813688+0000", 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035143199999999999 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813692+0000", 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5120000000000002e-06 2024-09-11T05:34:18.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816304+0000", 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026115449999999998 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816308+0000", 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2370000000000003e-06 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821720+0000", 2024-09-11T05:34:18.107 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0054114869999999 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821724+0000", 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873101+0000", 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0513774279999999 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.108 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873159+0000", 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819000000000003e-05 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873244+0000", 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4300000000000003e-05 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116714 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:18.109 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.287241393000002, 2024-09-11T05:34:18.110 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600505999999998, 2024-09-11T05:34:18.110 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.110 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.110 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.110 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.110 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.110 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.110 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116714 2024-09-11T05:34:18.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.110 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.110 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.110 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.111 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813366+0000", 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6919999999999998e-06 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813373+0000", 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8689999999999998e-06 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813378+0000", 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2159999999999997e-06 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813733+0000", 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035530300000000001 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813739+0000", 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8819999999999998e-06 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816340+0000", 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002600598 2024-09-11T05:34:18.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816349+0000", 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9169999999999995e-06 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821745+0000", 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005396416 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821750+0000", 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:34:18.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873269+0000", 2024-09-11T05:34:18.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0515195159999999 2024-09-11T05:34:18.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873328+0000", 2024-09-11T05:34:18.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9222999999999999e-05 2024-09-11T05:34:18.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873413+0000", 2024-09-11T05:34:18.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4983999999999998e-05 2024-09-11T05:34:18.116 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.116 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.116 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.116 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116715 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13109248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.116 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:18.116 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.287199911999998, 2024-09-11T05:34:18.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0602519180000001, 2024-09-11T05:34:18.116 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.116 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.117 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.117 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.117 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.117 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.117 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116715 2024-09-11T05:34:18.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.117 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.117 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813405+0000", 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.51e-07 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.118 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813407+0000", 2024-09-11T05:34:18.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:34:18.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813414+0000", 2024-09-11T05:34:18.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.686e-06 2024-09-11T05:34:18.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813419+0000", 2024-09-11T05:34:18.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4249999999999997e-06 2024-09-11T05:34:18.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813774+0000", 2024-09-11T05:34:18.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035460800000000002 2024-09-11T05:34:18.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:18.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813778+0000", 2024-09-11T05:34:18.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:34:18.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816375+0000", 2024-09-11T05:34:18.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025967730000000001 2024-09-11T05:34:18.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816379+0000", 2024-09-11T05:34:18.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3780000000000003e-06 2024-09-11T05:34:18.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821770+0000", 2024-09-11T05:34:18.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053903040000001 2024-09-11T05:34:18.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821774+0000", 2024-09-11T05:34:18.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:34:18.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873437+0000", 2024-09-11T05:34:18.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051663155 2024-09-11T05:34:18.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873500+0000", 2024-09-11T05:34:18.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3027000000000005e-05 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873656+0000", 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015580800000000001 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116716 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13133824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.287157454999999, 2024-09-11T05:34:18.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0605170350000002, 2024-09-11T05:34:18.124 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.124 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.124 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.124 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.124 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.124 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.124 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116716 2024-09-11T05:34:18.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.124 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.124 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:18.124 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5799999999999999e-07 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813450+0000", 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7659999999999999e-06 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813458+0000", 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7430000000000002e-06 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813464+0000", 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813814+0000", 2024-09-11T05:34:18.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035073199999999998 2024-09-11T05:34:18.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:18.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813819+0000", 2024-09-11T05:34:18.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:34:18.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816410+0000", 2024-09-11T05:34:18.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025904349999999999 2024-09-11T05:34:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816418+0000", 2024-09-11T05:34:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1610000000000003e-06 2024-09-11T05:34:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821794+0000", 2024-09-11T05:34:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005376391 2024-09-11T05:34:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821799+0000", 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4870000000000004e-06 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873697+0000", 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051898843 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873810+0000", 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112187 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873964+0000", 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015412800000000001 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116717 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13158400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.287132370999998, 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606806560000002, 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.130 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.131 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.131 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.131 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116717 2024-09-11T05:34:18.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.131 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:18.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813474+0000", 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1830000000000001e-06 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.132 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813481+0000", 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5540000000000003e-06 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813491+0000", 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0472000000000001e-05 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813867+0000", 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00037606 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813873+0000", 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.254e-06 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816443+0000", 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025701769999999999 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816446+0000", 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:34:18.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821818+0000", 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053719830000001 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821823+0000", 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5560000000000001e-06 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874006+0000", 2024-09-11T05:34:18.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05218342 2024-09-11T05:34:18.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.136 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874071+0000", 2024-09-11T05:34:18.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4369999999999995e-05 2024-09-11T05:34:18.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.136 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874152+0000", 2024-09-11T05:34:18.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1658999999999999e-05 2024-09-11T05:34:18.137 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.137 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.137 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.137 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116718 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13182976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.137 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:18.137 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.287100852999998, 2024-09-11T05:34:18.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0609185380000001, 2024-09-11T05:34:18.137 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.137 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.137 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.137 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116718 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:18.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813504+0000", 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7999999999999996e-07 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813506+0000", 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2989999999999999e-06 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813513+0000", 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8020000000000003e-06 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813517+0000", 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5639999999999998e-06 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813916+0000", 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039859800000000001 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:18.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813922+0000", 2024-09-11T05:34:18.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:34:18.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816476+0000", 2024-09-11T05:34:18.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025538359999999999 2024-09-11T05:34:18.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816481+0000", 2024-09-11T05:34:18.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819999999999999e-06 2024-09-11T05:34:18.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821843+0000", 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053620299999999 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821848+0000", 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874191+0000", 2024-09-11T05:34:18.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052342935 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874300+0000", 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000108764 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874422+0000", 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012221399999999999 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116719 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13207552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.287060054999998, 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0611734350000002, 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116719 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.144 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.145 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.145 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:18.145 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.145 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.145 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:18.145 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.145 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813545+0000", 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2600000000000002e-07 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813547+0000", 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3329999999999999e-06 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813553+0000", 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4640000000000003e-06 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813558+0000", 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813952+0000", 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039390999999999997 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813955+0000", 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.858e-06 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816524+0000", 2024-09-11T05:34:18.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002568847 2024-09-11T05:34:18.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816533+0000", 2024-09-11T05:34:18.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1749999999999994e-06 2024-09-11T05:34:18.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821869+0000", 2024-09-11T05:34:18.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053358939999999 2024-09-11T05:34:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821876+0000", 2024-09-11T05:34:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:34:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874454+0000", 2024-09-11T05:34:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052577621 2024-09-11T05:34:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874546+0000", 2024-09-11T05:34:18.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2151999999999995e-05 2024-09-11T05:34:18.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874718+0000", 2024-09-11T05:34:18.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017183399999999999 2024-09-11T05:34:18.150 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.150 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.150 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.150 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116720 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13232128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.287038168999999, 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0614845590000002, 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116720 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5600000000000002e-07 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.153 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813568+0000", 2024-09-11T05:34:18.153 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9089999999999998e-06 2024-09-11T05:34:18.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.153 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.153 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.153 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813573+0000", 2024-09-11T05:34:18.153 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2059999999999998e-06 2024-09-11T05:34:18.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.153 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.153 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.153 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813577+0000", 2024-09-11T05:34:18.153 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1489999999999996e-06 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813987+0000", 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040977800000000002 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813992+0000", 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1540000000000001e-06 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816560+0000", 2024-09-11T05:34:18.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025680389999999998 2024-09-11T05:34:18.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816566+0000", 2024-09-11T05:34:18.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0679999999999996e-06 2024-09-11T05:34:18.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821907+0000", 2024-09-11T05:34:18.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005341735 2024-09-11T05:34:18.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821916+0000", 2024-09-11T05:34:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3659999999999992e-06 2024-09-11T05:34:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874760+0000", 2024-09-11T05:34:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052844713 2024-09-11T05:34:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874878+0000", 2024-09-11T05:34:18.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000117321 2024-09-11T05:34:18.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.157 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.157 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.157 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875051+0000", 2024-09-11T05:34:18.157 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017286499999999999 2024-09-11T05:34:18.157 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.157 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.157 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116721 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13256704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.287020814999998, 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0616932019999998, 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116721 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.158 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.159 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.159 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:18.159 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.159 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.159 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:18.159 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.159 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.159 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813584+0000", 2024-09-11T05:34:18.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2e-07 2024-09-11T05:34:18.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.160 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813586+0000", 2024-09-11T05:34:18.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.277e-06 2024-09-11T05:34:18.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.160 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813592+0000", 2024-09-11T05:34:18.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5840000000000002e-06 2024-09-11T05:34:18.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.161 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813597+0000", 2024-09-11T05:34:18.161 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2839999999999997e-06 2024-09-11T05:34:18.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.161 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814028+0000", 2024-09-11T05:34:18.161 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000430689 2024-09-11T05:34:18.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:18.161 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814032+0000", 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3850000000000004e-06 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816597+0000", 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00256485 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816606+0000", 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.162 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821949+0000", 2024-09-11T05:34:18.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005342752 2024-09-11T05:34:18.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.163 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821954+0000", 2024-09-11T05:34:18.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2270000000000001e-06 2024-09-11T05:34:18.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.163 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875095+0000", 2024-09-11T05:34:18.164 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.053140669 2024-09-11T05:34:18.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.164 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.164 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875186+0000", 2024-09-11T05:34:18.164 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1391999999999995e-05 2024-09-11T05:34:18.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.164 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.164 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875277+0000", 2024-09-11T05:34:18.164 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0556000000000005e-05 2024-09-11T05:34:18.164 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.165 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.165 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.165 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116722 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13281280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.165 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:18.165 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.286983816000003, 2024-09-11T05:34:18.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.061825491, 2024-09-11T05:34:18.165 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.165 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.165 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.165 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.166 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.166 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.166 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116722 2024-09-11T05:34:18.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.166 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.166 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.166 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.166 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:18.166 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.166 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.166 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.166 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813621+0000", 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813625+0000", 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.228e-06 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813635+0000", 2024-09-11T05:34:18.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5179999999999993e-06 2024-09-11T05:34:18.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.168 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813641+0000", 2024-09-11T05:34:18.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4710000000000004e-06 2024-09-11T05:34:18.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.168 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814057+0000", 2024-09-11T05:34:18.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00041530099999999997 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814060+0000", 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-06 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816632+0000", 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00257186 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816636+0000", 2024-09-11T05:34:18.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2150000000000003e-06 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821977+0000", 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053407110000001 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821982+0000", 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875307+0000", 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0533247000000001 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875366+0000", 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8628999999999997e-05 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875446+0000", 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0026999999999998e-05 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.171 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116723 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13305856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.286950838000003, 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0619630779999998, 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116723 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.172 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813654+0000", 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:34:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813661+0000", 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1890000000000001e-06 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813675+0000", 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3878e-05 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813682+0000", 2024-09-11T05:34:18.174 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.063e-06 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816666+0000", 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029845679999999999 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816671+0000", 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822024+0000", 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053534660000001 2024-09-11T05:34:18.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822028+0000", 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7799999999999998e-06 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875471+0000", 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05344306 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875531+0000", 2024-09-11T05:34:18.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0019000000000003e-05 2024-09-11T05:34:18.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875616+0000", 2024-09-11T05:34:18.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5304999999999997e-05 2024-09-11T05:34:18.177 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.177 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.177 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.177 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116724 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13330432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.177 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:18.177 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.286911349, 2024-09-11T05:34:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0620902609999998, 2024-09-11T05:34:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116724 2024-09-11T05:34:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:18.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:18.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:18.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.99e-07 2024-09-11T05:34:18.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.180 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.180 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813697+0000", 2024-09-11T05:34:18.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2430000000000001e-06 2024-09-11T05:34:18.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.180 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.180 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813704+0000", 2024-09-11T05:34:18.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2980000000000003e-06 2024-09-11T05:34:18.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.181 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813709+0000", 2024-09-11T05:34:18.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8130000000000003e-06 2024-09-11T05:34:18.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.181 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816702+0000", 2024-09-11T05:34:18.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002992864 2024-09-11T05:34:18.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.181 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816711+0000", 2024-09-11T05:34:18.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1840000000000005e-06 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822050+0000", 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.00533864 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822055+0000", 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875642+0000", 2024-09-11T05:34:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0535874220000001 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875698+0000", 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5707e-05 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875783+0000", 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5362e-05 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116725 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13355008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.286877161, 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.06220984, 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116725 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813728+0000", 2024-09-11T05:34:18.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:34:18.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813730+0000", 2024-09-11T05:34:18.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6730000000000001e-06 2024-09-11T05:34:18.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.187 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813743+0000", 2024-09-11T05:34:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2833000000000001e-05 2024-09-11T05:34:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813749+0000", 2024-09-11T05:34:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:34:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816726+0000", 2024-09-11T05:34:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029772090000000002 2024-09-11T05:34:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816730+0000", 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.518e-06 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822074+0000", 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053444030000001 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822079+0000", 2024-09-11T05:34:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875807+0000", 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0537284410000001 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875858+0000", 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0574000000000001e-05 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875937+0000", 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9268000000000001e-05 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116974 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13185024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.278933324999997, 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598649249999998, 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.191 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116974 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821673+0000", 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.722e-06 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821686+0000", 2024-09-11T05:34:18.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2974e-05 2024-09-11T05:34:18.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821692+0000", 2024-09-11T05:34:18.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:34:18.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822089+0000", 2024-09-11T05:34:18.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039611699999999998 2024-09-11T05:34:18.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822099+0000", 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0029e-05 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822803+0000", 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000704507 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822808+0000", 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6460000000000001e-06 2024-09-11T05:34:18.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881361+0000", 2024-09-11T05:34:18.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0585529680000001 2024-09-11T05:34:18.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881432+0000", 2024-09-11T05:34:18.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:34:18.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881536+0000", 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000103243 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116975 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13209600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.278904990999997, 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.060124761, 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.197 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116975 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821700+0000", 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821701+0000", 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8369999999999999e-06 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821708+0000", 2024-09-11T05:34:18.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5520000000000001e-06 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821713+0000", 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.091e-06 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822135+0000", 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00042166399999999998 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822143+0000", 2024-09-11T05:34:18.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3089999999999996e-06 2024-09-11T05:34:18.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822820+0000", 2024-09-11T05:34:18.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000677145 2024-09-11T05:34:18.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822824+0000", 2024-09-11T05:34:18.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.641e-06 2024-09-11T05:34:18.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881569+0000", 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.058744785 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881674+0000", 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000105111 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881824+0000", 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000150197 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.202 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.203 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.203 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116976 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13234176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.203 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:18.203 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.278876011999998, 2024-09-11T05:34:18.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0603909900000001, 2024-09-11T05:34:18.203 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.203 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.203 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.203 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.203 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.203 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.204 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116976 2024-09-11T05:34:18.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.204 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:18.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:18.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821729+0000", 2024-09-11T05:34:18.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:34:18.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821731+0000", 2024-09-11T05:34:18.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0250000000000001e-06 2024-09-11T05:34:18.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821737+0000", 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8839999999999997e-06 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821743+0000", 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1050000000000003e-06 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822194+0000", 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000451574 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822203+0000", 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9449999999999999e-06 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822835+0000", 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000632019 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822839+0000", 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8229999999999997e-06 2024-09-11T05:34:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881861+0000", 2024-09-11T05:34:18.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.059021776 2024-09-11T05:34:18.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881976+0000", 2024-09-11T05:34:18.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00011531699999999999 2024-09-11T05:34:18.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882119+0000", 2024-09-11T05:34:18.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000143077 2024-09-11T05:34:18.209 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.209 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.209 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.209 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116977 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13258752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.209 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:18.209 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.278824778000001, 2024-09-11T05:34:18.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606236920000001, 2024-09-11T05:34:18.209 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.209 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.209 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116977 2024-09-11T05:34:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821782+0000", 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7719999999999999e-06 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821785+0000", 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9409999999999999e-06 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821793+0000", 2024-09-11T05:34:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:34:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821799+0000", 2024-09-11T05:34:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4609999999999999e-06 2024-09-11T05:34:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822246+0000", 2024-09-11T05:34:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044669000000000002 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822254+0000", 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1859999999999992e-06 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822850+0000", 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005962340000001 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822854+0000", 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5310000000000002e-06 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882149+0000", 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0592958729999999 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882253+0000", 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104058 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882403+0000", 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014958800000000001 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116978 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13283328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.278794554999998, 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0608297769999999, 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.215 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116978 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.216 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:18.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:18.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:34:18.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821813+0000", 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821820+0000", 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3669999999999999e-06 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821825+0000", 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5119999999999999e-06 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822273+0000", 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044727900000000003 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822278+0000", 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7529999999999998e-06 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822865+0000", 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005861579999999 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822868+0000", 2024-09-11T05:34:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4659999999999999e-06 2024-09-11T05:34:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882434+0000", 2024-09-11T05:34:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0595660170000001 2024-09-11T05:34:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882502+0000", 2024-09-11T05:34:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7442999999999998e-05 2024-09-11T05:34:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.221 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882639+0000", 2024-09-11T05:34:18.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013779999999999999 2024-09-11T05:34:18.221 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.221 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.221 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.221 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116980 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13332480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.221 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:18.221 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.277255033000003, 2024-09-11T05:34:18.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598269180000002, 2024-09-11T05:34:18.222 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.222 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.222 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.222 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.222 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.222 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.222 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116980 2024-09-11T05:34:18.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.222 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.222 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823350+0000", 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.223 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823352+0000", 2024-09-11T05:34:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5459999999999998e-06 2024-09-11T05:34:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823360+0000", 2024-09-11T05:34:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4359999999999996e-06 2024-09-11T05:34:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823365+0000", 2024-09-11T05:34:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3079999999999998e-06 2024-09-11T05:34:18.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823418+0000", 2024-09-11T05:34:18.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2735999999999998e-05 2024-09-11T05:34:18.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823423+0000", 2024-09-11T05:34:18.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3410000000000002e-06 2024-09-11T05:34:18.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822895+0000", 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99947249000000005 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822899+0000", 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6169999999999998e-06 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882964+0000", 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0600650840000001 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883020+0000", 2024-09-11T05:34:18.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5563000000000003e-05 2024-09-11T05:34:18.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.227 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883176+0000", 2024-09-11T05:34:18.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015629500000000001 2024-09-11T05:34:18.227 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.227 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.227 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.227 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116981 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13357056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:18.228 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:18.228 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 39.277231053000001, 2024-09-11T05:34:18.228 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600075910000002, 2024-09-11T05:34:18.228 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:18.228 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:18.228 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:18.228 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:18.228 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:18.228 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:18.228 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116981 2024-09-11T05:34:18.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.228 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:18.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.01e-07 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823376+0000", 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823381+0000", 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000001e-06 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823386+0000", 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5349999999999998e-06 2024-09-11T05:34:18.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823447+0000", 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1277000000000003e-05 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823456+0000", 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8859999999999993e-06 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822914+0000", 2024-09-11T05:34:18.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99945797999999997 2024-09-11T05:34:18.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.232 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.232 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:18.232 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822918+0000", 2024-09-11T05:34:18.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5810000000000001e-06 2024-09-11T05:34:18.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.232 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.232 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:18.232 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883209+0000", 2024-09-11T05:34:18.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0602916899999999 2024-09-11T05:34:18.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.232 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.232 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:18.233 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883292+0000", 2024-09-11T05:34:18.233 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2849000000000006e-05 2024-09-11T05:34:18.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:18.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:18.233 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:18.233 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883381+0000", 2024-09-11T05:34:18.233 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8585000000000007e-05 2024-09-11T05:34:18.233 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.233 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.233 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.233 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:18.233 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:18.233 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:18.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:34:18.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:18.236 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:18.234+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:18.336 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:18.335+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:18.359 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:18.360 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:18.376 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:18.377 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:18.380 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:18.380 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:18.380 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:18.380 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:18.388 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:18.393 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:18.409 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:18.409 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:18.409 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-11T05:34:18.426 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:18.437 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:18.437+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:18.442 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:18.442 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:18.459 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:18.462 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:34:18.462 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:34:18.531 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:18.531 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:18.538 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:18.538+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:18.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:18.639 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:18.639+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:18.643 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:18.643 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:18.650 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:34:18.653 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:18.740 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:18.740+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:18.773 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:18.773 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:18.783 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:18.866 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:18.866+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:18.927 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:18.927 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:18.936 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:18.942 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:18.941+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:19.043 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:19.042+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:19.079 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:19.079 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:19.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:19.144 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:19.143+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:19.191 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:19.191 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:19.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:19.244 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:19.244+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:19.303 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:19.304 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:19.313 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:19.353 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:19.353+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:19.447 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:19.446+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:19.455 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:19.455 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:19.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:19.548 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:19.547+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:19.567 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:19.567 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:19.576 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:19.652 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T05:34:19.653 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:19.652+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:19.741 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:19.741 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:19.749 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:19.749+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:19.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:19.850 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:19.849+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:19.894 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:19.895 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:19.903 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:19.951 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:19.950+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:20.008 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:20.008 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:20.016 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:20.060 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:20.060+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:20.118 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:20.118 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:20.127 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:20.152 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:20.151+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:20.253 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:20.252+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:20.270 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:20.270 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:20.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:20.354 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:20.354+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:20.382 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:20.382 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:20.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:20.455 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:20.455+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:20.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:34:20.492 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:20.492 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:20.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:20.556 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:20.555+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:20.583 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:20.583 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:20.600 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:20.600 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:20.605 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:20.605 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:20.614 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:20.615 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:20.631 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:20.632 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:20.632 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-11T05:34:20.648 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:20.649 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:20.671 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:20.671 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:20.690 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:20.690 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:20.693 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:34:20.694 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:34:20.698 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:20.697+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:20.758 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:20.757+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:20.763 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:20.763 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:20.764 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:20.764 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:20.773 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:20.859 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:20.858+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:20.915 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:20.915 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:20.915 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:20.915 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:20.916 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:20.924 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:20.960 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:20.960+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:21.061 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:21.061+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:21.069 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:21.069 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:21.069 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:21.069 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:21.069 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.069 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116713 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13060096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.254137634000003, 2024-09-11T05:34:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599235, 2024-09-11T05:34:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116713 2024-09-11T05:34:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813321+0000", 2024-09-11T05:34:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000005e-07 2024-09-11T05:34:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813323+0000", 2024-09-11T05:34:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.667e-06 2024-09-11T05:34:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813331+0000", 2024-09-11T05:34:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6529999999999994e-06 2024-09-11T05:34:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813336+0000", 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813688+0000", 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035143199999999999 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813692+0000", 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5120000000000002e-06 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816304+0000", 2024-09-11T05:34:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026115449999999998 2024-09-11T05:34:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816308+0000", 2024-09-11T05:34:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2370000000000003e-06 2024-09-11T05:34:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821720+0000", 2024-09-11T05:34:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0054114869999999 2024-09-11T05:34:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821724+0000", 2024-09-11T05:34:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:34:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873101+0000", 2024-09-11T05:34:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0513774279999999 2024-09-11T05:34:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873159+0000", 2024-09-11T05:34:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819000000000003e-05 2024-09-11T05:34:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873244+0000", 2024-09-11T05:34:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4300000000000003e-05 2024-09-11T05:34:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116714 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.254094999000003, 2024-09-11T05:34:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600505999999998, 2024-09-11T05:34:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116714 2024-09-11T05:34:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:34:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813366+0000", 2024-09-11T05:34:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6919999999999998e-06 2024-09-11T05:34:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813373+0000", 2024-09-11T05:34:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8689999999999998e-06 2024-09-11T05:34:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813378+0000", 2024-09-11T05:34:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2159999999999997e-06 2024-09-11T05:34:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813733+0000", 2024-09-11T05:34:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035530300000000001 2024-09-11T05:34:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813739+0000", 2024-09-11T05:34:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8819999999999998e-06 2024-09-11T05:34:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816340+0000", 2024-09-11T05:34:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002600598 2024-09-11T05:34:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816349+0000", 2024-09-11T05:34:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9169999999999995e-06 2024-09-11T05:34:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821745+0000", 2024-09-11T05:34:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005396416 2024-09-11T05:34:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821750+0000", 2024-09-11T05:34:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:34:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873269+0000", 2024-09-11T05:34:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0515195159999999 2024-09-11T05:34:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873328+0000", 2024-09-11T05:34:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9222999999999999e-05 2024-09-11T05:34:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873413+0000", 2024-09-11T05:34:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4983999999999998e-05 2024-09-11T05:34:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116715 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13109248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.254053517999999, 2024-09-11T05:34:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0602519180000001, 2024-09-11T05:34:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116715 2024-09-11T05:34:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813405+0000", 2024-09-11T05:34:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.51e-07 2024-09-11T05:34:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813407+0000", 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813414+0000", 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.686e-06 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813419+0000", 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4249999999999997e-06 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813774+0000", 2024-09-11T05:34:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035460800000000002 2024-09-11T05:34:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813778+0000", 2024-09-11T05:34:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:34:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816375+0000", 2024-09-11T05:34:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025967730000000001 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816379+0000", 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3780000000000003e-06 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821770+0000", 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053903040000001 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821774+0000", 2024-09-11T05:34:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:34:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873437+0000", 2024-09-11T05:34:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051663155 2024-09-11T05:34:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873500+0000", 2024-09-11T05:34:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3027000000000005e-05 2024-09-11T05:34:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873656+0000", 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015580800000000001 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116716 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13133824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.254011061, 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0605170350000002, 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116716 2024-09-11T05:34:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5799999999999999e-07 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813450+0000", 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7659999999999999e-06 2024-09-11T05:34:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813458+0000", 2024-09-11T05:34:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7430000000000002e-06 2024-09-11T05:34:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813464+0000", 2024-09-11T05:34:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:34:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813814+0000", 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035073199999999998 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813819+0000", 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816410+0000", 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025904349999999999 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816418+0000", 2024-09-11T05:34:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1610000000000003e-06 2024-09-11T05:34:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821794+0000", 2024-09-11T05:34:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005376391 2024-09-11T05:34:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821799+0000", 2024-09-11T05:34:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4870000000000004e-06 2024-09-11T05:34:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873697+0000", 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051898843 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873810+0000", 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112187 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873964+0000", 2024-09-11T05:34:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015412800000000001 2024-09-11T05:34:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116717 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13158400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.253985976999999, 2024-09-11T05:34:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606806560000002, 2024-09-11T05:34:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116717 2024-09-11T05:34:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813474+0000", 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1830000000000001e-06 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813481+0000", 2024-09-11T05:34:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5540000000000003e-06 2024-09-11T05:34:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813491+0000", 2024-09-11T05:34:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0472000000000001e-05 2024-09-11T05:34:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813867+0000", 2024-09-11T05:34:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00037606 2024-09-11T05:34:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813873+0000", 2024-09-11T05:34:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.254e-06 2024-09-11T05:34:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816443+0000", 2024-09-11T05:34:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025701769999999999 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816446+0000", 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821818+0000", 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053719830000001 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821823+0000", 2024-09-11T05:34:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5560000000000001e-06 2024-09-11T05:34:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874006+0000", 2024-09-11T05:34:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05218342 2024-09-11T05:34:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874071+0000", 2024-09-11T05:34:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4369999999999995e-05 2024-09-11T05:34:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874152+0000", 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1658999999999999e-05 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116718 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13182976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.253954458999999, 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0609185380000001, 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116718 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813504+0000", 2024-09-11T05:34:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7999999999999996e-07 2024-09-11T05:34:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813506+0000", 2024-09-11T05:34:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2989999999999999e-06 2024-09-11T05:34:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813513+0000", 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8020000000000003e-06 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813517+0000", 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5639999999999998e-06 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813916+0000", 2024-09-11T05:34:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039859800000000001 2024-09-11T05:34:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813922+0000", 2024-09-11T05:34:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:34:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816476+0000", 2024-09-11T05:34:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025538359999999999 2024-09-11T05:34:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816481+0000", 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819999999999999e-06 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821843+0000", 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053620299999999 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821848+0000", 2024-09-11T05:34:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874191+0000", 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052342935 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874300+0000", 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000108764 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874422+0000", 2024-09-11T05:34:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012221399999999999 2024-09-11T05:34:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116719 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13207552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.253913660999999, 2024-09-11T05:34:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0611734350000002, 2024-09-11T05:34:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116719 2024-09-11T05:34:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813545+0000", 2024-09-11T05:34:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2600000000000002e-07 2024-09-11T05:34:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813547+0000", 2024-09-11T05:34:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3329999999999999e-06 2024-09-11T05:34:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813553+0000", 2024-09-11T05:34:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4640000000000003e-06 2024-09-11T05:34:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813558+0000", 2024-09-11T05:34:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:34:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813952+0000", 2024-09-11T05:34:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039390999999999997 2024-09-11T05:34:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813955+0000", 2024-09-11T05:34:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.858e-06 2024-09-11T05:34:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816524+0000", 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002568847 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816533+0000", 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1749999999999994e-06 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821869+0000", 2024-09-11T05:34:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053358939999999 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821876+0000", 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874454+0000", 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052577621 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874546+0000", 2024-09-11T05:34:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2151999999999995e-05 2024-09-11T05:34:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874718+0000", 2024-09-11T05:34:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017183399999999999 2024-09-11T05:34:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116720 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13232128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.253891775, 2024-09-11T05:34:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0614845590000002, 2024-09-11T05:34:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116720 2024-09-11T05:34:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5600000000000002e-07 2024-09-11T05:34:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813568+0000", 2024-09-11T05:34:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9089999999999998e-06 2024-09-11T05:34:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813573+0000", 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2059999999999998e-06 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813577+0000", 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1489999999999996e-06 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813987+0000", 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040977800000000002 2024-09-11T05:34:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813992+0000", 2024-09-11T05:34:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1540000000000001e-06 2024-09-11T05:34:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816560+0000", 2024-09-11T05:34:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025680389999999998 2024-09-11T05:34:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816566+0000", 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0679999999999996e-06 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821907+0000", 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005341735 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821916+0000", 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3659999999999992e-06 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874760+0000", 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052844713 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874878+0000", 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000117321 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875051+0000", 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017286499999999999 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116721 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13256704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.253874420999999, 2024-09-11T05:34:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0616932019999998, 2024-09-11T05:34:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116721 2024-09-11T05:34:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813584+0000", 2024-09-11T05:34:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2e-07 2024-09-11T05:34:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813586+0000", 2024-09-11T05:34:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.277e-06 2024-09-11T05:34:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813592+0000", 2024-09-11T05:34:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5840000000000002e-06 2024-09-11T05:34:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813597+0000", 2024-09-11T05:34:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2839999999999997e-06 2024-09-11T05:34:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814028+0000", 2024-09-11T05:34:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000430689 2024-09-11T05:34:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814032+0000", 2024-09-11T05:34:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3850000000000004e-06 2024-09-11T05:34:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816597+0000", 2024-09-11T05:34:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00256485 2024-09-11T05:34:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816606+0000", 2024-09-11T05:34:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:34:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821949+0000", 2024-09-11T05:34:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005342752 2024-09-11T05:34:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821954+0000", 2024-09-11T05:34:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2270000000000001e-06 2024-09-11T05:34:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875095+0000", 2024-09-11T05:34:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.053140669 2024-09-11T05:34:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875186+0000", 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1391999999999995e-05 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875277+0000", 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0556000000000005e-05 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116722 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13281280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.253837421999997, 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.061825491, 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116722 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813621+0000", 2024-09-11T05:34:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:34:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813625+0000", 2024-09-11T05:34:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.228e-06 2024-09-11T05:34:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813635+0000", 2024-09-11T05:34:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5179999999999993e-06 2024-09-11T05:34:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813641+0000", 2024-09-11T05:34:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4710000000000004e-06 2024-09-11T05:34:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814057+0000", 2024-09-11T05:34:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00041530099999999997 2024-09-11T05:34:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814060+0000", 2024-09-11T05:34:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-06 2024-09-11T05:34:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816632+0000", 2024-09-11T05:34:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00257186 2024-09-11T05:34:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816636+0000", 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2150000000000003e-06 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821977+0000", 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053407110000001 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821982+0000", 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875307+0000", 2024-09-11T05:34:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0533247000000001 2024-09-11T05:34:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875366+0000", 2024-09-11T05:34:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8628999999999997e-05 2024-09-11T05:34:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875446+0000", 2024-09-11T05:34:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0026999999999998e-05 2024-09-11T05:34:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116723 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13305856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.253804443999996, 2024-09-11T05:34:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0619630779999998, 2024-09-11T05:34:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116723 2024-09-11T05:34:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813654+0000", 2024-09-11T05:34:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:34:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813661+0000", 2024-09-11T05:34:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1890000000000001e-06 2024-09-11T05:34:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813675+0000", 2024-09-11T05:34:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3878e-05 2024-09-11T05:34:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813682+0000", 2024-09-11T05:34:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.063e-06 2024-09-11T05:34:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816666+0000", 2024-09-11T05:34:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029845679999999999 2024-09-11T05:34:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816671+0000", 2024-09-11T05:34:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:34:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822024+0000", 2024-09-11T05:34:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053534660000001 2024-09-11T05:34:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822028+0000", 2024-09-11T05:34:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7799999999999998e-06 2024-09-11T05:34:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875471+0000", 2024-09-11T05:34:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05344306 2024-09-11T05:34:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875531+0000", 2024-09-11T05:34:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0019000000000003e-05 2024-09-11T05:34:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875616+0000", 2024-09-11T05:34:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5304999999999997e-05 2024-09-11T05:34:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116724 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13330432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.253764955000001, 2024-09-11T05:34:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0620902609999998, 2024-09-11T05:34:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116724 2024-09-11T05:34:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.99e-07 2024-09-11T05:34:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813697+0000", 2024-09-11T05:34:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2430000000000001e-06 2024-09-11T05:34:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813704+0000", 2024-09-11T05:34:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2980000000000003e-06 2024-09-11T05:34:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813709+0000", 2024-09-11T05:34:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8130000000000003e-06 2024-09-11T05:34:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816702+0000", 2024-09-11T05:34:21.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002992864 2024-09-11T05:34:21.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816711+0000", 2024-09-11T05:34:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1840000000000005e-06 2024-09-11T05:34:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822050+0000", 2024-09-11T05:34:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.00533864 2024-09-11T05:34:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822055+0000", 2024-09-11T05:34:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:34:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875642+0000", 2024-09-11T05:34:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0535874220000001 2024-09-11T05:34:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875698+0000", 2024-09-11T05:34:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5707e-05 2024-09-11T05:34:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875783+0000", 2024-09-11T05:34:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5362e-05 2024-09-11T05:34:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116725 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13355008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.253730767, 2024-09-11T05:34:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.06220984, 2024-09-11T05:34:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116725 2024-09-11T05:34:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813728+0000", 2024-09-11T05:34:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:34:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813730+0000", 2024-09-11T05:34:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6730000000000001e-06 2024-09-11T05:34:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813743+0000", 2024-09-11T05:34:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2833000000000001e-05 2024-09-11T05:34:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813749+0000", 2024-09-11T05:34:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:34:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816726+0000", 2024-09-11T05:34:21.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029772090000000002 2024-09-11T05:34:21.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.168 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816730+0000", 2024-09-11T05:34:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.518e-06 2024-09-11T05:34:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822074+0000", 2024-09-11T05:34:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053444030000001 2024-09-11T05:34:21.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822079+0000", 2024-09-11T05:34:21.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:34:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875807+0000", 2024-09-11T05:34:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0537284410000001 2024-09-11T05:34:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875858+0000", 2024-09-11T05:34:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0574000000000001e-05 2024-09-11T05:34:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875937+0000", 2024-09-11T05:34:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9268000000000001e-05 2024-09-11T05:34:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116974 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13185024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.245786930999998, 2024-09-11T05:34:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598649249999998, 2024-09-11T05:34:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116974 2024-09-11T05:34:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:34:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821673+0000", 2024-09-11T05:34:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.722e-06 2024-09-11T05:34:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821686+0000", 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2974e-05 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821692+0000", 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822089+0000", 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039611699999999998 2024-09-11T05:34:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822099+0000", 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0029e-05 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822803+0000", 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000704507 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822808+0000", 2024-09-11T05:34:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6460000000000001e-06 2024-09-11T05:34:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881361+0000", 2024-09-11T05:34:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0585529680000001 2024-09-11T05:34:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881432+0000", 2024-09-11T05:34:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:34:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881536+0000", 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000103243 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116975 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13209600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.245758596999998, 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.060124761, 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116975 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821700+0000", 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821701+0000", 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8369999999999999e-06 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821708+0000", 2024-09-11T05:34:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5520000000000001e-06 2024-09-11T05:34:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821713+0000", 2024-09-11T05:34:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.091e-06 2024-09-11T05:34:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822135+0000", 2024-09-11T05:34:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00042166399999999998 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822143+0000", 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3089999999999996e-06 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822820+0000", 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000677145 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822824+0000", 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.641e-06 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881569+0000", 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.058744785 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881674+0000", 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000105111 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881824+0000", 2024-09-11T05:34:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000150197 2024-09-11T05:34:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116976 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13234176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.245729617999999, 2024-09-11T05:34:21.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0603909900000001, 2024-09-11T05:34:21.188 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.188 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.188 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.188 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116976 2024-09-11T05:34:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821729+0000", 2024-09-11T05:34:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:34:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821731+0000", 2024-09-11T05:34:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0250000000000001e-06 2024-09-11T05:34:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821737+0000", 2024-09-11T05:34:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8839999999999997e-06 2024-09-11T05:34:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821743+0000", 2024-09-11T05:34:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1050000000000003e-06 2024-09-11T05:34:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822194+0000", 2024-09-11T05:34:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000451574 2024-09-11T05:34:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822203+0000", 2024-09-11T05:34:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9449999999999999e-06 2024-09-11T05:34:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822835+0000", 2024-09-11T05:34:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000632019 2024-09-11T05:34:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822839+0000", 2024-09-11T05:34:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8229999999999997e-06 2024-09-11T05:34:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881861+0000", 2024-09-11T05:34:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.059021776 2024-09-11T05:34:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881976+0000", 2024-09-11T05:34:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00011531699999999999 2024-09-11T05:34:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882119+0000", 2024-09-11T05:34:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000143077 2024-09-11T05:34:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116977 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13258752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.245678384000001, 2024-09-11T05:34:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606236920000001, 2024-09-11T05:34:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116977 2024-09-11T05:34:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821782+0000", 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7719999999999999e-06 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821785+0000", 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9409999999999999e-06 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821793+0000", 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821799+0000", 2024-09-11T05:34:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4609999999999999e-06 2024-09-11T05:34:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822246+0000", 2024-09-11T05:34:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044669000000000002 2024-09-11T05:34:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822254+0000", 2024-09-11T05:34:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1859999999999992e-06 2024-09-11T05:34:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822850+0000", 2024-09-11T05:34:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005962340000001 2024-09-11T05:34:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822854+0000", 2024-09-11T05:34:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5310000000000002e-06 2024-09-11T05:34:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882149+0000", 2024-09-11T05:34:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0592958729999999 2024-09-11T05:34:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882253+0000", 2024-09-11T05:34:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104058 2024-09-11T05:34:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882403+0000", 2024-09-11T05:34:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014958800000000001 2024-09-11T05:34:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116978 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13283328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.245648160999998, 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0608297769999999, 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116978 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:34:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821813+0000", 2024-09-11T05:34:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:34:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821820+0000", 2024-09-11T05:34:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3669999999999999e-06 2024-09-11T05:34:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821825+0000", 2024-09-11T05:34:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5119999999999999e-06 2024-09-11T05:34:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822273+0000", 2024-09-11T05:34:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044727900000000003 2024-09-11T05:34:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822278+0000", 2024-09-11T05:34:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7529999999999998e-06 2024-09-11T05:34:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822865+0000", 2024-09-11T05:34:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005861579999999 2024-09-11T05:34:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822868+0000", 2024-09-11T05:34:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4659999999999999e-06 2024-09-11T05:34:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882434+0000", 2024-09-11T05:34:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0595660170000001 2024-09-11T05:34:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882502+0000", 2024-09-11T05:34:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7442999999999998e-05 2024-09-11T05:34:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882639+0000", 2024-09-11T05:34:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013779999999999999 2024-09-11T05:34:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116980 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13332480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.244108638999997, 2024-09-11T05:34:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598269180000002, 2024-09-11T05:34:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116980 2024-09-11T05:34:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823350+0000", 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823352+0000", 2024-09-11T05:34:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5459999999999998e-06 2024-09-11T05:34:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823360+0000", 2024-09-11T05:34:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4359999999999996e-06 2024-09-11T05:34:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823365+0000", 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3079999999999998e-06 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823418+0000", 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2735999999999998e-05 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823423+0000", 2024-09-11T05:34:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3410000000000002e-06 2024-09-11T05:34:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822895+0000", 2024-09-11T05:34:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99947249000000005 2024-09-11T05:34:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822899+0000", 2024-09-11T05:34:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6169999999999998e-06 2024-09-11T05:34:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882964+0000", 2024-09-11T05:34:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0600650840000001 2024-09-11T05:34:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883020+0000", 2024-09-11T05:34:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5563000000000003e-05 2024-09-11T05:34:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883176+0000", 2024-09-11T05:34:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015629500000000001 2024-09-11T05:34:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116981 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13357056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 42.244084659000002, 2024-09-11T05:34:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600075910000002, 2024-09-11T05:34:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116981 2024-09-11T05:34:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.01e-07 2024-09-11T05:34:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823376+0000", 2024-09-11T05:34:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:34:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823381+0000", 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000001e-06 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823386+0000", 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5349999999999998e-06 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823447+0000", 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1277000000000003e-05 2024-09-11T05:34:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823456+0000", 2024-09-11T05:34:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8859999999999993e-06 2024-09-11T05:34:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822914+0000", 2024-09-11T05:34:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99945797999999997 2024-09-11T05:34:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822918+0000", 2024-09-11T05:34:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5810000000000001e-06 2024-09-11T05:34:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883209+0000", 2024-09-11T05:34:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0602916899999999 2024-09-11T05:34:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883292+0000", 2024-09-11T05:34:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2849000000000006e-05 2024-09-11T05:34:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883381+0000", 2024-09-11T05:34:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8585000000000007e-05 2024-09-11T05:34:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.222 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:21.224 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:21.224 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:21.224+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:21.325 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:21.325+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:21.327 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:21.327 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:21.327 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:21.327 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:21.336 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:21.425 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:21.425+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:21.438 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:21.438 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:21.438 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:21.438 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:21.438 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:21.446 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:21.527 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:21.526+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:21.552 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:21.552 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:21.552 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:21.552 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:21.553 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.553 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:34:21.553 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:21.553 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 70.901670386000006, 2024-09-11T05:34:21.553 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:34:21.554 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.554 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.554 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:21.554 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.554 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.554 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:34:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:21.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:34:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:34:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:34:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:34:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.559 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.559 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:34:21.559 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:34:21.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:34:21.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:34:21.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:34:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:34:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:34:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:34:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:34:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:34:21.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:34:21.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:21.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:34:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:34:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:34:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:34:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:34:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:34:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.566 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.566 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:34:21.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:34:21.566 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.566 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:146253 3.6 3:64dbadcf:::rbd_data.112d55d87bfc.0000000000000332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-11T05:34:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 35.712855478000002, 2024-09-11T05:34:21.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4166483809999999, 2024-09-11T05:34:21.568 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.568 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.568 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:21.568 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 146253 2024-09-11T05:34:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837090+0000", 2024-09-11T05:34:21.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.73e-06 2024-09-11T05:34:21.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837096+0000", 2024-09-11T05:34:21.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3500000000000002e-06 2024-09-11T05:34:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837115+0000", 2024-09-11T05:34:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8556e-05 2024-09-11T05:34:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837124+0000", 2024-09-11T05:34:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6739999999999992e-06 2024-09-11T05:34:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837184+0000", 2024-09-11T05:34:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9960000000000002e-05 2024-09-11T05:34:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:34:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837188+0000", 2024-09-11T05:34:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:21.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840481+0000", 2024-09-11T05:34:21.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032924080000000001 2024-09-11T05:34:21.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.577 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.577 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840497+0000", 2024-09-11T05:34:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6140000000000001e-05 2024-09-11T05:34:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850737+0000", 2024-09-11T05:34:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0102404119999999 2024-09-11T05:34:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850747+0000", 2024-09-11T05:34:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7969999999999995e-06 2024-09-11T05:34:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252495+0000", 2024-09-11T05:34:21.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.401748131 2024-09-11T05:34:21.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252636+0000", 2024-09-11T05:34:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014118900000000001 2024-09-11T05:34:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252737+0000", 2024-09-11T05:34:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00010058 2024-09-11T05:34:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253433+0000", 2024-09-11T05:34:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00069601999999999999 2024-09-11T05:34:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253604+0000", 2024-09-11T05:34:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000170824 2024-09-11T05:34:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253649+0000", 2024-09-11T05:34:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5050999999999999e-05 2024-09-11T05:34:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253736+0000", 2024-09-11T05:34:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7509000000000005e-05 2024-09-11T05:34:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:147298 3.6 3:652e51de:::rbd_data.112d55d87bfc.0000000000000377:head [set-alloc-hint object_size 262144 write_size 262144,write 122880~2839] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-11T05:34:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.316314902000002, 2024-09-11T05:34:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62981612099999995, 2024-09-11T05:34:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 147298 2024-09-11T05:34:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233630+0000", 2024-09-11T05:34:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5489999999999999e-06 2024-09-11T05:34:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233637+0000", 2024-09-11T05:34:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.272e-06 2024-09-11T05:34:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233654+0000", 2024-09-11T05:34:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6283999999999999e-05 2024-09-11T05:34:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233662+0000", 2024-09-11T05:34:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.875e-06 2024-09-11T05:34:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233723+0000", 2024-09-11T05:34:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1501000000000006e-05 2024-09-11T05:34:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233732+0000", 2024-09-11T05:34:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0699999999999996e-06 2024-09-11T05:34:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862055+0000", 2024-09-11T05:34:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62832274799999999 2024-09-11T05:34:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862219+0000", 2024-09-11T05:34:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016404899999999999 2024-09-11T05:34:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862313+0000", 2024-09-11T05:34:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4105999999999997e-05 2024-09-11T05:34:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862981+0000", 2024-09-11T05:34:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00066744199999999997 2024-09-11T05:34:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863382+0000", 2024-09-11T05:34:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040111200000000002 2024-09-11T05:34:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863419+0000", 2024-09-11T05:34:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6974000000000002e-05 2024-09-11T05:34:21.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863445+0000", 2024-09-11T05:34:21.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6139000000000002e-05 2024-09-11T05:34:21.599 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151292 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593663506999999, 2024-09-11T05:34:21.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054346481000000002, 2024-09-11T05:34:21.601 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.601 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.601 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.601 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151292 2024-09-11T05:34:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:34:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956283+0000", 2024-09-11T05:34:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2450000000000001e-06 2024-09-11T05:34:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956290+0000", 2024-09-11T05:34:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0910000000000004e-06 2024-09-11T05:34:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.607 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956296+0000", 2024-09-11T05:34:21.607 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.947e-06 2024-09-11T05:34:21.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.607 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.607 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.607 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010460+0000", 2024-09-11T05:34:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054164165 2024-09-11T05:34:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010537+0000", 2024-09-11T05:34:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6965000000000006e-05 2024-09-11T05:34:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010626+0000", 2024-09-11T05:34:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9628000000000003e-05 2024-09-11T05:34:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151293 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1933312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593640663999999, 2024-09-11T05:34:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054563858999999999, 2024-09-11T05:34:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151293 2024-09-11T05:34:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.46e-07 2024-09-11T05:34:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956306+0000", 2024-09-11T05:34:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2259999999999999e-06 2024-09-11T05:34:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956312+0000", 2024-09-11T05:34:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:34:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956317+0000", 2024-09-11T05:34:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:34:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010671+0000", 2024-09-11T05:34:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054353830999999998 2024-09-11T05:34:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010757+0000", 2024-09-11T05:34:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6120999999999998e-05 2024-09-11T05:34:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010867+0000", 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000109687 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151294 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2179072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593618802000002, 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054741825000000001, 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151294 2024-09-11T05:34:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.84e-07 2024-09-11T05:34:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956326+0000", 2024-09-11T05:34:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.483e-06 2024-09-11T05:34:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956330+0000", 2024-09-11T05:34:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8519999999999997e-06 2024-09-11T05:34:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956334+0000", 2024-09-11T05:34:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4139999999999998e-06 2024-09-11T05:34:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010894+0000", 2024-09-11T05:34:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054560243000000001 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010970+0000", 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6138999999999997e-05 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011067+0000", 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6409999999999993e-05 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151295 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2392064~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593606131000001, 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054949748999999999, 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151295 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956338+0000", 2024-09-11T05:34:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.23e-07 2024-09-11T05:34:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956339+0000", 2024-09-11T05:34:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.243e-06 2024-09-11T05:34:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956342+0000", 2024-09-11T05:34:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.473e-06 2024-09-11T05:34:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956345+0000", 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011109+0000", 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054763698999999999 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011188+0000", 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8887999999999994e-05 2024-09-11T05:34:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011287+0000", 2024-09-11T05:34:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9504000000000001e-05 2024-09-11T05:34:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151296 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593595020999999, 2024-09-11T05:34:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055045187000000002, 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151296 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956349+0000", 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956350+0000", 2024-09-11T05:34:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:34:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956353+0000", 2024-09-11T05:34:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.016e-06 2024-09-11T05:34:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956355+0000", 2024-09-11T05:34:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5509999999999998e-06 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011303+0000", 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054947306000000001 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011342+0000", 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9057999999999998e-05 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011394+0000", 2024-09-11T05:34:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1925999999999997e-05 2024-09-11T05:34:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151297 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2818048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593585090000001, 2024-09-11T05:34:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055238158000000002, 2024-09-11T05:34:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151297 2024-09-11T05:34:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956359+0000", 2024-09-11T05:34:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956360+0000", 2024-09-11T05:34:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1030000000000001e-06 2024-09-11T05:34:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956363+0000", 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.021e-06 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956365+0000", 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4770000000000002e-06 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011425+0000", 2024-09-11T05:34:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055059967000000001 2024-09-11T05:34:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011506+0000", 2024-09-11T05:34:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1063000000000006e-05 2024-09-11T05:34:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011597+0000", 2024-09-11T05:34:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0299999999999999e-05 2024-09-11T05:34:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151298 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3031040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593575124000001, 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055425825999999997, 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151298 2024-09-11T05:34:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956369+0000", 2024-09-11T05:34:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4400000000000001e-07 2024-09-11T05:34:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956370+0000", 2024-09-11T05:34:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.068e-06 2024-09-11T05:34:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956373+0000", 2024-09-11T05:34:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0419999999999998e-06 2024-09-11T05:34:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956375+0000", 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011631+0000", 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055255116999999999 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011703+0000", 2024-09-11T05:34:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2554999999999999e-05 2024-09-11T05:34:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011794+0000", 2024-09-11T05:34:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1119999999999995e-05 2024-09-11T05:34:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151299 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3276800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593563822, 2024-09-11T05:34:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055567477999999997, 2024-09-11T05:34:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151299 2024-09-11T05:34:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956382+0000", 2024-09-11T05:34:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.72e-06 2024-09-11T05:34:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956386+0000", 2024-09-11T05:34:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0990000000000001e-06 2024-09-11T05:34:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956390+0000", 2024-09-11T05:34:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.318e-06 2024-09-11T05:34:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011823+0000", 2024-09-11T05:34:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055432976000000002 2024-09-11T05:34:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011882+0000", 2024-09-11T05:34:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8656999999999998e-05 2024-09-11T05:34:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011947+0000", 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5177000000000003e-05 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151300 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3489792~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593547354999998, 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055745232999999998, 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151300 2024-09-11T05:34:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956397+0000", 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956398+0000", 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.869e-06 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956404+0000", 2024-09-11T05:34:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:34:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956407+0000", 2024-09-11T05:34:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.191e-06 2024-09-11T05:34:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011981+0000", 2024-09-11T05:34:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055573553999999997 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012051+0000", 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9542999999999995e-05 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012141+0000", 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0845000000000002e-05 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151301 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3702784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593532425999999, 2024-09-11T05:34:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055834747999999997, 2024-09-11T05:34:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151301 2024-09-11T05:34:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:34:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956413+0000", 2024-09-11T05:34:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2810000000000001e-06 2024-09-11T05:34:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956416+0000", 2024-09-11T05:34:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1559999999999999e-06 2024-09-11T05:34:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956418+0000", 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012155+0000", 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055736651999999998 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012193+0000", 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7848000000000001e-05 2024-09-11T05:34:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012246+0000", 2024-09-11T05:34:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3041000000000003e-05 2024-09-11T05:34:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151302 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3915776~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593522322999998, 2024-09-11T05:34:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056035532999999998, 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151302 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956426+0000", 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.853e-06 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956430+0000", 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3699999999999999e-06 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956432+0000", 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5979999999999999e-06 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012281+0000", 2024-09-11T05:34:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055848644000000003 2024-09-11T05:34:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012358+0000", 2024-09-11T05:34:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6662000000000006e-05 2024-09-11T05:34:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012457+0000", 2024-09-11T05:34:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9197999999999995e-05 2024-09-11T05:34:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151303 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4128768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593507741, 2024-09-11T05:34:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056186709000000001, 2024-09-11T05:34:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151303 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956437+0000", 2024-09-11T05:34:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.201e-06 2024-09-11T05:34:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956440+0000", 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-06 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956443+0000", 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5909999999999998e-06 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012494+0000", 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056051541000000003 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012558+0000", 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3347000000000002e-05 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012622+0000", 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4760999999999999e-05 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151304 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593497683999999, 2024-09-11T05:34:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056360149999999998, 2024-09-11T05:34:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151304 2024-09-11T05:34:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956447+0000", 2024-09-11T05:34:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.153e-06 2024-09-11T05:34:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956450+0000", 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9909999999999998e-06 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956453+0000", 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.447e-06 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012660+0000", 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056207510000000002 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012741+0000", 2024-09-11T05:34:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0734000000000003e-05 2024-09-11T05:34:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012806+0000", 2024-09-11T05:34:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5087999999999998e-05 2024-09-11T05:34:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151305 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4587520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593487923000001, 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056476407999999999, 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151305 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956457+0000", 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.353e-06 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956460+0000", 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0060000000000001e-06 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956463+0000", 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.452e-06 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012834+0000", 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056370917999999999 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012877+0000", 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000999999999997e-05 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012932+0000", 2024-09-11T05:34:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5470000000000003e-05 2024-09-11T05:34:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151306 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4800512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593477943, 2024-09-11T05:34:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056579203000000002, 2024-09-11T05:34:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151306 2024-09-11T05:34:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.28e-07 2024-09-11T05:34:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956467+0000", 2024-09-11T05:34:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.088e-06 2024-09-11T05:34:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956470+0000", 2024-09-11T05:34:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0240000000000002e-06 2024-09-11T05:34:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956472+0000", 2024-09-11T05:34:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4609999999999998e-06 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012953+0000", 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056480524999999997 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012994+0000", 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1394999999999999e-05 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013045+0000", 2024-09-11T05:34:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0482000000000002e-05 2024-09-11T05:34:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151307 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5013504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593468273999999, 2024-09-11T05:34:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056680525000000002, 2024-09-11T05:34:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151307 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:34:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956476+0000", 2024-09-11T05:34:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0359999999999999e-06 2024-09-11T05:34:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956479+0000", 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8899999999999999e-06 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956482+0000", 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5380000000000001e-06 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013065+0000", 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056582983000000003 2024-09-11T05:34:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013104+0000", 2024-09-11T05:34:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9119999999999998e-05 2024-09-11T05:34:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013156+0000", 2024-09-11T05:34:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1743999999999998e-05 2024-09-11T05:34:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151308 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5226496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 27.593450943000001, 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056772738000000003, 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151308 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2599999999999998e-07 2024-09-11T05:34:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956495+0000", 2024-09-11T05:34:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9750000000000001e-06 2024-09-11T05:34:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956499+0000", 2024-09-11T05:34:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5179999999999998e-06 2024-09-11T05:34:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956502+0000", 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7530000000000002e-06 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013177+0000", 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056674536999999997 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013215+0000", 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8578999999999998e-05 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013265+0000", 2024-09-11T05:34:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0049999999999997e-05 2024-09-11T05:34:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:21.689 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:21.690 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 5, 6] out_osds: [4, 3, 7] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-11T05:34:21.690 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:34:21.690 INFO:tasks.thrashosds.thrasher:Reviving osd 4 2024-09-11T05:34:21.690 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-11T05:34:21.690 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-11T05:34:21.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:34:21.692 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:21.690+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:21.693 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:21.734 INFO:tasks.ceph.osd.4:Started 2024-09-11T05:34:21.734 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:34:21.791 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:21.790+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:21.814 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:21.814 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:21.815 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:21.815 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:21.825 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:21.826 INFO:teuthology.orchestra.run.smithi084.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-11T05:34:21.828 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T05:34:21.828 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-4, ['dump_ops_in_flight'] 2024-09-11T05:34:21.909 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:21.909+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:21.970 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:21.971 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:21.971 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:21.971 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:21.971 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:21.980 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:22.021 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:22.020+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:22.094 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:22.093+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:22.125 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116524 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311764766000003, 2024-09-11T05:34:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344630100000001, 2024-09-11T05:34:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116524 2024-09-11T05:34:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811270+0000", 2024-09-11T05:34:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:34:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811272+0000", 2024-09-11T05:34:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:34:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811278+0000", 2024-09-11T05:34:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1970000000000001e-06 2024-09-11T05:34:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811283+0000", 2024-09-11T05:34:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-09-11T05:34:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813113+0000", 2024-09-11T05:34:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001830302 2024-09-11T05:34:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813117+0000", 2024-09-11T05:34:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0810000000000004e-06 2024-09-11T05:34:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814661+0000", 2024-09-11T05:34:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015436969999999999 2024-09-11T05:34:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814667+0000", 2024-09-11T05:34:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6370000000000002e-06 2024-09-11T05:34:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826115+0000", 2024-09-11T05:34:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114479059999999 2024-09-11T05:34:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826123+0000", 2024-09-11T05:34:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000004e-06 2024-09-11T05:34:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845722+0000", 2024-09-11T05:34:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195993000000001 2024-09-11T05:34:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845732+0000", 2024-09-11T05:34:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T05:34:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116525 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311744883999999, 2024-09-11T05:34:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344747700000001, 2024-09-11T05:34:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116525 2024-09-11T05:34:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811290+0000", 2024-09-11T05:34:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:34:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811295+0000", 2024-09-11T05:34:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8969999999999999e-06 2024-09-11T05:34:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811301+0000", 2024-09-11T05:34:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4919999999999998e-06 2024-09-11T05:34:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811306+0000", 2024-09-11T05:34:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999998e-06 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813138+0000", 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001832078 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813142+0000", 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0380000000000001e-06 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814689+0000", 2024-09-11T05:34:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546799 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814695+0000", 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8739999999999997e-06 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826148+0000", 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114527259999999 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826166+0000", 2024-09-11T05:34:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7484999999999999e-05 2024-09-11T05:34:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845756+0000", 2024-09-11T05:34:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019590609 2024-09-11T05:34:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845764+0000", 2024-09-11T05:34:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7020000000000001e-06 2024-09-11T05:34:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116526 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311722086000003, 2024-09-11T05:34:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344863210000002, 2024-09-11T05:34:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116526 2024-09-11T05:34:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:34:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811315+0000", 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079999999999999e-06 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811320+0000", 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8619999999999999e-06 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811325+0000", 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814736+0000", 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034115780000000002 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814744+0000", 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5340000000000002e-06 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826212+0000", 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114682749999999 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826225+0000", 2024-09-11T05:34:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:34:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845789+0000", 2024-09-11T05:34:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195649200000001 2024-09-11T05:34:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845798+0000", 2024-09-11T05:34:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9269999999999994e-06 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116527 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311703154, 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345095849999999, 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116527 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:34:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811334+0000", 2024-09-11T05:34:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:34:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811340+0000", 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.691e-06 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811345+0000", 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5480000000000003e-06 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814767+0000", 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034223190000000001 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814774+0000", 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826265+0000", 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114912460000001 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826274+0000", 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3909999999999998e-06 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845831+0000", 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195574080000001 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845841+0000", 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3610000000000007e-06 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116528 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311683715000001, 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345287679999999, 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116528 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811351+0000", 2024-09-11T05:34:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T05:34:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811353+0000", 2024-09-11T05:34:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:34:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811359+0000", 2024-09-11T05:34:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T05:34:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811364+0000", 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000001e-06 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814795+0000", 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034316569999999998 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814826+0000", 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0587999999999999e-05 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826309+0000", 2024-09-11T05:34:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011483444 2024-09-11T05:34:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826319+0000", 2024-09-11T05:34:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6849999999999996e-06 2024-09-11T05:34:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845868+0000", 2024-09-11T05:34:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195487110000001 2024-09-11T05:34:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845879+0000", 2024-09-11T05:34:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1428e-05 2024-09-11T05:34:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116529 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311665081000001, 2024-09-11T05:34:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034542531, 2024-09-11T05:34:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116529 2024-09-11T05:34:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:34:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811371+0000", 2024-09-11T05:34:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T05:34:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811377+0000", 2024-09-11T05:34:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1580000000000002e-06 2024-09-11T05:34:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811383+0000", 2024-09-11T05:34:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.135e-06 2024-09-11T05:34:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814851+0000", 2024-09-11T05:34:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034684690000000001 2024-09-11T05:34:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814858+0000", 2024-09-11T05:34:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6969999999999996e-06 2024-09-11T05:34:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826354+0000", 2024-09-11T05:34:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114962359999999 2024-09-11T05:34:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826364+0000", 2024-09-11T05:34:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0047999999999999e-05 2024-09-11T05:34:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845903+0000", 2024-09-11T05:34:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195393610000001 2024-09-11T05:34:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845912+0000", 2024-09-11T05:34:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2269999999999993e-06 2024-09-11T05:34:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116530 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311646168999999, 2024-09-11T05:34:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345557429999999, 2024-09-11T05:34:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116530 2024-09-11T05:34:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811390+0000", 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811396+0000", 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811402+0000", 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:34:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814879+0000", 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034769290000000001 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814885+0000", 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.156e-06 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826389+0000", 2024-09-11T05:34:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115041140000001 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826397+0000", 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845935+0000", 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195381370000001 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845944+0000", 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4540000000000007e-06 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116531 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311626109999999, 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345764630000001, 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116531 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:34:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811411+0000", 2024-09-11T05:34:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811417+0000", 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811422+0000", 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3229999999999997e-06 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814906+0000", 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034835389999999999 2024-09-11T05:34:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814913+0000", 2024-09-11T05:34:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309999999999996e-06 2024-09-11T05:34:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826423+0000", 2024-09-11T05:34:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115109019999999 2024-09-11T05:34:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826431+0000", 2024-09-11T05:34:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9410000000000007e-06 2024-09-11T05:34:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845975+0000", 2024-09-11T05:34:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019543767 2024-09-11T05:34:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845984+0000", 2024-09-11T05:34:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3530000000000001e-06 2024-09-11T05:34:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116532 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311605911999997, 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034588131, 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116532 2024-09-11T05:34:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811429+0000", 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811431+0000", 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9910000000000001e-06 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811437+0000", 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.049e-06 2024-09-11T05:34:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811441+0000", 2024-09-11T05:34:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8289999999999998e-06 2024-09-11T05:34:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814934+0000", 2024-09-11T05:34:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034927220000000002 2024-09-11T05:34:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814941+0000", 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.844e-06 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826480+0000", 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115393260000001 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826496+0000", 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5406000000000001e-05 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846008+0000", 2024-09-11T05:34:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.01951214 2024-09-11T05:34:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846016+0000", 2024-09-11T05:34:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4440000000000008e-06 2024-09-11T05:34:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116533 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311586358, 2024-09-11T05:34:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345994049999998, 2024-09-11T05:34:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116533 2024-09-11T05:34:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811450+0000", 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0940000000000002e-06 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811457+0000", 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2729999999999999e-06 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811461+0000", 2024-09-11T05:34:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.673e-06 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814962+0000", 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035012530000000002 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814970+0000", 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0539999999999997e-06 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826536+0000", 2024-09-11T05:34:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011566049 2024-09-11T05:34:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826542+0000", 2024-09-11T05:34:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1709999999999999e-06 2024-09-11T05:34:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846039+0000", 2024-09-11T05:34:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019497168 2024-09-11T05:34:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846047+0000", 2024-09-11T05:34:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-11T05:34:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116534 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311567451000002, 2024-09-11T05:34:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034610979, 2024-09-11T05:34:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116534 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:34:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811469+0000", 2024-09-11T05:34:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.871e-06 2024-09-11T05:34:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811475+0000", 2024-09-11T05:34:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1689999999999997e-06 2024-09-11T05:34:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811480+0000", 2024-09-11T05:34:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5990000000000004e-06 2024-09-11T05:34:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814990+0000", 2024-09-11T05:34:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003510876 2024-09-11T05:34:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814997+0000", 2024-09-11T05:34:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T05:34:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826571+0000", 2024-09-11T05:34:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115740230000001 2024-09-11T05:34:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826576+0000", 2024-09-11T05:34:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-11T05:34:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846070+0000", 2024-09-11T05:34:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194937660000001 2024-09-11T05:34:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846078+0000", 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.038e-06 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116535 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311548291999998, 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346218060000001, 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116535 2024-09-11T05:34:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:34:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811488+0000", 2024-09-11T05:34:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:34:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811495+0000", 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3960000000000003e-06 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811500+0000", 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9910000000000002e-06 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815019+0000", 2024-09-11T05:34:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035190479999999999 2024-09-11T05:34:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815025+0000", 2024-09-11T05:34:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2550000000000003e-06 2024-09-11T05:34:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826604+0000", 2024-09-11T05:34:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115789959999999 2024-09-11T05:34:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826611+0000", 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846100+0000", 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194890569999999 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846108+0000", 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4089999999999997e-06 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116536 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311528770999999, 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034634724, 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116536 2024-09-11T05:34:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811506+0000", 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811508+0000", 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811514+0000", 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0610000000000001e-06 2024-09-11T05:34:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811519+0000", 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0340000000000004e-06 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815049+0000", 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035296440000000002 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815055+0000", 2024-09-11T05:34:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:34:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826642+0000", 2024-09-11T05:34:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011586375 2024-09-11T05:34:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826649+0000", 2024-09-11T05:34:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-09-11T05:34:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846131+0000", 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194814569999999 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846140+0000", 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2240000000000001e-06 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116537 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311509202000003, 2024-09-11T05:34:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346492180000002, 2024-09-11T05:34:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116537 2024-09-11T05:34:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811532+0000", 2024-09-11T05:34:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:34:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811538+0000", 2024-09-11T05:34:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7259999999999996e-06 2024-09-11T05:34:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811543+0000", 2024-09-11T05:34:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.164e-06 2024-09-11T05:34:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815078+0000", 2024-09-11T05:34:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003534428 2024-09-11T05:34:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815086+0000", 2024-09-11T05:34:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8210000000000002e-06 2024-09-11T05:34:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826736+0000", 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116503429999999 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826751+0000", 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4895999999999999e-05 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846165+0000", 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019413854 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846174+0000", 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3149999999999998e-06 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116538 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311484513000003, 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346557729999999, 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116538 2024-09-11T05:34:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811552+0000", 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2869999999999999e-06 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811559+0000", 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3820000000000001e-06 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811564+0000", 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815109+0000", 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035450989999999999 2024-09-11T05:34:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815115+0000", 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826780+0000", 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116645799999999 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826787+0000", 2024-09-11T05:34:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3880000000000002e-06 2024-09-11T05:34:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846196+0000", 2024-09-11T05:34:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194094069999999 2024-09-11T05:34:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846205+0000", 2024-09-11T05:34:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.884e-06 2024-09-11T05:34:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116539 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311464467, 2024-09-11T05:34:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346668399999999, 2024-09-11T05:34:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116539 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:34:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811572+0000", 2024-09-11T05:34:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:34:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811578+0000", 2024-09-11T05:34:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T05:34:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811583+0000", 2024-09-11T05:34:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:34:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815137+0000", 2024-09-11T05:34:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035540210000000001 2024-09-11T05:34:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815144+0000", 2024-09-11T05:34:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5969999999999997e-06 2024-09-11T05:34:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826851+0000", 2024-09-11T05:34:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117072149999999 2024-09-11T05:34:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826860+0000", 2024-09-11T05:34:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4200000000000007e-06 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846228+0000", 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019368287 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846236+0000", 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.541e-06 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116540 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311445042999999, 2024-09-11T05:34:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346767830000001, 2024-09-11T05:34:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116540 2024-09-11T05:34:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811591+0000", 2024-09-11T05:34:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:34:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811598+0000", 2024-09-11T05:34:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T05:34:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811603+0000", 2024-09-11T05:34:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9470000000000002e-06 2024-09-11T05:34:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815168+0000", 2024-09-11T05:34:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035651810000000002 2024-09-11T05:34:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815174+0000", 2024-09-11T05:34:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T05:34:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826883+0000", 2024-09-11T05:34:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117088830000001 2024-09-11T05:34:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826891+0000", 2024-09-11T05:34:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7179999999999996e-06 2024-09-11T05:34:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846258+0000", 2024-09-11T05:34:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019367328 2024-09-11T05:34:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846266+0000", 2024-09-11T05:34:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4880000000000001e-06 2024-09-11T05:34:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116541 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311425749000001, 2024-09-11T05:34:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346837, 2024-09-11T05:34:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116541 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811609+0000", 2024-09-11T05:34:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:34:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811611+0000", 2024-09-11T05:34:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8679999999999999e-06 2024-09-11T05:34:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811617+0000", 2024-09-11T05:34:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811622+0000", 2024-09-11T05:34:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9370000000000003e-06 2024-09-11T05:34:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815201+0000", 2024-09-11T05:34:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035788679999999998 2024-09-11T05:34:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815207+0000", 2024-09-11T05:34:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7530000000000004e-06 2024-09-11T05:34:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826988+0000", 2024-09-11T05:34:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117802300000001 2024-09-11T05:34:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826996+0000", 2024-09-11T05:34:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.259e-06 2024-09-11T05:34:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846285+0000", 2024-09-11T05:34:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192892090000001 2024-09-11T05:34:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846292+0000", 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9399999999999996e-06 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116542 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311406839, 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034697618, 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116542 2024-09-11T05:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811628+0000", 2024-09-11T05:34:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:34:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811629+0000", 2024-09-11T05:34:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8059999999999999e-06 2024-09-11T05:34:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811636+0000", 2024-09-11T05:34:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0990000000000004e-06 2024-09-11T05:34:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811640+0000", 2024-09-11T05:34:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6630000000000001e-06 2024-09-11T05:34:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815230+0000", 2024-09-11T05:34:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035897009999999998 2024-09-11T05:34:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815237+0000", 2024-09-11T05:34:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6590000000000001e-06 2024-09-11T05:34:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827019+0000", 2024-09-11T05:34:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011782261 2024-09-11T05:34:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827026+0000", 2024-09-11T05:34:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.605e-06 2024-09-11T05:34:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846317+0000", 2024-09-11T05:34:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192904270000001 2024-09-11T05:34:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846325+0000", 2024-09-11T05:34:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0530000000000007e-06 2024-09-11T05:34:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116543 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.311388164999997, 2024-09-11T05:34:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0347097559999998, 2024-09-11T05:34:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116543 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811648+0000", 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811654+0000", 2024-09-11T05:34:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T05:34:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811659+0000", 2024-09-11T05:34:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9409999999999998e-06 2024-09-11T05:34:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815259+0000", 2024-09-11T05:34:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035993980000000002 2024-09-11T05:34:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815265+0000", 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827049+0000", 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117836019999999 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827056+0000", 2024-09-11T05:34:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3919999999999997e-06 2024-09-11T05:34:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846348+0000", 2024-09-11T05:34:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192919039999999 2024-09-11T05:34:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846356+0000", 2024-09-11T05:34:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7449999999999995e-06 2024-09-11T05:34:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.247 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:22.248 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:22.249 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:22.248+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:22.349 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:22.348+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:22.396 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:22.396 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:22.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:22.450 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:22.449+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:22.550 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:22.550 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:22.551 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:22.550+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:22.559 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:22.652 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:22.651+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:22.668 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T05:34:22.694 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:34:22.711 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:184170 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.789884229, 2024-09-11T05:34:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047293133000000001, 2024-09-11T05:34:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 184170 2024-09-11T05:34:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921808+0000", 2024-09-11T05:34:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001805868 2024-09-11T05:34:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921819+0000", 2024-09-11T05:34:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0458e-05 2024-09-11T05:34:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921830+0000", 2024-09-11T05:34:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1482e-05 2024-09-11T05:34:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921837+0000", 2024-09-11T05:34:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3709999999999996e-06 2024-09-11T05:34:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967150+0000", 2024-09-11T05:34:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045313402000000003 2024-09-11T05:34:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967216+0000", 2024-09-11T05:34:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6322999999999995e-05 2024-09-11T05:34:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967296+0000", 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9228999999999996e-05 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185733 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3309568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.435851217, 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047365106999999997, 2024-09-11T05:34:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185733 2024-09-11T05:34:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275806+0000", 2024-09-11T05:34:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001769966 2024-09-11T05:34:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275810+0000", 2024-09-11T05:34:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5539999999999999e-06 2024-09-11T05:34:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275821+0000", 2024-09-11T05:34:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1253999999999999e-05 2024-09-11T05:34:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275828+0000", 2024-09-11T05:34:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321211+0000", 2024-09-11T05:34:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045383053999999999 2024-09-11T05:34:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321306+0000", 2024-09-11T05:34:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4712999999999999e-05 2024-09-11T05:34:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321401+0000", 2024-09-11T05:34:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4825000000000001e-05 2024-09-11T05:34:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185743 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3719168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.433839381, 2024-09-11T05:34:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047361001999999999, 2024-09-11T05:34:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185743 2024-09-11T05:34:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276048+0000", 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276050+0000", 2024-09-11T05:34:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:34:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276056+0000", 2024-09-11T05:34:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:34:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276061+0000", 2024-09-11T05:34:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T05:34:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323215+0000", 2024-09-11T05:34:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047153977999999999 2024-09-11T05:34:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323278+0000", 2024-09-11T05:34:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3053999999999996e-05 2024-09-11T05:34:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323408+0000", 2024-09-11T05:34:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013012899999999999 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185744 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3760128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.433818701, 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047563095, 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185744 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277808+0000", 2024-09-11T05:34:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001739652 2024-09-11T05:34:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277816+0000", 2024-09-11T05:34:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.208e-06 2024-09-11T05:34:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277829+0000", 2024-09-11T05:34:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2848e-05 2024-09-11T05:34:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277837+0000", 2024-09-11T05:34:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6379999999999993e-06 2024-09-11T05:34:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323448+0000", 2024-09-11T05:34:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045610604999999999 2024-09-11T05:34:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323562+0000", 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113706 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323631+0000", 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9437999999999995e-05 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185753 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.431855655, 2024-09-11T05:34:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047283944000000001, 2024-09-11T05:34:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185753 2024-09-11T05:34:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278033+0000", 2024-09-11T05:34:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.237e-06 2024-09-11T05:34:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278036+0000", 2024-09-11T05:34:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:34:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278038+0000", 2024-09-11T05:34:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5490000000000001e-06 2024-09-11T05:34:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325140+0000", 2024-09-11T05:34:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047101845000000003 2024-09-11T05:34:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325219+0000", 2024-09-11T05:34:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9444999999999996e-05 2024-09-11T05:34:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325315+0000", 2024-09-11T05:34:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.569e-05 2024-09-11T05:34:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185754 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4169728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.431845757, 2024-09-11T05:34:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047450697, 2024-09-11T05:34:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185754 2024-09-11T05:34:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278043+0000", 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278045+0000", 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278048+0000", 2024-09-11T05:34:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5679999999999998e-06 2024-09-11T05:34:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325359+0000", 2024-09-11T05:34:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047311262 2024-09-11T05:34:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325421+0000", 2024-09-11T05:34:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1717999999999994e-05 2024-09-11T05:34:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325492+0000", 2024-09-11T05:34:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0716000000000005e-05 2024-09-11T05:34:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185755 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2125824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.43183569, 2024-09-11T05:34:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047669481999999999, 2024-09-11T05:34:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185755 2024-09-11T05:34:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278052+0000", 2024-09-11T05:34:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-11T05:34:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278055+0000", 2024-09-11T05:34:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8059999999999999e-06 2024-09-11T05:34:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278058+0000", 2024-09-11T05:34:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.503e-06 2024-09-11T05:34:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325563+0000", 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047505316999999998 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325645+0000", 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2439000000000001e-05 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325721+0000", 2024-09-11T05:34:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5092999999999994e-05 2024-09-11T05:34:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185756 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2166784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.431823359999999, 2024-09-11T05:34:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047861556, 2024-09-11T05:34:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185756 2024-09-11T05:34:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279805+0000", 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001741586 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279809+0000", 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0890000000000002e-06 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279816+0000", 2024-09-11T05:34:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2060000000000001e-06 2024-09-11T05:34:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279821+0000", 2024-09-11T05:34:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6709999999999998e-06 2024-09-11T05:34:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325764+0000", 2024-09-11T05:34:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045942749999999997 2024-09-11T05:34:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325846+0000", 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2470000000000002e-05 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325925+0000", 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8783999999999997e-05 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185764 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2494464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.429859304000001, 2024-09-11T05:34:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308594000000002, 2024-09-11T05:34:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185764 2024-09-11T05:34:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280028+0000", 2024-09-11T05:34:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.27e-07 2024-09-11T05:34:22.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280030+0000", 2024-09-11T05:34:22.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3319999999999999e-06 2024-09-11T05:34:22.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280036+0000", 2024-09-11T05:34:22.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:34:22.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280041+0000", 2024-09-11T05:34:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7530000000000001e-06 2024-09-11T05:34:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327196+0000", 2024-09-11T05:34:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047154967999999998 2024-09-11T05:34:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327266+0000", 2024-09-11T05:34:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0427999999999997e-05 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327336+0000", 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9659000000000005e-05 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185765 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2535424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.429839384999999, 2024-09-11T05:34:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047410790000000001, 2024-09-11T05:34:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185765 2024-09-11T05:34:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280048+0000", 2024-09-11T05:34:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T05:34:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280050+0000", 2024-09-11T05:34:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-11T05:34:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280056+0000", 2024-09-11T05:34:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:34:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280061+0000", 2024-09-11T05:34:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T05:34:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327369+0000", 2024-09-11T05:34:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308416999999998 2024-09-11T05:34:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327413+0000", 2024-09-11T05:34:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070999999999999e-05 2024-09-11T05:34:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327458+0000", 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4836000000000002e-05 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185766 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2576384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.429819394999999, 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047571239000000001, 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.760 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185766 2024-09-11T05:34:22.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.760 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:22.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280068+0000", 2024-09-11T05:34:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:34:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280070+0000", 2024-09-11T05:34:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280081+0000", 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0951999999999999e-05 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280086+0000", 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5029999999999997e-06 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327495+0000", 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047408497000000001 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327568+0000", 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3450999999999999e-05 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327639+0000", 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0309999999999996e-05 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185767 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2617344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.429772258, 2024-09-11T05:34:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047672355, 2024-09-11T05:34:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185767 2024-09-11T05:34:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8999999999999996e-07 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280121+0000", 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0599999999999996e-06 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280128+0000", 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1029999999999996e-06 2024-09-11T05:34:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280133+0000", 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327702+0000", 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047568307999999997 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327745+0000", 2024-09-11T05:34:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3407e-05 2024-09-11T05:34:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327787+0000", 2024-09-11T05:34:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1749000000000003e-05 2024-09-11T05:34:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185768 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2658304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.429744907, 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047830091999999998, 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185768 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281805+0000", 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016635809999999999 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281810+0000", 2024-09-11T05:34:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3540000000000002e-06 2024-09-11T05:34:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281820+0000", 2024-09-11T05:34:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T05:34:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281828+0000", 2024-09-11T05:34:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327826+0000", 2024-09-11T05:34:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045998206999999999 2024-09-11T05:34:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327902+0000", 2024-09-11T05:34:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5761999999999997e-05 2024-09-11T05:34:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327972+0000", 2024-09-11T05:34:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0414999999999996e-05 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185775 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2945024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.427950848, 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047301277000000003, 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185775 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:34:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281938+0000", 2024-09-11T05:34:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5099999999999999e-06 2024-09-11T05:34:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281941+0000", 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-06 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281943+0000", 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.751e-06 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329092+0000", 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047148177999999999 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329166+0000", 2024-09-11T05:34:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4795000000000005e-05 2024-09-11T05:34:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329237+0000", 2024-09-11T05:34:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0864000000000005e-05 2024-09-11T05:34:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185777 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2985984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.427940419, 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047500597999999998, 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185777 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281947+0000", 2024-09-11T05:34:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281948+0000", 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1429999999999999e-06 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281951+0000", 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281953+0000", 2024-09-11T05:34:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6709999999999999e-06 2024-09-11T05:34:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329280+0000", 2024-09-11T05:34:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047326857999999999 2024-09-11T05:34:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329364+0000", 2024-09-11T05:34:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3586999999999998e-05 2024-09-11T05:34:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329447+0000", 2024-09-11T05:34:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3314999999999998e-05 2024-09-11T05:34:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185778 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3026944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.427930606, 2024-09-11T05:34:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047668384000000001, 2024-09-11T05:34:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185778 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283808+0000", 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018518919999999999 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283812+0000", 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283820+0000", 2024-09-11T05:34:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3319999999999992e-06 2024-09-11T05:34:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283825+0000", 2024-09-11T05:34:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8729999999999998e-06 2024-09-11T05:34:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329484+0000", 2024-09-11T05:34:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045658404999999999 2024-09-11T05:34:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329554+0000", 2024-09-11T05:34:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0099999999999996e-05 2024-09-11T05:34:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329625+0000", 2024-09-11T05:34:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0732e-05 2024-09-11T05:34:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185790 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2170880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.425945652999999, 2024-09-11T05:34:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047276674999999997, 2024-09-11T05:34:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185790 2024-09-11T05:34:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283942+0000", 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283944+0000", 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9800000000000001e-06 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283948+0000", 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9729999999999999e-06 2024-09-11T05:34:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283950+0000", 2024-09-11T05:34:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7020000000000001e-06 2024-09-11T05:34:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331076+0000", 2024-09-11T05:34:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047126016 2024-09-11T05:34:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331147+0000", 2024-09-11T05:34:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0848999999999999e-05 2024-09-11T05:34:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331218+0000", 2024-09-11T05:34:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0621e-05 2024-09-11T05:34:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185791 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3395584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.425919603000001, 2024-09-11T05:34:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047372307000000002, 2024-09-11T05:34:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185791 2024-09-11T05:34:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283968+0000", 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283970+0000", 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.199e-06 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283976+0000", 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283981+0000", 2024-09-11T05:34:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:34:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331252+0000", 2024-09-11T05:34:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047270999000000001 2024-09-11T05:34:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331299+0000", 2024-09-11T05:34:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7376999999999997e-05 2024-09-11T05:34:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331339+0000", 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0428e-05 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185792 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2211840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.425899705999999, 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047522035999999997, 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185792 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283990+0000", 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283995+0000", 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3329999999999996e-06 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284002+0000", 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6120000000000001e-06 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331373+0000", 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047370269999999999 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331442+0000", 2024-09-11T05:34:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8794999999999994e-05 2024-09-11T05:34:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331509+0000", 2024-09-11T05:34:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7570000000000005e-05 2024-09-11T05:34:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185793 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3436544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.425877607, 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047706692000000002, 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185793 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285808+0000", 2024-09-11T05:34:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001798352 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285812+0000", 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6399999999999996e-06 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285823+0000", 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0783e-05 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285831+0000", 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331550+0000", 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045719518000000001 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331633+0000", 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2992999999999996e-05 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331716+0000", 2024-09-11T05:34:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2455999999999998e-05 2024-09-11T05:34:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:22.805 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:22.807 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:22.807 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:22.806+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:22.907 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:22.907+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:22.927 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:22.927 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:22.944 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:22.944 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:22.955 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:22.955 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:22.961 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:22.964 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:22.978 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:22.979 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:22.979 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-11T05:34:22.997 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:22.997 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:23.008 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:23.008+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:23.014 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:23.014 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:23.031 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:23.031 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:23.035 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:34:23.035 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:34:23.083 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:23.083 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:23.092 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:23.115 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:23.113+0000 7f7804a18640 -1 Falling back to public interface 2024-09-11T05:34:23.139 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:23.138+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:23.194 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:23.194 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:23.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:23.245 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:23.244+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:23.311 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:23.310+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:23.347 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:23.348 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:23.356 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:23.442 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:23.442+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:23.500 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:23.500 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:23.509 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:23.550 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:23.549+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:23.614 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:23.614+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:23.652 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:23.653 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:23.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:23.716 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:23.715+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:23.781 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:23.782 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:23.791 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:23.835 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:23.834+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:23.894 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:23.903 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:23.917 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:23.916+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:24.018 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:24.017+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:24.046 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:24.046 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:24.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:24.119 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:24.117+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:24.159 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:24.159 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:24.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:24.220 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:24.219+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:24.311 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:24.311 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:24.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:24.321 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:24.320+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:24.422 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:24.422 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:24.422 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:24.421+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:24.431 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:24.523 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:24.521+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:24.534 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:24.535 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:24.544 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:24.624 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:24.623+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:24.645 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:24.645 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:24.655 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:24.690 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:34:24.735 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:24.734+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:24.762 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:24.762 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:24.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:24.826 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:24.825+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:24.881 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:24.882 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:24.890 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:24.927 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:24.926+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:24.995 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:24.995 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:25.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:25.036 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:34:25.047 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:25.046+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:25.110 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:25.110 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:25.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:25.162 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:25.161+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:25.171 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:25.189 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:25.190 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:25.206 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:25.206 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:25.222 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-11T05:34:25.228 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:25.228 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:25.229 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:25.227+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:25.237 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:25.239 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:25.256 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:25.256 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:25.273 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:25.277 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:34:25.277 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:34:25.329 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:25.328+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:25.344 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:25.345 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:25.345 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:25.345 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:25.345 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:25.351 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:25.430 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:25.429+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:25.455 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:25.456 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:25.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:25.456 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:25.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.456 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:184170 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.456 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:25.456 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.534384963000001, 2024-09-11T05:34:25.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047293133000000001, 2024-09-11T05:34:25.456 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 184170 2024-09-11T05:34:25.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.457 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:25.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:25.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921808+0000", 2024-09-11T05:34:25.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001805868 2024-09-11T05:34:25.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921819+0000", 2024-09-11T05:34:25.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0458e-05 2024-09-11T05:34:25.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921830+0000", 2024-09-11T05:34:25.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1482e-05 2024-09-11T05:34:25.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921837+0000", 2024-09-11T05:34:25.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3709999999999996e-06 2024-09-11T05:34:25.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967150+0000", 2024-09-11T05:34:25.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045313402000000003 2024-09-11T05:34:25.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967216+0000", 2024-09-11T05:34:25.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6322999999999995e-05 2024-09-11T05:34:25.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967296+0000", 2024-09-11T05:34:25.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9228999999999996e-05 2024-09-11T05:34:25.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.461 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.461 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185733 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3309568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.461 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:25.461 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.180351951, 2024-09-11T05:34:25.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047365106999999997, 2024-09-11T05:34:25.461 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.462 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.462 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185733 2024-09-11T05:34:25.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.462 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:25.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:25.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275806+0000", 2024-09-11T05:34:25.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001769966 2024-09-11T05:34:25.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275810+0000", 2024-09-11T05:34:25.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5539999999999999e-06 2024-09-11T05:34:25.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275821+0000", 2024-09-11T05:34:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1253999999999999e-05 2024-09-11T05:34:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275828+0000", 2024-09-11T05:34:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321211+0000", 2024-09-11T05:34:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045383053999999999 2024-09-11T05:34:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321306+0000", 2024-09-11T05:34:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4712999999999999e-05 2024-09-11T05:34:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321401+0000", 2024-09-11T05:34:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4825000000000001e-05 2024-09-11T05:34:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185743 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3719168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.178340114999999, 2024-09-11T05:34:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047361001999999999, 2024-09-11T05:34:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185743 2024-09-11T05:34:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276048+0000", 2024-09-11T05:34:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:34:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276050+0000", 2024-09-11T05:34:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:34:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276056+0000", 2024-09-11T05:34:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:34:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276061+0000", 2024-09-11T05:34:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T05:34:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323215+0000", 2024-09-11T05:34:25.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047153977999999999 2024-09-11T05:34:25.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323278+0000", 2024-09-11T05:34:25.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3053999999999996e-05 2024-09-11T05:34:25.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323408+0000", 2024-09-11T05:34:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013012899999999999 2024-09-11T05:34:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185744 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3760128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.178319435000001, 2024-09-11T05:34:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047563095, 2024-09-11T05:34:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185744 2024-09-11T05:34:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277808+0000", 2024-09-11T05:34:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001739652 2024-09-11T05:34:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277816+0000", 2024-09-11T05:34:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.208e-06 2024-09-11T05:34:25.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277829+0000", 2024-09-11T05:34:25.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2848e-05 2024-09-11T05:34:25.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277837+0000", 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6379999999999993e-06 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323448+0000", 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045610604999999999 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323562+0000", 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113706 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323631+0000", 2024-09-11T05:34:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9437999999999995e-05 2024-09-11T05:34:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185753 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.176356389, 2024-09-11T05:34:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047283944000000001, 2024-09-11T05:34:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185753 2024-09-11T05:34:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278033+0000", 2024-09-11T05:34:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.237e-06 2024-09-11T05:34:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278036+0000", 2024-09-11T05:34:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:34:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278038+0000", 2024-09-11T05:34:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5490000000000001e-06 2024-09-11T05:34:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325140+0000", 2024-09-11T05:34:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047101845000000003 2024-09-11T05:34:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325219+0000", 2024-09-11T05:34:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9444999999999996e-05 2024-09-11T05:34:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325315+0000", 2024-09-11T05:34:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.569e-05 2024-09-11T05:34:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185754 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4169728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.176346491, 2024-09-11T05:34:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047450697, 2024-09-11T05:34:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185754 2024-09-11T05:34:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278043+0000", 2024-09-11T05:34:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:34:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278045+0000", 2024-09-11T05:34:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278048+0000", 2024-09-11T05:34:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5679999999999998e-06 2024-09-11T05:34:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325359+0000", 2024-09-11T05:34:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047311262 2024-09-11T05:34:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325421+0000", 2024-09-11T05:34:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1717999999999994e-05 2024-09-11T05:34:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325492+0000", 2024-09-11T05:34:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0716000000000005e-05 2024-09-11T05:34:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185755 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2125824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.176336424, 2024-09-11T05:34:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047669481999999999, 2024-09-11T05:34:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185755 2024-09-11T05:34:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:34:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278052+0000", 2024-09-11T05:34:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-11T05:34:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278055+0000", 2024-09-11T05:34:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8059999999999999e-06 2024-09-11T05:34:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278058+0000", 2024-09-11T05:34:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.503e-06 2024-09-11T05:34:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325563+0000", 2024-09-11T05:34:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047505316999999998 2024-09-11T05:34:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325645+0000", 2024-09-11T05:34:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2439000000000001e-05 2024-09-11T05:34:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325721+0000", 2024-09-11T05:34:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5092999999999994e-05 2024-09-11T05:34:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185756 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2166784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.176324094, 2024-09-11T05:34:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047861556, 2024-09-11T05:34:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185756 2024-09-11T05:34:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279805+0000", 2024-09-11T05:34:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001741586 2024-09-11T05:34:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279809+0000", 2024-09-11T05:34:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0890000000000002e-06 2024-09-11T05:34:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279816+0000", 2024-09-11T05:34:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2060000000000001e-06 2024-09-11T05:34:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279821+0000", 2024-09-11T05:34:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6709999999999998e-06 2024-09-11T05:34:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325764+0000", 2024-09-11T05:34:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045942749999999997 2024-09-11T05:34:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325846+0000", 2024-09-11T05:34:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2470000000000002e-05 2024-09-11T05:34:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325925+0000", 2024-09-11T05:34:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8783999999999997e-05 2024-09-11T05:34:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185764 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2494464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.174360038, 2024-09-11T05:34:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308594000000002, 2024-09-11T05:34:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185764 2024-09-11T05:34:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280028+0000", 2024-09-11T05:34:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.27e-07 2024-09-11T05:34:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280030+0000", 2024-09-11T05:34:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3319999999999999e-06 2024-09-11T05:34:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280036+0000", 2024-09-11T05:34:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:34:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280041+0000", 2024-09-11T05:34:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7530000000000001e-06 2024-09-11T05:34:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327196+0000", 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047154967999999998 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327266+0000", 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0427999999999997e-05 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327336+0000", 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9659000000000005e-05 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185765 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2535424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.174340119, 2024-09-11T05:34:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047410790000000001, 2024-09-11T05:34:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185765 2024-09-11T05:34:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280048+0000", 2024-09-11T05:34:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T05:34:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280050+0000", 2024-09-11T05:34:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-11T05:34:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280056+0000", 2024-09-11T05:34:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:34:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280061+0000", 2024-09-11T05:34:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T05:34:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327369+0000", 2024-09-11T05:34:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308416999999998 2024-09-11T05:34:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327413+0000", 2024-09-11T05:34:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070999999999999e-05 2024-09-11T05:34:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327458+0000", 2024-09-11T05:34:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4836000000000002e-05 2024-09-11T05:34:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185766 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2576384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.174320129, 2024-09-11T05:34:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047571239000000001, 2024-09-11T05:34:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185766 2024-09-11T05:34:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280068+0000", 2024-09-11T05:34:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:34:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280070+0000", 2024-09-11T05:34:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280081+0000", 2024-09-11T05:34:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0951999999999999e-05 2024-09-11T05:34:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280086+0000", 2024-09-11T05:34:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5029999999999997e-06 2024-09-11T05:34:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327495+0000", 2024-09-11T05:34:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047408497000000001 2024-09-11T05:34:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327568+0000", 2024-09-11T05:34:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3450999999999999e-05 2024-09-11T05:34:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327639+0000", 2024-09-11T05:34:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0309999999999996e-05 2024-09-11T05:34:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185767 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2617344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.174272992000001, 2024-09-11T05:34:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047672355, 2024-09-11T05:34:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185767 2024-09-11T05:34:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8999999999999996e-07 2024-09-11T05:34:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280121+0000", 2024-09-11T05:34:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0599999999999996e-06 2024-09-11T05:34:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280128+0000", 2024-09-11T05:34:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1029999999999996e-06 2024-09-11T05:34:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280133+0000", 2024-09-11T05:34:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T05:34:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327702+0000", 2024-09-11T05:34:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047568307999999997 2024-09-11T05:34:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327745+0000", 2024-09-11T05:34:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3407e-05 2024-09-11T05:34:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327787+0000", 2024-09-11T05:34:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1749000000000003e-05 2024-09-11T05:34:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185768 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2658304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.174245641000001, 2024-09-11T05:34:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047830091999999998, 2024-09-11T05:34:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185768 2024-09-11T05:34:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281805+0000", 2024-09-11T05:34:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016635809999999999 2024-09-11T05:34:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281810+0000", 2024-09-11T05:34:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3540000000000002e-06 2024-09-11T05:34:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281820+0000", 2024-09-11T05:34:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T05:34:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281828+0000", 2024-09-11T05:34:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327826+0000", 2024-09-11T05:34:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045998206999999999 2024-09-11T05:34:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327902+0000", 2024-09-11T05:34:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5761999999999997e-05 2024-09-11T05:34:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327972+0000", 2024-09-11T05:34:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0414999999999996e-05 2024-09-11T05:34:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185775 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2945024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.172451582000001, 2024-09-11T05:34:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047301277000000003, 2024-09-11T05:34:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185775 2024-09-11T05:34:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281938+0000", 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5099999999999999e-06 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281941+0000", 2024-09-11T05:34:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-06 2024-09-11T05:34:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281943+0000", 2024-09-11T05:34:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.751e-06 2024-09-11T05:34:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329092+0000", 2024-09-11T05:34:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047148177999999999 2024-09-11T05:34:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329166+0000", 2024-09-11T05:34:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4795000000000005e-05 2024-09-11T05:34:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329237+0000", 2024-09-11T05:34:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0864000000000005e-05 2024-09-11T05:34:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185777 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2985984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.172441152999999, 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047500597999999998, 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185777 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281947+0000", 2024-09-11T05:34:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281948+0000", 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1429999999999999e-06 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281951+0000", 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281953+0000", 2024-09-11T05:34:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6709999999999999e-06 2024-09-11T05:34:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329280+0000", 2024-09-11T05:34:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047326857999999999 2024-09-11T05:34:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329364+0000", 2024-09-11T05:34:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3586999999999998e-05 2024-09-11T05:34:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329447+0000", 2024-09-11T05:34:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3314999999999998e-05 2024-09-11T05:34:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185778 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3026944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.172431339999999, 2024-09-11T05:34:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047668384000000001, 2024-09-11T05:34:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185778 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283808+0000", 2024-09-11T05:34:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018518919999999999 2024-09-11T05:34:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283812+0000", 2024-09-11T05:34:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283820+0000", 2024-09-11T05:34:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3319999999999992e-06 2024-09-11T05:34:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283825+0000", 2024-09-11T05:34:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8729999999999998e-06 2024-09-11T05:34:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329484+0000", 2024-09-11T05:34:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045658404999999999 2024-09-11T05:34:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329554+0000", 2024-09-11T05:34:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0099999999999996e-05 2024-09-11T05:34:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329625+0000", 2024-09-11T05:34:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0732e-05 2024-09-11T05:34:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185790 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2170880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.170446387, 2024-09-11T05:34:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047276674999999997, 2024-09-11T05:34:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185790 2024-09-11T05:34:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283942+0000", 2024-09-11T05:34:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283944+0000", 2024-09-11T05:34:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9800000000000001e-06 2024-09-11T05:34:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283948+0000", 2024-09-11T05:34:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9729999999999999e-06 2024-09-11T05:34:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283950+0000", 2024-09-11T05:34:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7020000000000001e-06 2024-09-11T05:34:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331076+0000", 2024-09-11T05:34:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047126016 2024-09-11T05:34:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331147+0000", 2024-09-11T05:34:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0848999999999999e-05 2024-09-11T05:34:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331218+0000", 2024-09-11T05:34:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0621e-05 2024-09-11T05:34:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185791 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3395584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.170420336999999, 2024-09-11T05:34:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047372307000000002, 2024-09-11T05:34:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185791 2024-09-11T05:34:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283968+0000", 2024-09-11T05:34:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283970+0000", 2024-09-11T05:34:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.199e-06 2024-09-11T05:34:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283976+0000", 2024-09-11T05:34:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T05:34:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283981+0000", 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331252+0000", 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047270999000000001 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331299+0000", 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7376999999999997e-05 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331339+0000", 2024-09-11T05:34:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0428e-05 2024-09-11T05:34:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185792 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2211840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.17040044, 2024-09-11T05:34:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047522035999999997, 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185792 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T05:34:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283990+0000", 2024-09-11T05:34:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:34:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283995+0000", 2024-09-11T05:34:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3329999999999996e-06 2024-09-11T05:34:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284002+0000", 2024-09-11T05:34:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6120000000000001e-06 2024-09-11T05:34:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331373+0000", 2024-09-11T05:34:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047370269999999999 2024-09-11T05:34:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331442+0000", 2024-09-11T05:34:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8794999999999994e-05 2024-09-11T05:34:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331509+0000", 2024-09-11T05:34:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7570000000000005e-05 2024-09-11T05:34:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185793 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3436544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.170378340999999, 2024-09-11T05:34:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047706692000000002, 2024-09-11T05:34:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185793 2024-09-11T05:34:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285808+0000", 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001798352 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285812+0000", 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6399999999999996e-06 2024-09-11T05:34:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285823+0000", 2024-09-11T05:34:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0783e-05 2024-09-11T05:34:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285831+0000", 2024-09-11T05:34:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:34:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331550+0000", 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045719518000000001 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331633+0000", 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2992999999999996e-05 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331716+0000", 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2455999999999998e-05 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.555 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:25.556 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:25.557 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:25.554+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:25.616 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T05:34:25.674 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:25.673+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:25.716 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:25.717 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:25.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:25.767 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:25.765+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:25.859 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:25.858+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:25.869 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:25.869 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:25.877 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:25.961 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:25.960+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:25.983 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:25.984 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:25.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:25.984 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:25.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.984 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116623 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13477888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:25.984 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:25.984 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092471578000001, 2024-09-11T05:34:25.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9661491070000001, 2024-09-11T05:34:25.984 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.984 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.985 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116623 2024-09-11T05:34:25.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.985 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:25.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889573+0000", 2024-09-11T05:34:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889574+0000", 2024-09-11T05:34:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4810000000000001e-06 2024-09-11T05:34:25.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889578+0000", 2024-09-11T05:34:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T05:34:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889581+0000", 2024-09-11T05:34:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2380000000000002e-06 2024-09-11T05:34:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890367+0000", 2024-09-11T05:34:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078646599999999999 2024-09-11T05:34:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890377+0000", 2024-09-11T05:34:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5789999999999993e-06 2024-09-11T05:34:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829092+0000", 2024-09-11T05:34:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871527899999996 2024-09-11T05:34:25.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829101+0000", 2024-09-11T05:34:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:34:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854695+0000", 2024-09-11T05:34:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0255937369999999 2024-09-11T05:34:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854786+0000", 2024-09-11T05:34:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1831999999999998e-05 2024-09-11T05:34:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855721+0000", 2024-09-11T05:34:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093499800000000004 2024-09-11T05:34:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.990 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116624 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13502464~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092457731000003, 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9664307189999999, 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116624 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889587+0000", 2024-09-11T05:34:25.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:34:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889588+0000", 2024-09-11T05:34:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T05:34:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889592+0000", 2024-09-11T05:34:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.472e-06 2024-09-11T05:34:25.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889594+0000", 2024-09-11T05:34:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T05:34:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890405+0000", 2024-09-11T05:34:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00081088199999999997 2024-09-11T05:34:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:25.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890410+0000", 2024-09-11T05:34:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999996e-06 2024-09-11T05:34:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829131+0000", 2024-09-11T05:34:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93872118999999998 2024-09-11T05:34:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829138+0000", 2024-09-11T05:34:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1760000000000004e-06 2024-09-11T05:34:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855755+0000", 2024-09-11T05:34:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026616722 2024-09-11T05:34:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855872+0000", 2024-09-11T05:34:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116927 2024-09-11T05:34:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856017+0000", 2024-09-11T05:34:25.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145313 2024-09-11T05:34:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116625 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13527040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092446512000002, 2024-09-11T05:34:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9666986180000001, 2024-09-11T05:34:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:25.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116625 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:25.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889598+0000", 2024-09-11T05:34:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:34:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889599+0000", 2024-09-11T05:34:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.144e-06 2024-09-11T05:34:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889602+0000", 2024-09-11T05:34:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889604+0000", 2024-09-11T05:34:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7640000000000001e-06 2024-09-11T05:34:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890442+0000", 2024-09-11T05:34:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083777099999999996 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890452+0000", 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5559999999999996e-06 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829170+0000", 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871818900000004 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829177+0000", 2024-09-11T05:34:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7220000000000002e-06 2024-09-11T05:34:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856046+0000", 2024-09-11T05:34:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026868943 2024-09-11T05:34:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856144+0000", 2024-09-11T05:34:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8684999999999995e-05 2024-09-11T05:34:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856296+0000", 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151667 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116626 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13551616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092435741999999, 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.96707056, 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116626 2024-09-11T05:34:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889610+0000", 2024-09-11T05:34:26.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.186e-06 2024-09-11T05:34:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889613+0000", 2024-09-11T05:34:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T05:34:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889615+0000", 2024-09-11T05:34:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:34:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890487+0000", 2024-09-11T05:34:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087202600000000003 2024-09-11T05:34:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890492+0000", 2024-09-11T05:34:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:34:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829202+0000", 2024-09-11T05:34:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871036299999999 2024-09-11T05:34:26.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829209+0000", 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7669999999999998e-06 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856327+0000", 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027118465 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856525+0000", 2024-09-11T05:34:26.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019825499999999999 2024-09-11T05:34:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856679+0000", 2024-09-11T05:34:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015328 2024-09-11T05:34:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116627 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13576192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:26.009 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092425857000002, 2024-09-11T05:34:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9673406419999999, 2024-09-11T05:34:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116627 2024-09-11T05:34:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:34:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889619+0000", 2024-09-11T05:34:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.093e-06 2024-09-11T05:34:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889622+0000", 2024-09-11T05:34:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T05:34:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889625+0000", 2024-09-11T05:34:26.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:34:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890528+0000", 2024-09-11T05:34:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000902804 2024-09-11T05:34:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890537+0000", 2024-09-11T05:34:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2029999999999998e-06 2024-09-11T05:34:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829232+0000", 2024-09-11T05:34:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93869459799999999 2024-09-11T05:34:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829238+0000", 2024-09-11T05:34:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6699999999999997e-06 2024-09-11T05:34:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856709+0000", 2024-09-11T05:34:26.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027470925 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856815+0000", 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010566899999999999 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856959+0000", 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000143752 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116628 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13600768~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092401862000003, 2024-09-11T05:34:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9676105420000001, 2024-09-11T05:34:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.016 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116628 2024-09-11T05:34:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:34:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889644+0000", 2024-09-11T05:34:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:34:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889647+0000", 2024-09-11T05:34:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3950000000000001e-06 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889650+0000", 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890570+0000", 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092007999999999999 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890577+0000", 2024-09-11T05:34:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.764e-06 2024-09-11T05:34:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829261+0000", 2024-09-11T05:34:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93868468500000002 2024-09-11T05:34:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829268+0000", 2024-09-11T05:34:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T05:34:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857004+0000", 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027736043 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857102+0000", 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8066999999999995e-05 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857253+0000", 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015050400000000001 2024-09-11T05:34:26.021 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116629 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13625344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092385350999997, 2024-09-11T05:34:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967906154, 2024-09-11T05:34:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.022 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116629 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-07 2024-09-11T05:34:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889660+0000", 2024-09-11T05:34:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5650000000000001e-06 2024-09-11T05:34:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889664+0000", 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4000000000000001e-06 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889666+0000", 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890614+0000", 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00094762999999999998 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890621+0000", 2024-09-11T05:34:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.379e-06 2024-09-11T05:34:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829291+0000", 2024-09-11T05:34:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866938499999997 2024-09-11T05:34:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829298+0000", 2024-09-11T05:34:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6610000000000003e-06 2024-09-11T05:34:26.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857284+0000", 2024-09-11T05:34:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027986522 2024-09-11T05:34:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857393+0000", 2024-09-11T05:34:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109054 2024-09-11T05:34:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857565+0000", 2024-09-11T05:34:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017160999999999999 2024-09-11T05:34:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116843 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12595200~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092374129, 2024-09-11T05:34:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9682605290000001, 2024-09-11T05:34:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.028 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116843 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889671+0000", 2024-09-11T05:34:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-11T05:34:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889674+0000", 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.005e-06 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889677+0000", 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890648+0000", 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097103399999999996 2024-09-11T05:34:26.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890652+0000", 2024-09-11T05:34:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0790000000000002e-06 2024-09-11T05:34:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829320+0000", 2024-09-11T05:34:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866793199999998 2024-09-11T05:34:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829327+0000", 2024-09-11T05:34:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5529999999999998e-06 2024-09-11T05:34:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857596+0000", 2024-09-11T05:34:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028269125 2024-09-11T05:34:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857834+0000", 2024-09-11T05:34:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023784300000000001 2024-09-11T05:34:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857930+0000", 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6704000000000001e-05 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116844 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12619776~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092363937999998, 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9685250679999999, 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.035 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.035 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116844 2024-09-11T05:34:26.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.035 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:26.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:26.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:26.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:26.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889681+0000", 2024-09-11T05:34:26.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.229e-06 2024-09-11T05:34:26.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889684+0000", 2024-09-11T05:34:26.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0130000000000002e-06 2024-09-11T05:34:26.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889687+0000", 2024-09-11T05:34:26.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7259999999999998e-06 2024-09-11T05:34:26.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890685+0000", 2024-09-11T05:34:26.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099783399999999996 2024-09-11T05:34:26.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890695+0000", 2024-09-11T05:34:26.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-09-11T05:34:26.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829349+0000", 2024-09-11T05:34:26.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865456300000005 2024-09-11T05:34:26.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829356+0000", 2024-09-11T05:34:26.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5130000000000002e-06 2024-09-11T05:34:26.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857959+0000", 2024-09-11T05:34:26.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0286034959999999 2024-09-11T05:34:26.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858057+0000", 2024-09-11T05:34:26.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8097999999999995e-05 2024-09-11T05:34:26.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858205+0000", 2024-09-11T05:34:26.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147732 2024-09-11T05:34:26.040 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.040 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.040 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.040 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116845 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12644352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.040 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:26.041 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092353705000001, 2024-09-11T05:34:26.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968783033, 2024-09-11T05:34:26.041 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.041 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.041 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.041 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.041 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.041 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116845 2024-09-11T05:34:26.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.041 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889692+0000", 2024-09-11T05:34:26.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2330000000000001e-06 2024-09-11T05:34:26.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889695+0000", 2024-09-11T05:34:26.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9249999999999999e-06 2024-09-11T05:34:26.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889697+0000", 2024-09-11T05:34:26.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:34:26.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890719+0000", 2024-09-11T05:34:26.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010218429999999999 2024-09-11T05:34:26.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890723+0000", 2024-09-11T05:34:26.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:34:26.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829378+0000", 2024-09-11T05:34:26.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865562000000002 2024-09-11T05:34:26.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829385+0000", 2024-09-11T05:34:26.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4579999999999998e-06 2024-09-11T05:34:26.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858234+0000", 2024-09-11T05:34:26.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028849288 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858337+0000", 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102371 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858473+0000", 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013669299999999999 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.047 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116846 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12668928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.047 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:26.047 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092330779999998, 2024-09-11T05:34:26.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.969056522, 2024-09-11T05:34:26.047 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.047 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.047 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.047 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116846 2024-09-11T05:34:26.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.048 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:26.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:26.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:26.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-07 2024-09-11T05:34:26.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889715+0000", 2024-09-11T05:34:26.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.482e-06 2024-09-11T05:34:26.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889718+0000", 2024-09-11T05:34:26.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889721+0000", 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890762+0000", 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010413659999999999 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890772+0000", 2024-09-11T05:34:26.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5750000000000007e-06 2024-09-11T05:34:26.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829407+0000", 2024-09-11T05:34:26.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93863550699999998 2024-09-11T05:34:26.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829414+0000", 2024-09-11T05:34:26.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5640000000000002e-06 2024-09-11T05:34:26.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858502+0000", 2024-09-11T05:34:26.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0290880099999999 2024-09-11T05:34:26.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858634+0000", 2024-09-11T05:34:26.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013173199999999999 2024-09-11T05:34:26.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858770+0000", 2024-09-11T05:34:26.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135943 2024-09-11T05:34:26.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.053 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.053 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116847 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12693504~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.053 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:26.053 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092301092, 2024-09-11T05:34:26.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9692923329999998, 2024-09-11T05:34:26.054 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.054 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116847 2024-09-11T05:34:26.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.054 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:26.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889747+0000", 2024-09-11T05:34:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.501e-06 2024-09-11T05:34:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889753+0000", 2024-09-11T05:34:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1360000000000002e-06 2024-09-11T05:34:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889756+0000", 2024-09-11T05:34:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3110000000000001e-06 2024-09-11T05:34:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890808+0000", 2024-09-11T05:34:26.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010523240000000001 2024-09-11T05:34:26.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890813+0000", 2024-09-11T05:34:26.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5650000000000003e-06 2024-09-11T05:34:26.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829436+0000", 2024-09-11T05:34:26.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93862351799999999 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829443+0000", 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5220000000000004e-06 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858798+0000", 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029354903 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858899+0000", 2024-09-11T05:34:26.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101414 2024-09-11T05:34:26.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859035+0000", 2024-09-11T05:34:26.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013589 2024-09-11T05:34:26.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.059 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.059 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116848 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12718080~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.059 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:26.060 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092284407000001, 2024-09-11T05:34:26.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9695514759999999, 2024-09-11T05:34:26.060 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.060 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.060 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116848 2024-09-11T05:34:26.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.060 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:26.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:26.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889760+0000", 2024-09-11T05:34:26.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:26.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889761+0000", 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.189e-06 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889764+0000", 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889766+0000", 2024-09-11T05:34:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890850+0000", 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010835479999999999 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890857+0000", 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6299999999999998e-06 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829465+0000", 2024-09-11T05:34:26.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860787000000001 2024-09-11T05:34:26.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829472+0000", 2024-09-11T05:34:26.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4420000000000003e-06 2024-09-11T05:34:26.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859062+0000", 2024-09-11T05:34:26.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0295903360000001 2024-09-11T05:34:26.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859169+0000", 2024-09-11T05:34:26.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010674400000000001 2024-09-11T05:34:26.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859311+0000", 2024-09-11T05:34:26.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014209499999999999 2024-09-11T05:34:26.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.065 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.066 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116849 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12742656~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.066 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:26.066 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092274621000001, 2024-09-11T05:34:26.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9698160310000001, 2024-09-11T05:34:26.066 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.066 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.066 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116849 2024-09-11T05:34:26.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.067 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:26.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:26.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:26.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:26.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889771+0000", 2024-09-11T05:34:26.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:34:26.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889774+0000", 2024-09-11T05:34:26.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:34:26.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889776+0000", 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.638e-06 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890886+0000", 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011102519999999999 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890891+0000", 2024-09-11T05:34:26.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2200000000000003e-06 2024-09-11T05:34:26.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829494+0000", 2024-09-11T05:34:26.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860342500000005 2024-09-11T05:34:26.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829501+0000", 2024-09-11T05:34:26.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4829999999999996e-06 2024-09-11T05:34:26.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859339+0000", 2024-09-11T05:34:26.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0298381320000001 2024-09-11T05:34:26.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859440+0000", 2024-09-11T05:34:26.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010145 2024-09-11T05:34:26.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859585+0000", 2024-09-11T05:34:26.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014513300000000001 2024-09-11T05:34:26.071 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.072 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.072 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116850 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12767232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.072 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:26.072 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092253595000003, 2024-09-11T05:34:26.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970125645, 2024-09-11T05:34:26.072 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.072 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.073 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.073 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.073 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116850 2024-09-11T05:34:26.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.073 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:26.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889791+0000", 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889792+0000", 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4899999999999999e-06 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889795+0000", 2024-09-11T05:34:26.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:26.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889798+0000", 2024-09-11T05:34:26.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7089999999999998e-06 2024-09-11T05:34:26.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890924+0000", 2024-09-11T05:34:26.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001125685 2024-09-11T05:34:26.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890933+0000", 2024-09-11T05:34:26.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3340000000000008e-06 2024-09-11T05:34:26.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829523+0000", 2024-09-11T05:34:26.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858966099999996 2024-09-11T05:34:26.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829529+0000", 2024-09-11T05:34:26.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5740000000000001e-06 2024-09-11T05:34:26.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859614+0000", 2024-09-11T05:34:26.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0300843289999999 2024-09-11T05:34:26.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859743+0000", 2024-09-11T05:34:26.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129407 2024-09-11T05:34:26.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859916+0000", 2024-09-11T05:34:26.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017282500000000001 2024-09-11T05:34:26.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.078 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.078 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116851 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12791808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.078 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:26.078 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092213725000001, 2024-09-11T05:34:26.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970347268, 2024-09-11T05:34:26.078 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.079 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.079 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116851 2024-09-11T05:34:26.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.079 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:26.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:26.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:26.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:34:26.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889832+0000", 2024-09-11T05:34:26.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6819999999999999e-06 2024-09-11T05:34:26.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889838+0000", 2024-09-11T05:34:26.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:34:26.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889841+0000", 2024-09-11T05:34:26.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:34:26.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890957+0000", 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001115956 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890961+0000", 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7050000000000001e-06 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829552+0000", 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93859101499999997 2024-09-11T05:34:26.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829558+0000", 2024-09-11T05:34:26.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5429999999999999e-06 2024-09-11T05:34:26.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859947+0000", 2024-09-11T05:34:26.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030388248 2024-09-11T05:34:26.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860043+0000", 2024-09-11T05:34:26.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5847999999999994e-05 2024-09-11T05:34:26.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860177+0000", 2024-09-11T05:34:26.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013484400000000001 2024-09-11T05:34:26.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.084 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.084 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116852 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12816384~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.084 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:26.085 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092199114000003, 2024-09-11T05:34:26.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970594859, 2024-09-11T05:34:26.085 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.085 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116852 2024-09-11T05:34:26.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.085 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:26.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:26.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:26.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:26.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889846+0000", 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.204e-06 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889849+0000", 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.931e-06 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889852+0000", 2024-09-11T05:34:26.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:34:26.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890993+0000", 2024-09-11T05:34:26.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001141176 2024-09-11T05:34:26.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891001+0000", 2024-09-11T05:34:26.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5259999999999996e-06 2024-09-11T05:34:26.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829582+0000", 2024-09-11T05:34:26.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858050800000004 2024-09-11T05:34:26.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829588+0000", 2024-09-11T05:34:26.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4980000000000003e-06 2024-09-11T05:34:26.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860207+0000", 2024-09-11T05:34:26.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030618713 2024-09-11T05:34:26.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860305+0000", 2024-09-11T05:34:26.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8209999999999997e-05 2024-09-11T05:34:26.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860440+0000", 2024-09-11T05:34:26.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134692 2024-09-11T05:34:26.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.090 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116853 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12840960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092188395999997, 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.97084075, 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116853 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.091 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:26.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:26.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889856+0000", 2024-09-11T05:34:26.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:34:26.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889857+0000", 2024-09-11T05:34:26.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.435e-06 2024-09-11T05:34:26.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889860+0000", 2024-09-11T05:34:26.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9620000000000002e-06 2024-09-11T05:34:26.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889863+0000", 2024-09-11T05:34:26.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T05:34:26.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891036+0000", 2024-09-11T05:34:26.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011734580000000001 2024-09-11T05:34:26.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891042+0000", 2024-09-11T05:34:26.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3290000000000001e-06 2024-09-11T05:34:26.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829611+0000", 2024-09-11T05:34:26.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856954299999995 2024-09-11T05:34:26.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829618+0000", 2024-09-11T05:34:26.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T05:34:26.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860465+0000", 2024-09-11T05:34:26.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0308472500000001 2024-09-11T05:34:26.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860558+0000", 2024-09-11T05:34:26.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3253999999999999e-05 2024-09-11T05:34:26.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860696+0000", 2024-09-11T05:34:26.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138169 2024-09-11T05:34:26.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.097 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116854 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12865536~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:26.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092178205000003, 2024-09-11T05:34:26.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9710979320000002, 2024-09-11T05:34:26.097 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116854 2024-09-11T05:34:26.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.098 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:26.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:26.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:26.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:26.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889867+0000", 2024-09-11T05:34:26.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.155e-06 2024-09-11T05:34:26.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889871+0000", 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9260000000000002e-06 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889875+0000", 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.262e-06 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891070+0000", 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011945160000000001 2024-09-11T05:34:26.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891079+0000", 2024-09-11T05:34:26.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3759999999999997e-06 2024-09-11T05:34:26.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829642+0000", 2024-09-11T05:34:26.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856325900000004 2024-09-11T05:34:26.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829649+0000", 2024-09-11T05:34:26.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:34:26.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860726+0000", 2024-09-11T05:34:26.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.031076791 2024-09-11T05:34:26.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860831+0000", 2024-09-11T05:34:26.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105003 2024-09-11T05:34:26.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860964+0000", 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013285700000000001 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116855 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12890112~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.092163425000003, 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.971277814, 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.104 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.104 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116855 2024-09-11T05:34:26.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.104 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:26.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817809+0000", 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.92792850999999998 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817815+0000", 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4110000000000001e-06 2024-09-11T05:34:26.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817827+0000", 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2031000000000001e-05 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817837+0000", 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2159999999999995e-06 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829673+0000", 2024-09-11T05:34:26.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011836197 2024-09-11T05:34:26.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829679+0000", 2024-09-11T05:34:26.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5390000000000004e-06 2024-09-11T05:34:26.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861000+0000", 2024-09-11T05:34:26.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0313209539999999 2024-09-11T05:34:26.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861080+0000", 2024-09-11T05:34:26.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9606999999999999e-05 2024-09-11T05:34:26.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861158+0000", 2024-09-11T05:34:26.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8349000000000005e-05 2024-09-11T05:34:26.108 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.108 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.108 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.108 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.108 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.108 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:26.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:26.110 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:26.108+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:26.211 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:26.210+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:26.213 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:26.213 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:26.213 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:26.213 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:26.221 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:26.311 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:26.310+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:26.325 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:26.326 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:26.326 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:26.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:26.412 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:26.411+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:26.479 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:26.479 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:26.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:26.480 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:26.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.480 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:34:26.480 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:26.480 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 100.887988944, 2024-09-11T05:34:26.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:34:26.480 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:26.480 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.480 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:34:26.480 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:34:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:34:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:34:26.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:26.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:34:26.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:34:26.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:34:26.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:34:26.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:34:26.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:34:26.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.484 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.485 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.485 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:26.485 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.311053684000001, 2024-09-11T05:34:26.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:34:26.485 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:34:26.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.486 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:26.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:26.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:34:26.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:34:26.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:34:26.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:34:26.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:34:26.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:34:26.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:34:26.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:34:26.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:34:26.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:34:26.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:34:26.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:34:26.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:34:26.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:34:26.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.490 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.490 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.490 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:26.490 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.311034884999998, 2024-09-11T05:34:26.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:34:26.490 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:34:26.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.491 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:26.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:34:26.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.495 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.495 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:26.495 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.311010854000003, 2024-09-11T05:34:26.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:34:26.495 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:34:26.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.496 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:26.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:26.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:34:26.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:34:26.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:34:26.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:34:26.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:34:26.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.499 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.499 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.499 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:26.499 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.310934066000002, 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:26.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:26.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:26.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:26.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:34:26.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:34:26.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:34:26.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:34:26.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:34:26.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:34:26.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.504 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.504 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.504 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:26.504 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.310906742999997, 2024-09-11T05:34:26.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:34:26.504 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.505 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.505 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.505 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:34:26.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.505 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:26.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:26.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:26.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:34:26.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:34:26.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:34:26.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:34:26.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:34:26.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:34:26.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:34:26.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:34:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:34:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:34:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:34:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:34:26.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:34:26.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.509 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.509 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.509 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:26.509 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.310888194999997, 2024-09-11T05:34:26.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:34:26.509 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:26.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:26.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:26.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:34:26.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:34:26.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:34:26.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:34:26.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:34:26.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:34:26.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.513 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.514 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.514 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:26.514 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.310870123999997, 2024-09-11T05:34:26.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:34:26.514 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.515 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:34:26.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.515 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:26.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:26.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:34:26.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:34:26.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:34:26.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:34:26.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:34:26.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:34:26.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:34:26.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:34:26.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:34:26.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:34:26.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:34:26.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:34:26.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:34:26.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:34:26.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.519 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.519 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:26.519 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.309272481000001, 2024-09-11T05:34:26.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:34:26.519 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:34:26.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.520 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:26.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:26.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:34:26.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:34:26.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.309252155000003, 2024-09-11T05:34:26.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.527 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.528 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.528 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:26.528 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.309213157000002, 2024-09-11T05:34:26.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:34:26.528 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.528 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.528 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.528 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.528 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:26.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:34:26.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:34:26.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:34:26.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:34:26.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:34:26.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:34:26.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:34:26.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:34:26.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.532 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.309192514999999, 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.533 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:26.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:26.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:34:26.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:26.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:34:26.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:34:26.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:34:26.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:34:26.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.309069651999998, 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:34:26.537 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:26.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:34:26.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:34:26.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:34:26.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:34:26.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:34:26.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:34:26.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:34:26.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:34:26.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.542 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.542 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.542 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:26.542 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.308910095000002, 2024-09-11T05:34:26.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:34:26.542 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:34:26.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:34:26.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:34:26.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:34:26.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:26.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.307225428000002, 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:34:26.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.548 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:26.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:26.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:34:26.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.307197422999998, 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:34:26.551 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:34:26.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:34:26.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:34:26.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:34:26.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:34:26.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:34:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:34:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:34:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:34:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:34:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:34:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44388 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8118272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.305806089999997, 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044546074999999997, 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44388 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172487+0000", 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172490+0000", 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5090000000000002e-06 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172497+0000", 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172502+0000", 2024-09-11T05:34:26.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2000000000000002e-06 2024-09-11T05:34:26.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216878+0000", 2024-09-11T05:34:26.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044375900000000003 2024-09-11T05:34:26.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216925+0000", 2024-09-11T05:34:26.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7058999999999998e-05 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216982+0000", 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6932000000000003e-05 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.305730959999998, 2024-09-11T05:34:26.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:34:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:34:26.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:34:26.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:34:26.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:34:26.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:34:26.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:34:26.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.564 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.565 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.565 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.565 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:26.565 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.305545659000003, 2024-09-11T05:34:26.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:34:26.565 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:34:26.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:34:26.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:34:26.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:34:26.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:34:26.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:26.569 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.305374204000003, 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:26.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:26.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:26.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:34:26.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:34:26.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:26.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:34:26.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:34:26.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:26.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:26.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:26.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:34:26.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:34:26.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.577 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:26.577 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:26.577 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:26.579 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:26.579 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:26.578+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:26.679 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:26.678+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:26.687 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:26.687 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:26.687 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:26.688 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:26.697 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:26.780 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:26.779+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:26.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:34:26.843 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:26.843 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:26.843 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:26.843 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:26.843 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:26.852 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:26.893 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:26.892+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:26.932 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:26.931+0000 7f7804a18640 -1 osd.4 74 log_to_monitors true 2024-09-11T05:34:26.942 INFO:teuthology.orchestra.run.smithi084.stderr:no valid command found; 10 closest matches: 2024-09-11T05:34:26.942 INFO:teuthology.orchestra.run.smithi084.stderr:0 2024-09-11T05:34:26.943 INFO:teuthology.orchestra.run.smithi084.stderr:1 2024-09-11T05:34:26.943 INFO:teuthology.orchestra.run.smithi084.stderr:2 2024-09-11T05:34:26.943 INFO:teuthology.orchestra.run.smithi084.stderr:abort 2024-09-11T05:34:26.943 INFO:teuthology.orchestra.run.smithi084.stderr:assert 2024-09-11T05:34:26.943 INFO:teuthology.orchestra.run.smithi084.stderr:bluefs debug_inject_read_zeros 2024-09-11T05:34:26.943 INFO:teuthology.orchestra.run.smithi084.stderr:bluefs files list 2024-09-11T05:34:26.943 INFO:teuthology.orchestra.run.smithi084.stderr:bluefs stats 2024-09-11T05:34:26.943 INFO:teuthology.orchestra.run.smithi084.stderr:bluestore allocator dump block 2024-09-11T05:34:26.943 INFO:teuthology.orchestra.run.smithi084.stderr:bluestore allocator fragmentation block 2024-09-11T05:34:26.943 INFO:teuthology.orchestra.run.smithi084.stderr:admin_socket: invalid command 2024-09-11T05:34:26.945 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T05:34:26.946 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-4, ['dump_ops_in_flight'] 2024-09-11T05:34:26.982 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:26.980+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:26.999 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:26.999 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:27.000 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:27.000 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:27.000 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.000 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183598 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8097792~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.000 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:27.000 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.256284101, 2024-09-11T05:34:27.000 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038436577999999999, 2024-09-11T05:34:27.000 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.000 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.001 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.001 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.001 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.001 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.001 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183598 2024-09-11T05:34:27.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.001 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.001 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.001 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.001 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:27.001 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742042+0000", 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742044+0000", 2024-09-11T05:34:27.002 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.119e-06 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742049+0000", 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6710000000000004e-06 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742054+0000", 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.003 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780385+0000", 2024-09-11T05:34:27.004 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038330831000000003 2024-09-11T05:34:27.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.004 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.004 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.004 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780435+0000", 2024-09-11T05:34:27.004 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0018999999999997e-05 2024-09-11T05:34:27.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.004 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.004 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.004 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780478+0000", 2024-09-11T05:34:27.004 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2823e-05 2024-09-11T05:34:27.004 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.004 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183599 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6750208~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.256265308, 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038610453000000003, 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.005 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183599 2024-09-11T05:34:27.006 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.006 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.006 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.006 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.006 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:27.006 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.006 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.006 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.006 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.006 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:27.006 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.006 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.006 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.007 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.007 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742061+0000", 2024-09-11T05:34:27.007 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2200000000000004e-07 2024-09-11T05:34:27.007 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.007 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.007 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.007 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742063+0000", 2024-09-11T05:34:27.007 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:34:27.007 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.007 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742068+0000", 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6389999999999997e-06 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742073+0000", 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6990000000000002e-06 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780516+0000", 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038443428000000002 2024-09-11T05:34:27.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.009 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.009 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.009 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780601+0000", 2024-09-11T05:34:27.009 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4618999999999997e-05 2024-09-11T05:34:27.009 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.009 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.009 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.009 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780670+0000", 2024-09-11T05:34:27.009 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9593999999999998e-05 2024-09-11T05:34:27.009 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.009 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.009 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.009 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183600 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8138752~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.256246493000001, 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038699900000000002, 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183600 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:27.011 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:34:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742081+0000", 2024-09-11T05:34:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.086e-06 2024-09-11T05:34:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742087+0000", 2024-09-11T05:34:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4770000000000002e-06 2024-09-11T05:34:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742092+0000", 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7190000000000001e-06 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780697+0000", 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038605577000000002 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780740+0000", 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3139999999999997e-05 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.013 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.014 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.014 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780779+0000", 2024-09-11T05:34:27.014 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8473000000000002e-05 2024-09-11T05:34:27.014 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.014 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.014 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.014 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.014 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183601 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6791168~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.014 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:27.014 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.256228463999999, 2024-09-11T05:34:27.014 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038869364000000003, 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183601 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.016 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.016 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.016 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:27.016 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.016 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.016 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.016 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:27.016 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9900000000000002e-07 2024-09-11T05:34:27.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.016 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.016 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.016 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742099+0000", 2024-09-11T05:34:27.017 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:34:27.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.017 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.017 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.017 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742105+0000", 2024-09-11T05:34:27.017 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0759999999999999e-06 2024-09-11T05:34:27.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.017 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.017 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.017 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742110+0000", 2024-09-11T05:34:27.017 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6600000000000003e-06 2024-09-11T05:34:27.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.017 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.018 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.018 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780809+0000", 2024-09-11T05:34:27.018 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038698681999999998 2024-09-11T05:34:27.018 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.018 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.018 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.018 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780886+0000", 2024-09-11T05:34:27.018 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7888999999999999e-05 2024-09-11T05:34:27.018 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.018 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.018 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.018 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780966+0000", 2024-09-11T05:34:27.018 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9797999999999997e-05 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183602 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8179712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.256209645, 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038955028000000003, 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.019 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.020 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.020 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183602 2024-09-11T05:34:27.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.020 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.020 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.020 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.020 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:27.020 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.021 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.021 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.021 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:27.021 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.021 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.021 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.021 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.021 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:27.021 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:34:27.021 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.021 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.021 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.021 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742122+0000", 2024-09-11T05:34:27.022 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9880000000000001e-06 2024-09-11T05:34:27.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.022 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.022 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.022 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742128+0000", 2024-09-11T05:34:27.022 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2600000000000002e-06 2024-09-11T05:34:27.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.022 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.022 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.022 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742133+0000", 2024-09-11T05:34:27.022 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9010000000000002e-06 2024-09-11T05:34:27.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.022 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.023 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.023 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780981+0000", 2024-09-11T05:34:27.023 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038848102000000002 2024-09-11T05:34:27.023 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.023 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.023 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.023 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781024+0000", 2024-09-11T05:34:27.023 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2231000000000003e-05 2024-09-11T05:34:27.023 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.023 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.023 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.023 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781071+0000", 2024-09-11T05:34:27.023 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7215000000000001e-05 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183603 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6832128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.256186018999999, 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039121378999999998, 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.024 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.025 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.025 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183603 2024-09-11T05:34:27.025 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.025 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.025 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.025 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.025 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:27.025 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.025 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.025 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.025 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.025 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:27.025 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.026 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.026 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.026 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742215+0000", 2024-09-11T05:34:27.026 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5419000000000004e-05 2024-09-11T05:34:27.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.026 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.026 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.026 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742218+0000", 2024-09-11T05:34:27.026 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0989999999999999e-06 2024-09-11T05:34:27.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.026 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.026 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742225+0000", 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4019999999999996e-06 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742231+0000", 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6969999999999998e-06 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781102+0000", 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038871348 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.028 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.028 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781187+0000", 2024-09-11T05:34:27.028 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4719e-05 2024-09-11T05:34:27.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.028 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.028 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.028 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781261+0000", 2024-09-11T05:34:27.028 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3695000000000005e-05 2024-09-11T05:34:27.028 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.028 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.028 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.028 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.029 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183604 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8220672~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.029 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:27.029 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.256085458999999, 2024-09-11T05:34:27.029 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039154538000000003, 2024-09-11T05:34:27.029 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.029 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.029 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.029 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.029 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.029 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.029 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183604 2024-09-11T05:34:27.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.029 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743491+0000", 2024-09-11T05:34:27.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0012514620000000001 2024-09-11T05:34:27.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.031 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.031 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.031 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743496+0000", 2024-09-11T05:34:27.031 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2910000000000001e-06 2024-09-11T05:34:27.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.031 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.031 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.031 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743506+0000", 2024-09-11T05:34:27.031 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0039e-05 2024-09-11T05:34:27.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.031 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.031 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743513+0000", 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781296+0000", 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037783187000000003 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781347+0000", 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1375000000000002e-05 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.032 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.033 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.033 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781394+0000", 2024-09-11T05:34:27.033 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119000000000001e-05 2024-09-11T05:34:27.033 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.033 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.033 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.033 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.033 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.033 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183609 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6955008~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.033 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:27.033 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.254690604, 2024-09-11T05:34:27.033 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038553630999999998, 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183609 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.15e-07 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743637+0000", 2024-09-11T05:34:27.035 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.86e-06 2024-09-11T05:34:27.036 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.036 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.036 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.036 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743641+0000", 2024-09-11T05:34:27.036 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7000000000000002e-06 2024-09-11T05:34:27.036 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.036 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.036 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.036 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743645+0000", 2024-09-11T05:34:27.036 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9600000000000002e-06 2024-09-11T05:34:27.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.037 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.037 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.037 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782023+0000", 2024-09-11T05:34:27.037 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038378520999999999 2024-09-11T05:34:27.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.037 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.037 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.037 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782119+0000", 2024-09-11T05:34:27.037 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5665e-05 2024-09-11T05:34:27.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.037 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.037 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.038 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782188+0000", 2024-09-11T05:34:27.038 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9610000000000006e-05 2024-09-11T05:34:27.038 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.038 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.038 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.038 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.038 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183610 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8343552~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.038 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:27.038 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.254677026, 2024-09-11T05:34:27.038 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038675859, 2024-09-11T05:34:27.038 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.038 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183610 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.039 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.040 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:27.040 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.040 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.040 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.040 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743649+0000", 2024-09-11T05:34:27.040 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-07 2024-09-11T05:34:27.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.040 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.040 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.040 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743650+0000", 2024-09-11T05:34:27.040 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5799999999999999e-06 2024-09-11T05:34:27.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743656+0000", 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743660+0000", 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4259999999999999e-06 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782218+0000", 2024-09-11T05:34:27.041 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038558508999999998 2024-09-11T05:34:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782270+0000", 2024-09-11T05:34:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.168e-05 2024-09-11T05:34:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782324+0000", 2024-09-11T05:34:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4388999999999997e-05 2024-09-11T05:34:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183611 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6995968~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.254662134, 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038861554999999999, 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183611 2024-09-11T05:34:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.044 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.044 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.044 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.044 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:27.044 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.044 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.044 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.044 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:27.044 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.044 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.044 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.045 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:27.045 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4299999999999999e-07 2024-09-11T05:34:27.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.045 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.045 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.045 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743665+0000", 2024-09-11T05:34:27.045 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5060000000000001e-06 2024-09-11T05:34:27.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.045 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.045 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.045 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743668+0000", 2024-09-11T05:34:27.045 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1549999999999999e-06 2024-09-11T05:34:27.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743671+0000", 2024-09-11T05:34:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7599999999999998e-06 2024-09-11T05:34:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782359+0000", 2024-09-11T05:34:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038687946000000001 2024-09-11T05:34:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782437+0000", 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8539000000000001e-05 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782525+0000", 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7405999999999996e-05 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183612 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8384512~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.254650965, 2024-09-11T05:34:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039040111000000002, 2024-09-11T05:34:27.048 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.048 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.048 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.048 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.048 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.048 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.048 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183612 2024-09-11T05:34:27.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.048 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.048 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.048 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.048 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:27.048 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743675+0000", 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2100000000000001e-07 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.049 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743676+0000", 2024-09-11T05:34:27.050 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.212e-06 2024-09-11T05:34:27.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.050 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.050 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.050 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743679+0000", 2024-09-11T05:34:27.050 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:34:27.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.050 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.050 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.050 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743681+0000", 2024-09-11T05:34:27.050 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.604e-06 2024-09-11T05:34:27.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.050 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782560+0000", 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038878687000000002 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782644+0000", 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3733000000000006e-05 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782714+0000", 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0655999999999996e-05 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.051 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.052 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.052 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.052 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183613 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7036928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.052 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:27.052 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.254640931999999, 2024-09-11T05:34:27.052 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039233924000000003, 2024-09-11T05:34:27.052 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.052 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.052 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.052 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.052 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.052 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183613 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.053 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745489+0000", 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0018047549999999999 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745493+0000", 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0439999999999997e-06 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745501+0000", 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:34:27.054 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.055 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.055 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.055 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745507+0000", 2024-09-11T05:34:27.055 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9490000000000001e-06 2024-09-11T05:34:27.055 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.055 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.055 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.055 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782756+0000", 2024-09-11T05:34:27.055 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037249522 2024-09-11T05:34:27.055 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.055 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.055 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.055 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782839+0000", 2024-09-11T05:34:27.056 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3133999999999994e-05 2024-09-11T05:34:27.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.056 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.056 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.056 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782918+0000", 2024-09-11T05:34:27.056 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9167999999999998e-05 2024-09-11T05:34:27.056 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.056 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.056 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.056 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.056 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183622 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7323648~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.056 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.252682517, 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038618008000000002, 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183622 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.057 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:27.058 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.058 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.058 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.058 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:27.058 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.058 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.058 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.058 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:27.058 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4900000000000001e-07 2024-09-11T05:34:27.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.058 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745645+0000", 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9709999999999998e-06 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745651+0000", 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.251e-06 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745657+0000", 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:34:27.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.060 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.060 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.060 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784095+0000", 2024-09-11T05:34:27.060 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038437791999999998 2024-09-11T05:34:27.060 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.060 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.060 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.060 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784201+0000", 2024-09-11T05:34:27.060 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000106801 2024-09-11T05:34:27.060 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.060 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.060 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.060 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784261+0000", 2024-09-11T05:34:27.061 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9475999999999998e-05 2024-09-11T05:34:27.061 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.061 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.061 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.061 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.061 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.061 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183623 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4296704~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.061 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:27.061 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.252662333, 2024-09-11T05:34:27.061 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038730705999999997, 2024-09-11T05:34:27.061 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.061 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.061 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183623 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.062 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:27.063 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.063 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.063 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.063 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:27.063 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.39e-07 2024-09-11T05:34:27.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.063 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.063 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.063 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745665+0000", 2024-09-11T05:34:27.063 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9860000000000001e-06 2024-09-11T05:34:27.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.063 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.064 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745671+0000", 2024-09-11T05:34:27.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.818e-06 2024-09-11T05:34:27.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.064 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.064 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745676+0000", 2024-09-11T05:34:27.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.972e-06 2024-09-11T05:34:27.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.064 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.064 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784296+0000", 2024-09-11T05:34:27.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038620131000000002 2024-09-11T05:34:27.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.065 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.065 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.065 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784353+0000", 2024-09-11T05:34:27.065 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6644999999999997e-05 2024-09-11T05:34:27.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.065 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.065 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.065 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784394+0000", 2024-09-11T05:34:27.065 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0815000000000001e-05 2024-09-11T05:34:27.065 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183624 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7364608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.252643455999999, 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038826315, 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.066 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183624 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.067 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.068 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.068 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:27.068 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:34:27.068 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.068 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.068 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.068 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745684+0000", 2024-09-11T05:34:27.068 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0980000000000001e-06 2024-09-11T05:34:27.068 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.068 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.068 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.068 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745690+0000", 2024-09-11T05:34:27.068 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.733e-06 2024-09-11T05:34:27.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.069 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.069 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.069 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745695+0000", 2024-09-11T05:34:27.069 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:34:27.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.069 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.069 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.069 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784418+0000", 2024-09-11T05:34:27.069 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038722813000000002 2024-09-11T05:34:27.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.069 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.069 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784460+0000", 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2222999999999999e-05 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784508+0000", 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8349000000000001e-05 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183625 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4337664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.252623748, 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923776, 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183625 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.071 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.41e-07 2024-09-11T05:34:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.073 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.073 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745713+0000", 2024-09-11T05:34:27.073 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0579e-05 2024-09-11T05:34:27.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.073 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.073 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.073 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745719+0000", 2024-09-11T05:34:27.073 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4540000000000004e-06 2024-09-11T05:34:27.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.073 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.073 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.073 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745724+0000", 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1170000000000003e-06 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784532+0000", 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038807618000000002 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784586+0000", 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4432999999999999e-05 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.074 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784625+0000", 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9233999999999997e-05 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183626 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.252594086, 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038934147000000002, 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183626 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.076 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:27.077 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.077 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.077 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.077 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745732+0000", 2024-09-11T05:34:27.077 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:34:27.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.077 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.077 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.077 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745734+0000", 2024-09-11T05:34:27.077 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9649999999999998e-06 2024-09-11T05:34:27.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745739+0000", 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.806e-06 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745744+0000", 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5210000000000004e-06 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784660+0000", 2024-09-11T05:34:27.078 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038916077 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784665+0000", 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3929999999999999e-06 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183627 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.252575567999999, 2024-09-11T05:34:27.079 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038942282000000002, 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183627 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.081 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.081 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.081 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:27.081 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.081 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.081 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.081 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:27.081 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:27.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.081 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.081 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745752+0000", 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9e-06 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745758+0000", 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6899999999999997e-06 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745763+0000", 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9169999999999997e-06 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.082 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.083 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.083 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784686+0000", 2024-09-11T05:34:27.083 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923874999999997 2024-09-11T05:34:27.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.083 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.083 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.083 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784692+0000", 2024-09-11T05:34:27.083 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5600000000000001e-06 2024-09-11T05:34:27.083 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.083 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.083 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.083 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.084 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183628 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.084 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:27.084 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.252536957, 2024-09-11T05:34:27.084 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038927438000000002, 2024-09-11T05:34:27.084 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.084 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.084 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:27.084 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.084 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.084 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.084 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183628 2024-09-11T05:34:27.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.084 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.085 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.085 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.085 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:27.085 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.085 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.085 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.085 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.085 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:27.085 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.085 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.085 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.085 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745789+0000", 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3000000000000002e-07 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745791+0000", 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0209999999999998e-06 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745802+0000", 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0886e-05 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.086 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.087 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.087 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745806+0000", 2024-09-11T05:34:27.087 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0289999999999999e-06 2024-09-11T05:34:27.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.087 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.087 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784712+0000", 2024-09-11T05:34:27.087 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038905922000000003 2024-09-11T05:34:27.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.087 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.087 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784716+0000", 2024-09-11T05:34:27.087 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.25e-06 2024-09-11T05:34:27.088 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.088 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.088 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.088 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.088 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183629 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:27.088 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:27.088 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 15.252515239999999, 2024-09-11T05:34:27.088 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038954874, 2024-09-11T05:34:27.088 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.088 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.088 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:27.088 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183629 2024-09-11T05:34:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.089 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:27.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.090 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.090 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747489+0000", 2024-09-11T05:34:27.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0016785529999999999 2024-09-11T05:34:27.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.090 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.090 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747493+0000", 2024-09-11T05:34:27.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0600000000000001e-06 2024-09-11T05:34:27.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747501+0000", 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9109999999999993e-06 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747507+0000", 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3899999999999998e-06 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784760+0000", 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037253197000000002 2024-09-11T05:34:27.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.092 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.092 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.092 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784765+0000", 2024-09-11T05:34:27.092 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.763e-06 2024-09-11T05:34:27.092 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.092 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.092 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.092 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.092 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.092 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:27.094 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:27.094 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:27.093+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:27.195 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:27.193+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:27.237 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:27.237 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:27.237 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:27.237 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:27.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:27.278 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:34:27.322 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:27.321+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:27.349 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:27.349 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:27.349 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:27.349 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:27.349 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:27.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:27.397 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:27.395+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:27.401 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:27.401 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:27.418 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:27.418 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:27.434 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:27.434 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:27.449 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:27.450 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:27.450 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-11T05:34:27.462 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:27.462 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:27.462 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:27.462 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116713 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13060096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.647459251999997, 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599235, 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116713 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.463 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813321+0000", 2024-09-11T05:34:27.464 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000005e-07 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813323+0000", 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.667e-06 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813331+0000", 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6529999999999994e-06 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813336+0000", 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813688+0000", 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035143199999999999 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813692+0000", 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5120000000000002e-06 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.466 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.467 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816304+0000", 2024-09-11T05:34:27.467 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026115449999999998 2024-09-11T05:34:27.467 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.467 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.467 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.467 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816308+0000", 2024-09-11T05:34:27.467 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2370000000000003e-06 2024-09-11T05:34:27.467 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.467 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.467 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.467 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821720+0000", 2024-09-11T05:34:27.468 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0054114869999999 2024-09-11T05:34:27.468 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.468 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.468 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.468 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821724+0000", 2024-09-11T05:34:27.468 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:34:27.468 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.468 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.468 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.468 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873101+0000", 2024-09-11T05:34:27.468 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0513774279999999 2024-09-11T05:34:27.468 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.468 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.469 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.469 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873159+0000", 2024-09-11T05:34:27.469 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819000000000003e-05 2024-09-11T05:34:27.469 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.469 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.469 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.469 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873244+0000", 2024-09-11T05:34:27.469 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4300000000000003e-05 2024-09-11T05:34:27.469 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.469 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.469 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.470 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.470 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.470 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116714 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.470 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:27.470 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.647416616999998, 2024-09-11T05:34:27.470 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600505999999998, 2024-09-11T05:34:27.470 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.470 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.470 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.470 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.470 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.470 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.471 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116714 2024-09-11T05:34:27.471 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.471 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.471 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.471 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.471 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:27.471 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.471 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.471 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.472 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.472 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:27.472 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.472 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.472 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.472 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.472 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:27.472 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:34:27.472 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.472 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.472 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.473 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813366+0000", 2024-09-11T05:34:27.473 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6919999999999998e-06 2024-09-11T05:34:27.473 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.473 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.473 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.473 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813373+0000", 2024-09-11T05:34:27.473 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8689999999999998e-06 2024-09-11T05:34:27.473 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.473 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.473 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.473 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813378+0000", 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2159999999999997e-06 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813733+0000", 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035530300000000001 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813739+0000", 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8819999999999998e-06 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.474 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816340+0000", 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002600598 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816349+0000", 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9169999999999995e-06 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821745+0000", 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005396416 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.475 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.476 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.476 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821750+0000", 2024-09-11T05:34:27.476 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:34:27.476 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.476 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.476 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.476 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873269+0000", 2024-09-11T05:34:27.476 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0515195159999999 2024-09-11T05:34:27.476 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.476 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.476 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.476 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873328+0000", 2024-09-11T05:34:27.476 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9222999999999999e-05 2024-09-11T05:34:27.477 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.477 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.477 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.477 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873413+0000", 2024-09-11T05:34:27.477 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4983999999999998e-05 2024-09-11T05:34:27.477 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.477 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.477 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.477 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.477 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.477 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116715 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13109248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.477 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:27.478 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.647375136000001, 2024-09-11T05:34:27.478 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0602519180000001, 2024-09-11T05:34:27.478 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.478 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.478 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.478 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.478 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.478 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.478 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116715 2024-09-11T05:34:27.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.478 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.478 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.479 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.479 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:27.479 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.479 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.479 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.479 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:27.479 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813405+0000", 2024-09-11T05:34:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.51e-07 2024-09-11T05:34:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813407+0000", 2024-09-11T05:34:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:34:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813414+0000", 2024-09-11T05:34:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.686e-06 2024-09-11T05:34:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813419+0000", 2024-09-11T05:34:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4249999999999997e-06 2024-09-11T05:34:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813774+0000", 2024-09-11T05:34:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035460800000000002 2024-09-11T05:34:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813778+0000", 2024-09-11T05:34:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:34:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.483 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816375+0000", 2024-09-11T05:34:27.483 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025967730000000001 2024-09-11T05:34:27.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.483 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.483 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.483 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816379+0000", 2024-09-11T05:34:27.483 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3780000000000003e-06 2024-09-11T05:34:27.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.483 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.483 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.483 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821770+0000", 2024-09-11T05:34:27.483 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053903040000001 2024-09-11T05:34:27.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.484 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.484 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.484 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821774+0000", 2024-09-11T05:34:27.484 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:34:27.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.484 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.484 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.484 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873437+0000", 2024-09-11T05:34:27.484 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051663155 2024-09-11T05:34:27.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.484 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.484 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.484 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873500+0000", 2024-09-11T05:34:27.485 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3027000000000005e-05 2024-09-11T05:34:27.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.485 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.485 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.485 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873656+0000", 2024-09-11T05:34:27.485 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015580800000000001 2024-09-11T05:34:27.485 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.485 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.485 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.485 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.485 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116716 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13133824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.486 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:27.486 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.647332679000002, 2024-09-11T05:34:27.486 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0605170350000002, 2024-09-11T05:34:27.486 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.486 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.486 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.486 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.486 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.486 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.486 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116716 2024-09-11T05:34:27.486 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:27.488 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5799999999999999e-07 2024-09-11T05:34:27.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.488 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.488 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.488 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813450+0000", 2024-09-11T05:34:27.488 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7659999999999999e-06 2024-09-11T05:34:27.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.488 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.488 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.488 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813458+0000", 2024-09-11T05:34:27.488 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7430000000000002e-06 2024-09-11T05:34:27.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.489 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.489 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.489 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813464+0000", 2024-09-11T05:34:27.489 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:34:27.489 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.489 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.489 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.489 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813814+0000", 2024-09-11T05:34:27.489 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035073199999999998 2024-09-11T05:34:27.489 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.489 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.489 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:27.489 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813819+0000", 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816410+0000", 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025904349999999999 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816418+0000", 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1610000000000003e-06 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.490 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.491 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821794+0000", 2024-09-11T05:34:27.491 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005376391 2024-09-11T05:34:27.491 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.491 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.491 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.491 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821799+0000", 2024-09-11T05:34:27.491 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4870000000000004e-06 2024-09-11T05:34:27.491 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.491 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.492 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.492 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873697+0000", 2024-09-11T05:34:27.492 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051898843 2024-09-11T05:34:27.492 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.492 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.492 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.492 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873810+0000", 2024-09-11T05:34:27.492 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112187 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873964+0000", 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015412800000000001 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116717 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13158400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.647307595000001, 2024-09-11T05:34:27.493 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606806560000002, 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116717 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.495 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.495 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.495 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:27.495 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.495 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.495 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.495 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.495 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:27.495 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:34:27.495 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.495 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.495 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.495 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813474+0000", 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1830000000000001e-06 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813481+0000", 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5540000000000003e-06 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813491+0000", 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0472000000000001e-05 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813867+0000", 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00037606 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813873+0000", 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.254e-06 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816443+0000", 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025701769999999999 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816446+0000", 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821818+0000", 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053719830000001 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821823+0000", 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5560000000000001e-06 2024-09-11T05:34:27.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.499 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.499 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.499 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874006+0000", 2024-09-11T05:34:27.499 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05218342 2024-09-11T05:34:27.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.499 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.499 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.499 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874071+0000", 2024-09-11T05:34:27.499 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4369999999999995e-05 2024-09-11T05:34:27.500 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.500 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.500 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.500 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874152+0000", 2024-09-11T05:34:27.500 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1658999999999999e-05 2024-09-11T05:34:27.500 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.500 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.500 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.500 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.500 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.500 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116718 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13182976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.500 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.647276077000001, 2024-09-11T05:34:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0609185380000001, 2024-09-11T05:34:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116718 2024-09-11T05:34:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.502 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:27.502 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.502 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.502 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.502 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.502 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:27.502 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.502 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.502 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.502 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.502 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813504+0000", 2024-09-11T05:34:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7999999999999996e-07 2024-09-11T05:34:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813506+0000", 2024-09-11T05:34:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2989999999999999e-06 2024-09-11T05:34:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813513+0000", 2024-09-11T05:34:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8020000000000003e-06 2024-09-11T05:34:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813517+0000", 2024-09-11T05:34:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5639999999999998e-06 2024-09-11T05:34:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813916+0000", 2024-09-11T05:34:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039859800000000001 2024-09-11T05:34:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813922+0000", 2024-09-11T05:34:27.505 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:34:27.505 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.505 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.505 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.505 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816476+0000", 2024-09-11T05:34:27.505 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025538359999999999 2024-09-11T05:34:27.505 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.505 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.505 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.505 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816481+0000", 2024-09-11T05:34:27.505 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819999999999999e-06 2024-09-11T05:34:27.505 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.505 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821843+0000", 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053620299999999 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821848+0000", 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874191+0000", 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052342935 2024-09-11T05:34:27.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874300+0000", 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000108764 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874422+0000", 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012221399999999999 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.507 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116719 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13207552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.647235279, 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0611734350000002, 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116719 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.508 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813545+0000", 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2600000000000002e-07 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.509 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813547+0000", 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3329999999999999e-06 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813553+0000", 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4640000000000003e-06 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813558+0000", 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:34:27.510 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.511 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.511 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.511 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813952+0000", 2024-09-11T05:34:27.511 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039390999999999997 2024-09-11T05:34:27.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.511 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.511 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:27.511 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813955+0000", 2024-09-11T05:34:27.511 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.858e-06 2024-09-11T05:34:27.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.511 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.512 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.512 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816524+0000", 2024-09-11T05:34:27.512 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002568847 2024-09-11T05:34:27.512 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.512 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.512 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.512 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816533+0000", 2024-09-11T05:34:27.512 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1749999999999994e-06 2024-09-11T05:34:27.512 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.512 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.512 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.512 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821869+0000", 2024-09-11T05:34:27.513 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053358939999999 2024-09-11T05:34:27.513 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.513 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.513 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.513 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821876+0000", 2024-09-11T05:34:27.513 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:34:27.513 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.513 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874454+0000", 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052577621 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874546+0000", 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2151999999999995e-05 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874718+0000", 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017183399999999999 2024-09-11T05:34:27.514 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116720 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13232128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.647213393000001, 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0614845590000002, 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.515 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.516 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116720 2024-09-11T05:34:27.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.516 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.516 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.516 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.516 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:27.516 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.516 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.516 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.516 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:27.516 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.517 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.517 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.517 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:27.517 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5600000000000002e-07 2024-09-11T05:34:27.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.517 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.517 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.517 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813568+0000", 2024-09-11T05:34:27.517 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9089999999999998e-06 2024-09-11T05:34:27.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.517 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.517 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.517 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813573+0000", 2024-09-11T05:34:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2059999999999998e-06 2024-09-11T05:34:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813577+0000", 2024-09-11T05:34:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1489999999999996e-06 2024-09-11T05:34:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813987+0000", 2024-09-11T05:34:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040977800000000002 2024-09-11T05:34:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.518 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813992+0000", 2024-09-11T05:34:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1540000000000001e-06 2024-09-11T05:34:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816560+0000", 2024-09-11T05:34:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025680389999999998 2024-09-11T05:34:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816566+0000", 2024-09-11T05:34:27.519 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0679999999999996e-06 2024-09-11T05:34:27.520 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.520 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.520 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.520 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821907+0000", 2024-09-11T05:34:27.520 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005341735 2024-09-11T05:34:27.520 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.520 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.520 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.520 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821916+0000", 2024-09-11T05:34:27.520 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3659999999999992e-06 2024-09-11T05:34:27.520 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.520 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.520 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874760+0000", 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052844713 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874878+0000", 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000117321 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875051+0000", 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017286499999999999 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.521 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.522 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.522 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.522 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.522 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116721 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13256704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.522 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:27.522 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.647196039000001, 2024-09-11T05:34:27.522 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0616932019999998, 2024-09-11T05:34:27.522 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.522 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.522 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.522 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.522 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.522 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.523 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116721 2024-09-11T05:34:27.523 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.523 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.523 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.523 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.523 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:27.523 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.523 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.523 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.523 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.523 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:27.524 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.524 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.524 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.524 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.524 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813584+0000", 2024-09-11T05:34:27.524 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2e-07 2024-09-11T05:34:27.524 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.524 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.524 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.524 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813586+0000", 2024-09-11T05:34:27.524 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.277e-06 2024-09-11T05:34:27.525 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.525 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.525 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.525 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813592+0000", 2024-09-11T05:34:27.525 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5840000000000002e-06 2024-09-11T05:34:27.525 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.525 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.525 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.525 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813597+0000", 2024-09-11T05:34:27.525 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2839999999999997e-06 2024-09-11T05:34:27.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.526 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.526 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.526 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814028+0000", 2024-09-11T05:34:27.526 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000430689 2024-09-11T05:34:27.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.526 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.526 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:27.526 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814032+0000", 2024-09-11T05:34:27.526 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3850000000000004e-06 2024-09-11T05:34:27.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.527 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.527 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.527 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816597+0000", 2024-09-11T05:34:27.527 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00256485 2024-09-11T05:34:27.527 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.527 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.527 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.527 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816606+0000", 2024-09-11T05:34:27.527 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:34:27.527 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.527 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.527 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.527 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821949+0000", 2024-09-11T05:34:27.528 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005342752 2024-09-11T05:34:27.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.528 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.528 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.528 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821954+0000", 2024-09-11T05:34:27.528 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2270000000000001e-06 2024-09-11T05:34:27.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.528 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.528 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.528 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875095+0000", 2024-09-11T05:34:27.528 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.053140669 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875186+0000", 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1391999999999995e-05 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875277+0000", 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0556000000000005e-05 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116722 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13281280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.647159039999998, 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.061825491, 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116722 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.530 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813621+0000", 2024-09-11T05:34:27.531 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813625+0000", 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.228e-06 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813635+0000", 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5179999999999993e-06 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.532 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813641+0000", 2024-09-11T05:34:27.533 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4710000000000004e-06 2024-09-11T05:34:27.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.533 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.533 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.533 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814057+0000", 2024-09-11T05:34:27.533 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00041530099999999997 2024-09-11T05:34:27.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.533 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.533 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:27.533 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814060+0000", 2024-09-11T05:34:27.533 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-06 2024-09-11T05:34:27.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.534 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.534 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.534 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816632+0000", 2024-09-11T05:34:27.534 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00257186 2024-09-11T05:34:27.534 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.534 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.534 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.534 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816636+0000", 2024-09-11T05:34:27.534 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2150000000000003e-06 2024-09-11T05:34:27.534 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.535 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.535 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.535 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821977+0000", 2024-09-11T05:34:27.535 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053407110000001 2024-09-11T05:34:27.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.535 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.535 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.535 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821982+0000", 2024-09-11T05:34:27.535 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:34:27.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.535 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.535 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.535 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875307+0000", 2024-09-11T05:34:27.536 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0533247000000001 2024-09-11T05:34:27.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.536 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.536 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.536 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875366+0000", 2024-09-11T05:34:27.536 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8628999999999997e-05 2024-09-11T05:34:27.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.536 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.536 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.536 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875446+0000", 2024-09-11T05:34:27.536 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0026999999999998e-05 2024-09-11T05:34:27.536 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.536 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116723 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13305856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.647126061999998, 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0619630779999998, 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.537 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116723 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.538 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813654+0000", 2024-09-11T05:34:27.539 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:34:27.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.539 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.539 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.539 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813661+0000", 2024-09-11T05:34:27.539 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1890000000000001e-06 2024-09-11T05:34:27.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.539 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.539 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.539 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813675+0000", 2024-09-11T05:34:27.539 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3878e-05 2024-09-11T05:34:27.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.540 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.540 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.540 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813682+0000", 2024-09-11T05:34:27.540 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.063e-06 2024-09-11T05:34:27.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.540 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.540 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.540 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816666+0000", 2024-09-11T05:34:27.540 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029845679999999999 2024-09-11T05:34:27.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.540 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.540 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.541 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816671+0000", 2024-09-11T05:34:27.541 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:34:27.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.541 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.541 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.541 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822024+0000", 2024-09-11T05:34:27.541 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053534660000001 2024-09-11T05:34:27.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.541 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.541 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.541 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822028+0000", 2024-09-11T05:34:27.541 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7799999999999998e-06 2024-09-11T05:34:27.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.542 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.542 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.542 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875471+0000", 2024-09-11T05:34:27.542 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05344306 2024-09-11T05:34:27.542 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.542 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.542 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.542 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875531+0000", 2024-09-11T05:34:27.542 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0019000000000003e-05 2024-09-11T05:34:27.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.543 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.543 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.543 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875616+0000", 2024-09-11T05:34:27.543 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5304999999999997e-05 2024-09-11T05:34:27.543 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.543 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.543 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.544 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.544 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116724 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13330432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.544 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:27.544 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.647086573000003, 2024-09-11T05:34:27.544 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0620902609999998, 2024-09-11T05:34:27.544 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.544 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.544 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.544 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.544 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116724 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.545 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.546 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.546 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:27.546 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.99e-07 2024-09-11T05:34:27.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.546 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.546 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.546 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813697+0000", 2024-09-11T05:34:27.546 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2430000000000001e-06 2024-09-11T05:34:27.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.547 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.547 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.547 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813704+0000", 2024-09-11T05:34:27.547 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2980000000000003e-06 2024-09-11T05:34:27.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.547 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.548 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.548 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813709+0000", 2024-09-11T05:34:27.548 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8130000000000003e-06 2024-09-11T05:34:27.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.548 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.548 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.549 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816702+0000", 2024-09-11T05:34:27.549 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002992864 2024-09-11T05:34:27.549 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.549 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.549 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.549 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816711+0000", 2024-09-11T05:34:27.549 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1840000000000005e-06 2024-09-11T05:34:27.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.550 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.550 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.550 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822050+0000", 2024-09-11T05:34:27.550 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.00533864 2024-09-11T05:34:27.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.550 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.550 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.551 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822055+0000", 2024-09-11T05:34:27.551 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:34:27.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.551 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.551 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.551 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875642+0000", 2024-09-11T05:34:27.551 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0535874220000001 2024-09-11T05:34:27.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.552 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.552 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.552 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875698+0000", 2024-09-11T05:34:27.552 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5707e-05 2024-09-11T05:34:27.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.553 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.553 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.553 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875783+0000", 2024-09-11T05:34:27.553 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5362e-05 2024-09-11T05:34:27.553 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.553 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.553 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.554 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.554 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.554 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116725 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13355008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.554 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:27.554 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.647052385000002, 2024-09-11T05:34:27.554 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.06220984, 2024-09-11T05:34:27.555 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.555 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.555 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.555 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.555 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.555 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.555 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116725 2024-09-11T05:34:27.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.556 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:27.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:27.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.557 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813728+0000", 2024-09-11T05:34:27.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:34:27.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.557 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813730+0000", 2024-09-11T05:34:27.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6730000000000001e-06 2024-09-11T05:34:27.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813743+0000", 2024-09-11T05:34:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2833000000000001e-05 2024-09-11T05:34:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813749+0000", 2024-09-11T05:34:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:34:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816726+0000", 2024-09-11T05:34:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029772090000000002 2024-09-11T05:34:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.559 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.559 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816730+0000", 2024-09-11T05:34:27.559 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.518e-06 2024-09-11T05:34:27.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.559 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822074+0000", 2024-09-11T05:34:27.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053444030000001 2024-09-11T05:34:27.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822079+0000", 2024-09-11T05:34:27.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:34:27.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875807+0000", 2024-09-11T05:34:27.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0537284410000001 2024-09-11T05:34:27.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875858+0000", 2024-09-11T05:34:27.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0574000000000001e-05 2024-09-11T05:34:27.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875937+0000", 2024-09-11T05:34:27.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9268000000000001e-05 2024-09-11T05:34:27.561 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.561 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.561 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116974 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13185024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.639108548999999, 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598649249999998, 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116974 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.562 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:27.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821673+0000", 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.722e-06 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821686+0000", 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2974e-05 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821692+0000", 2024-09-11T05:34:27.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:34:27.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822089+0000", 2024-09-11T05:34:27.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039611699999999998 2024-09-11T05:34:27.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822099+0000", 2024-09-11T05:34:27.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0029e-05 2024-09-11T05:34:27.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.566 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.566 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822803+0000", 2024-09-11T05:34:27.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000704507 2024-09-11T05:34:27.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.566 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.566 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822808+0000", 2024-09-11T05:34:27.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6460000000000001e-06 2024-09-11T05:34:27.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881361+0000", 2024-09-11T05:34:27.567 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0585529680000001 2024-09-11T05:34:27.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881432+0000", 2024-09-11T05:34:27.567 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:34:27.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881536+0000", 2024-09-11T05:34:27.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000103243 2024-09-11T05:34:27.568 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.568 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.568 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.568 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116975 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13209600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.568 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:27.568 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.639080215, 2024-09-11T05:34:27.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.060124761, 2024-09-11T05:34:27.568 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.568 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.568 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.569 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.569 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.569 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.569 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116975 2024-09-11T05:34:27.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.569 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.569 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.569 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:27.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821700+0000", 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821701+0000", 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8369999999999999e-06 2024-09-11T05:34:27.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821708+0000", 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5520000000000001e-06 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821713+0000", 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.091e-06 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822135+0000", 2024-09-11T05:34:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00042166399999999998 2024-09-11T05:34:27.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822143+0000", 2024-09-11T05:34:27.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3089999999999996e-06 2024-09-11T05:34:27.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822820+0000", 2024-09-11T05:34:27.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000677145 2024-09-11T05:34:27.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822824+0000", 2024-09-11T05:34:27.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.641e-06 2024-09-11T05:34:27.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881569+0000", 2024-09-11T05:34:27.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.058744785 2024-09-11T05:34:27.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881674+0000", 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000105111 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881824+0000", 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000150197 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116976 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13234176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:27.574 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.639051236, 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0603909900000001, 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116976 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:27.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:27.576 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821729+0000", 2024-09-11T05:34:27.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:34:27.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.577 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.577 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821731+0000", 2024-09-11T05:34:27.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0250000000000001e-06 2024-09-11T05:34:27.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.577 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.577 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821737+0000", 2024-09-11T05:34:27.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8839999999999997e-06 2024-09-11T05:34:27.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821743+0000", 2024-09-11T05:34:27.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1050000000000003e-06 2024-09-11T05:34:27.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822194+0000", 2024-09-11T05:34:27.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000451574 2024-09-11T05:34:27.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822203+0000", 2024-09-11T05:34:27.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9449999999999999e-06 2024-09-11T05:34:27.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822835+0000", 2024-09-11T05:34:27.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000632019 2024-09-11T05:34:27.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822839+0000", 2024-09-11T05:34:27.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8229999999999997e-06 2024-09-11T05:34:27.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881861+0000", 2024-09-11T05:34:27.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.059021776 2024-09-11T05:34:27.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881976+0000", 2024-09-11T05:34:27.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00011531699999999999 2024-09-11T05:34:27.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882119+0000", 2024-09-11T05:34:27.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000143077 2024-09-11T05:34:27.581 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.581 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.581 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.581 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116977 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13258752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.581 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:27.581 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.639000002000003, 2024-09-11T05:34:27.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606236920000001, 2024-09-11T05:34:27.581 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.581 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.581 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.582 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.582 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.582 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.582 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116977 2024-09-11T05:34:27.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.582 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.582 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.582 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.582 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:27.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821782+0000", 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7719999999999999e-06 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821785+0000", 2024-09-11T05:34:27.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9409999999999999e-06 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821793+0000", 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821799+0000", 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4609999999999999e-06 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822246+0000", 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044669000000000002 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822254+0000", 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1859999999999992e-06 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822850+0000", 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005962340000001 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822854+0000", 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5310000000000002e-06 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882149+0000", 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0592958729999999 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882253+0000", 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104058 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.587 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.587 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882403+0000", 2024-09-11T05:34:27.587 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014958800000000001 2024-09-11T05:34:27.587 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.587 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.587 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.587 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.587 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116978 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13283328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.588 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:27.588 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.638969779, 2024-09-11T05:34:27.588 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0608297769999999, 2024-09-11T05:34:27.588 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.588 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.588 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.588 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.588 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.588 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.588 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116978 2024-09-11T05:34:27.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.588 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.588 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:34:27.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821813+0000", 2024-09-11T05:34:27.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:34:27.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821820+0000", 2024-09-11T05:34:27.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3669999999999999e-06 2024-09-11T05:34:27.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821825+0000", 2024-09-11T05:34:27.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5119999999999999e-06 2024-09-11T05:34:27.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822273+0000", 2024-09-11T05:34:27.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044727900000000003 2024-09-11T05:34:27.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822278+0000", 2024-09-11T05:34:27.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7529999999999998e-06 2024-09-11T05:34:27.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822865+0000", 2024-09-11T05:34:27.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005861579999999 2024-09-11T05:34:27.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822868+0000", 2024-09-11T05:34:27.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4659999999999999e-06 2024-09-11T05:34:27.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882434+0000", 2024-09-11T05:34:27.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0595660170000001 2024-09-11T05:34:27.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882502+0000", 2024-09-11T05:34:27.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7442999999999998e-05 2024-09-11T05:34:27.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882639+0000", 2024-09-11T05:34:27.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013779999999999999 2024-09-11T05:34:27.593 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116980 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13332480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.637430256999998, 2024-09-11T05:34:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598269180000002, 2024-09-11T05:34:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116980 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823350+0000", 2024-09-11T05:34:27.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:34:27.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823352+0000", 2024-09-11T05:34:27.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5459999999999998e-06 2024-09-11T05:34:27.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823360+0000", 2024-09-11T05:34:27.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4359999999999996e-06 2024-09-11T05:34:27.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.597 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.597 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823365+0000", 2024-09-11T05:34:27.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3079999999999998e-06 2024-09-11T05:34:27.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.597 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.597 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823418+0000", 2024-09-11T05:34:27.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2735999999999998e-05 2024-09-11T05:34:27.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823423+0000", 2024-09-11T05:34:27.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3410000000000002e-06 2024-09-11T05:34:27.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822895+0000", 2024-09-11T05:34:27.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99947249000000005 2024-09-11T05:34:27.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822899+0000", 2024-09-11T05:34:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6169999999999998e-06 2024-09-11T05:34:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882964+0000", 2024-09-11T05:34:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0600650840000001 2024-09-11T05:34:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883020+0000", 2024-09-11T05:34:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5563000000000003e-05 2024-09-11T05:34:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883176+0000", 2024-09-11T05:34:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015629500000000001 2024-09-11T05:34:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116981 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13357056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 48.637406276999997, 2024-09-11T05:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600075910000002, 2024-09-11T05:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116981 2024-09-11T05:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:27.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:27.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:27.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:27.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:27.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:27.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:27.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.01e-07 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823376+0000", 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823381+0000", 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000001e-06 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823386+0000", 2024-09-11T05:34:27.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5349999999999998e-06 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823447+0000", 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1277000000000003e-05 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823456+0000", 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8859999999999993e-06 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.604 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822914+0000", 2024-09-11T05:34:27.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99945797999999997 2024-09-11T05:34:27.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:27.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822918+0000", 2024-09-11T05:34:27.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5810000000000001e-06 2024-09-11T05:34:27.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:27.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883209+0000", 2024-09-11T05:34:27.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0602916899999999 2024-09-11T05:34:27.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883292+0000", 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2849000000000006e-05 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883381+0000", 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8585000000000007e-05 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:27.606 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:27.607 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:27.608 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:27.609 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:27.609 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:27.609 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:27.610 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:27.610 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T05:34:27.611 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:27.611 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T05:34:27.611 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:27.607+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:27.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:34:27.701 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:27.700+0000 7f77f81a9640 -1 osd.4 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T05:34:27.708 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:27.707+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:27.720 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:27.720 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:27.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:27.809 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:27.808+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:27.835 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:27.836 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:27.844 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:27.910 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:27.909+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:27.949 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:27.949 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:27.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:28.011 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:28.010+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:28.061 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:28.065 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:28.070 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:28.114 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:28.113+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:28.173 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:28.173 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:28.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:28.213 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:28.212+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:28.314 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:28.312+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:28.325 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:28.325 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:28.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:28.417 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:28.416+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:28.478 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:28.478 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:28.486 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:28.516 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:28.515+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:28.616 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:28.615+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:28.629 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:28.629 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:28.637 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:28.688 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T05:34:28.747 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:28.746+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:28.798 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:28.799 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:28.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:28.850 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:28.848+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:28.918 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:28.918+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:28.952 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:28.952 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:28.961 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:29.019 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:29.018+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:29.063 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:29.064 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:29.072 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:29.120 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:29.119+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:29.216 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:29.216 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:29.221 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:29.220+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:29.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:29.322 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:29.321+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:29.328 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:29.328 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:29.337 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:29.423 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:29.422+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:29.479 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:29.479 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:29.487 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:29.524 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:29.523+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:29.590 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:29.590 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:29.599 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:29.612 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:34:29.645 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:29.644+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:29.718 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:29.718 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:29.725 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:29.724+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:29.727 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:29.745 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:29.746 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:29.765 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:29.766 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:29.786 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:29.786 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:29.802 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:29.802 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:29.822 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:29.822 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-11T05:34:29.826 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:29.825+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:29.838 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:29.839 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:29.855 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:29.855 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:29.871 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:29.872 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:29.873 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:29.873 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:29.873 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:29.874 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:29.874 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:29.882 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:29.928 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:29.927+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:30.027 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:30.027 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:30.027 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:30.027 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:30.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.028 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183598 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8097792~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.028 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:30.028 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.283950372, 2024-09-11T05:34:30.028 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038436577999999999, 2024-09-11T05:34:30.028 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.028 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.028 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.028 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.028 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.028 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.028 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183598 2024-09-11T05:34:30.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.028 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742042+0000", 2024-09-11T05:34:30.029 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742044+0000", 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.119e-06 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742049+0000", 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6710000000000004e-06 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742054+0000", 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780385+0000", 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038330831000000003 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780435+0000", 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0018999999999997e-05 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.031 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780478+0000", 2024-09-11T05:34:30.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2823e-05 2024-09-11T05:34:30.032 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.032 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.032 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.032 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.032 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183599 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6750208~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.032 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:30.032 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.283931579000001, 2024-09-11T05:34:30.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038610453000000003, 2024-09-11T05:34:30.032 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.033 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.033 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.033 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.033 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.033 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.033 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183599 2024-09-11T05:34:30.033 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.033 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.033 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.033 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.033 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742061+0000", 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2200000000000004e-07 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.034 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.035 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742063+0000", 2024-09-11T05:34:30.035 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:34:30.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.035 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.035 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.035 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742068+0000", 2024-09-11T05:34:30.035 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6389999999999997e-06 2024-09-11T05:34:30.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.035 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.035 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.035 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742073+0000", 2024-09-11T05:34:30.035 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6990000000000002e-06 2024-09-11T05:34:30.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780516+0000", 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038443428000000002 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780601+0000", 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4618999999999997e-05 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780670+0000", 2024-09-11T05:34:30.036 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9593999999999998e-05 2024-09-11T05:34:30.037 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.037 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.037 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.037 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.037 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183600 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8138752~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.037 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:30.037 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.283912764, 2024-09-11T05:34:30.037 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038699900000000002, 2024-09-11T05:34:30.037 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.037 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.037 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.037 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.038 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.038 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.038 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183600 2024-09-11T05:34:30.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.038 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.038 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.038 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.038 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:30.038 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.038 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.038 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.039 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:30.039 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.039 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.039 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.039 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:30.039 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:34:30.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.039 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.039 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.039 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742081+0000", 2024-09-11T05:34:30.039 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.086e-06 2024-09-11T05:34:30.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.040 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.040 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.040 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742087+0000", 2024-09-11T05:34:30.040 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4770000000000002e-06 2024-09-11T05:34:30.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.040 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.040 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.040 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742092+0000", 2024-09-11T05:34:30.040 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7190000000000001e-06 2024-09-11T05:34:30.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.040 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.040 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780697+0000", 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038605577000000002 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780740+0000", 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3139999999999997e-05 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780779+0000", 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8473000000000002e-05 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.041 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183601 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6791168~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.283894735000001, 2024-09-11T05:34:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038869364000000003, 2024-09-11T05:34:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183601 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.043 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.044 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.044 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:30.044 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9900000000000002e-07 2024-09-11T05:34:30.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.044 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.044 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.044 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742099+0000", 2024-09-11T05:34:30.044 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:34:30.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.044 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.044 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.044 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742105+0000", 2024-09-11T05:34:30.044 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0759999999999999e-06 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742110+0000", 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6600000000000003e-06 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780809+0000", 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038698681999999998 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.045 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780886+0000", 2024-09-11T05:34:30.046 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7888999999999999e-05 2024-09-11T05:34:30.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.046 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.046 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.046 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780966+0000", 2024-09-11T05:34:30.046 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9797999999999997e-05 2024-09-11T05:34:30.046 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.046 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.046 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.046 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.046 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183602 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8179712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.046 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:30.047 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.283875916, 2024-09-11T05:34:30.047 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038955028000000003, 2024-09-11T05:34:30.047 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.047 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.047 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.047 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.047 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.047 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.047 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183602 2024-09-11T05:34:30.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.048 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.048 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.048 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.048 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:30.048 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.049 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.049 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.049 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:30.049 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.050 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.050 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.050 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:30.050 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:34:30.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.050 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.051 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.051 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742122+0000", 2024-09-11T05:34:30.051 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9880000000000001e-06 2024-09-11T05:34:30.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.051 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.051 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.052 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742128+0000", 2024-09-11T05:34:30.052 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2600000000000002e-06 2024-09-11T05:34:30.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.052 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.052 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.052 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742133+0000", 2024-09-11T05:34:30.053 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9010000000000002e-06 2024-09-11T05:34:30.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.056 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.057 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.057 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780981+0000", 2024-09-11T05:34:30.057 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038848102000000002 2024-09-11T05:34:30.057 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.057 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.057 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.058 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781024+0000", 2024-09-11T05:34:30.058 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2231000000000003e-05 2024-09-11T05:34:30.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.058 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.058 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.059 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781071+0000", 2024-09-11T05:34:30.059 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7215000000000001e-05 2024-09-11T05:34:30.059 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.059 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.059 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.060 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.060 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183603 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6832128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.060 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:30.060 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.283852289999999, 2024-09-11T05:34:30.060 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039121378999999998, 2024-09-11T05:34:30.060 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.061 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.061 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.061 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.061 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.061 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.062 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183603 2024-09-11T05:34:30.062 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.062 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.062 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.062 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.062 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:30.063 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.063 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.063 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.063 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:30.063 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.064 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.064 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742215+0000", 2024-09-11T05:34:30.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5419000000000004e-05 2024-09-11T05:34:30.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.065 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.065 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.065 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742218+0000", 2024-09-11T05:34:30.065 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0989999999999999e-06 2024-09-11T05:34:30.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.066 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.066 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.066 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742225+0000", 2024-09-11T05:34:30.066 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4019999999999996e-06 2024-09-11T05:34:30.066 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.066 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.067 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.067 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742231+0000", 2024-09-11T05:34:30.067 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6969999999999998e-06 2024-09-11T05:34:30.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.067 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.067 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.068 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781102+0000", 2024-09-11T05:34:30.068 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038871348 2024-09-11T05:34:30.068 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.068 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.068 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.069 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781187+0000", 2024-09-11T05:34:30.069 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4719e-05 2024-09-11T05:34:30.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.069 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.069 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.069 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781261+0000", 2024-09-11T05:34:30.070 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3695000000000005e-05 2024-09-11T05:34:30.070 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.070 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.070 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.070 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.071 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183604 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8220672~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.071 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:30.071 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.283751729999999, 2024-09-11T05:34:30.071 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039154538000000003, 2024-09-11T05:34:30.072 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.072 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.072 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.072 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.072 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.073 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.073 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183604 2024-09-11T05:34:30.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.073 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.073 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.074 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.074 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:30.074 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.074 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.074 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.075 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:30.075 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.075 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.075 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.075 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.075 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743491+0000", 2024-09-11T05:34:30.076 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0012514620000000001 2024-09-11T05:34:30.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.076 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.076 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.076 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743496+0000", 2024-09-11T05:34:30.076 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2910000000000001e-06 2024-09-11T05:34:30.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.077 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.077 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.077 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743506+0000", 2024-09-11T05:34:30.077 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0039e-05 2024-09-11T05:34:30.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.078 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.078 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.078 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743513+0000", 2024-09-11T05:34:30.078 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:34:30.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.078 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.079 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.079 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781296+0000", 2024-09-11T05:34:30.079 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037783187000000003 2024-09-11T05:34:30.079 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.079 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.079 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.080 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781347+0000", 2024-09-11T05:34:30.080 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1375000000000002e-05 2024-09-11T05:34:30.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.080 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.080 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.081 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781394+0000", 2024-09-11T05:34:30.081 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119000000000001e-05 2024-09-11T05:34:30.081 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.081 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.081 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.082 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.082 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183609 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6955008~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.082 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:30.082 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.282356875000001, 2024-09-11T05:34:30.082 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038553630999999998, 2024-09-11T05:34:30.082 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.083 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.083 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.083 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.083 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.083 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.083 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183609 2024-09-11T05:34:30.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.084 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.084 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.084 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.084 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:30.085 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.085 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.085 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.085 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.085 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:30.085 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.086 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.086 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.086 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:30.086 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.15e-07 2024-09-11T05:34:30.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743637+0000", 2024-09-11T05:34:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.86e-06 2024-09-11T05:34:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.088 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.088 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743641+0000", 2024-09-11T05:34:30.088 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7000000000000002e-06 2024-09-11T05:34:30.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.088 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.089 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.089 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743645+0000", 2024-09-11T05:34:30.089 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9600000000000002e-06 2024-09-11T05:34:30.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.089 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.089 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.090 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782023+0000", 2024-09-11T05:34:30.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038378520999999999 2024-09-11T05:34:30.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.090 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.090 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782119+0000", 2024-09-11T05:34:30.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5665e-05 2024-09-11T05:34:30.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.091 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.091 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.091 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782188+0000", 2024-09-11T05:34:30.091 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9610000000000006e-05 2024-09-11T05:34:30.091 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.091 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.091 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.092 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.092 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183610 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8343552~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.092 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:30.092 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.282343297000001, 2024-09-11T05:34:30.092 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038675859, 2024-09-11T05:34:30.092 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.092 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.093 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.093 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.093 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.093 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.093 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183610 2024-09-11T05:34:30.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.093 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.093 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.094 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.094 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:30.094 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.094 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.094 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.094 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.094 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:30.094 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.095 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.095 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.095 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743649+0000", 2024-09-11T05:34:30.095 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-07 2024-09-11T05:34:30.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.095 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.095 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.096 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743650+0000", 2024-09-11T05:34:30.096 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5799999999999999e-06 2024-09-11T05:34:30.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.096 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.096 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.096 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743656+0000", 2024-09-11T05:34:30.096 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:30.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.096 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.096 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.096 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743660+0000", 2024-09-11T05:34:30.096 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4259999999999999e-06 2024-09-11T05:34:30.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.097 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.097 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.097 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782218+0000", 2024-09-11T05:34:30.097 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038558508999999998 2024-09-11T05:34:30.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.097 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.097 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.097 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782270+0000", 2024-09-11T05:34:30.097 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.168e-05 2024-09-11T05:34:30.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.097 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.097 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.097 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782324+0000", 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4388999999999997e-05 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183611 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6995968~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.282328405000001, 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038861554999999999, 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.098 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.099 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.099 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.099 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183611 2024-09-11T05:34:30.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.099 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.099 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.099 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.099 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:30.099 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.099 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.099 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.099 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4299999999999999e-07 2024-09-11T05:34:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743665+0000", 2024-09-11T05:34:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5060000000000001e-06 2024-09-11T05:34:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743668+0000", 2024-09-11T05:34:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1549999999999999e-06 2024-09-11T05:34:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743671+0000", 2024-09-11T05:34:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7599999999999998e-06 2024-09-11T05:34:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782359+0000", 2024-09-11T05:34:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038687946000000001 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782437+0000", 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8539000000000001e-05 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782525+0000", 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7405999999999996e-05 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183612 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8384512~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.282317236000001, 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039040111000000002, 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183612 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743675+0000", 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2100000000000001e-07 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743676+0000", 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.212e-06 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743679+0000", 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743681+0000", 2024-09-11T05:34:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.604e-06 2024-09-11T05:34:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782560+0000", 2024-09-11T05:34:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038878687000000002 2024-09-11T05:34:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782644+0000", 2024-09-11T05:34:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3733000000000006e-05 2024-09-11T05:34:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782714+0000", 2024-09-11T05:34:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0655999999999996e-05 2024-09-11T05:34:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183613 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7036928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.282307202999998, 2024-09-11T05:34:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039233924000000003, 2024-09-11T05:34:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183613 2024-09-11T05:34:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745489+0000", 2024-09-11T05:34:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0018047549999999999 2024-09-11T05:34:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745493+0000", 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0439999999999997e-06 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745501+0000", 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745507+0000", 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9490000000000001e-06 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782756+0000", 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037249522 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782839+0000", 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3133999999999994e-05 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782918+0000", 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9167999999999998e-05 2024-09-11T05:34:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183622 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7323648~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.280348788000001, 2024-09-11T05:34:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038618008000000002, 2024-09-11T05:34:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183622 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4900000000000001e-07 2024-09-11T05:34:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745645+0000", 2024-09-11T05:34:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9709999999999998e-06 2024-09-11T05:34:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745651+0000", 2024-09-11T05:34:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.251e-06 2024-09-11T05:34:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745657+0000", 2024-09-11T05:34:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:34:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784095+0000", 2024-09-11T05:34:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038437791999999998 2024-09-11T05:34:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784201+0000", 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000106801 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784261+0000", 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9475999999999998e-05 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183623 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4296704~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.280328604000001, 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038730705999999997, 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183623 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.39e-07 2024-09-11T05:34:30.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745665+0000", 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9860000000000001e-06 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745671+0000", 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.818e-06 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745676+0000", 2024-09-11T05:34:30.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.972e-06 2024-09-11T05:34:30.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784296+0000", 2024-09-11T05:34:30.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038620131000000002 2024-09-11T05:34:30.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784353+0000", 2024-09-11T05:34:30.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6644999999999997e-05 2024-09-11T05:34:30.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784394+0000", 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0815000000000001e-05 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183624 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7364608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.280309726999999, 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038826315, 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.122 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.123 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.123 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.123 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183624 2024-09-11T05:34:30.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.123 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.123 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:30.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.123 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745684+0000", 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0980000000000001e-06 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745690+0000", 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.733e-06 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745695+0000", 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784418+0000", 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038722813000000002 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784460+0000", 2024-09-11T05:34:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2222999999999999e-05 2024-09-11T05:34:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784508+0000", 2024-09-11T05:34:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8349000000000001e-05 2024-09-11T05:34:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183625 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4337664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.280290018999999, 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923776, 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183625 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.128 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:30.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.128 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:30.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.128 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:30.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.41e-07 2024-09-11T05:34:30.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745713+0000", 2024-09-11T05:34:30.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0579e-05 2024-09-11T05:34:30.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745719+0000", 2024-09-11T05:34:30.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4540000000000004e-06 2024-09-11T05:34:30.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745724+0000", 2024-09-11T05:34:30.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1170000000000003e-06 2024-09-11T05:34:30.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784532+0000", 2024-09-11T05:34:30.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038807618000000002 2024-09-11T05:34:30.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784586+0000", 2024-09-11T05:34:30.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4432999999999999e-05 2024-09-11T05:34:30.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784625+0000", 2024-09-11T05:34:30.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9233999999999997e-05 2024-09-11T05:34:30.131 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.131 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.131 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.131 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183626 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.131 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:30.131 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.280260357, 2024-09-11T05:34:30.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038934147000000002, 2024-09-11T05:34:30.132 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.132 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.132 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:30.132 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.132 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.132 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.132 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183626 2024-09-11T05:34:30.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.132 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.132 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:30.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:30.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745732+0000", 2024-09-11T05:34:30.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:34:30.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745734+0000", 2024-09-11T05:34:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9649999999999998e-06 2024-09-11T05:34:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745739+0000", 2024-09-11T05:34:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.806e-06 2024-09-11T05:34:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745744+0000", 2024-09-11T05:34:30.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5210000000000004e-06 2024-09-11T05:34:30.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784660+0000", 2024-09-11T05:34:30.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038916077 2024-09-11T05:34:30.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784665+0000", 2024-09-11T05:34:30.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3929999999999999e-06 2024-09-11T05:34:30.135 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.135 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.136 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.136 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183627 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.136 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:30.136 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.280241838999999, 2024-09-11T05:34:30.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038942282000000002, 2024-09-11T05:34:30.136 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.136 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.136 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:30.136 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.136 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.136 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183627 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745752+0000", 2024-09-11T05:34:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9e-06 2024-09-11T05:34:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745758+0000", 2024-09-11T05:34:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6899999999999997e-06 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745763+0000", 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9169999999999997e-06 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784686+0000", 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923874999999997 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784692+0000", 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5600000000000001e-06 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183628 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.280203228000001, 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038927438000000002, 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:30.140 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.141 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.141 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.141 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183628 2024-09-11T05:34:30.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.141 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:30.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745789+0000", 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3000000000000002e-07 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745791+0000", 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0209999999999998e-06 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745802+0000", 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0886e-05 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745806+0000", 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0289999999999999e-06 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784712+0000", 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038905922000000003 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.144 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.144 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784716+0000", 2024-09-11T05:34:30.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.25e-06 2024-09-11T05:34:30.144 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.144 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.144 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.144 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.144 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183629 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:30.144 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:30.144 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 18.280181510999999, 2024-09-11T05:34:30.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038954874, 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183629 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747489+0000", 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0016785529999999999 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747493+0000", 2024-09-11T05:34:30.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0600000000000001e-06 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747501+0000", 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9109999999999993e-06 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747507+0000", 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3899999999999998e-06 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784760+0000", 2024-09-11T05:34:30.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037253197000000002 2024-09-11T05:34:30.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784765+0000", 2024-09-11T05:34:30.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.763e-06 2024-09-11T05:34:30.148 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.148 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.148 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.148 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.148 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.148 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:30.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:30.150 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:30.149+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:30.251 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:30.250+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:30.294 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:30.294 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:30.294 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:30.294 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:30.302 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:30.352 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:30.351+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:30.444 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:30.444 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:30.445 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:30.445 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:30.445 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:30.453 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:30.454 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:30.452+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:30.554 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:30.554+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:30.558 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:30.558 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:30.558 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:30.558 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:30.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.558 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116713 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13060096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.558 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:30.558 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.743212055999997, 2024-09-11T05:34:30.559 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599235, 2024-09-11T05:34:30.559 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.559 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.559 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.559 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.559 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.559 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.559 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116713 2024-09-11T05:34:30.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.559 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.559 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.559 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813321+0000", 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000005e-07 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813323+0000", 2024-09-11T05:34:30.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.667e-06 2024-09-11T05:34:30.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813331+0000", 2024-09-11T05:34:30.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6529999999999994e-06 2024-09-11T05:34:30.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813336+0000", 2024-09-11T05:34:30.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:34:30.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.562 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.562 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813688+0000", 2024-09-11T05:34:30.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035143199999999999 2024-09-11T05:34:30.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.562 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:30.562 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813692+0000", 2024-09-11T05:34:30.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5120000000000002e-06 2024-09-11T05:34:30.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.562 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.562 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816304+0000", 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026115449999999998 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816308+0000", 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2370000000000003e-06 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821720+0000", 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0054114869999999 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821724+0000", 2024-09-11T05:34:30.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:34:30.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873101+0000", 2024-09-11T05:34:30.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0513774279999999 2024-09-11T05:34:30.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873159+0000", 2024-09-11T05:34:30.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819000000000003e-05 2024-09-11T05:34:30.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873244+0000", 2024-09-11T05:34:30.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4300000000000003e-05 2024-09-11T05:34:30.565 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.565 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.565 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.566 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116714 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.566 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:30.566 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.743169420999997, 2024-09-11T05:34:30.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600505999999998, 2024-09-11T05:34:30.566 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.566 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.566 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.566 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.567 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.567 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.567 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116714 2024-09-11T05:34:30.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.567 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:30.567 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813366+0000", 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6919999999999998e-06 2024-09-11T05:34:30.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.569 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.569 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813373+0000", 2024-09-11T05:34:30.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8689999999999998e-06 2024-09-11T05:34:30.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813378+0000", 2024-09-11T05:34:30.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2159999999999997e-06 2024-09-11T05:34:30.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813733+0000", 2024-09-11T05:34:30.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035530300000000001 2024-09-11T05:34:30.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.570 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:30.570 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813739+0000", 2024-09-11T05:34:30.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8819999999999998e-06 2024-09-11T05:34:30.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816340+0000", 2024-09-11T05:34:30.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002600598 2024-09-11T05:34:30.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816349+0000", 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9169999999999995e-06 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821745+0000", 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005396416 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821750+0000", 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873269+0000", 2024-09-11T05:34:30.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0515195159999999 2024-09-11T05:34:30.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873328+0000", 2024-09-11T05:34:30.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9222999999999999e-05 2024-09-11T05:34:30.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873413+0000", 2024-09-11T05:34:30.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4983999999999998e-05 2024-09-11T05:34:30.573 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.574 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.574 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.574 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116715 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13109248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.574 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:30.574 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.743127940000001, 2024-09-11T05:34:30.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0602519180000001, 2024-09-11T05:34:30.574 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.575 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.575 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.575 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.575 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.575 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.575 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116715 2024-09-11T05:34:30.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.575 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.575 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:30.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.577 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:30.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.577 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.577 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813405+0000", 2024-09-11T05:34:30.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.51e-07 2024-09-11T05:34:30.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813407+0000", 2024-09-11T05:34:30.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:34:30.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813414+0000", 2024-09-11T05:34:30.578 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.686e-06 2024-09-11T05:34:30.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.578 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813419+0000", 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4249999999999997e-06 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813774+0000", 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035460800000000002 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813778+0000", 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816375+0000", 2024-09-11T05:34:30.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025967730000000001 2024-09-11T05:34:30.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816379+0000", 2024-09-11T05:34:30.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3780000000000003e-06 2024-09-11T05:34:30.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821770+0000", 2024-09-11T05:34:30.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053903040000001 2024-09-11T05:34:30.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821774+0000", 2024-09-11T05:34:30.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:34:30.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873437+0000", 2024-09-11T05:34:30.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051663155 2024-09-11T05:34:30.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873500+0000", 2024-09-11T05:34:30.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3027000000000005e-05 2024-09-11T05:34:30.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.582 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.582 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.582 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873656+0000", 2024-09-11T05:34:30.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015580800000000001 2024-09-11T05:34:30.582 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.582 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.582 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.582 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.582 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116716 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13133824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.582 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:30.583 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.743085483000002, 2024-09-11T05:34:30.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0605170350000002, 2024-09-11T05:34:30.583 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.583 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.583 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.583 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.583 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.583 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.583 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116716 2024-09-11T05:34:30.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.584 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:30.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:30.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:30.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5799999999999999e-07 2024-09-11T05:34:30.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813450+0000", 2024-09-11T05:34:30.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7659999999999999e-06 2024-09-11T05:34:30.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.585 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.585 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813458+0000", 2024-09-11T05:34:30.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7430000000000002e-06 2024-09-11T05:34:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813464+0000", 2024-09-11T05:34:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:34:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813814+0000", 2024-09-11T05:34:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035073199999999998 2024-09-11T05:34:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813819+0000", 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816410+0000", 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025904349999999999 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816418+0000", 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1610000000000003e-06 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.587 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.588 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.588 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821794+0000", 2024-09-11T05:34:30.588 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005376391 2024-09-11T05:34:30.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.588 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.588 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.588 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821799+0000", 2024-09-11T05:34:30.588 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4870000000000004e-06 2024-09-11T05:34:30.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.588 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.588 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.588 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873697+0000", 2024-09-11T05:34:30.588 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051898843 2024-09-11T05:34:30.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873810+0000", 2024-09-11T05:34:30.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112187 2024-09-11T05:34:30.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873964+0000", 2024-09-11T05:34:30.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015412800000000001 2024-09-11T05:34:30.589 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.589 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.589 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116717 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13158400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.743060399000001, 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606806560000002, 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116717 2024-09-11T05:34:30.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:34:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813474+0000", 2024-09-11T05:34:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1830000000000001e-06 2024-09-11T05:34:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813481+0000", 2024-09-11T05:34:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5540000000000003e-06 2024-09-11T05:34:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813491+0000", 2024-09-11T05:34:30.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0472000000000001e-05 2024-09-11T05:34:30.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813867+0000", 2024-09-11T05:34:30.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00037606 2024-09-11T05:34:30.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:30.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813873+0000", 2024-09-11T05:34:30.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.254e-06 2024-09-11T05:34:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816443+0000", 2024-09-11T05:34:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025701769999999999 2024-09-11T05:34:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816446+0000", 2024-09-11T05:34:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:34:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821818+0000", 2024-09-11T05:34:30.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053719830000001 2024-09-11T05:34:30.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.595 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821823+0000", 2024-09-11T05:34:30.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5560000000000001e-06 2024-09-11T05:34:30.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.595 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874006+0000", 2024-09-11T05:34:30.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05218342 2024-09-11T05:34:30.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874071+0000", 2024-09-11T05:34:30.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4369999999999995e-05 2024-09-11T05:34:30.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874152+0000", 2024-09-11T05:34:30.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1658999999999999e-05 2024-09-11T05:34:30.596 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.596 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.596 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.597 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.597 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116718 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13182976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.597 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:30.597 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.743028881000001, 2024-09-11T05:34:30.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0609185380000001, 2024-09-11T05:34:30.597 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.597 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.597 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.597 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.597 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.597 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.597 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116718 2024-09-11T05:34:30.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813504+0000", 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7999999999999996e-07 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813506+0000", 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2989999999999999e-06 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813513+0000", 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8020000000000003e-06 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.600 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813517+0000", 2024-09-11T05:34:30.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5639999999999998e-06 2024-09-11T05:34:30.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.600 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.600 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813916+0000", 2024-09-11T05:34:30.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039859800000000001 2024-09-11T05:34:30.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.600 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:30.600 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813922+0000", 2024-09-11T05:34:30.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:34:30.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.601 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816476+0000", 2024-09-11T05:34:30.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025538359999999999 2024-09-11T05:34:30.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.601 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816481+0000", 2024-09-11T05:34:30.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819999999999999e-06 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821843+0000", 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053620299999999 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821848+0000", 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.602 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874191+0000", 2024-09-11T05:34:30.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052342935 2024-09-11T05:34:30.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874300+0000", 2024-09-11T05:34:30.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000108764 2024-09-11T05:34:30.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874422+0000", 2024-09-11T05:34:30.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012221399999999999 2024-09-11T05:34:30.603 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.603 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116719 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13207552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.742988083, 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0611734350000002, 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.604 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116719 2024-09-11T05:34:30.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.605 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:30.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:30.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813545+0000", 2024-09-11T05:34:30.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2600000000000002e-07 2024-09-11T05:34:30.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813547+0000", 2024-09-11T05:34:30.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3329999999999999e-06 2024-09-11T05:34:30.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813553+0000", 2024-09-11T05:34:30.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4640000000000003e-06 2024-09-11T05:34:30.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.607 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.607 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.607 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813558+0000", 2024-09-11T05:34:30.607 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:34:30.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.607 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.607 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.607 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813952+0000", 2024-09-11T05:34:30.607 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039390999999999997 2024-09-11T05:34:30.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.607 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.607 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:30.608 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813955+0000", 2024-09-11T05:34:30.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.858e-06 2024-09-11T05:34:30.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.608 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.608 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.608 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816524+0000", 2024-09-11T05:34:30.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002568847 2024-09-11T05:34:30.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.608 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.608 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.608 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816533+0000", 2024-09-11T05:34:30.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1749999999999994e-06 2024-09-11T05:34:30.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.609 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.609 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.609 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821869+0000", 2024-09-11T05:34:30.609 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053358939999999 2024-09-11T05:34:30.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.609 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.609 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.609 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821876+0000", 2024-09-11T05:34:30.609 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:34:30.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.609 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.609 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.609 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874454+0000", 2024-09-11T05:34:30.610 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052577621 2024-09-11T05:34:30.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.610 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.610 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.610 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874546+0000", 2024-09-11T05:34:30.610 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2151999999999995e-05 2024-09-11T05:34:30.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.610 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.610 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.610 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874718+0000", 2024-09-11T05:34:30.610 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017183399999999999 2024-09-11T05:34:30.610 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.610 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116720 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13232128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.742966197000001, 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0614845590000002, 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.611 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116720 2024-09-11T05:34:30.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.612 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.612 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.612 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.612 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:30.612 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.612 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.612 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.612 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:30.612 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5600000000000002e-07 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813568+0000", 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9089999999999998e-06 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813573+0000", 2024-09-11T05:34:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2059999999999998e-06 2024-09-11T05:34:30.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.614 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.614 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.614 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813577+0000", 2024-09-11T05:34:30.614 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1489999999999996e-06 2024-09-11T05:34:30.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.614 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.614 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.614 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813987+0000", 2024-09-11T05:34:30.614 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040977800000000002 2024-09-11T05:34:30.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.614 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.614 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813992+0000", 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1540000000000001e-06 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816560+0000", 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025680389999999998 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816566+0000", 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0679999999999996e-06 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821907+0000", 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005341735 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821916+0000", 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3659999999999992e-06 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874760+0000", 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052844713 2024-09-11T05:34:30.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.617 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.617 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874878+0000", 2024-09-11T05:34:30.617 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000117321 2024-09-11T05:34:30.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.617 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.617 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875051+0000", 2024-09-11T05:34:30.617 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017286499999999999 2024-09-11T05:34:30.617 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.617 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.617 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116721 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13256704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.742948843000001, 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0616932019999998, 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116721 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.618 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813584+0000", 2024-09-11T05:34:30.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2e-07 2024-09-11T05:34:30.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.620 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.620 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813586+0000", 2024-09-11T05:34:30.620 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.277e-06 2024-09-11T05:34:30.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.620 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.620 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813592+0000", 2024-09-11T05:34:30.620 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5840000000000002e-06 2024-09-11T05:34:30.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.620 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813597+0000", 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2839999999999997e-06 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814028+0000", 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000430689 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814032+0000", 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3850000000000004e-06 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.622 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816597+0000", 2024-09-11T05:34:30.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00256485 2024-09-11T05:34:30.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.622 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816606+0000", 2024-09-11T05:34:30.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:34:30.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.622 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821949+0000", 2024-09-11T05:34:30.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005342752 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821954+0000", 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2270000000000001e-06 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875095+0000", 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.053140669 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875186+0000", 2024-09-11T05:34:30.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1391999999999995e-05 2024-09-11T05:34:30.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.624 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.624 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875277+0000", 2024-09-11T05:34:30.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0556000000000005e-05 2024-09-11T05:34:30.624 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.624 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.624 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.624 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116722 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13281280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.624 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:30.625 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.742911843999998, 2024-09-11T05:34:30.625 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.061825491, 2024-09-11T05:34:30.625 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.625 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.625 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.625 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.625 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.625 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.625 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116722 2024-09-11T05:34:30.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.625 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.625 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.625 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813621+0000", 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813625+0000", 2024-09-11T05:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.228e-06 2024-09-11T05:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813635+0000", 2024-09-11T05:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5179999999999993e-06 2024-09-11T05:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813641+0000", 2024-09-11T05:34:30.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4710000000000004e-06 2024-09-11T05:34:30.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814057+0000", 2024-09-11T05:34:30.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00041530099999999997 2024-09-11T05:34:30.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:30.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814060+0000", 2024-09-11T05:34:30.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-06 2024-09-11T05:34:30.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816632+0000", 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00257186 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816636+0000", 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2150000000000003e-06 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821977+0000", 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053407110000001 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821982+0000", 2024-09-11T05:34:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:34:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875307+0000", 2024-09-11T05:34:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0533247000000001 2024-09-11T05:34:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875366+0000", 2024-09-11T05:34:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8628999999999997e-05 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875446+0000", 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0026999999999998e-05 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116723 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13305856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.742878865999998, 2024-09-11T05:34:30.631 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0619630779999998, 2024-09-11T05:34:30.632 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.632 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.632 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.632 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.632 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.632 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.632 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116723 2024-09-11T05:34:30.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.632 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:30.632 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813654+0000", 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813661+0000", 2024-09-11T05:34:30.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1890000000000001e-06 2024-09-11T05:34:30.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813675+0000", 2024-09-11T05:34:30.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3878e-05 2024-09-11T05:34:30.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813682+0000", 2024-09-11T05:34:30.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.063e-06 2024-09-11T05:34:30.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816666+0000", 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029845679999999999 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816671+0000", 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822024+0000", 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053534660000001 2024-09-11T05:34:30.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.636 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822028+0000", 2024-09-11T05:34:30.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7799999999999998e-06 2024-09-11T05:34:30.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.636 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875471+0000", 2024-09-11T05:34:30.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05344306 2024-09-11T05:34:30.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.636 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875531+0000", 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0019000000000003e-05 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875616+0000", 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5304999999999997e-05 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116724 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13330432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:30.637 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.742839377000003, 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0620902609999998, 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116724 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:30.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.99e-07 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.639 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813697+0000", 2024-09-11T05:34:30.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2430000000000001e-06 2024-09-11T05:34:30.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.640 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.640 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813704+0000", 2024-09-11T05:34:30.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2980000000000003e-06 2024-09-11T05:34:30.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.640 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.640 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813709+0000", 2024-09-11T05:34:30.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8130000000000003e-06 2024-09-11T05:34:30.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816702+0000", 2024-09-11T05:34:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002992864 2024-09-11T05:34:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816711+0000", 2024-09-11T05:34:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1840000000000005e-06 2024-09-11T05:34:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822050+0000", 2024-09-11T05:34:30.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.00533864 2024-09-11T05:34:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822055+0000", 2024-09-11T05:34:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:34:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875642+0000", 2024-09-11T05:34:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0535874220000001 2024-09-11T05:34:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875698+0000", 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5707e-05 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875783+0000", 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5362e-05 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116725 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13355008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.643 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:30.644 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.742805189000002, 2024-09-11T05:34:30.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.06220984, 2024-09-11T05:34:30.644 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.644 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.644 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.644 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.644 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.644 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.644 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116725 2024-09-11T05:34:30.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.644 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:30.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:30.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813728+0000", 2024-09-11T05:34:30.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:34:30.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813730+0000", 2024-09-11T05:34:30.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6730000000000001e-06 2024-09-11T05:34:30.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813743+0000", 2024-09-11T05:34:30.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2833000000000001e-05 2024-09-11T05:34:30.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813749+0000", 2024-09-11T05:34:30.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:34:30.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816726+0000", 2024-09-11T05:34:30.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029772090000000002 2024-09-11T05:34:30.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816730+0000", 2024-09-11T05:34:30.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.518e-06 2024-09-11T05:34:30.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822074+0000", 2024-09-11T05:34:30.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053444030000001 2024-09-11T05:34:30.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822079+0000", 2024-09-11T05:34:30.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:34:30.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875807+0000", 2024-09-11T05:34:30.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0537284410000001 2024-09-11T05:34:30.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875858+0000", 2024-09-11T05:34:30.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0574000000000001e-05 2024-09-11T05:34:30.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875937+0000", 2024-09-11T05:34:30.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9268000000000001e-05 2024-09-11T05:34:30.649 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.649 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.650 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.650 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116974 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13185024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.650 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:30.650 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.734861352999999, 2024-09-11T05:34:30.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598649249999998, 2024-09-11T05:34:30.650 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.650 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.650 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.650 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.650 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.650 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.651 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116974 2024-09-11T05:34:30.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.651 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:30.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:30.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:30.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:34:30.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821673+0000", 2024-09-11T05:34:30.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.722e-06 2024-09-11T05:34:30.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821686+0000", 2024-09-11T05:34:30.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2974e-05 2024-09-11T05:34:30.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821692+0000", 2024-09-11T05:34:30.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:34:30.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822089+0000", 2024-09-11T05:34:30.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039611699999999998 2024-09-11T05:34:30.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822099+0000", 2024-09-11T05:34:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0029e-05 2024-09-11T05:34:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822803+0000", 2024-09-11T05:34:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000704507 2024-09-11T05:34:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822808+0000", 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6460000000000001e-06 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881361+0000", 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0585529680000001 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881432+0000", 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881536+0000", 2024-09-11T05:34:30.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000103243 2024-09-11T05:34:30.656 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.656 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.656 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.656 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116975 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13209600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.656 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:30.656 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.734833019, 2024-09-11T05:34:30.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.060124761, 2024-09-11T05:34:30.656 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.656 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.657 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.657 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.657 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.657 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.657 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116975 2024-09-11T05:34:30.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.657 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:30.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821700+0000", 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821701+0000", 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8369999999999999e-06 2024-09-11T05:34:30.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821708+0000", 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5520000000000001e-06 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821713+0000", 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.091e-06 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822135+0000", 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00042166399999999998 2024-09-11T05:34:30.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822143+0000", 2024-09-11T05:34:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3089999999999996e-06 2024-09-11T05:34:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822820+0000", 2024-09-11T05:34:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000677145 2024-09-11T05:34:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822824+0000", 2024-09-11T05:34:30.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.641e-06 2024-09-11T05:34:30.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881569+0000", 2024-09-11T05:34:30.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.058744785 2024-09-11T05:34:30.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881674+0000", 2024-09-11T05:34:30.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000105111 2024-09-11T05:34:30.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881824+0000", 2024-09-11T05:34:30.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000150197 2024-09-11T05:34:30.662 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.662 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.662 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.662 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116976 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13234176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.662 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:30.662 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.73480404, 2024-09-11T05:34:30.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0603909900000001, 2024-09-11T05:34:30.662 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116976 2024-09-11T05:34:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821729+0000", 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821731+0000", 2024-09-11T05:34:30.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0250000000000001e-06 2024-09-11T05:34:30.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821737+0000", 2024-09-11T05:34:30.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8839999999999997e-06 2024-09-11T05:34:30.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.668 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821743+0000", 2024-09-11T05:34:30.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1050000000000003e-06 2024-09-11T05:34:30.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.668 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.668 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822194+0000", 2024-09-11T05:34:30.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000451574 2024-09-11T05:34:30.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822203+0000", 2024-09-11T05:34:30.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9449999999999999e-06 2024-09-11T05:34:30.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822835+0000", 2024-09-11T05:34:30.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000632019 2024-09-11T05:34:30.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822839+0000", 2024-09-11T05:34:30.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8229999999999997e-06 2024-09-11T05:34:30.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881861+0000", 2024-09-11T05:34:30.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.059021776 2024-09-11T05:34:30.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881976+0000", 2024-09-11T05:34:30.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00011531699999999999 2024-09-11T05:34:30.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882119+0000", 2024-09-11T05:34:30.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000143077 2024-09-11T05:34:30.671 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.671 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.671 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116977 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13258752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.734752806000003, 2024-09-11T05:34:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606236920000001, 2024-09-11T05:34:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116977 2024-09-11T05:34:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.673 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:30.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:30.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821782+0000", 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7719999999999999e-06 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821785+0000", 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9409999999999999e-06 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821793+0000", 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821799+0000", 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4609999999999999e-06 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822246+0000", 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044669000000000002 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822254+0000", 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1859999999999992e-06 2024-09-11T05:34:30.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822850+0000", 2024-09-11T05:34:30.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005962340000001 2024-09-11T05:34:30.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822854+0000", 2024-09-11T05:34:30.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5310000000000002e-06 2024-09-11T05:34:30.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882149+0000", 2024-09-11T05:34:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0592958729999999 2024-09-11T05:34:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882253+0000", 2024-09-11T05:34:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104058 2024-09-11T05:34:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882403+0000", 2024-09-11T05:34:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014958800000000001 2024-09-11T05:34:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116978 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13283328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.734722583, 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0608297769999999, 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.678 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116978 2024-09-11T05:34:30.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.679 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:30.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:30.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:30.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:34:30.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821813+0000", 2024-09-11T05:34:30.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:34:30.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821820+0000", 2024-09-11T05:34:30.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3669999999999999e-06 2024-09-11T05:34:30.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821825+0000", 2024-09-11T05:34:30.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5119999999999999e-06 2024-09-11T05:34:30.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822273+0000", 2024-09-11T05:34:30.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044727900000000003 2024-09-11T05:34:30.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822278+0000", 2024-09-11T05:34:30.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7529999999999998e-06 2024-09-11T05:34:30.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822865+0000", 2024-09-11T05:34:30.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005861579999999 2024-09-11T05:34:30.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822868+0000", 2024-09-11T05:34:30.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4659999999999999e-06 2024-09-11T05:34:30.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882434+0000", 2024-09-11T05:34:30.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0595660170000001 2024-09-11T05:34:30.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882502+0000", 2024-09-11T05:34:30.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7442999999999998e-05 2024-09-11T05:34:30.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882639+0000", 2024-09-11T05:34:30.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013779999999999999 2024-09-11T05:34:30.684 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.684 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.684 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.684 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116980 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13332480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.684 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:30.684 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.733183060999998, 2024-09-11T05:34:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598269180000002, 2024-09-11T05:34:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116980 2024-09-11T05:34:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823350+0000", 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823352+0000", 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5459999999999998e-06 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823360+0000", 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4359999999999996e-06 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823365+0000", 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3079999999999998e-06 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823418+0000", 2024-09-11T05:34:30.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2735999999999998e-05 2024-09-11T05:34:30.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823423+0000", 2024-09-11T05:34:30.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3410000000000002e-06 2024-09-11T05:34:30.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822895+0000", 2024-09-11T05:34:30.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99947249000000005 2024-09-11T05:34:30.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822899+0000", 2024-09-11T05:34:30.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6169999999999998e-06 2024-09-11T05:34:30.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882964+0000", 2024-09-11T05:34:30.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0600650840000001 2024-09-11T05:34:30.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883020+0000", 2024-09-11T05:34:30.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5563000000000003e-05 2024-09-11T05:34:30.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.690 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883176+0000", 2024-09-11T05:34:30.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015629500000000001 2024-09-11T05:34:30.690 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.690 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.690 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.690 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116981 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13357056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.733159080999997, 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600075910000002, 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116981 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.691 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.01e-07 2024-09-11T05:34:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:30.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823376+0000", 2024-09-11T05:34:30.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:34:30.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:30.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823381+0000", 2024-09-11T05:34:30.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000001e-06 2024-09-11T05:34:30.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:30.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823386+0000", 2024-09-11T05:34:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5349999999999998e-06 2024-09-11T05:34:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823447+0000", 2024-09-11T05:34:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1277000000000003e-05 2024-09-11T05:34:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823456+0000", 2024-09-11T05:34:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8859999999999993e-06 2024-09-11T05:34:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822914+0000", 2024-09-11T05:34:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99945797999999997 2024-09-11T05:34:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822918+0000", 2024-09-11T05:34:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5810000000000001e-06 2024-09-11T05:34:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883209+0000", 2024-09-11T05:34:30.695 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0602916899999999 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883292+0000", 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2849000000000006e-05 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883381+0000", 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8585000000000007e-05 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:30.697 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:30.697 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:30.698 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:30.699 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:30.696+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:30.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:34:30.798 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:30.797+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:30.806 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:30.807 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:30.807 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:30.807 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:30.816 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:30.900 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:30.899+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:30.960 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:30.960 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:30.960 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:30.960 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:30.960 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:30.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:31.009 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:31.008+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:31.100 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:31.100+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:31.113 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:31.113 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:31.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:31.113 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:31.113 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.113 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:34:31.113 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:31.113 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.463192710000001, 2024-09-11T05:34:31.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:34:31.113 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:34:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:34:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:34:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:34:31.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.116 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:34:31.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:34:31.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.116 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:34:31.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:34:31.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.118 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:31.118 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:34:31.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:34:31.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.118 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:31.118 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:34:31.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:34:31.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.118 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:31.118 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:34:31.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:146253 3.6 3:64dbadcf:::rbd_data.112d55d87bfc.0000000000000332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 45.274377801999997, 2024-09-11T05:34:31.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4166483809999999, 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 146253 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:31.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837090+0000", 2024-09-11T05:34:31.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.73e-06 2024-09-11T05:34:31.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837096+0000", 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3500000000000002e-06 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837115+0000", 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8556e-05 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837124+0000", 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6739999999999992e-06 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837184+0000", 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9960000000000002e-05 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837188+0000", 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840481+0000", 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032924080000000001 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840497+0000", 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6140000000000001e-05 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850737+0000", 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0102404119999999 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850747+0000", 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7969999999999995e-06 2024-09-11T05:34:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252495+0000", 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.401748131 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252636+0000", 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014118900000000001 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252737+0000", 2024-09-11T05:34:31.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00010058 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253433+0000", 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00069601999999999999 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253604+0000", 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000170824 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:31.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253649+0000", 2024-09-11T05:34:31.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5050999999999999e-05 2024-09-11T05:34:31.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253736+0000", 2024-09-11T05:34:31.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7509000000000005e-05 2024-09-11T05:34:31.127 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.127 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.127 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.127 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:147298 3.6 3:652e51de:::rbd_data.112d55d87bfc.0000000000000377:head [set-alloc-hint object_size 262144 write_size 262144,write 122880~2839] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-11T05:34:31.127 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 41.877837225999997, 2024-09-11T05:34:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62981612099999995, 2024-09-11T05:34:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 147298 2024-09-11T05:34:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:31.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:31.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233630+0000", 2024-09-11T05:34:31.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5489999999999999e-06 2024-09-11T05:34:31.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233637+0000", 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.272e-06 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233654+0000", 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6283999999999999e-05 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233662+0000", 2024-09-11T05:34:31.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.875e-06 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233723+0000", 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1501000000000006e-05 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233732+0000", 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0699999999999996e-06 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862055+0000", 2024-09-11T05:34:31.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62832274799999999 2024-09-11T05:34:31.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.132 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.132 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862219+0000", 2024-09-11T05:34:31.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016404899999999999 2024-09-11T05:34:31.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.132 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:31.132 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862313+0000", 2024-09-11T05:34:31.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4105999999999997e-05 2024-09-11T05:34:31.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:31.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862981+0000", 2024-09-11T05:34:31.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00066744199999999997 2024-09-11T05:34:31.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:31.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863382+0000", 2024-09-11T05:34:31.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040111200000000002 2024-09-11T05:34:31.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:31.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863419+0000", 2024-09-11T05:34:31.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6974000000000002e-05 2024-09-11T05:34:31.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863445+0000", 2024-09-11T05:34:31.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6139000000000002e-05 2024-09-11T05:34:31.134 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.134 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.134 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.134 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151292 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.134 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:31.134 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155185830999997, 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054346481000000002, 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151292 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:31.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.136 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956283+0000", 2024-09-11T05:34:31.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2450000000000001e-06 2024-09-11T05:34:31.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956290+0000", 2024-09-11T05:34:31.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0910000000000004e-06 2024-09-11T05:34:31.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956296+0000", 2024-09-11T05:34:31.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.947e-06 2024-09-11T05:34:31.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010460+0000", 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054164165 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010537+0000", 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6965000000000006e-05 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010626+0000", 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9628000000000003e-05 2024-09-11T05:34:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151293 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1933312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155162988000001, 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054563858999999999, 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.139 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.140 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151293 2024-09-11T05:34:31.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.140 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.140 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:31.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.140 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:31.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.46e-07 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956306+0000", 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2259999999999999e-06 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956312+0000", 2024-09-11T05:34:31.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:34:31.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956317+0000", 2024-09-11T05:34:31.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:34:31.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010671+0000", 2024-09-11T05:34:31.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054353830999999998 2024-09-11T05:34:31.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010757+0000", 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6120999999999998e-05 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010867+0000", 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000109687 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151294 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2179072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.143 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155141125999997, 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054741825000000001, 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151294 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:31.145 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.145 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.145 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:31.145 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.145 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.145 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:31.145 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.84e-07 2024-09-11T05:34:31.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956326+0000", 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.483e-06 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956330+0000", 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8519999999999997e-06 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956334+0000", 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4139999999999998e-06 2024-09-11T05:34:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010894+0000", 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054560243000000001 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010970+0000", 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6138999999999997e-05 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011067+0000", 2024-09-11T05:34:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6409999999999993e-05 2024-09-11T05:34:31.148 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.148 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.148 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.148 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151295 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2392064~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.148 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:31.148 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155128455000003, 2024-09-11T05:34:31.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054949748999999999, 2024-09-11T05:34:31.148 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.148 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.148 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.148 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.149 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.149 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.149 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151295 2024-09-11T05:34:31.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.149 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.149 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.149 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:31.149 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.149 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.149 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956338+0000", 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.23e-07 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956339+0000", 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.243e-06 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956342+0000", 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.473e-06 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956345+0000", 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011109+0000", 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054763698999999999 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011188+0000", 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8887999999999994e-05 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011287+0000", 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9504000000000001e-05 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.152 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151296 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.153 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:31.153 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155117345000001, 2024-09-11T05:34:31.153 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055045187000000002, 2024-09-11T05:34:31.153 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.153 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.153 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.153 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.153 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.153 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.153 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151296 2024-09-11T05:34:31.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.153 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.153 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956349+0000", 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:31.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956350+0000", 2024-09-11T05:34:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:34:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956353+0000", 2024-09-11T05:34:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.016e-06 2024-09-11T05:34:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956355+0000", 2024-09-11T05:34:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5509999999999998e-06 2024-09-11T05:34:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011303+0000", 2024-09-11T05:34:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054947306000000001 2024-09-11T05:34:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011342+0000", 2024-09-11T05:34:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9057999999999998e-05 2024-09-11T05:34:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011394+0000", 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1925999999999997e-05 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151297 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2818048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155107414, 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055238158000000002, 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.157 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.158 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.158 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.158 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.158 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.158 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151297 2024-09-11T05:34:31.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.158 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.158 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.158 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:31.158 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956359+0000", 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956360+0000", 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1030000000000001e-06 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.160 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956363+0000", 2024-09-11T05:34:31.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.021e-06 2024-09-11T05:34:31.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.160 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956365+0000", 2024-09-11T05:34:31.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4770000000000002e-06 2024-09-11T05:34:31.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.160 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011425+0000", 2024-09-11T05:34:31.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055059967000000001 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011506+0000", 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1063000000000006e-05 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011597+0000", 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0299999999999999e-05 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151298 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3031040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155097447999999, 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055425825999999997, 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151298 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.162 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956369+0000", 2024-09-11T05:34:31.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4400000000000001e-07 2024-09-11T05:34:31.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.164 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.164 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956370+0000", 2024-09-11T05:34:31.164 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.068e-06 2024-09-11T05:34:31.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.164 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.164 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956373+0000", 2024-09-11T05:34:31.164 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0419999999999998e-06 2024-09-11T05:34:31.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.164 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956375+0000", 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011631+0000", 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055255116999999999 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011703+0000", 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2554999999999999e-05 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011794+0000", 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1119999999999995e-05 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151299 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3276800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155086146000002, 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055567477999999997, 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.166 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151299 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956382+0000", 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.72e-06 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956386+0000", 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0990000000000001e-06 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956390+0000", 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.318e-06 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011823+0000", 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055432976000000002 2024-09-11T05:34:31.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011882+0000", 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8656999999999998e-05 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011947+0000", 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5177000000000003e-05 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.171 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151300 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3489792~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.171 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:31.171 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155069679, 2024-09-11T05:34:31.171 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055745232999999998, 2024-09-11T05:34:31.171 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.171 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.171 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.171 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.171 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.171 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.171 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151300 2024-09-11T05:34:31.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.172 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.172 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.172 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.172 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:31.172 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.172 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.172 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.172 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:31.172 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.172 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.173 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.173 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956397+0000", 2024-09-11T05:34:31.173 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:34:31.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.173 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.173 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.173 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956398+0000", 2024-09-11T05:34:31.173 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.869e-06 2024-09-11T05:34:31.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.173 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.173 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.173 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956404+0000", 2024-09-11T05:34:31.173 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956407+0000", 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.191e-06 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011981+0000", 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055573553999999997 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.174 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012051+0000", 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9542999999999995e-05 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012141+0000", 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0845000000000002e-05 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151301 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3702784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:31.175 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155054749999998, 2024-09-11T05:34:31.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055834747999999997, 2024-09-11T05:34:31.176 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.176 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.176 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.176 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.176 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.176 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.176 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151301 2024-09-11T05:34:31.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.176 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956413+0000", 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2810000000000001e-06 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956416+0000", 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1559999999999999e-06 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956418+0000", 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.178 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012155+0000", 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055736651999999998 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012193+0000", 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7848000000000001e-05 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012246+0000", 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3041000000000003e-05 2024-09-11T05:34:31.179 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151302 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3915776~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155044646999997, 2024-09-11T05:34:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056035532999999998, 2024-09-11T05:34:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151302 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956426+0000", 2024-09-11T05:34:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.853e-06 2024-09-11T05:34:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956430+0000", 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3699999999999999e-06 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956432+0000", 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5979999999999999e-06 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012281+0000", 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055848644000000003 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012358+0000", 2024-09-11T05:34:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6662000000000006e-05 2024-09-11T05:34:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012457+0000", 2024-09-11T05:34:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9197999999999995e-05 2024-09-11T05:34:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151303 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4128768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155030064999998, 2024-09-11T05:34:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056186709000000001, 2024-09-11T05:34:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151303 2024-09-11T05:34:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956437+0000", 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.201e-06 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956440+0000", 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-06 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956443+0000", 2024-09-11T05:34:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5909999999999998e-06 2024-09-11T05:34:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012494+0000", 2024-09-11T05:34:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056051541000000003 2024-09-11T05:34:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012558+0000", 2024-09-11T05:34:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3347000000000002e-05 2024-09-11T05:34:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012622+0000", 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4760999999999999e-05 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151304 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155020008000001, 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056360149999999998, 2024-09-11T05:34:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151304 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956447+0000", 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.153e-06 2024-09-11T05:34:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956450+0000", 2024-09-11T05:34:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9909999999999998e-06 2024-09-11T05:34:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956453+0000", 2024-09-11T05:34:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.447e-06 2024-09-11T05:34:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012660+0000", 2024-09-11T05:34:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056207510000000002 2024-09-11T05:34:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012741+0000", 2024-09-11T05:34:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0734000000000003e-05 2024-09-11T05:34:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012806+0000", 2024-09-11T05:34:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5087999999999998e-05 2024-09-11T05:34:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151305 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4587520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155010247, 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056476407999999999, 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151305 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956457+0000", 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.353e-06 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956460+0000", 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0060000000000001e-06 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956463+0000", 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.452e-06 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012834+0000", 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056370917999999999 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012877+0000", 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000999999999997e-05 2024-09-11T05:34:31.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012932+0000", 2024-09-11T05:34:31.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5470000000000003e-05 2024-09-11T05:34:31.198 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.198 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.198 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.198 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151306 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4800512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.198 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:31.198 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.155000266999998, 2024-09-11T05:34:31.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056579203000000002, 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151306 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:31.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:31.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.28e-07 2024-09-11T05:34:31.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956467+0000", 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.088e-06 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956470+0000", 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0240000000000002e-06 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956472+0000", 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4609999999999998e-06 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.202 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012953+0000", 2024-09-11T05:34:31.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056480524999999997 2024-09-11T05:34:31.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.202 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.202 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012994+0000", 2024-09-11T05:34:31.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1394999999999999e-05 2024-09-11T05:34:31.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.202 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.202 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013045+0000", 2024-09-11T05:34:31.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0482000000000002e-05 2024-09-11T05:34:31.202 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151307 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5013504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.154990597999998, 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056680525000000002, 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.203 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151307 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956476+0000", 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0359999999999999e-06 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956479+0000", 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8899999999999999e-06 2024-09-11T05:34:31.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956482+0000", 2024-09-11T05:34:31.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5380000000000001e-06 2024-09-11T05:34:31.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013065+0000", 2024-09-11T05:34:31.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056582983000000003 2024-09-11T05:34:31.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013104+0000", 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9119999999999998e-05 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013156+0000", 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1743999999999998e-05 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151308 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5226496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:31.207 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 37.154973267000003, 2024-09-11T05:34:31.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056772738000000003, 2024-09-11T05:34:31.208 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:31.208 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:31.208 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:31.208 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:31.208 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:31.208 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.208 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151308 2024-09-11T05:34:31.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.208 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:31.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:31.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2599999999999998e-07 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956495+0000", 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9750000000000001e-06 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956499+0000", 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5179999999999998e-06 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956502+0000", 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7530000000000002e-06 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013177+0000", 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056674536999999997 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013215+0000", 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8578999999999998e-05 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013265+0000", 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0049999999999997e-05 2024-09-11T05:34:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.212 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.212 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.212 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:31.212 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:31.212 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:31.213 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:31.212+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:31.214 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:31.314 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:31.314+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:31.318 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:31.318 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:31.318 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:31.327 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:31.415 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:31.415+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:31.471 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:31.471 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:31.471 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:31.471 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:31.471 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:31.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:31.520 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:31.520+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:31.617 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:31.616+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:31.625 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:31.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116524 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812547434000003, 2024-09-11T05:34:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344630100000001, 2024-09-11T05:34:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116524 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811270+0000", 2024-09-11T05:34:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:34:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811272+0000", 2024-09-11T05:34:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:34:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811278+0000", 2024-09-11T05:34:31.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1970000000000001e-06 2024-09-11T05:34:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811283+0000", 2024-09-11T05:34:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-09-11T05:34:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813113+0000", 2024-09-11T05:34:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001830302 2024-09-11T05:34:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813117+0000", 2024-09-11T05:34:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0810000000000004e-06 2024-09-11T05:34:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814661+0000", 2024-09-11T05:34:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015436969999999999 2024-09-11T05:34:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814667+0000", 2024-09-11T05:34:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6370000000000002e-06 2024-09-11T05:34:31.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826115+0000", 2024-09-11T05:34:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114479059999999 2024-09-11T05:34:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826123+0000", 2024-09-11T05:34:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000004e-06 2024-09-11T05:34:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845722+0000", 2024-09-11T05:34:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195993000000001 2024-09-11T05:34:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845732+0000", 2024-09-11T05:34:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T05:34:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116525 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812527551999999, 2024-09-11T05:34:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344747700000001, 2024-09-11T05:34:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116525 2024-09-11T05:34:31.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811290+0000", 2024-09-11T05:34:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:34:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811295+0000", 2024-09-11T05:34:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8969999999999999e-06 2024-09-11T05:34:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811301+0000", 2024-09-11T05:34:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4919999999999998e-06 2024-09-11T05:34:31.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811306+0000", 2024-09-11T05:34:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999998e-06 2024-09-11T05:34:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813138+0000", 2024-09-11T05:34:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001832078 2024-09-11T05:34:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813142+0000", 2024-09-11T05:34:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0380000000000001e-06 2024-09-11T05:34:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814689+0000", 2024-09-11T05:34:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546799 2024-09-11T05:34:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814695+0000", 2024-09-11T05:34:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8739999999999997e-06 2024-09-11T05:34:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826148+0000", 2024-09-11T05:34:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114527259999999 2024-09-11T05:34:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826166+0000", 2024-09-11T05:34:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7484999999999999e-05 2024-09-11T05:34:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845756+0000", 2024-09-11T05:34:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019590609 2024-09-11T05:34:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845764+0000", 2024-09-11T05:34:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7020000000000001e-06 2024-09-11T05:34:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116526 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812504754000003, 2024-09-11T05:34:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344863210000002, 2024-09-11T05:34:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116526 2024-09-11T05:34:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.640 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:34:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811315+0000", 2024-09-11T05:34:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079999999999999e-06 2024-09-11T05:34:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811320+0000", 2024-09-11T05:34:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8619999999999999e-06 2024-09-11T05:34:31.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811325+0000", 2024-09-11T05:34:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T05:34:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814736+0000", 2024-09-11T05:34:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034115780000000002 2024-09-11T05:34:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814744+0000", 2024-09-11T05:34:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5340000000000002e-06 2024-09-11T05:34:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826212+0000", 2024-09-11T05:34:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114682749999999 2024-09-11T05:34:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826225+0000", 2024-09-11T05:34:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:34:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845789+0000", 2024-09-11T05:34:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195649200000001 2024-09-11T05:34:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845798+0000", 2024-09-11T05:34:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9269999999999994e-06 2024-09-11T05:34:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116527 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812485821999999, 2024-09-11T05:34:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345095849999999, 2024-09-11T05:34:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116527 2024-09-11T05:34:31.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:34:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811334+0000", 2024-09-11T05:34:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:34:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811340+0000", 2024-09-11T05:34:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.691e-06 2024-09-11T05:34:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811345+0000", 2024-09-11T05:34:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5480000000000003e-06 2024-09-11T05:34:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814767+0000", 2024-09-11T05:34:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034223190000000001 2024-09-11T05:34:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814774+0000", 2024-09-11T05:34:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:34:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826265+0000", 2024-09-11T05:34:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114912460000001 2024-09-11T05:34:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826274+0000", 2024-09-11T05:34:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3909999999999998e-06 2024-09-11T05:34:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845831+0000", 2024-09-11T05:34:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195574080000001 2024-09-11T05:34:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845841+0000", 2024-09-11T05:34:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3610000000000007e-06 2024-09-11T05:34:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116528 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812466383, 2024-09-11T05:34:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345287679999999, 2024-09-11T05:34:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116528 2024-09-11T05:34:31.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811351+0000", 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811353+0000", 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811359+0000", 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811364+0000", 2024-09-11T05:34:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000001e-06 2024-09-11T05:34:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814795+0000", 2024-09-11T05:34:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034316569999999998 2024-09-11T05:34:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814826+0000", 2024-09-11T05:34:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0587999999999999e-05 2024-09-11T05:34:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826309+0000", 2024-09-11T05:34:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011483444 2024-09-11T05:34:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826319+0000", 2024-09-11T05:34:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6849999999999996e-06 2024-09-11T05:34:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845868+0000", 2024-09-11T05:34:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195487110000001 2024-09-11T05:34:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845879+0000", 2024-09-11T05:34:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1428e-05 2024-09-11T05:34:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116529 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812447749, 2024-09-11T05:34:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034542531, 2024-09-11T05:34:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116529 2024-09-11T05:34:31.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:31.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811371+0000", 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811377+0000", 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1580000000000002e-06 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811383+0000", 2024-09-11T05:34:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.135e-06 2024-09-11T05:34:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814851+0000", 2024-09-11T05:34:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034684690000000001 2024-09-11T05:34:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814858+0000", 2024-09-11T05:34:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6969999999999996e-06 2024-09-11T05:34:31.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826354+0000", 2024-09-11T05:34:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114962359999999 2024-09-11T05:34:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826364+0000", 2024-09-11T05:34:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0047999999999999e-05 2024-09-11T05:34:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845903+0000", 2024-09-11T05:34:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195393610000001 2024-09-11T05:34:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845912+0000", 2024-09-11T05:34:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2269999999999993e-06 2024-09-11T05:34:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.663 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116530 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812428836999999, 2024-09-11T05:34:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345557429999999, 2024-09-11T05:34:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116530 2024-09-11T05:34:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:31.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811390+0000", 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811396+0000", 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811402+0000", 2024-09-11T05:34:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:34:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814879+0000", 2024-09-11T05:34:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034769290000000001 2024-09-11T05:34:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814885+0000", 2024-09-11T05:34:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.156e-06 2024-09-11T05:34:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826389+0000", 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115041140000001 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826397+0000", 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845935+0000", 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195381370000001 2024-09-11T05:34:31.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845944+0000", 2024-09-11T05:34:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4540000000000007e-06 2024-09-11T05:34:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116531 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812408777999998, 2024-09-11T05:34:31.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345764630000001, 2024-09-11T05:34:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116531 2024-09-11T05:34:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:31.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:34:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811411+0000", 2024-09-11T05:34:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811417+0000", 2024-09-11T05:34:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:34:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811422+0000", 2024-09-11T05:34:31.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3229999999999997e-06 2024-09-11T05:34:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814906+0000", 2024-09-11T05:34:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034835389999999999 2024-09-11T05:34:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814913+0000", 2024-09-11T05:34:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309999999999996e-06 2024-09-11T05:34:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826423+0000", 2024-09-11T05:34:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115109019999999 2024-09-11T05:34:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826431+0000", 2024-09-11T05:34:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9410000000000007e-06 2024-09-11T05:34:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845975+0000", 2024-09-11T05:34:31.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019543767 2024-09-11T05:34:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845984+0000", 2024-09-11T05:34:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3530000000000001e-06 2024-09-11T05:34:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116532 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:31.675 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812388579999997, 2024-09-11T05:34:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034588131, 2024-09-11T05:34:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116532 2024-09-11T05:34:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811429+0000", 2024-09-11T05:34:31.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811431+0000", 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9910000000000001e-06 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811437+0000", 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.049e-06 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811441+0000", 2024-09-11T05:34:31.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8289999999999998e-06 2024-09-11T05:34:31.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814934+0000", 2024-09-11T05:34:31.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034927220000000002 2024-09-11T05:34:31.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814941+0000", 2024-09-11T05:34:31.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.844e-06 2024-09-11T05:34:31.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826480+0000", 2024-09-11T05:34:31.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115393260000001 2024-09-11T05:34:31.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826496+0000", 2024-09-11T05:34:31.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5406000000000001e-05 2024-09-11T05:34:31.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846008+0000", 2024-09-11T05:34:31.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.01951214 2024-09-11T05:34:31.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846016+0000", 2024-09-11T05:34:31.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4440000000000008e-06 2024-09-11T05:34:31.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.681 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.681 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116533 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.681 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:31.682 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812369025999999, 2024-09-11T05:34:31.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345994049999998, 2024-09-11T05:34:31.682 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116533 2024-09-11T05:34:31.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.682 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:31.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:31.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:31.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:31.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811450+0000", 2024-09-11T05:34:31.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0940000000000002e-06 2024-09-11T05:34:31.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811457+0000", 2024-09-11T05:34:31.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2729999999999999e-06 2024-09-11T05:34:31.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811461+0000", 2024-09-11T05:34:31.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.673e-06 2024-09-11T05:34:31.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814962+0000", 2024-09-11T05:34:31.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035012530000000002 2024-09-11T05:34:31.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814970+0000", 2024-09-11T05:34:31.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0539999999999997e-06 2024-09-11T05:34:31.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826536+0000", 2024-09-11T05:34:31.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011566049 2024-09-11T05:34:31.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826542+0000", 2024-09-11T05:34:31.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1709999999999999e-06 2024-09-11T05:34:31.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846039+0000", 2024-09-11T05:34:31.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019497168 2024-09-11T05:34:31.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846047+0000", 2024-09-11T05:34:31.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-11T05:34:31.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.687 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.687 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116534 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.687 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:31.688 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812350119000001, 2024-09-11T05:34:31.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034610979, 2024-09-11T05:34:31.688 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.688 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.688 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.688 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.688 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116534 2024-09-11T05:34:31.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.688 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:31.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:31.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:31.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:34:31.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811469+0000", 2024-09-11T05:34:31.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.871e-06 2024-09-11T05:34:31.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811475+0000", 2024-09-11T05:34:31.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1689999999999997e-06 2024-09-11T05:34:31.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811480+0000", 2024-09-11T05:34:31.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5990000000000004e-06 2024-09-11T05:34:31.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814990+0000", 2024-09-11T05:34:31.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003510876 2024-09-11T05:34:31.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814997+0000", 2024-09-11T05:34:31.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T05:34:31.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826571+0000", 2024-09-11T05:34:31.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115740230000001 2024-09-11T05:34:31.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826576+0000", 2024-09-11T05:34:31.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-11T05:34:31.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846070+0000", 2024-09-11T05:34:31.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194937660000001 2024-09-11T05:34:31.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846078+0000", 2024-09-11T05:34:31.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.038e-06 2024-09-11T05:34:31.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.702 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.703 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116535 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.703 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:31.703 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812330959999997, 2024-09-11T05:34:31.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346218060000001, 2024-09-11T05:34:31.703 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116535 2024-09-11T05:34:31.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.704 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:31.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:31.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:31.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:34:31.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811488+0000", 2024-09-11T05:34:31.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:34:31.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811495+0000", 2024-09-11T05:34:31.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3960000000000003e-06 2024-09-11T05:34:31.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811500+0000", 2024-09-11T05:34:31.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9910000000000002e-06 2024-09-11T05:34:31.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815019+0000", 2024-09-11T05:34:31.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035190479999999999 2024-09-11T05:34:31.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815025+0000", 2024-09-11T05:34:31.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2550000000000003e-06 2024-09-11T05:34:31.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826604+0000", 2024-09-11T05:34:31.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115789959999999 2024-09-11T05:34:31.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826611+0000", 2024-09-11T05:34:31.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:34:31.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846100+0000", 2024-09-11T05:34:31.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194890569999999 2024-09-11T05:34:31.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846108+0000", 2024-09-11T05:34:31.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4089999999999997e-06 2024-09-11T05:34:31.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.711 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.711 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116536 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.712 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:31.712 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812311438999998, 2024-09-11T05:34:31.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034634724, 2024-09-11T05:34:31.712 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.713 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116536 2024-09-11T05:34:31.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.713 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:31.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:31.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811506+0000", 2024-09-11T05:34:31.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:31.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811508+0000", 2024-09-11T05:34:31.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T05:34:31.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811514+0000", 2024-09-11T05:34:31.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0610000000000001e-06 2024-09-11T05:34:31.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811519+0000", 2024-09-11T05:34:31.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0340000000000004e-06 2024-09-11T05:34:31.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815049+0000", 2024-09-11T05:34:31.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035296440000000002 2024-09-11T05:34:31.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815055+0000", 2024-09-11T05:34:31.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:34:31.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826642+0000", 2024-09-11T05:34:31.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011586375 2024-09-11T05:34:31.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826649+0000", 2024-09-11T05:34:31.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-09-11T05:34:31.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846131+0000", 2024-09-11T05:34:31.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194814569999999 2024-09-11T05:34:31.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846140+0000", 2024-09-11T05:34:31.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2240000000000001e-06 2024-09-11T05:34:31.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.720 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116537 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.720 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:31.720 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812291870000003, 2024-09-11T05:34:31.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346492180000002, 2024-09-11T05:34:31.720 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116537 2024-09-11T05:34:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:31.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:31.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:31.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811532+0000", 2024-09-11T05:34:31.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:34:31.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811538+0000", 2024-09-11T05:34:31.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7259999999999996e-06 2024-09-11T05:34:31.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811543+0000", 2024-09-11T05:34:31.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.164e-06 2024-09-11T05:34:31.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815078+0000", 2024-09-11T05:34:31.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003534428 2024-09-11T05:34:31.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815086+0000", 2024-09-11T05:34:31.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8210000000000002e-06 2024-09-11T05:34:31.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826736+0000", 2024-09-11T05:34:31.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116503429999999 2024-09-11T05:34:31.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826751+0000", 2024-09-11T05:34:31.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4895999999999999e-05 2024-09-11T05:34:31.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846165+0000", 2024-09-11T05:34:31.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019413854 2024-09-11T05:34:31.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846174+0000", 2024-09-11T05:34:31.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3149999999999998e-06 2024-09-11T05:34:31.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.726 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.726 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116538 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.726 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:31.727 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812267181000003, 2024-09-11T05:34:31.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346557729999999, 2024-09-11T05:34:31.727 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.727 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116538 2024-09-11T05:34:31.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.727 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:31.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:31.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:31.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:34:31.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811552+0000", 2024-09-11T05:34:31.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2869999999999999e-06 2024-09-11T05:34:31.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811559+0000", 2024-09-11T05:34:31.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3820000000000001e-06 2024-09-11T05:34:31.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811564+0000", 2024-09-11T05:34:31.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:34:31.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815109+0000", 2024-09-11T05:34:31.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035450989999999999 2024-09-11T05:34:31.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815115+0000", 2024-09-11T05:34:31.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:31.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826780+0000", 2024-09-11T05:34:31.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116645799999999 2024-09-11T05:34:31.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826787+0000", 2024-09-11T05:34:31.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3880000000000002e-06 2024-09-11T05:34:31.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846196+0000", 2024-09-11T05:34:31.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194094069999999 2024-09-11T05:34:31.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846205+0000", 2024-09-11T05:34:31.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.884e-06 2024-09-11T05:34:31.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.734 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.734 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116539 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.734 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:31.735 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812247135, 2024-09-11T05:34:31.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346668399999999, 2024-09-11T05:34:31.735 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.735 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116539 2024-09-11T05:34:31.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.736 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:31.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:31.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:31.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:34:31.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811572+0000", 2024-09-11T05:34:31.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:34:31.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811578+0000", 2024-09-11T05:34:31.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T05:34:31.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811583+0000", 2024-09-11T05:34:31.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:34:31.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815137+0000", 2024-09-11T05:34:31.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035540210000000001 2024-09-11T05:34:31.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815144+0000", 2024-09-11T05:34:31.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5969999999999997e-06 2024-09-11T05:34:31.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826851+0000", 2024-09-11T05:34:31.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117072149999999 2024-09-11T05:34:31.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826860+0000", 2024-09-11T05:34:31.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4200000000000007e-06 2024-09-11T05:34:31.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846228+0000", 2024-09-11T05:34:31.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019368287 2024-09-11T05:34:31.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846236+0000", 2024-09-11T05:34:31.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.541e-06 2024-09-11T05:34:31.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.741 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.741 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116540 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812227710999998, 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346767830000001, 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116540 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:31.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:31.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:31.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:31.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811591+0000", 2024-09-11T05:34:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:34:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811598+0000", 2024-09-11T05:34:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T05:34:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811603+0000", 2024-09-11T05:34:31.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9470000000000002e-06 2024-09-11T05:34:31.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815168+0000", 2024-09-11T05:34:31.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035651810000000002 2024-09-11T05:34:31.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815174+0000", 2024-09-11T05:34:31.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T05:34:31.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826883+0000", 2024-09-11T05:34:31.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117088830000001 2024-09-11T05:34:31.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826891+0000", 2024-09-11T05:34:31.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7179999999999996e-06 2024-09-11T05:34:31.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846258+0000", 2024-09-11T05:34:31.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019367328 2024-09-11T05:34:31.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846266+0000", 2024-09-11T05:34:31.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4880000000000001e-06 2024-09-11T05:34:31.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.747 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.747 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116541 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.747 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:31.748 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812208417000001, 2024-09-11T05:34:31.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346837, 2024-09-11T05:34:31.748 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.748 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.748 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116541 2024-09-11T05:34:31.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.748 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:31.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:31.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811609+0000", 2024-09-11T05:34:31.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:34:31.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811611+0000", 2024-09-11T05:34:31.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8679999999999999e-06 2024-09-11T05:34:31.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811617+0000", 2024-09-11T05:34:31.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:31.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811622+0000", 2024-09-11T05:34:31.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9370000000000003e-06 2024-09-11T05:34:31.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815201+0000", 2024-09-11T05:34:31.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035788679999999998 2024-09-11T05:34:31.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815207+0000", 2024-09-11T05:34:31.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7530000000000004e-06 2024-09-11T05:34:31.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826988+0000", 2024-09-11T05:34:31.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117802300000001 2024-09-11T05:34:31.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826996+0000", 2024-09-11T05:34:31.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.259e-06 2024-09-11T05:34:31.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846285+0000", 2024-09-11T05:34:31.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192892090000001 2024-09-11T05:34:31.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846292+0000", 2024-09-11T05:34:31.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9399999999999996e-06 2024-09-11T05:34:31.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.753 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.753 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116542 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812189506999999, 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034697618, 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116542 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811628+0000", 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811629+0000", 2024-09-11T05:34:31.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8059999999999999e-06 2024-09-11T05:34:31.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811636+0000", 2024-09-11T05:34:31.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0990000000000004e-06 2024-09-11T05:34:31.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811640+0000", 2024-09-11T05:34:31.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6630000000000001e-06 2024-09-11T05:34:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815230+0000", 2024-09-11T05:34:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035897009999999998 2024-09-11T05:34:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815237+0000", 2024-09-11T05:34:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6590000000000001e-06 2024-09-11T05:34:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827019+0000", 2024-09-11T05:34:31.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011782261 2024-09-11T05:34:31.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827026+0000", 2024-09-11T05:34:31.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.605e-06 2024-09-11T05:34:31.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846317+0000", 2024-09-11T05:34:31.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192904270000001 2024-09-11T05:34:31.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846325+0000", 2024-09-11T05:34:31.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0530000000000007e-06 2024-09-11T05:34:31.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.759 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.759 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116543 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:31.759 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:31.760 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.812170833000003, 2024-09-11T05:34:31.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0347097559999998, 2024-09-11T05:34:31.760 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:31.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:31.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:31.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:31.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:31.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:31.760 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116543 2024-09-11T05:34:31.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.760 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:31.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:31.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:31.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:31.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:31.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:31.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:31.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:31.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:34:31.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:31.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811648+0000", 2024-09-11T05:34:31.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:34:31.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:31.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811654+0000", 2024-09-11T05:34:31.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T05:34:31.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:31.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811659+0000", 2024-09-11T05:34:31.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9409999999999998e-06 2024-09-11T05:34:31.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815259+0000", 2024-09-11T05:34:31.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035993980000000002 2024-09-11T05:34:31.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815265+0000", 2024-09-11T05:34:31.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-11T05:34:31.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827049+0000", 2024-09-11T05:34:31.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117836019999999 2024-09-11T05:34:31.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:31.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827056+0000", 2024-09-11T05:34:31.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3919999999999997e-06 2024-09-11T05:34:31.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:31.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846348+0000", 2024-09-11T05:34:31.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192919039999999 2024-09-11T05:34:31.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:31.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:31.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:31.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846356+0000", 2024-09-11T05:34:31.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7449999999999995e-06 2024-09-11T05:34:31.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.765 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:31.765 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:31.765 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:31.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:31.768 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T05:34:31.768 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:31.766+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:31.867 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:31.867+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:31.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:34:31.914 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:31.914 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:31.915 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:31.915 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:31.924 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:31.946 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:34:31.991 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:31.990+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:32.008 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:32.008 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:32.025 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:32.025 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:32.041 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:32.041 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:32.051 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:32.051 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:32.051 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:32.052 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:32.058 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:32.058 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:32.071 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:32.071 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:32.074 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:32.075 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:34:32.080 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:32.093 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:32.094 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:32.101 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:32.100+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:32.116 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:32.133 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:32.133 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:32.185 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:32.185+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:32.190 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:32.190 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:32.199 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:32.284 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:32.283+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:32.342 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:32.343 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:32.351 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:32.371 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:32.371+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:32.472 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:32.472+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:32.495 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:32.495 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:32.504 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:32.574 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:32.572+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:32.647 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:32.647 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:32.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:32.700 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:32.700+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:32.774 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:32.774 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:32.774 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:32.773+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:32.785 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:32.875 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:32.875+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:32.927 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:32.927 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:32.936 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:32.976 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:32.976+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:33.077 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:33.077+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:33.079 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:33.080 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:33.088 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:33.179 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:33.177+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:33.204 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:33.204 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:33.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:33.297 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:33.296+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:33.357 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:33.357 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:33.366 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:33.407 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:33.406+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:33.482 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:33.481+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:33.508 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:33.508 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:33.516 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:33.582 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:33.581+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:33.619 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:33.619 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:33.628 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:33.684 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:33.683+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:33.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:34:33.783 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:33.783 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:33.793 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:33.813 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:33.813+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:33.885 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:33.885+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:33.896 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:33.896 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:33.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:33.986 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:33.985+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:34.009 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:34.009 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:34.018 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:34.102 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:34.101+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:34.146 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:34:34.161 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:34.161 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:34.170 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:34.211 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:34.210+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:34.266 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:34.266 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:34.283 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:34.289 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:34.288+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:34.299 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:34.299 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:34.312 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:34.312 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:34.315 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:34.315 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:34.321 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:34:34.332 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:34.332 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:34:34.348 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:34.348 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:34.364 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:34.365 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:34.383 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:34.383 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:34.390 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:34.390+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:34.425 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:34.426 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:34.426 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:34.426 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:34.434 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:34:34.491 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:34.491+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:34.536 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:34.537 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:34.537 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:34.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:34:34.592 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:34.591+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:34.648 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:34.648 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:34.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:34.648 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:34:34.648 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:34.657 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:34.698 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:34.697+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:34.722 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T05:34:34.773 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:34.773 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:34.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:34.774 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:191940 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=36b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-11T05:34:34.774 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:34.772773+0000", 2024-09-11T05:34:34.774 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00062737100000000005, 2024-09-11T05:34:34.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064466000000000002, 2024-09-11T05:34:34.774 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:34.774 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:34.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-09-11T05:34:34.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:34.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:34.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:34.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 191940 2024-09-11T05:34:34.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:34.775 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:34.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:34.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:34.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:34.772773+0000", 2024-09-11T05:34:34.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:34.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:34.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:34.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:34.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:34.772773+0000", 2024-09-11T05:34:34.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:34.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:34.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:34.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:34.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:34.772774+0000", 2024-09-11T05:34:34.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0800000000000003e-07 2024-09-11T05:34:34.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:34.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:34.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:34.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:34.772777+0000", 2024-09-11T05:34:34.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.039e-06 2024-09-11T05:34:34.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:34.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:34.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:34.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:34.772784+0000", 2024-09-11T05:34:34.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1250000000000004e-06 2024-09-11T05:34:34.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:34.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:34.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:34.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:34.772788+0000", 2024-09-11T05:34:34.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.799e-06 2024-09-11T05:34:34.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:34.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:34.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:34.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:34.772821+0000", 2024-09-11T05:34:34.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2706999999999997e-05 2024-09-11T05:34:34.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:34.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:34.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:34.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:34.772860+0000", 2024-09-11T05:34:34.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9218000000000003e-05 2024-09-11T05:34:34.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:34.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:34.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:34.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:34.772959+0000", 2024-09-11T05:34:34.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8568999999999998e-05 2024-09-11T05:34:34.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:34.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:34.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:34:34.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:34.773359+0000", 2024-09-11T05:34:34.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000400009 2024-09-11T05:34:34.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:34.780 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:34.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:34.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:34.780 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:34:34.780 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 1 2024-09-11T05:34:34.780 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:34.784 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:34.794 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:34.793+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:34.895 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:34.895+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:34.929 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:34.930 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:34.938 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:34.996 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:34.995+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:35.084 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:35.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116524 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271504772, 2024-09-11T05:34:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344630100000001, 2024-09-11T05:34:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.085 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116524 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811270+0000", 2024-09-11T05:34:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:34:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811272+0000", 2024-09-11T05:34:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:34:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811278+0000", 2024-09-11T05:34:35.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1970000000000001e-06 2024-09-11T05:34:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811283+0000", 2024-09-11T05:34:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-09-11T05:34:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813113+0000", 2024-09-11T05:34:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001830302 2024-09-11T05:34:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813117+0000", 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0810000000000004e-06 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814661+0000", 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015436969999999999 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814667+0000", 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6370000000000002e-06 2024-09-11T05:34:35.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826115+0000", 2024-09-11T05:34:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114479059999999 2024-09-11T05:34:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826123+0000", 2024-09-11T05:34:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000004e-06 2024-09-11T05:34:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845722+0000", 2024-09-11T05:34:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195993000000001 2024-09-11T05:34:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845732+0000", 2024-09-11T05:34:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T05:34:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.091 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116525 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271484889999996, 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344747700000001, 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116525 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811290+0000", 2024-09-11T05:34:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:34:35.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811295+0000", 2024-09-11T05:34:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8969999999999999e-06 2024-09-11T05:34:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811301+0000", 2024-09-11T05:34:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4919999999999998e-06 2024-09-11T05:34:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811306+0000", 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999998e-06 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813138+0000", 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001832078 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813142+0000", 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0380000000000001e-06 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814689+0000", 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546799 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814695+0000", 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8739999999999997e-06 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826148+0000", 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114527259999999 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826166+0000", 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7484999999999999e-05 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845756+0000", 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019590609 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845764+0000", 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7020000000000001e-06 2024-09-11T05:34:35.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116526 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271462092, 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344863210000002, 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116526 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:34:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811315+0000", 2024-09-11T05:34:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079999999999999e-06 2024-09-11T05:34:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811320+0000", 2024-09-11T05:34:35.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8619999999999999e-06 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811325+0000", 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814736+0000", 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034115780000000002 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814744+0000", 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5340000000000002e-06 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826212+0000", 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114682749999999 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826225+0000", 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845789+0000", 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195649200000001 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845798+0000", 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9269999999999994e-06 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116527 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.103 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271443159999997, 2024-09-11T05:34:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345095849999999, 2024-09-11T05:34:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116527 2024-09-11T05:34:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811334+0000", 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811340+0000", 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.691e-06 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811345+0000", 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5480000000000003e-06 2024-09-11T05:34:35.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814767+0000", 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034223190000000001 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814774+0000", 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826265+0000", 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114912460000001 2024-09-11T05:34:35.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826274+0000", 2024-09-11T05:34:35.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3909999999999998e-06 2024-09-11T05:34:35.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845831+0000", 2024-09-11T05:34:35.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195574080000001 2024-09-11T05:34:35.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845841+0000", 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3610000000000007e-06 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116528 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271423720999998, 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345287679999999, 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.109 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116528 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811351+0000", 2024-09-11T05:34:35.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T05:34:35.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811353+0000", 2024-09-11T05:34:35.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:34:35.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811359+0000", 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811364+0000", 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000001e-06 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814795+0000", 2024-09-11T05:34:35.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034316569999999998 2024-09-11T05:34:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814826+0000", 2024-09-11T05:34:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0587999999999999e-05 2024-09-11T05:34:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826309+0000", 2024-09-11T05:34:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011483444 2024-09-11T05:34:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826319+0000", 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6849999999999996e-06 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845868+0000", 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195487110000001 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845879+0000", 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1428e-05 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.114 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.115 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116529 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.115 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:35.115 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271405086999998, 2024-09-11T05:34:35.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034542531, 2024-09-11T05:34:35.115 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116529 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:35.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:34:35.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811371+0000", 2024-09-11T05:34:35.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T05:34:35.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811377+0000", 2024-09-11T05:34:35.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1580000000000002e-06 2024-09-11T05:34:35.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811383+0000", 2024-09-11T05:34:35.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.135e-06 2024-09-11T05:34:35.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814851+0000", 2024-09-11T05:34:35.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034684690000000001 2024-09-11T05:34:35.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814858+0000", 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6969999999999996e-06 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826354+0000", 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114962359999999 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826364+0000", 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0047999999999999e-05 2024-09-11T05:34:35.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845903+0000", 2024-09-11T05:34:35.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195393610000001 2024-09-11T05:34:35.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845912+0000", 2024-09-11T05:34:35.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2269999999999993e-06 2024-09-11T05:34:35.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.120 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.121 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116530 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.121 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:35.121 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271386175000004, 2024-09-11T05:34:35.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345557429999999, 2024-09-11T05:34:35.121 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116530 2024-09-11T05:34:35.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811390+0000", 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811396+0000", 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811402+0000", 2024-09-11T05:34:35.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:34:35.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814879+0000", 2024-09-11T05:34:35.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034769290000000001 2024-09-11T05:34:35.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814885+0000", 2024-09-11T05:34:35.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.156e-06 2024-09-11T05:34:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826389+0000", 2024-09-11T05:34:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115041140000001 2024-09-11T05:34:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826397+0000", 2024-09-11T05:34:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:34:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845935+0000", 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195381370000001 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845944+0000", 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4540000000000007e-06 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116531 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.126 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271366116000003, 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345764630000001, 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116531 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:34:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811411+0000", 2024-09-11T05:34:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811417+0000", 2024-09-11T05:34:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:34:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811422+0000", 2024-09-11T05:34:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3229999999999997e-06 2024-09-11T05:34:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814906+0000", 2024-09-11T05:34:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034835389999999999 2024-09-11T05:34:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814913+0000", 2024-09-11T05:34:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309999999999996e-06 2024-09-11T05:34:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826423+0000", 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115109019999999 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826431+0000", 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9410000000000007e-06 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845975+0000", 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019543767 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845984+0000", 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3530000000000001e-06 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116532 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271345918000002, 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034588131, 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116532 2024-09-11T05:34:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811429+0000", 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811431+0000", 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9910000000000001e-06 2024-09-11T05:34:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811437+0000", 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.049e-06 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811441+0000", 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8289999999999998e-06 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814934+0000", 2024-09-11T05:34:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034927220000000002 2024-09-11T05:34:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814941+0000", 2024-09-11T05:34:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.844e-06 2024-09-11T05:34:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826480+0000", 2024-09-11T05:34:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115393260000001 2024-09-11T05:34:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826496+0000", 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5406000000000001e-05 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846008+0000", 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.01951214 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846016+0000", 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4440000000000008e-06 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116533 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271326363999997, 2024-09-11T05:34:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345994049999998, 2024-09-11T05:34:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116533 2024-09-11T05:34:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811450+0000", 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0940000000000002e-06 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811457+0000", 2024-09-11T05:34:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2729999999999999e-06 2024-09-11T05:34:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811461+0000", 2024-09-11T05:34:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.673e-06 2024-09-11T05:34:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814962+0000", 2024-09-11T05:34:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035012530000000002 2024-09-11T05:34:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814970+0000", 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0539999999999997e-06 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826536+0000", 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011566049 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826542+0000", 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1709999999999999e-06 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846039+0000", 2024-09-11T05:34:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019497168 2024-09-11T05:34:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846047+0000", 2024-09-11T05:34:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-11T05:34:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116534 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271307456999999, 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034610979, 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116534 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811469+0000", 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.871e-06 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811475+0000", 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1689999999999997e-06 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811480+0000", 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5990000000000004e-06 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814990+0000", 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003510876 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814997+0000", 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826571+0000", 2024-09-11T05:34:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115740230000001 2024-09-11T05:34:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826576+0000", 2024-09-11T05:34:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-11T05:34:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846070+0000", 2024-09-11T05:34:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194937660000001 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846078+0000", 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.038e-06 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116535 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271288298000002, 2024-09-11T05:34:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346218060000001, 2024-09-11T05:34:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116535 2024-09-11T05:34:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811488+0000", 2024-09-11T05:34:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:34:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811495+0000", 2024-09-11T05:34:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3960000000000003e-06 2024-09-11T05:34:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811500+0000", 2024-09-11T05:34:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9910000000000002e-06 2024-09-11T05:34:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815019+0000", 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035190479999999999 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815025+0000", 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2550000000000003e-06 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826604+0000", 2024-09-11T05:34:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115789959999999 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826611+0000", 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846100+0000", 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194890569999999 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846108+0000", 2024-09-11T05:34:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4089999999999997e-06 2024-09-11T05:34:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116536 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271268777000003, 2024-09-11T05:34:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034634724, 2024-09-11T05:34:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116536 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811506+0000", 2024-09-11T05:34:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811508+0000", 2024-09-11T05:34:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T05:34:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811514+0000", 2024-09-11T05:34:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0610000000000001e-06 2024-09-11T05:34:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811519+0000", 2024-09-11T05:34:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0340000000000004e-06 2024-09-11T05:34:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815049+0000", 2024-09-11T05:34:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035296440000000002 2024-09-11T05:34:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815055+0000", 2024-09-11T05:34:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:34:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826642+0000", 2024-09-11T05:34:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011586375 2024-09-11T05:34:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826649+0000", 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846131+0000", 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194814569999999 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846140+0000", 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2240000000000001e-06 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116537 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271249208, 2024-09-11T05:34:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346492180000002, 2024-09-11T05:34:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116537 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811532+0000", 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811538+0000", 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7259999999999996e-06 2024-09-11T05:34:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811543+0000", 2024-09-11T05:34:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.164e-06 2024-09-11T05:34:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815078+0000", 2024-09-11T05:34:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003534428 2024-09-11T05:34:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815086+0000", 2024-09-11T05:34:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8210000000000002e-06 2024-09-11T05:34:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826736+0000", 2024-09-11T05:34:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116503429999999 2024-09-11T05:34:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826751+0000", 2024-09-11T05:34:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4895999999999999e-05 2024-09-11T05:34:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846165+0000", 2024-09-11T05:34:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019413854 2024-09-11T05:34:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846174+0000", 2024-09-11T05:34:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3149999999999998e-06 2024-09-11T05:34:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116538 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271224519, 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346557729999999, 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116538 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:34:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811552+0000", 2024-09-11T05:34:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2869999999999999e-06 2024-09-11T05:34:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811559+0000", 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3820000000000001e-06 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811564+0000", 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815109+0000", 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035450989999999999 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815115+0000", 2024-09-11T05:34:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826780+0000", 2024-09-11T05:34:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116645799999999 2024-09-11T05:34:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826787+0000", 2024-09-11T05:34:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3880000000000002e-06 2024-09-11T05:34:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846196+0000", 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194094069999999 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846205+0000", 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.884e-06 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116539 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271204472999997, 2024-09-11T05:34:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346668399999999, 2024-09-11T05:34:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116539 2024-09-11T05:34:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811572+0000", 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811578+0000", 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811583+0000", 2024-09-11T05:34:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:34:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815137+0000", 2024-09-11T05:34:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035540210000000001 2024-09-11T05:34:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815144+0000", 2024-09-11T05:34:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5969999999999997e-06 2024-09-11T05:34:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826851+0000", 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117072149999999 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826860+0000", 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4200000000000007e-06 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846228+0000", 2024-09-11T05:34:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019368287 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846236+0000", 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.541e-06 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116540 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271185049000003, 2024-09-11T05:34:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346767830000001, 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116540 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811591+0000", 2024-09-11T05:34:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811598+0000", 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811603+0000", 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9470000000000002e-06 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815168+0000", 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035651810000000002 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815174+0000", 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826883+0000", 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117088830000001 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826891+0000", 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7179999999999996e-06 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846258+0000", 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019367328 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846266+0000", 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4880000000000001e-06 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116541 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271165754999998, 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346837, 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116541 2024-09-11T05:34:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811609+0000", 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811611+0000", 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8679999999999999e-06 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811617+0000", 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811622+0000", 2024-09-11T05:34:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9370000000000003e-06 2024-09-11T05:34:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815201+0000", 2024-09-11T05:34:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035788679999999998 2024-09-11T05:34:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815207+0000", 2024-09-11T05:34:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7530000000000004e-06 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826988+0000", 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117802300000001 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826996+0000", 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.259e-06 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846285+0000", 2024-09-11T05:34:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192892090000001 2024-09-11T05:34:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846292+0000", 2024-09-11T05:34:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9399999999999996e-06 2024-09-11T05:34:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116542 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271146844999997, 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034697618, 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116542 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811628+0000", 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811629+0000", 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8059999999999999e-06 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811636+0000", 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0990000000000004e-06 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811640+0000", 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6630000000000001e-06 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815230+0000", 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035897009999999998 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815237+0000", 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6590000000000001e-06 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827019+0000", 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011782261 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827026+0000", 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.605e-06 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846317+0000", 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192904270000001 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846325+0000", 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0530000000000007e-06 2024-09-11T05:34:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116543 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.271128171000001, 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0347097559999998, 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116543 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811648+0000", 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811654+0000", 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T05:34:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811659+0000", 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9409999999999998e-06 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815259+0000", 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035993980000000002 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815265+0000", 2024-09-11T05:34:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827049+0000", 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117836019999999 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827056+0000", 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3919999999999997e-06 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846348+0000", 2024-09-11T05:34:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192919039999999 2024-09-11T05:34:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846356+0000", 2024-09-11T05:34:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7449999999999995e-06 2024-09-11T05:34:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.203 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:35.205 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:35.205 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:35.203+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:35.306 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:35.305+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:35.308 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:35.309 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:35.309 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:35.309 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:35.318 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:35.407 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:35.406+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:35.460 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:35.460 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:35.460 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:35.460 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:35.461 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:35.469 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:35.512 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:35.512+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:35.573 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:35.573 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:35.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:35.573 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:35.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.573 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:184170 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.573 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:35.573 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.651615278000001, 2024-09-11T05:34:35.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047293133000000001, 2024-09-11T05:34:35.574 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 184170 2024-09-11T05:34:35.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.574 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:35.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:35.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921808+0000", 2024-09-11T05:34:35.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001805868 2024-09-11T05:34:35.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921819+0000", 2024-09-11T05:34:35.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0458e-05 2024-09-11T05:34:35.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921830+0000", 2024-09-11T05:34:35.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1482e-05 2024-09-11T05:34:35.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921837+0000", 2024-09-11T05:34:35.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3709999999999996e-06 2024-09-11T05:34:35.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967150+0000", 2024-09-11T05:34:35.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045313402000000003 2024-09-11T05:34:35.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967216+0000", 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6322999999999995e-05 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967296+0000", 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9228999999999996e-05 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185733 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3309568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.297582265999999, 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047365106999999997, 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185733 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:35.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:35.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275806+0000", 2024-09-11T05:34:35.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001769966 2024-09-11T05:34:35.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275810+0000", 2024-09-11T05:34:35.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5539999999999999e-06 2024-09-11T05:34:35.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275821+0000", 2024-09-11T05:34:35.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1253999999999999e-05 2024-09-11T05:34:35.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275828+0000", 2024-09-11T05:34:35.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:35.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321211+0000", 2024-09-11T05:34:35.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045383053999999999 2024-09-11T05:34:35.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321306+0000", 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4712999999999999e-05 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321401+0000", 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4825000000000001e-05 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.584 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185743 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3719168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.584 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:35.584 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.295570430000001, 2024-09-11T05:34:35.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047361001999999999, 2024-09-11T05:34:35.584 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.584 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185743 2024-09-11T05:34:35.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.584 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:35.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:35.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276048+0000", 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276050+0000", 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276056+0000", 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276061+0000", 2024-09-11T05:34:35.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T05:34:35.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323215+0000", 2024-09-11T05:34:35.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047153977999999999 2024-09-11T05:34:35.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323278+0000", 2024-09-11T05:34:35.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3053999999999996e-05 2024-09-11T05:34:35.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323408+0000", 2024-09-11T05:34:35.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013012899999999999 2024-09-11T05:34:35.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.588 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.589 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185744 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3760128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.589 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:35.589 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.295549749999999, 2024-09-11T05:34:35.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047563095, 2024-09-11T05:34:35.589 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185744 2024-09-11T05:34:35.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.590 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:35.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:35.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277808+0000", 2024-09-11T05:34:35.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001739652 2024-09-11T05:34:35.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277816+0000", 2024-09-11T05:34:35.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.208e-06 2024-09-11T05:34:35.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277829+0000", 2024-09-11T05:34:35.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2848e-05 2024-09-11T05:34:35.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277837+0000", 2024-09-11T05:34:35.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6379999999999993e-06 2024-09-11T05:34:35.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323448+0000", 2024-09-11T05:34:35.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045610604999999999 2024-09-11T05:34:35.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323562+0000", 2024-09-11T05:34:35.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113706 2024-09-11T05:34:35.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323631+0000", 2024-09-11T05:34:35.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9437999999999995e-05 2024-09-11T05:34:35.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.593 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.594 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185753 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.594 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:35.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.293586703999999, 2024-09-11T05:34:35.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047283944000000001, 2024-09-11T05:34:35.594 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185753 2024-09-11T05:34:35.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.595 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:35.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:35.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:35.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:35.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278033+0000", 2024-09-11T05:34:35.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.237e-06 2024-09-11T05:34:35.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278036+0000", 2024-09-11T05:34:35.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:34:35.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278038+0000", 2024-09-11T05:34:35.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5490000000000001e-06 2024-09-11T05:34:35.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325140+0000", 2024-09-11T05:34:35.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047101845000000003 2024-09-11T05:34:35.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325219+0000", 2024-09-11T05:34:35.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9444999999999996e-05 2024-09-11T05:34:35.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325315+0000", 2024-09-11T05:34:35.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.569e-05 2024-09-11T05:34:35.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.598 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.599 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185754 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4169728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.599 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:35.599 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.293576806000001, 2024-09-11T05:34:35.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047450697, 2024-09-11T05:34:35.599 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185754 2024-09-11T05:34:35.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.600 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:35.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:35.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278043+0000", 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278045+0000", 2024-09-11T05:34:35.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:35.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278048+0000", 2024-09-11T05:34:35.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5679999999999998e-06 2024-09-11T05:34:35.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325359+0000", 2024-09-11T05:34:35.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047311262 2024-09-11T05:34:35.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325421+0000", 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1717999999999994e-05 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325492+0000", 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0716000000000005e-05 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.604 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185755 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2125824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.605 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:35.605 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.293566738999999, 2024-09-11T05:34:35.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047669481999999999, 2024-09-11T05:34:35.605 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.605 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185755 2024-09-11T05:34:35.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.606 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:35.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:35.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:35.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:34:35.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278052+0000", 2024-09-11T05:34:35.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-11T05:34:35.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278055+0000", 2024-09-11T05:34:35.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8059999999999999e-06 2024-09-11T05:34:35.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278058+0000", 2024-09-11T05:34:35.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.503e-06 2024-09-11T05:34:35.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325563+0000", 2024-09-11T05:34:35.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047505316999999998 2024-09-11T05:34:35.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325645+0000", 2024-09-11T05:34:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2439000000000001e-05 2024-09-11T05:34:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325721+0000", 2024-09-11T05:34:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5092999999999994e-05 2024-09-11T05:34:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.610 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185756 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2166784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.610 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:35.610 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.293554408999999, 2024-09-11T05:34:35.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047861556, 2024-09-11T05:34:35.610 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.610 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.610 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.610 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.610 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.610 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.611 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185756 2024-09-11T05:34:35.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.611 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:35.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:35.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279805+0000", 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001741586 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279809+0000", 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0890000000000002e-06 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279816+0000", 2024-09-11T05:34:35.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2060000000000001e-06 2024-09-11T05:34:35.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279821+0000", 2024-09-11T05:34:35.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6709999999999998e-06 2024-09-11T05:34:35.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325764+0000", 2024-09-11T05:34:35.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045942749999999997 2024-09-11T05:34:35.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325846+0000", 2024-09-11T05:34:35.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2470000000000002e-05 2024-09-11T05:34:35.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325925+0000", 2024-09-11T05:34:35.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8783999999999997e-05 2024-09-11T05:34:35.615 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.615 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.615 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.615 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185764 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2494464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.615 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:35.616 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.291590353, 2024-09-11T05:34:35.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308594000000002, 2024-09-11T05:34:35.616 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.616 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.616 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.616 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.616 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.616 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185764 2024-09-11T05:34:35.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.616 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:35.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:35.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280028+0000", 2024-09-11T05:34:35.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.27e-07 2024-09-11T05:34:35.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280030+0000", 2024-09-11T05:34:35.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3319999999999999e-06 2024-09-11T05:34:35.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280036+0000", 2024-09-11T05:34:35.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:34:35.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280041+0000", 2024-09-11T05:34:35.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7530000000000001e-06 2024-09-11T05:34:35.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327196+0000", 2024-09-11T05:34:35.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047154967999999998 2024-09-11T05:34:35.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327266+0000", 2024-09-11T05:34:35.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0427999999999997e-05 2024-09-11T05:34:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327336+0000", 2024-09-11T05:34:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9659000000000005e-05 2024-09-11T05:34:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185765 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2535424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.291570434, 2024-09-11T05:34:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047410790000000001, 2024-09-11T05:34:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185765 2024-09-11T05:34:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:35.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:35.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280048+0000", 2024-09-11T05:34:35.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T05:34:35.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280050+0000", 2024-09-11T05:34:35.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-11T05:34:35.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280056+0000", 2024-09-11T05:34:35.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:34:35.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280061+0000", 2024-09-11T05:34:35.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T05:34:35.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327369+0000", 2024-09-11T05:34:35.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308416999999998 2024-09-11T05:34:35.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327413+0000", 2024-09-11T05:34:35.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070999999999999e-05 2024-09-11T05:34:35.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327458+0000", 2024-09-11T05:34:35.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4836000000000002e-05 2024-09-11T05:34:35.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.626 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.626 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185766 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2576384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.626 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:35.626 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.291550443999999, 2024-09-11T05:34:35.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047571239000000001, 2024-09-11T05:34:35.627 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.628 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185766 2024-09-11T05:34:35.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.628 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:35.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:35.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280068+0000", 2024-09-11T05:34:35.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:34:35.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280070+0000", 2024-09-11T05:34:35.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:35.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280081+0000", 2024-09-11T05:34:35.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0951999999999999e-05 2024-09-11T05:34:35.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280086+0000", 2024-09-11T05:34:35.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5029999999999997e-06 2024-09-11T05:34:35.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327495+0000", 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047408497000000001 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327568+0000", 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3450999999999999e-05 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327639+0000", 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0309999999999996e-05 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.632 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185767 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2617344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.632 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:35.632 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.291503306999999, 2024-09-11T05:34:35.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047672355, 2024-09-11T05:34:35.632 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185767 2024-09-11T05:34:35.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.633 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:35.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8999999999999996e-07 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280121+0000", 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0599999999999996e-06 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280128+0000", 2024-09-11T05:34:35.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1029999999999996e-06 2024-09-11T05:34:35.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280133+0000", 2024-09-11T05:34:35.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T05:34:35.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327702+0000", 2024-09-11T05:34:35.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047568307999999997 2024-09-11T05:34:35.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327745+0000", 2024-09-11T05:34:35.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3407e-05 2024-09-11T05:34:35.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327787+0000", 2024-09-11T05:34:35.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1749000000000003e-05 2024-09-11T05:34:35.637 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.637 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.637 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.637 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185768 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2658304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.637 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.291475955999999, 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047830091999999998, 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185768 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:35.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:35.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281805+0000", 2024-09-11T05:34:35.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016635809999999999 2024-09-11T05:34:35.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281810+0000", 2024-09-11T05:34:35.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3540000000000002e-06 2024-09-11T05:34:35.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281820+0000", 2024-09-11T05:34:35.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T05:34:35.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281828+0000", 2024-09-11T05:34:35.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:35.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327826+0000", 2024-09-11T05:34:35.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045998206999999999 2024-09-11T05:34:35.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327902+0000", 2024-09-11T05:34:35.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5761999999999997e-05 2024-09-11T05:34:35.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327972+0000", 2024-09-11T05:34:35.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0414999999999996e-05 2024-09-11T05:34:35.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.642 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.643 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185775 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2945024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.643 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:35.643 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.289681897000001, 2024-09-11T05:34:35.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047301277000000003, 2024-09-11T05:34:35.643 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.643 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.644 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185775 2024-09-11T05:34:35.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.645 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:35.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:35.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:35.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:34:35.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281938+0000", 2024-09-11T05:34:35.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5099999999999999e-06 2024-09-11T05:34:35.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281941+0000", 2024-09-11T05:34:35.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-06 2024-09-11T05:34:35.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281943+0000", 2024-09-11T05:34:35.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.751e-06 2024-09-11T05:34:35.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329092+0000", 2024-09-11T05:34:35.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047148177999999999 2024-09-11T05:34:35.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329166+0000", 2024-09-11T05:34:35.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4795000000000005e-05 2024-09-11T05:34:35.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329237+0000", 2024-09-11T05:34:35.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0864000000000005e-05 2024-09-11T05:34:35.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.649 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.649 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185777 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2985984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.649 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:35.649 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.289671468000002, 2024-09-11T05:34:35.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047500597999999998, 2024-09-11T05:34:35.650 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185777 2024-09-11T05:34:35.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.650 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:35.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:35.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281947+0000", 2024-09-11T05:34:35.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:35.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281948+0000", 2024-09-11T05:34:35.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1429999999999999e-06 2024-09-11T05:34:35.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281951+0000", 2024-09-11T05:34:35.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-11T05:34:35.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281953+0000", 2024-09-11T05:34:35.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6709999999999999e-06 2024-09-11T05:34:35.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329280+0000", 2024-09-11T05:34:35.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047326857999999999 2024-09-11T05:34:35.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329364+0000", 2024-09-11T05:34:35.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3586999999999998e-05 2024-09-11T05:34:35.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329447+0000", 2024-09-11T05:34:35.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3314999999999998e-05 2024-09-11T05:34:35.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.654 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.654 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185778 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3026944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.654 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:35.654 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.289661655, 2024-09-11T05:34:35.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047668384000000001, 2024-09-11T05:34:35.655 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185778 2024-09-11T05:34:35.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.655 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:35.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:35.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283808+0000", 2024-09-11T05:34:35.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018518919999999999 2024-09-11T05:34:35.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283812+0000", 2024-09-11T05:34:35.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:35.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283820+0000", 2024-09-11T05:34:35.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3319999999999992e-06 2024-09-11T05:34:35.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283825+0000", 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8729999999999998e-06 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329484+0000", 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045658404999999999 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329554+0000", 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0099999999999996e-05 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329625+0000", 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0732e-05 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185790 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2170880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.287676701999999, 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047276674999999997, 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.660 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185790 2024-09-11T05:34:35.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.660 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:35.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:35.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283942+0000", 2024-09-11T05:34:35.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:35.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283944+0000", 2024-09-11T05:34:35.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9800000000000001e-06 2024-09-11T05:34:35.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283948+0000", 2024-09-11T05:34:35.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9729999999999999e-06 2024-09-11T05:34:35.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283950+0000", 2024-09-11T05:34:35.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7020000000000001e-06 2024-09-11T05:34:35.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331076+0000", 2024-09-11T05:34:35.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047126016 2024-09-11T05:34:35.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331147+0000", 2024-09-11T05:34:35.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0848999999999999e-05 2024-09-11T05:34:35.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331218+0000", 2024-09-11T05:34:35.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0621e-05 2024-09-11T05:34:35.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.667 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.668 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185791 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3395584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.668 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:35.668 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.287650652, 2024-09-11T05:34:35.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047372307000000002, 2024-09-11T05:34:35.668 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.669 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.669 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.669 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.669 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.669 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185791 2024-09-11T05:34:35.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.670 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:35.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:35.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283968+0000", 2024-09-11T05:34:35.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:35.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283970+0000", 2024-09-11T05:34:35.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.199e-06 2024-09-11T05:34:35.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283976+0000", 2024-09-11T05:34:35.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T05:34:35.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283981+0000", 2024-09-11T05:34:35.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:34:35.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331252+0000", 2024-09-11T05:34:35.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047270999000000001 2024-09-11T05:34:35.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331299+0000", 2024-09-11T05:34:35.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7376999999999997e-05 2024-09-11T05:34:35.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331339+0000", 2024-09-11T05:34:35.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0428e-05 2024-09-11T05:34:35.678 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.678 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.678 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.679 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185792 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2211840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.679 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:35.679 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.287630754999999, 2024-09-11T05:34:35.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047522035999999997, 2024-09-11T05:34:35.679 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185792 2024-09-11T05:34:35.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.681 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:35.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:35.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:35.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T05:34:35.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283990+0000", 2024-09-11T05:34:35.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:34:35.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283995+0000", 2024-09-11T05:34:35.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3329999999999996e-06 2024-09-11T05:34:35.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284002+0000", 2024-09-11T05:34:35.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6120000000000001e-06 2024-09-11T05:34:35.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331373+0000", 2024-09-11T05:34:35.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047370269999999999 2024-09-11T05:34:35.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331442+0000", 2024-09-11T05:34:35.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8794999999999994e-05 2024-09-11T05:34:35.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331509+0000", 2024-09-11T05:34:35.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7570000000000005e-05 2024-09-11T05:34:35.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.686 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185793 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3436544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.287608656, 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047706692000000002, 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185793 2024-09-11T05:34:35.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.688 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:35.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:35.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:35.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:35.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:35.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:35.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:35.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285808+0000", 2024-09-11T05:34:35.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001798352 2024-09-11T05:34:35.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:35.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285812+0000", 2024-09-11T05:34:35.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6399999999999996e-06 2024-09-11T05:34:35.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:35.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285823+0000", 2024-09-11T05:34:35.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0783e-05 2024-09-11T05:34:35.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285831+0000", 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331550+0000", 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045719518000000001 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331633+0000", 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2992999999999996e-05 2024-09-11T05:34:35.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:35.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:35.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:35.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331716+0000", 2024-09-11T05:34:35.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2455999999999998e-05 2024-09-11T05:34:35.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.691 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:35.691 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:35.691 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:35.693 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:35.693 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:35.692+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:35.793 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:35.793+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:35.837 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:35.837 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:35.837 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:35.837 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:35.846 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:35.894 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:35.893+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:35.990 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:35.990 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:35.990 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:35.990 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:35.991 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:35.996 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:35.995+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:35.999 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:36.096 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:36.096+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:36.145 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:36.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116623 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13477888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253436141000002, 2024-09-11T05:34:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9661491070000001, 2024-09-11T05:34:36.146 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116623 2024-09-11T05:34:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:36.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889573+0000", 2024-09-11T05:34:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889574+0000", 2024-09-11T05:34:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4810000000000001e-06 2024-09-11T05:34:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889578+0000", 2024-09-11T05:34:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T05:34:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889581+0000", 2024-09-11T05:34:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2380000000000002e-06 2024-09-11T05:34:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890367+0000", 2024-09-11T05:34:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078646599999999999 2024-09-11T05:34:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890377+0000", 2024-09-11T05:34:36.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5789999999999993e-06 2024-09-11T05:34:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829092+0000", 2024-09-11T05:34:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871527899999996 2024-09-11T05:34:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829101+0000", 2024-09-11T05:34:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:34:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854695+0000", 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0255937369999999 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854786+0000", 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1831999999999998e-05 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855721+0000", 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093499800000000004 2024-09-11T05:34:36.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116624 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13502464~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253422294000003, 2024-09-11T05:34:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9664307189999999, 2024-09-11T05:34:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116624 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889587+0000", 2024-09-11T05:34:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:34:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889588+0000", 2024-09-11T05:34:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T05:34:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889592+0000", 2024-09-11T05:34:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.472e-06 2024-09-11T05:34:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889594+0000", 2024-09-11T05:34:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T05:34:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890405+0000", 2024-09-11T05:34:36.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00081088199999999997 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890410+0000", 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999996e-06 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829131+0000", 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93872118999999998 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829138+0000", 2024-09-11T05:34:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1760000000000004e-06 2024-09-11T05:34:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855755+0000", 2024-09-11T05:34:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026616722 2024-09-11T05:34:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855872+0000", 2024-09-11T05:34:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116927 2024-09-11T05:34:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856017+0000", 2024-09-11T05:34:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145313 2024-09-11T05:34:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116625 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13527040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253411075000002, 2024-09-11T05:34:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9666986180000001, 2024-09-11T05:34:36.160 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116625 2024-09-11T05:34:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889598+0000", 2024-09-11T05:34:36.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:34:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889599+0000", 2024-09-11T05:34:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.144e-06 2024-09-11T05:34:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889602+0000", 2024-09-11T05:34:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889604+0000", 2024-09-11T05:34:36.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7640000000000001e-06 2024-09-11T05:34:36.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890442+0000", 2024-09-11T05:34:36.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083777099999999996 2024-09-11T05:34:36.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890452+0000", 2024-09-11T05:34:36.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5559999999999996e-06 2024-09-11T05:34:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829170+0000", 2024-09-11T05:34:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871818900000004 2024-09-11T05:34:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829177+0000", 2024-09-11T05:34:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7220000000000002e-06 2024-09-11T05:34:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856046+0000", 2024-09-11T05:34:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026868943 2024-09-11T05:34:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856144+0000", 2024-09-11T05:34:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8684999999999995e-05 2024-09-11T05:34:36.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856296+0000", 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151667 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116626 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13551616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253400305, 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.96707056, 2024-09-11T05:34:36.167 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116626 2024-09-11T05:34:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:36.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889610+0000", 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.186e-06 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889613+0000", 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889615+0000", 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890487+0000", 2024-09-11T05:34:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087202600000000003 2024-09-11T05:34:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890492+0000", 2024-09-11T05:34:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:34:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829202+0000", 2024-09-11T05:34:36.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871036299999999 2024-09-11T05:34:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829209+0000", 2024-09-11T05:34:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7669999999999998e-06 2024-09-11T05:34:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856327+0000", 2024-09-11T05:34:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027118465 2024-09-11T05:34:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856525+0000", 2024-09-11T05:34:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019825499999999999 2024-09-11T05:34:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856679+0000", 2024-09-11T05:34:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015328 2024-09-11T05:34:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116627 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13576192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253390420000002, 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9673406419999999, 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116627 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:34:36.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889619+0000", 2024-09-11T05:34:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.093e-06 2024-09-11T05:34:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889622+0000", 2024-09-11T05:34:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T05:34:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889625+0000", 2024-09-11T05:34:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:34:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890528+0000", 2024-09-11T05:34:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000902804 2024-09-11T05:34:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890537+0000", 2024-09-11T05:34:36.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2029999999999998e-06 2024-09-11T05:34:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829232+0000", 2024-09-11T05:34:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93869459799999999 2024-09-11T05:34:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829238+0000", 2024-09-11T05:34:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6699999999999997e-06 2024-09-11T05:34:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856709+0000", 2024-09-11T05:34:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027470925 2024-09-11T05:34:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856815+0000", 2024-09-11T05:34:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010566899999999999 2024-09-11T05:34:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856959+0000", 2024-09-11T05:34:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000143752 2024-09-11T05:34:36.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116628 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13600768~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253366425000003, 2024-09-11T05:34:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9676105420000001, 2024-09-11T05:34:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116628 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:34:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889644+0000", 2024-09-11T05:34:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:34:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889647+0000", 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3950000000000001e-06 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889650+0000", 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890570+0000", 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092007999999999999 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890577+0000", 2024-09-11T05:34:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.764e-06 2024-09-11T05:34:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829261+0000", 2024-09-11T05:34:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93868468500000002 2024-09-11T05:34:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829268+0000", 2024-09-11T05:34:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T05:34:36.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857004+0000", 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027736043 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857102+0000", 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8066999999999995e-05 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857253+0000", 2024-09-11T05:34:36.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015050400000000001 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116629 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13625344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253349913999998, 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967906154, 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116629 2024-09-11T05:34:36.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.187 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:36.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:36.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:36.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-07 2024-09-11T05:34:36.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889660+0000", 2024-09-11T05:34:36.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5650000000000001e-06 2024-09-11T05:34:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889664+0000", 2024-09-11T05:34:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4000000000000001e-06 2024-09-11T05:34:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889666+0000", 2024-09-11T05:34:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:36.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890614+0000", 2024-09-11T05:34:36.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00094762999999999998 2024-09-11T05:34:36.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890621+0000", 2024-09-11T05:34:36.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.379e-06 2024-09-11T05:34:36.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829291+0000", 2024-09-11T05:34:36.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866938499999997 2024-09-11T05:34:36.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829298+0000", 2024-09-11T05:34:36.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6610000000000003e-06 2024-09-11T05:34:36.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857284+0000", 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027986522 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857393+0000", 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109054 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857565+0000", 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017160999999999999 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.192 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116843 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12595200~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253338692, 2024-09-11T05:34:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9682605290000001, 2024-09-11T05:34:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116843 2024-09-11T05:34:36.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.194 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:36.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:36.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:36.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:36.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889671+0000", 2024-09-11T05:34:36.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-11T05:34:36.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889674+0000", 2024-09-11T05:34:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.005e-06 2024-09-11T05:34:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889677+0000", 2024-09-11T05:34:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T05:34:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890648+0000", 2024-09-11T05:34:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097103399999999996 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890652+0000", 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0790000000000002e-06 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829320+0000", 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866793199999998 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829327+0000", 2024-09-11T05:34:36.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5529999999999998e-06 2024-09-11T05:34:36.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857596+0000", 2024-09-11T05:34:36.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028269125 2024-09-11T05:34:36.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857834+0000", 2024-09-11T05:34:36.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023784300000000001 2024-09-11T05:34:36.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857930+0000", 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6704000000000001e-05 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116844 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12619776~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253328500999999, 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9685250679999999, 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.200 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.200 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.200 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.200 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.200 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116844 2024-09-11T05:34:36.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.200 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:36.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889681+0000", 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.229e-06 2024-09-11T05:34:36.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889684+0000", 2024-09-11T05:34:36.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0130000000000002e-06 2024-09-11T05:34:36.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889687+0000", 2024-09-11T05:34:36.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7259999999999998e-06 2024-09-11T05:34:36.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890685+0000", 2024-09-11T05:34:36.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099783399999999996 2024-09-11T05:34:36.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890695+0000", 2024-09-11T05:34:36.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-09-11T05:34:36.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829349+0000", 2024-09-11T05:34:36.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865456300000005 2024-09-11T05:34:36.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829356+0000", 2024-09-11T05:34:36.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5130000000000002e-06 2024-09-11T05:34:36.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857959+0000", 2024-09-11T05:34:36.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0286034959999999 2024-09-11T05:34:36.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858057+0000", 2024-09-11T05:34:36.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8097999999999995e-05 2024-09-11T05:34:36.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858205+0000", 2024-09-11T05:34:36.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147732 2024-09-11T05:34:36.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.205 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.205 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116845 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12644352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.206 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:36.206 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253318268000001, 2024-09-11T05:34:36.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968783033, 2024-09-11T05:34:36.206 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.206 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116845 2024-09-11T05:34:36.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.206 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:36.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:36.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:36.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:36.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889692+0000", 2024-09-11T05:34:36.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2330000000000001e-06 2024-09-11T05:34:36.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889695+0000", 2024-09-11T05:34:36.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9249999999999999e-06 2024-09-11T05:34:36.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889697+0000", 2024-09-11T05:34:36.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:34:36.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890719+0000", 2024-09-11T05:34:36.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010218429999999999 2024-09-11T05:34:36.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890723+0000", 2024-09-11T05:34:36.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:34:36.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829378+0000", 2024-09-11T05:34:36.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865562000000002 2024-09-11T05:34:36.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829385+0000", 2024-09-11T05:34:36.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4579999999999998e-06 2024-09-11T05:34:36.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858234+0000", 2024-09-11T05:34:36.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028849288 2024-09-11T05:34:36.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858337+0000", 2024-09-11T05:34:36.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102371 2024-09-11T05:34:36.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858473+0000", 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013669299999999999 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116846 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12668928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253295342999998, 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.969056522, 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116846 2024-09-11T05:34:36.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.215 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:36.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:36.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:36.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-07 2024-09-11T05:34:36.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889715+0000", 2024-09-11T05:34:36.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.482e-06 2024-09-11T05:34:36.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889718+0000", 2024-09-11T05:34:36.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:36.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889721+0000", 2024-09-11T05:34:36.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-11T05:34:36.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890762+0000", 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010413659999999999 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890772+0000", 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5750000000000007e-06 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829407+0000", 2024-09-11T05:34:36.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93863550699999998 2024-09-11T05:34:36.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829414+0000", 2024-09-11T05:34:36.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5640000000000002e-06 2024-09-11T05:34:36.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858502+0000", 2024-09-11T05:34:36.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0290880099999999 2024-09-11T05:34:36.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858634+0000", 2024-09-11T05:34:36.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013173199999999999 2024-09-11T05:34:36.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858770+0000", 2024-09-11T05:34:36.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135943 2024-09-11T05:34:36.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.220 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.220 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116847 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12693504~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.221 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:36.221 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253265655, 2024-09-11T05:34:36.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9692923329999998, 2024-09-11T05:34:36.221 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.221 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116847 2024-09-11T05:34:36.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.221 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:36.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:36.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:36.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T05:34:36.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889747+0000", 2024-09-11T05:34:36.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.501e-06 2024-09-11T05:34:36.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889753+0000", 2024-09-11T05:34:36.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1360000000000002e-06 2024-09-11T05:34:36.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889756+0000", 2024-09-11T05:34:36.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3110000000000001e-06 2024-09-11T05:34:36.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890808+0000", 2024-09-11T05:34:36.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010523240000000001 2024-09-11T05:34:36.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890813+0000", 2024-09-11T05:34:36.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5650000000000003e-06 2024-09-11T05:34:36.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829436+0000", 2024-09-11T05:34:36.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93862351799999999 2024-09-11T05:34:36.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829443+0000", 2024-09-11T05:34:36.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5220000000000004e-06 2024-09-11T05:34:36.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858798+0000", 2024-09-11T05:34:36.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029354903 2024-09-11T05:34:36.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858899+0000", 2024-09-11T05:34:36.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101414 2024-09-11T05:34:36.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859035+0000", 2024-09-11T05:34:36.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013589 2024-09-11T05:34:36.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.229 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116848 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12718080~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253248970000001, 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9695514759999999, 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116848 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.230 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:36.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:36.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889760+0000", 2024-09-11T05:34:36.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:36.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889761+0000", 2024-09-11T05:34:36.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.189e-06 2024-09-11T05:34:36.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889764+0000", 2024-09-11T05:34:36.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:34:36.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889766+0000", 2024-09-11T05:34:36.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:34:36.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890850+0000", 2024-09-11T05:34:36.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010835479999999999 2024-09-11T05:34:36.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890857+0000", 2024-09-11T05:34:36.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6299999999999998e-06 2024-09-11T05:34:36.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829465+0000", 2024-09-11T05:34:36.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860787000000001 2024-09-11T05:34:36.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829472+0000", 2024-09-11T05:34:36.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4420000000000003e-06 2024-09-11T05:34:36.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859062+0000", 2024-09-11T05:34:36.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0295903360000001 2024-09-11T05:34:36.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859169+0000", 2024-09-11T05:34:36.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010674400000000001 2024-09-11T05:34:36.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859311+0000", 2024-09-11T05:34:36.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014209499999999999 2024-09-11T05:34:36.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.239 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.240 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116849 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12742656~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.240 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:36.240 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253239184000002, 2024-09-11T05:34:36.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9698160310000001, 2024-09-11T05:34:36.240 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116849 2024-09-11T05:34:36.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.241 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:36.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:36.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:36.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:36.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889771+0000", 2024-09-11T05:34:36.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:34:36.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889774+0000", 2024-09-11T05:34:36.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:34:36.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889776+0000", 2024-09-11T05:34:36.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.638e-06 2024-09-11T05:34:36.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890886+0000", 2024-09-11T05:34:36.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011102519999999999 2024-09-11T05:34:36.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890891+0000", 2024-09-11T05:34:36.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2200000000000003e-06 2024-09-11T05:34:36.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829494+0000", 2024-09-11T05:34:36.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860342500000005 2024-09-11T05:34:36.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829501+0000", 2024-09-11T05:34:36.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4829999999999996e-06 2024-09-11T05:34:36.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859339+0000", 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0298381320000001 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859440+0000", 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010145 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859585+0000", 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014513300000000001 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.247 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116850 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12767232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.247 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:36.247 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253218158000003, 2024-09-11T05:34:36.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970125645, 2024-09-11T05:34:36.247 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116850 2024-09-11T05:34:36.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.248 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:36.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:36.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889791+0000", 2024-09-11T05:34:36.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:36.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889792+0000", 2024-09-11T05:34:36.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4899999999999999e-06 2024-09-11T05:34:36.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889795+0000", 2024-09-11T05:34:36.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:36.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889798+0000", 2024-09-11T05:34:36.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7089999999999998e-06 2024-09-11T05:34:36.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890924+0000", 2024-09-11T05:34:36.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001125685 2024-09-11T05:34:36.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890933+0000", 2024-09-11T05:34:36.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3340000000000008e-06 2024-09-11T05:34:36.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829523+0000", 2024-09-11T05:34:36.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858966099999996 2024-09-11T05:34:36.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829529+0000", 2024-09-11T05:34:36.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5740000000000001e-06 2024-09-11T05:34:36.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859614+0000", 2024-09-11T05:34:36.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0300843289999999 2024-09-11T05:34:36.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859743+0000", 2024-09-11T05:34:36.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129407 2024-09-11T05:34:36.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859916+0000", 2024-09-11T05:34:36.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017282500000000001 2024-09-11T05:34:36.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.253 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.253 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116851 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12791808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.253 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:36.254 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253178288000001, 2024-09-11T05:34:36.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970347268, 2024-09-11T05:34:36.254 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116851 2024-09-11T05:34:36.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.254 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889832+0000", 2024-09-11T05:34:36.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6819999999999999e-06 2024-09-11T05:34:36.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889838+0000", 2024-09-11T05:34:36.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:34:36.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889841+0000", 2024-09-11T05:34:36.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:34:36.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890957+0000", 2024-09-11T05:34:36.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001115956 2024-09-11T05:34:36.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890961+0000", 2024-09-11T05:34:36.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7050000000000001e-06 2024-09-11T05:34:36.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829552+0000", 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93859101499999997 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829558+0000", 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5429999999999999e-06 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859947+0000", 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030388248 2024-09-11T05:34:36.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860043+0000", 2024-09-11T05:34:36.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5847999999999994e-05 2024-09-11T05:34:36.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860177+0000", 2024-09-11T05:34:36.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013484400000000001 2024-09-11T05:34:36.259 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.259 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.259 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.260 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116852 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12816384~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.260 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:36.260 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253163677000003, 2024-09-11T05:34:36.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970594859, 2024-09-11T05:34:36.260 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116852 2024-09-11T05:34:36.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.261 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:36.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:36.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:36.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:36.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889846+0000", 2024-09-11T05:34:36.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.204e-06 2024-09-11T05:34:36.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889849+0000", 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.931e-06 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889852+0000", 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890993+0000", 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001141176 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891001+0000", 2024-09-11T05:34:36.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5259999999999996e-06 2024-09-11T05:34:36.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829582+0000", 2024-09-11T05:34:36.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858050800000004 2024-09-11T05:34:36.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829588+0000", 2024-09-11T05:34:36.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4980000000000003e-06 2024-09-11T05:34:36.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860207+0000", 2024-09-11T05:34:36.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030618713 2024-09-11T05:34:36.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860305+0000", 2024-09-11T05:34:36.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8209999999999997e-05 2024-09-11T05:34:36.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860440+0000", 2024-09-11T05:34:36.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134692 2024-09-11T05:34:36.266 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.266 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.266 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.266 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116853 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12840960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.266 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:36.266 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253152958999998, 2024-09-11T05:34:36.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.97084075, 2024-09-11T05:34:36.267 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.267 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116853 2024-09-11T05:34:36.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.267 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:36.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:36.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889856+0000", 2024-09-11T05:34:36.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:34:36.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889857+0000", 2024-09-11T05:34:36.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.435e-06 2024-09-11T05:34:36.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889860+0000", 2024-09-11T05:34:36.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9620000000000002e-06 2024-09-11T05:34:36.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889863+0000", 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891036+0000", 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011734580000000001 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891042+0000", 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3290000000000001e-06 2024-09-11T05:34:36.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829611+0000", 2024-09-11T05:34:36.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856954299999995 2024-09-11T05:34:36.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829618+0000", 2024-09-11T05:34:36.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T05:34:36.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860465+0000", 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0308472500000001 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860558+0000", 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3253999999999999e-05 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860696+0000", 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138169 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.272 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.273 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116854 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12865536~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.273 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:36.273 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253142768000004, 2024-09-11T05:34:36.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9710979320000002, 2024-09-11T05:34:36.273 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116854 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889867+0000", 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.155e-06 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889871+0000", 2024-09-11T05:34:36.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9260000000000002e-06 2024-09-11T05:34:36.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889875+0000", 2024-09-11T05:34:36.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.262e-06 2024-09-11T05:34:36.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891070+0000", 2024-09-11T05:34:36.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011945160000000001 2024-09-11T05:34:36.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891079+0000", 2024-09-11T05:34:36.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3759999999999997e-06 2024-09-11T05:34:36.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829642+0000", 2024-09-11T05:34:36.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856325900000004 2024-09-11T05:34:36.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829649+0000", 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860726+0000", 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.031076791 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860831+0000", 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105003 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860964+0000", 2024-09-11T05:34:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013285700000000001 2024-09-11T05:34:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116855 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12890112~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.253127988000003, 2024-09-11T05:34:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.971277814, 2024-09-11T05:34:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:36.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:36.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:36.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:36.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:36.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:36.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116855 2024-09-11T05:34:36.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.280 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:36.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:36.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:36.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:36.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:36.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:36.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:36.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817809+0000", 2024-09-11T05:34:36.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.92792850999999998 2024-09-11T05:34:36.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:36.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817815+0000", 2024-09-11T05:34:36.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4110000000000001e-06 2024-09-11T05:34:36.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:36.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817827+0000", 2024-09-11T05:34:36.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2031000000000001e-05 2024-09-11T05:34:36.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:36.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817837+0000", 2024-09-11T05:34:36.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2159999999999995e-06 2024-09-11T05:34:36.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829673+0000", 2024-09-11T05:34:36.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011836197 2024-09-11T05:34:36.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:36.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829679+0000", 2024-09-11T05:34:36.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5390000000000004e-06 2024-09-11T05:34:36.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:36.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861000+0000", 2024-09-11T05:34:36.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0313209539999999 2024-09-11T05:34:36.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:36.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861080+0000", 2024-09-11T05:34:36.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9606999999999999e-05 2024-09-11T05:34:36.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:36.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:36.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:36.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861158+0000", 2024-09-11T05:34:36.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8349000000000005e-05 2024-09-11T05:34:36.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.288 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:36.288 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:36.288 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:36.290 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:36.290 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:36.289+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:36.394 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:34:36.395 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:36.394+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:36.436 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:36.436 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:36.436 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:36.437 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:36.445 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:36.522 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:36.523 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:36.523 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:36.522+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:36.539 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:36.540 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:36.557 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:36.557 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:36.574 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:36.591 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:34:36.597 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:36.598 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:36.598 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:36.597+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:36.606 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:36.609 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:36.609 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:36.635 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:36.635 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:36.653 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:36.653 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:36.698 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:36.697+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:36.732 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:36.733 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:36.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:36.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:34:36.801 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:36.800+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:36.854 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:36.854 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:36.863 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:36.904 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:36.903+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:37.005 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:37.005 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:37.006 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:37.004+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:37.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:37.061 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 5, 6] out_osds: [4, 3, 7] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-09-11T05:34:37.061 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:34:37.061 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T05:34:37.061 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.000000 2024-09-11T05:34:37.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0 2024-09-11T05:34:37.106 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:37.106+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:37.156 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:37.157 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:37.166 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:37.209 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:37.208+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:37.269 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:37.269 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:37.278 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:37.308 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:37.308+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:37.409 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:37.409+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:37.420 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:37.421 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:37.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:37.510 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:37.509+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:37.531 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:37.531 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:37.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:37.624 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:37.623+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:37.683 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:37.683 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:37.692 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T05:34:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.2 primary-affinity to 0 (802) 2024-09-11T05:34:37.733 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:37.732+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:37.812 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:37.812+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:37.838 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:37.838 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:37.846 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:37.914 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:37.913+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:37.950 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:37.950 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:37.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:34:38.015 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:38.015+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:38.103 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:38.103 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:38.112 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:34:38.156 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:38.155+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:38.215 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:38.215 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:38.216 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:38.215+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:38.223 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:34:38.317 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:38.317+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:38.366 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:38.366 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:38.375 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:38.418 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:38.417+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:38.489 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:38.489 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:38.498 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:38.542 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:38.542+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:38.601 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:38.601 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:38.610 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:38.620 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:38.619+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:38.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:34:38.737 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:38.737+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:38.765 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:38.765 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:38.776 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:38.826 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:38.826 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:38.827 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:38.826+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:38.844 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:38.844 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:38.860 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:38.860 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:38.876 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:38.877 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:38.893 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:38.893 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:34:38.911 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:38.911 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:38.922 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:38.923 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:38.923 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:38.923 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:38.922+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:38.927 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:38.927 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:38.931 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:38.944 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:38.945 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:39.024 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:39.023+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:39.047 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:39.048 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:39.058 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:39.124 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:39.124+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:39.203 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:39.204 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:39.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:39.204 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:39.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.204 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:184170 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.204 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:39.204 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.282272284000001, 2024-09-11T05:34:39.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047293133000000001, 2024-09-11T05:34:39.204 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 184170 2024-09-11T05:34:39.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.205 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:39.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:39.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921808+0000", 2024-09-11T05:34:39.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001805868 2024-09-11T05:34:39.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921819+0000", 2024-09-11T05:34:39.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0458e-05 2024-09-11T05:34:39.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921830+0000", 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1482e-05 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921837+0000", 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3709999999999996e-06 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967150+0000", 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045313402000000003 2024-09-11T05:34:39.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967216+0000", 2024-09-11T05:34:39.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6322999999999995e-05 2024-09-11T05:34:39.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967296+0000", 2024-09-11T05:34:39.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9228999999999996e-05 2024-09-11T05:34:39.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.208 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.209 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185733 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3309568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.209 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:39.209 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.928239271999999, 2024-09-11T05:34:39.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047365106999999997, 2024-09-11T05:34:39.209 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185733 2024-09-11T05:34:39.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275806+0000", 2024-09-11T05:34:39.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001769966 2024-09-11T05:34:39.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275810+0000", 2024-09-11T05:34:39.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5539999999999999e-06 2024-09-11T05:34:39.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275821+0000", 2024-09-11T05:34:39.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1253999999999999e-05 2024-09-11T05:34:39.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275828+0000", 2024-09-11T05:34:39.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:39.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321211+0000", 2024-09-11T05:34:39.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045383053999999999 2024-09-11T05:34:39.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321306+0000", 2024-09-11T05:34:39.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4712999999999999e-05 2024-09-11T05:34:39.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321401+0000", 2024-09-11T05:34:39.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4825000000000001e-05 2024-09-11T05:34:39.213 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.213 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.213 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.213 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185743 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3719168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.214 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:39.214 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.926227436000001, 2024-09-11T05:34:39.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047361001999999999, 2024-09-11T05:34:39.214 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185743 2024-09-11T05:34:39.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.214 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:39.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:39.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276048+0000", 2024-09-11T05:34:39.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:34:39.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276050+0000", 2024-09-11T05:34:39.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:34:39.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276056+0000", 2024-09-11T05:34:39.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:34:39.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276061+0000", 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323215+0000", 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047153977999999999 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323278+0000", 2024-09-11T05:34:39.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3053999999999996e-05 2024-09-11T05:34:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323408+0000", 2024-09-11T05:34:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013012899999999999 2024-09-11T05:34:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185744 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3760128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.926206755999999, 2024-09-11T05:34:39.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047563095, 2024-09-11T05:34:39.219 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.219 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.219 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.219 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.219 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185744 2024-09-11T05:34:39.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.219 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:39.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:39.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277808+0000", 2024-09-11T05:34:39.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001739652 2024-09-11T05:34:39.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277816+0000", 2024-09-11T05:34:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.208e-06 2024-09-11T05:34:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277829+0000", 2024-09-11T05:34:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2848e-05 2024-09-11T05:34:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277837+0000", 2024-09-11T05:34:39.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6379999999999993e-06 2024-09-11T05:34:39.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323448+0000", 2024-09-11T05:34:39.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045610604999999999 2024-09-11T05:34:39.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323562+0000", 2024-09-11T05:34:39.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113706 2024-09-11T05:34:39.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323631+0000", 2024-09-11T05:34:39.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9437999999999995e-05 2024-09-11T05:34:39.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.223 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.223 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185753 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.223 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:39.224 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.924243709999999, 2024-09-11T05:34:39.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047283944000000001, 2024-09-11T05:34:39.224 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.224 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185753 2024-09-11T05:34:39.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.224 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:39.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:39.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:39.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:39.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278033+0000", 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.237e-06 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278036+0000", 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278038+0000", 2024-09-11T05:34:39.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5490000000000001e-06 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325140+0000", 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047101845000000003 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325219+0000", 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9444999999999996e-05 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325315+0000", 2024-09-11T05:34:39.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.569e-05 2024-09-11T05:34:39.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.228 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.228 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185754 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4169728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.228 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:39.228 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.924233812000001, 2024-09-11T05:34:39.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047450697, 2024-09-11T05:34:39.228 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.228 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185754 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278043+0000", 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278045+0000", 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278048+0000", 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5679999999999998e-06 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325359+0000", 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047311262 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325421+0000", 2024-09-11T05:34:39.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1717999999999994e-05 2024-09-11T05:34:39.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325492+0000", 2024-09-11T05:34:39.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0716000000000005e-05 2024-09-11T05:34:39.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.232 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.233 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185755 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2125824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.233 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:39.233 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.924223744999999, 2024-09-11T05:34:39.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047669481999999999, 2024-09-11T05:34:39.233 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.233 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185755 2024-09-11T05:34:39.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.233 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:39.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:39.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278052+0000", 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278055+0000", 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8059999999999999e-06 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278058+0000", 2024-09-11T05:34:39.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.503e-06 2024-09-11T05:34:39.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325563+0000", 2024-09-11T05:34:39.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047505316999999998 2024-09-11T05:34:39.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325645+0000", 2024-09-11T05:34:39.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2439000000000001e-05 2024-09-11T05:34:39.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325721+0000", 2024-09-11T05:34:39.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5092999999999994e-05 2024-09-11T05:34:39.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.237 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.237 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185756 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2166784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.237 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:39.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.924211414999998, 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047861556, 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185756 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:39.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:39.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279805+0000", 2024-09-11T05:34:39.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001741586 2024-09-11T05:34:39.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279809+0000", 2024-09-11T05:34:39.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0890000000000002e-06 2024-09-11T05:34:39.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279816+0000", 2024-09-11T05:34:39.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2060000000000001e-06 2024-09-11T05:34:39.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279821+0000", 2024-09-11T05:34:39.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6709999999999998e-06 2024-09-11T05:34:39.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325764+0000", 2024-09-11T05:34:39.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045942749999999997 2024-09-11T05:34:39.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325846+0000", 2024-09-11T05:34:39.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2470000000000002e-05 2024-09-11T05:34:39.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325925+0000", 2024-09-11T05:34:39.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8783999999999997e-05 2024-09-11T05:34:39.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.242 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.242 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185764 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2494464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.242 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:39.242 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.922247359, 2024-09-11T05:34:39.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308594000000002, 2024-09-11T05:34:39.242 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.243 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185764 2024-09-11T05:34:39.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.243 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:39.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280028+0000", 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.27e-07 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280030+0000", 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3319999999999999e-06 2024-09-11T05:34:39.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280036+0000", 2024-09-11T05:34:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:34:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280041+0000", 2024-09-11T05:34:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7530000000000001e-06 2024-09-11T05:34:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327196+0000", 2024-09-11T05:34:39.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047154967999999998 2024-09-11T05:34:39.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327266+0000", 2024-09-11T05:34:39.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0427999999999997e-05 2024-09-11T05:34:39.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327336+0000", 2024-09-11T05:34:39.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9659000000000005e-05 2024-09-11T05:34:39.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.246 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185765 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2535424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.92222744, 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047410790000000001, 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185765 2024-09-11T05:34:39.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.248 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:39.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:39.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280048+0000", 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280050+0000", 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280056+0000", 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:34:39.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280061+0000", 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327369+0000", 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308416999999998 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327413+0000", 2024-09-11T05:34:39.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070999999999999e-05 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327458+0000", 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4836000000000002e-05 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185766 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2576384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.922207449999998, 2024-09-11T05:34:39.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047571239000000001, 2024-09-11T05:34:39.252 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185766 2024-09-11T05:34:39.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.252 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:39.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280068+0000", 2024-09-11T05:34:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:34:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280070+0000", 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280081+0000", 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0951999999999999e-05 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280086+0000", 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5029999999999997e-06 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327495+0000", 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047408497000000001 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327568+0000", 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3450999999999999e-05 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327639+0000", 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0309999999999996e-05 2024-09-11T05:34:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.256 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.256 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185767 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2617344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.256 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:39.256 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.922160312999999, 2024-09-11T05:34:39.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047672355, 2024-09-11T05:34:39.256 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.257 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.257 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185767 2024-09-11T05:34:39.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.257 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:39.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:39.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8999999999999996e-07 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280121+0000", 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0599999999999996e-06 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280128+0000", 2024-09-11T05:34:39.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1029999999999996e-06 2024-09-11T05:34:39.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280133+0000", 2024-09-11T05:34:39.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T05:34:39.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327702+0000", 2024-09-11T05:34:39.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047568307999999997 2024-09-11T05:34:39.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327745+0000", 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3407e-05 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327787+0000", 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1749000000000003e-05 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.260 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185768 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2658304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.922132961999999, 2024-09-11T05:34:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047830091999999998, 2024-09-11T05:34:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185768 2024-09-11T05:34:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:39.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:39.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281805+0000", 2024-09-11T05:34:39.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016635809999999999 2024-09-11T05:34:39.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281810+0000", 2024-09-11T05:34:39.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3540000000000002e-06 2024-09-11T05:34:39.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281820+0000", 2024-09-11T05:34:39.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T05:34:39.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281828+0000", 2024-09-11T05:34:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327826+0000", 2024-09-11T05:34:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045998206999999999 2024-09-11T05:34:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327902+0000", 2024-09-11T05:34:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5761999999999997e-05 2024-09-11T05:34:39.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327972+0000", 2024-09-11T05:34:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0414999999999996e-05 2024-09-11T05:34:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185775 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2945024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.920338903000001, 2024-09-11T05:34:39.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047301277000000003, 2024-09-11T05:34:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185775 2024-09-11T05:34:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:39.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281938+0000", 2024-09-11T05:34:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5099999999999999e-06 2024-09-11T05:34:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281941+0000", 2024-09-11T05:34:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-06 2024-09-11T05:34:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281943+0000", 2024-09-11T05:34:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.751e-06 2024-09-11T05:34:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329092+0000", 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047148177999999999 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329166+0000", 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4795000000000005e-05 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329237+0000", 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0864000000000005e-05 2024-09-11T05:34:39.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185777 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2985984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.920328474000002, 2024-09-11T05:34:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047500597999999998, 2024-09-11T05:34:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185777 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281947+0000", 2024-09-11T05:34:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281948+0000", 2024-09-11T05:34:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1429999999999999e-06 2024-09-11T05:34:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281951+0000", 2024-09-11T05:34:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-11T05:34:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281953+0000", 2024-09-11T05:34:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6709999999999999e-06 2024-09-11T05:34:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329280+0000", 2024-09-11T05:34:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047326857999999999 2024-09-11T05:34:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329364+0000", 2024-09-11T05:34:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3586999999999998e-05 2024-09-11T05:34:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329447+0000", 2024-09-11T05:34:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3314999999999998e-05 2024-09-11T05:34:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185778 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3026944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.920318661, 2024-09-11T05:34:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047668384000000001, 2024-09-11T05:34:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185778 2024-09-11T05:34:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.275 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283808+0000", 2024-09-11T05:34:39.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018518919999999999 2024-09-11T05:34:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283812+0000", 2024-09-11T05:34:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283820+0000", 2024-09-11T05:34:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3319999999999992e-06 2024-09-11T05:34:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283825+0000", 2024-09-11T05:34:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8729999999999998e-06 2024-09-11T05:34:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329484+0000", 2024-09-11T05:34:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045658404999999999 2024-09-11T05:34:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329554+0000", 2024-09-11T05:34:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0099999999999996e-05 2024-09-11T05:34:39.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329625+0000", 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0732e-05 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185790 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2170880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.918333707999999, 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047276674999999997, 2024-09-11T05:34:39.279 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185790 2024-09-11T05:34:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283942+0000", 2024-09-11T05:34:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283944+0000", 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9800000000000001e-06 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283948+0000", 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9729999999999999e-06 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283950+0000", 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7020000000000001e-06 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331076+0000", 2024-09-11T05:34:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047126016 2024-09-11T05:34:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331147+0000", 2024-09-11T05:34:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0848999999999999e-05 2024-09-11T05:34:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331218+0000", 2024-09-11T05:34:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0621e-05 2024-09-11T05:34:39.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185791 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3395584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.918307658, 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047372307000000002, 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185791 2024-09-11T05:34:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283968+0000", 2024-09-11T05:34:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283970+0000", 2024-09-11T05:34:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.199e-06 2024-09-11T05:34:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283976+0000", 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283981+0000", 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331252+0000", 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047270999000000001 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331299+0000", 2024-09-11T05:34:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7376999999999997e-05 2024-09-11T05:34:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331339+0000", 2024-09-11T05:34:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0428e-05 2024-09-11T05:34:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.288 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185792 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2211840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.918287760999998, 2024-09-11T05:34:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047522035999999997, 2024-09-11T05:34:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185792 2024-09-11T05:34:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T05:34:39.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283990+0000", 2024-09-11T05:34:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:34:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283995+0000", 2024-09-11T05:34:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3329999999999996e-06 2024-09-11T05:34:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284002+0000", 2024-09-11T05:34:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6120000000000001e-06 2024-09-11T05:34:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331373+0000", 2024-09-11T05:34:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047370269999999999 2024-09-11T05:34:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331442+0000", 2024-09-11T05:34:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8794999999999994e-05 2024-09-11T05:34:39.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331509+0000", 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7570000000000005e-05 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185793 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3436544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.918265662, 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047706692000000002, 2024-09-11T05:34:39.293 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185793 2024-09-11T05:34:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285808+0000", 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001798352 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285812+0000", 2024-09-11T05:34:39.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6399999999999996e-06 2024-09-11T05:34:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285823+0000", 2024-09-11T05:34:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0783e-05 2024-09-11T05:34:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285831+0000", 2024-09-11T05:34:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:34:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331550+0000", 2024-09-11T05:34:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045719518000000001 2024-09-11T05:34:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331633+0000", 2024-09-11T05:34:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2992999999999996e-05 2024-09-11T05:34:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331716+0000", 2024-09-11T05:34:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2455999999999998e-05 2024-09-11T05:34:39.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.298 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:39.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:39.300 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:39.299+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:39.400 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:39.400+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:39.443 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:39.444 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:39.444 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:39.444 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:39.453 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:39.501 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:39.501+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:39.556 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:39.556 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:39.556 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:39.564 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:39.605 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:39.605+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:39.703 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:39.702+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:39.710 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116623 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13477888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818794314999998, 2024-09-11T05:34:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9661491070000001, 2024-09-11T05:34:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116623 2024-09-11T05:34:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889573+0000", 2024-09-11T05:34:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889574+0000", 2024-09-11T05:34:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4810000000000001e-06 2024-09-11T05:34:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889578+0000", 2024-09-11T05:34:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T05:34:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889581+0000", 2024-09-11T05:34:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2380000000000002e-06 2024-09-11T05:34:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890367+0000", 2024-09-11T05:34:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078646599999999999 2024-09-11T05:34:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890377+0000", 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5789999999999993e-06 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829092+0000", 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871527899999996 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829101+0000", 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854695+0000", 2024-09-11T05:34:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0255937369999999 2024-09-11T05:34:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854786+0000", 2024-09-11T05:34:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1831999999999998e-05 2024-09-11T05:34:39.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855721+0000", 2024-09-11T05:34:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093499800000000004 2024-09-11T05:34:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116624 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13502464~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:39.717 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818780468, 2024-09-11T05:34:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9664307189999999, 2024-09-11T05:34:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116624 2024-09-11T05:34:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889587+0000", 2024-09-11T05:34:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:34:39.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889588+0000", 2024-09-11T05:34:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T05:34:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889592+0000", 2024-09-11T05:34:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.472e-06 2024-09-11T05:34:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889594+0000", 2024-09-11T05:34:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T05:34:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890405+0000", 2024-09-11T05:34:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00081088199999999997 2024-09-11T05:34:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890410+0000", 2024-09-11T05:34:39.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999996e-06 2024-09-11T05:34:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829131+0000", 2024-09-11T05:34:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93872118999999998 2024-09-11T05:34:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829138+0000", 2024-09-11T05:34:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1760000000000004e-06 2024-09-11T05:34:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855755+0000", 2024-09-11T05:34:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026616722 2024-09-11T05:34:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855872+0000", 2024-09-11T05:34:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116927 2024-09-11T05:34:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856017+0000", 2024-09-11T05:34:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145313 2024-09-11T05:34:39.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116625 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13527040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818769248999999, 2024-09-11T05:34:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9666986180000001, 2024-09-11T05:34:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116625 2024-09-11T05:34:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:39.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889598+0000", 2024-09-11T05:34:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:34:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889599+0000", 2024-09-11T05:34:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.144e-06 2024-09-11T05:34:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889602+0000", 2024-09-11T05:34:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889604+0000", 2024-09-11T05:34:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7640000000000001e-06 2024-09-11T05:34:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890442+0000", 2024-09-11T05:34:39.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083777099999999996 2024-09-11T05:34:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890452+0000", 2024-09-11T05:34:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5559999999999996e-06 2024-09-11T05:34:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829170+0000", 2024-09-11T05:34:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871818900000004 2024-09-11T05:34:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829177+0000", 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7220000000000002e-06 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856046+0000", 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026868943 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856144+0000", 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8684999999999995e-05 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856296+0000", 2024-09-11T05:34:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151667 2024-09-11T05:34:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116626 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13551616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818758479000003, 2024-09-11T05:34:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.96707056, 2024-09-11T05:34:39.730 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116626 2024-09-11T05:34:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889610+0000", 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.186e-06 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889613+0000", 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889615+0000", 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890487+0000", 2024-09-11T05:34:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087202600000000003 2024-09-11T05:34:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890492+0000", 2024-09-11T05:34:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:34:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829202+0000", 2024-09-11T05:34:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871036299999999 2024-09-11T05:34:39.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829209+0000", 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7669999999999998e-06 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856327+0000", 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027118465 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856525+0000", 2024-09-11T05:34:39.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019825499999999999 2024-09-11T05:34:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856679+0000", 2024-09-11T05:34:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015328 2024-09-11T05:34:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116627 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13576192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:39.736 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818748593999999, 2024-09-11T05:34:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9673406419999999, 2024-09-11T05:34:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116627 2024-09-11T05:34:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:34:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889619+0000", 2024-09-11T05:34:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.093e-06 2024-09-11T05:34:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889622+0000", 2024-09-11T05:34:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T05:34:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889625+0000", 2024-09-11T05:34:39.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:34:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890528+0000", 2024-09-11T05:34:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000902804 2024-09-11T05:34:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890537+0000", 2024-09-11T05:34:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2029999999999998e-06 2024-09-11T05:34:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829232+0000", 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93869459799999999 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829238+0000", 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6699999999999997e-06 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856709+0000", 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027470925 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856815+0000", 2024-09-11T05:34:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010566899999999999 2024-09-11T05:34:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856959+0000", 2024-09-11T05:34:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000143752 2024-09-11T05:34:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116628 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13600768~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818724598999999, 2024-09-11T05:34:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9676105420000001, 2024-09-11T05:34:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116628 2024-09-11T05:34:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.743 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:34:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889644+0000", 2024-09-11T05:34:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:34:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889647+0000", 2024-09-11T05:34:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3950000000000001e-06 2024-09-11T05:34:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889650+0000", 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890570+0000", 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092007999999999999 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890577+0000", 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.764e-06 2024-09-11T05:34:39.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829261+0000", 2024-09-11T05:34:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93868468500000002 2024-09-11T05:34:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829268+0000", 2024-09-11T05:34:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T05:34:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857004+0000", 2024-09-11T05:34:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027736043 2024-09-11T05:34:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857102+0000", 2024-09-11T05:34:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8066999999999995e-05 2024-09-11T05:34:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857253+0000", 2024-09-11T05:34:39.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015050400000000001 2024-09-11T05:34:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116629 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13625344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818708088000001, 2024-09-11T05:34:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967906154, 2024-09-11T05:34:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116629 2024-09-11T05:34:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-07 2024-09-11T05:34:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889660+0000", 2024-09-11T05:34:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5650000000000001e-06 2024-09-11T05:34:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889664+0000", 2024-09-11T05:34:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4000000000000001e-06 2024-09-11T05:34:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889666+0000", 2024-09-11T05:34:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890614+0000", 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00094762999999999998 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890621+0000", 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.379e-06 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829291+0000", 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866938499999997 2024-09-11T05:34:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829298+0000", 2024-09-11T05:34:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6610000000000003e-06 2024-09-11T05:34:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857284+0000", 2024-09-11T05:34:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027986522 2024-09-11T05:34:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857393+0000", 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109054 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857565+0000", 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017160999999999999 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116843 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12595200~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.755 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818696866000003, 2024-09-11T05:34:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9682605290000001, 2024-09-11T05:34:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116843 2024-09-11T05:34:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:39.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889671+0000", 2024-09-11T05:34:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-11T05:34:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889674+0000", 2024-09-11T05:34:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.005e-06 2024-09-11T05:34:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889677+0000", 2024-09-11T05:34:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T05:34:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890648+0000", 2024-09-11T05:34:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097103399999999996 2024-09-11T05:34:39.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890652+0000", 2024-09-11T05:34:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0790000000000002e-06 2024-09-11T05:34:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829320+0000", 2024-09-11T05:34:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866793199999998 2024-09-11T05:34:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829327+0000", 2024-09-11T05:34:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5529999999999998e-06 2024-09-11T05:34:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857596+0000", 2024-09-11T05:34:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028269125 2024-09-11T05:34:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857834+0000", 2024-09-11T05:34:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023784300000000001 2024-09-11T05:34:39.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857930+0000", 2024-09-11T05:34:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6704000000000001e-05 2024-09-11T05:34:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116844 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12619776~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818686675000002, 2024-09-11T05:34:39.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9685250679999999, 2024-09-11T05:34:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116844 2024-09-11T05:34:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:39.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889681+0000", 2024-09-11T05:34:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.229e-06 2024-09-11T05:34:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889684+0000", 2024-09-11T05:34:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0130000000000002e-06 2024-09-11T05:34:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889687+0000", 2024-09-11T05:34:39.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7259999999999998e-06 2024-09-11T05:34:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890685+0000", 2024-09-11T05:34:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099783399999999996 2024-09-11T05:34:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890695+0000", 2024-09-11T05:34:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-09-11T05:34:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829349+0000", 2024-09-11T05:34:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865456300000005 2024-09-11T05:34:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829356+0000", 2024-09-11T05:34:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5130000000000002e-06 2024-09-11T05:34:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857959+0000", 2024-09-11T05:34:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0286034959999999 2024-09-11T05:34:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858057+0000", 2024-09-11T05:34:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8097999999999995e-05 2024-09-11T05:34:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858205+0000", 2024-09-11T05:34:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147732 2024-09-11T05:34:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116845 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12644352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818676441999997, 2024-09-11T05:34:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968783033, 2024-09-11T05:34:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.769 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116845 2024-09-11T05:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889692+0000", 2024-09-11T05:34:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2330000000000001e-06 2024-09-11T05:34:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889695+0000", 2024-09-11T05:34:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9249999999999999e-06 2024-09-11T05:34:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889697+0000", 2024-09-11T05:34:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:34:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890719+0000", 2024-09-11T05:34:39.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010218429999999999 2024-09-11T05:34:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890723+0000", 2024-09-11T05:34:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:34:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829378+0000", 2024-09-11T05:34:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865562000000002 2024-09-11T05:34:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829385+0000", 2024-09-11T05:34:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4579999999999998e-06 2024-09-11T05:34:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858234+0000", 2024-09-11T05:34:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028849288 2024-09-11T05:34:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858337+0000", 2024-09-11T05:34:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102371 2024-09-11T05:34:39.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858473+0000", 2024-09-11T05:34:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013669299999999999 2024-09-11T05:34:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116846 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12668928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818653517000001, 2024-09-11T05:34:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.969056522, 2024-09-11T05:34:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116846 2024-09-11T05:34:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:39.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-07 2024-09-11T05:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889715+0000", 2024-09-11T05:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.482e-06 2024-09-11T05:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889718+0000", 2024-09-11T05:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889721+0000", 2024-09-11T05:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-11T05:34:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890762+0000", 2024-09-11T05:34:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010413659999999999 2024-09-11T05:34:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890772+0000", 2024-09-11T05:34:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5750000000000007e-06 2024-09-11T05:34:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829407+0000", 2024-09-11T05:34:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93863550699999998 2024-09-11T05:34:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829414+0000", 2024-09-11T05:34:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5640000000000002e-06 2024-09-11T05:34:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858502+0000", 2024-09-11T05:34:39.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0290880099999999 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858634+0000", 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013173199999999999 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858770+0000", 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135943 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116847 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12693504~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818623829000003, 2024-09-11T05:34:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9692923329999998, 2024-09-11T05:34:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.782 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116847 2024-09-11T05:34:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T05:34:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889747+0000", 2024-09-11T05:34:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.501e-06 2024-09-11T05:34:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889753+0000", 2024-09-11T05:34:39.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1360000000000002e-06 2024-09-11T05:34:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889756+0000", 2024-09-11T05:34:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3110000000000001e-06 2024-09-11T05:34:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890808+0000", 2024-09-11T05:34:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010523240000000001 2024-09-11T05:34:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890813+0000", 2024-09-11T05:34:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5650000000000003e-06 2024-09-11T05:34:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829436+0000", 2024-09-11T05:34:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93862351799999999 2024-09-11T05:34:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829443+0000", 2024-09-11T05:34:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5220000000000004e-06 2024-09-11T05:34:39.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858798+0000", 2024-09-11T05:34:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029354903 2024-09-11T05:34:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858899+0000", 2024-09-11T05:34:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101414 2024-09-11T05:34:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859035+0000", 2024-09-11T05:34:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013589 2024-09-11T05:34:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116848 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12718080~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818607143999998, 2024-09-11T05:34:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9695514759999999, 2024-09-11T05:34:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116848 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889760+0000", 2024-09-11T05:34:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889761+0000", 2024-09-11T05:34:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.189e-06 2024-09-11T05:34:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889764+0000", 2024-09-11T05:34:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:34:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889766+0000", 2024-09-11T05:34:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:34:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890850+0000", 2024-09-11T05:34:39.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010835479999999999 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890857+0000", 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6299999999999998e-06 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829465+0000", 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860787000000001 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829472+0000", 2024-09-11T05:34:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4420000000000003e-06 2024-09-11T05:34:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859062+0000", 2024-09-11T05:34:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0295903360000001 2024-09-11T05:34:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859169+0000", 2024-09-11T05:34:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010674400000000001 2024-09-11T05:34:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859311+0000", 2024-09-11T05:34:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014209499999999999 2024-09-11T05:34:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116849 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12742656~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818597357999998, 2024-09-11T05:34:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9698160310000001, 2024-09-11T05:34:39.794 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116849 2024-09-11T05:34:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889771+0000", 2024-09-11T05:34:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:34:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889774+0000", 2024-09-11T05:34:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:34:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889776+0000", 2024-09-11T05:34:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.638e-06 2024-09-11T05:34:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890886+0000", 2024-09-11T05:34:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011102519999999999 2024-09-11T05:34:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890891+0000", 2024-09-11T05:34:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2200000000000003e-06 2024-09-11T05:34:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829494+0000", 2024-09-11T05:34:39.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860342500000005 2024-09-11T05:34:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829501+0000", 2024-09-11T05:34:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4829999999999996e-06 2024-09-11T05:34:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859339+0000", 2024-09-11T05:34:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0298381320000001 2024-09-11T05:34:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859440+0000", 2024-09-11T05:34:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010145 2024-09-11T05:34:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859585+0000", 2024-09-11T05:34:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014513300000000001 2024-09-11T05:34:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116850 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12767232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818576331999999, 2024-09-11T05:34:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970125645, 2024-09-11T05:34:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116850 2024-09-11T05:34:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.801 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889791+0000", 2024-09-11T05:34:39.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889792+0000", 2024-09-11T05:34:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4899999999999999e-06 2024-09-11T05:34:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889795+0000", 2024-09-11T05:34:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889798+0000", 2024-09-11T05:34:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7089999999999998e-06 2024-09-11T05:34:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890924+0000", 2024-09-11T05:34:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001125685 2024-09-11T05:34:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890933+0000", 2024-09-11T05:34:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3340000000000008e-06 2024-09-11T05:34:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829523+0000", 2024-09-11T05:34:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858966099999996 2024-09-11T05:34:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829529+0000", 2024-09-11T05:34:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5740000000000001e-06 2024-09-11T05:34:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859614+0000", 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0300843289999999 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859743+0000", 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129407 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859916+0000", 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017282500000000001 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.806 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116851 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12791808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818536461999997, 2024-09-11T05:34:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970347268, 2024-09-11T05:34:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116851 2024-09-11T05:34:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:34:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889832+0000", 2024-09-11T05:34:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6819999999999999e-06 2024-09-11T05:34:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889838+0000", 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889841+0000", 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890957+0000", 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001115956 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890961+0000", 2024-09-11T05:34:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7050000000000001e-06 2024-09-11T05:34:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829552+0000", 2024-09-11T05:34:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93859101499999997 2024-09-11T05:34:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829558+0000", 2024-09-11T05:34:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5429999999999999e-06 2024-09-11T05:34:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859947+0000", 2024-09-11T05:34:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030388248 2024-09-11T05:34:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860043+0000", 2024-09-11T05:34:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5847999999999994e-05 2024-09-11T05:34:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860177+0000", 2024-09-11T05:34:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013484400000000001 2024-09-11T05:34:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116852 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12816384~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818521851, 2024-09-11T05:34:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970594859, 2024-09-11T05:34:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.813 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116852 2024-09-11T05:34:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889846+0000", 2024-09-11T05:34:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.204e-06 2024-09-11T05:34:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889849+0000", 2024-09-11T05:34:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.931e-06 2024-09-11T05:34:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889852+0000", 2024-09-11T05:34:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:34:39.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890993+0000", 2024-09-11T05:34:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001141176 2024-09-11T05:34:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891001+0000", 2024-09-11T05:34:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5259999999999996e-06 2024-09-11T05:34:39.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829582+0000", 2024-09-11T05:34:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858050800000004 2024-09-11T05:34:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829588+0000", 2024-09-11T05:34:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4980000000000003e-06 2024-09-11T05:34:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860207+0000", 2024-09-11T05:34:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030618713 2024-09-11T05:34:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860305+0000", 2024-09-11T05:34:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8209999999999997e-05 2024-09-11T05:34:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860440+0000", 2024-09-11T05:34:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134692 2024-09-11T05:34:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.819 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116853 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12840960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818511133000001, 2024-09-11T05:34:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.97084075, 2024-09-11T05:34:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116853 2024-09-11T05:34:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889856+0000", 2024-09-11T05:34:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:34:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889857+0000", 2024-09-11T05:34:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.435e-06 2024-09-11T05:34:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889860+0000", 2024-09-11T05:34:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9620000000000002e-06 2024-09-11T05:34:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889863+0000", 2024-09-11T05:34:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T05:34:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891036+0000", 2024-09-11T05:34:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011734580000000001 2024-09-11T05:34:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891042+0000", 2024-09-11T05:34:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3290000000000001e-06 2024-09-11T05:34:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829611+0000", 2024-09-11T05:34:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856954299999995 2024-09-11T05:34:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829618+0000", 2024-09-11T05:34:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T05:34:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860465+0000", 2024-09-11T05:34:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0308472500000001 2024-09-11T05:34:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860558+0000", 2024-09-11T05:34:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3253999999999999e-05 2024-09-11T05:34:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860696+0000", 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138169 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116854 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12865536~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818500942, 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9710979320000002, 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116854 2024-09-11T05:34:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889867+0000", 2024-09-11T05:34:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.155e-06 2024-09-11T05:34:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889871+0000", 2024-09-11T05:34:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9260000000000002e-06 2024-09-11T05:34:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889875+0000", 2024-09-11T05:34:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.262e-06 2024-09-11T05:34:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891070+0000", 2024-09-11T05:34:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011945160000000001 2024-09-11T05:34:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891079+0000", 2024-09-11T05:34:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3759999999999997e-06 2024-09-11T05:34:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829642+0000", 2024-09-11T05:34:39.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856325900000004 2024-09-11T05:34:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829649+0000", 2024-09-11T05:34:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:34:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860726+0000", 2024-09-11T05:34:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.031076791 2024-09-11T05:34:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860831+0000", 2024-09-11T05:34:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105003 2024-09-11T05:34:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860964+0000", 2024-09-11T05:34:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013285700000000001 2024-09-11T05:34:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116855 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12890112~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.818486161999999, 2024-09-11T05:34:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.971277814, 2024-09-11T05:34:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116855 2024-09-11T05:34:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.833 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817809+0000", 2024-09-11T05:34:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.92792850999999998 2024-09-11T05:34:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817815+0000", 2024-09-11T05:34:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4110000000000001e-06 2024-09-11T05:34:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817827+0000", 2024-09-11T05:34:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2031000000000001e-05 2024-09-11T05:34:39.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817837+0000", 2024-09-11T05:34:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2159999999999995e-06 2024-09-11T05:34:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829673+0000", 2024-09-11T05:34:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011836197 2024-09-11T05:34:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:39.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829679+0000", 2024-09-11T05:34:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5390000000000004e-06 2024-09-11T05:34:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861000+0000", 2024-09-11T05:34:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0313209539999999 2024-09-11T05:34:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861080+0000", 2024-09-11T05:34:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9606999999999999e-05 2024-09-11T05:34:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:39.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861158+0000", 2024-09-11T05:34:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8349000000000005e-05 2024-09-11T05:34:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:39.838 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:39.838 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:39.838 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:34:39.840 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:39.841 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:39.839+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:39.941 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:39.940+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:39.986 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:39.987 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:39.987 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:39.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:40.042 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:40.041+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:40.102 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:40.102 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:40.111 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:40.143 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:40.142+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:40.215 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:40.215 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:40.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:34:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 114.623933149, 2024-09-11T05:34:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:34:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:34:40.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:34:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:34:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:34:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:34:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:34:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:34:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:34:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:34:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:34:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:34:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:34:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:34:40.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:34:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:34:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:34:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:34:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:34:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:34:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.046997888999996, 2024-09-11T05:34:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:34:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:34:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:34:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:34:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:34:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:34:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:34:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:34:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:34:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:34:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:34:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:34:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:34:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:34:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:34:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:34:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.046979089999994, 2024-09-11T05:34:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:34:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:34:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:34:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:34:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:34:40.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:34:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:34:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:34:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:34:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:34:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.230 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.046955058999998, 2024-09-11T05:34:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:34:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:34:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:34:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:34:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:34:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:34:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:34:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:34:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:34:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:34:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:34:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:34:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:34:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:34:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:34:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.046878270999997, 2024-09-11T05:34:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:34:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:34:40.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:34:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:34:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:34:40.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:34:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:34:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:34:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:34:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:34:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:34:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:34:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:34:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:34:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.046850947999999, 2024-09-11T05:34:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:34:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:34:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.241 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:34:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:34:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:34:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:34:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:34:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:34:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:34:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:34:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:34:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:34:40.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:34:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:34:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:34:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:40.245 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.0468324, 2024-09-11T05:34:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:34:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:34:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:40.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:34:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:34:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:34:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:34:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:34:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:34:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:34:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:34:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:34:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:34:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:34:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:34:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.046814329, 2024-09-11T05:34:40.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:34:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:34:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:34:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:34:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:34:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:34:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:34:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:34:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:34:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:34:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:34:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:34:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:34:40.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:34:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.045216686000003, 2024-09-11T05:34:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:34:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:34:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:34:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:34:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:34:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:34:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:34:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:34:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:34:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:34:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:34:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:34:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.045196360000006, 2024-09-11T05:34:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:34:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:34:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:34:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:34:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:34:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:34:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:34:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:34:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:34:40.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:34:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:34:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:34:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:34:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.045157361999998, 2024-09-11T05:34:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:34:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:34:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:34:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:34:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:34:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:34:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:34:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:34:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:34:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:34:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:34:40.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:34:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:34:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:34:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:34:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.045136720000002, 2024-09-11T05:34:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:34:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:34:40.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:34:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:34:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:34:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:34:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:34:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:34:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:34:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:34:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.274 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.045013857000001, 2024-09-11T05:34:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:34:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:34:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:34:40.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:34:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:34:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:34:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:34:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:34:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:34:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:34:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:34:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:34:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:34:40.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:34:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:34:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:34:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:40.279 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.044854299999997, 2024-09-11T05:34:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:34:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:34:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:34:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:34:40.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:34:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:34:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:34:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:34:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:34:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:34:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:34:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:34:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:34:40.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:34:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:34:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.043169633000005, 2024-09-11T05:34:40.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:34:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:34:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:40.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:34:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:34:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:34:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:34:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:34:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:34:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.043141628000001, 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:34:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:34:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:34:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:34:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:34:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:34:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:34:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:34:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:34:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:34:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:34:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:34:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:34:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:34:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:34:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44388 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8118272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.041750295, 2024-09-11T05:34:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044546074999999997, 2024-09-11T05:34:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44388 2024-09-11T05:34:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172487+0000", 2024-09-11T05:34:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-11T05:34:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172490+0000", 2024-09-11T05:34:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5090000000000002e-06 2024-09-11T05:34:40.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172497+0000", 2024-09-11T05:34:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:34:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172502+0000", 2024-09-11T05:34:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2000000000000002e-06 2024-09-11T05:34:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216878+0000", 2024-09-11T05:34:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044375900000000003 2024-09-11T05:34:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216925+0000", 2024-09-11T05:34:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7058999999999998e-05 2024-09-11T05:34:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216982+0000", 2024-09-11T05:34:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6932000000000003e-05 2024-09-11T05:34:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.298 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.041675165000001, 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:34:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:34:40.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:34:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:34:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:34:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:34:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:34:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.303 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.041489863999999, 2024-09-11T05:34:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:34:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:34:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:34:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:34:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:34:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:34:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:34:40.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:34:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:34:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:34:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:34:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:34:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:34:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:34:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.041318408999999, 2024-09-11T05:34:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:34:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:40.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:34:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:34:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:34:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:34:40.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:34:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:34:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:34:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:34:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:34:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:34:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:34:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:34:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:34:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:34:40.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:34:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:40.313 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:40.313 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:40.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:40.315 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:40.314+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:40.415 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:40.415+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:40.419 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:40.420 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:40.420 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:40.420 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:40.428 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:40.517 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:40.516+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:40.530 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:40.530 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:40.530 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:40.531 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:40.531 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:40.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:40.617 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:40.617+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:40.643 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:40.643 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:40.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:40.643 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:40.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.644 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183598 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8097792~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.644 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:40.644 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.899905841999999, 2024-09-11T05:34:40.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038436577999999999, 2024-09-11T05:34:40.644 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.644 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.644 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.644 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.644 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.645 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.645 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183598 2024-09-11T05:34:40.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.645 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:40.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:40.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742042+0000", 2024-09-11T05:34:40.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:34:40.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742044+0000", 2024-09-11T05:34:40.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.119e-06 2024-09-11T05:34:40.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742049+0000", 2024-09-11T05:34:40.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6710000000000004e-06 2024-09-11T05:34:40.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.647 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.647 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742054+0000", 2024-09-11T05:34:40.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:34:40.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780385+0000", 2024-09-11T05:34:40.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038330831000000003 2024-09-11T05:34:40.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780435+0000", 2024-09-11T05:34:40.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0018999999999997e-05 2024-09-11T05:34:40.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780478+0000", 2024-09-11T05:34:40.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2823e-05 2024-09-11T05:34:40.649 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.649 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.649 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.649 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183599 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6750208~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.649 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:40.649 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.899887049, 2024-09-11T05:34:40.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038610453000000003, 2024-09-11T05:34:40.650 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.650 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.650 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.650 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.650 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.650 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.650 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183599 2024-09-11T05:34:40.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.650 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:40.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:40.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742061+0000", 2024-09-11T05:34:40.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2200000000000004e-07 2024-09-11T05:34:40.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742063+0000", 2024-09-11T05:34:40.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:34:40.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742068+0000", 2024-09-11T05:34:40.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6389999999999997e-06 2024-09-11T05:34:40.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742073+0000", 2024-09-11T05:34:40.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6990000000000002e-06 2024-09-11T05:34:40.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780516+0000", 2024-09-11T05:34:40.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038443428000000002 2024-09-11T05:34:40.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.654 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780601+0000", 2024-09-11T05:34:40.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4618999999999997e-05 2024-09-11T05:34:40.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.654 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.654 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780670+0000", 2024-09-11T05:34:40.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9593999999999998e-05 2024-09-11T05:34:40.654 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.654 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.654 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.655 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183600 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8138752~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.655 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:40.655 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.899868233999999, 2024-09-11T05:34:40.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038699900000000002, 2024-09-11T05:34:40.655 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.655 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.655 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.655 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.655 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.655 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.655 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183600 2024-09-11T05:34:40.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.656 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:40.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:40.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:34:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742081+0000", 2024-09-11T05:34:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.086e-06 2024-09-11T05:34:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742087+0000", 2024-09-11T05:34:40.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4770000000000002e-06 2024-09-11T05:34:40.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742092+0000", 2024-09-11T05:34:40.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7190000000000001e-06 2024-09-11T05:34:40.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780697+0000", 2024-09-11T05:34:40.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038605577000000002 2024-09-11T05:34:40.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780740+0000", 2024-09-11T05:34:40.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3139999999999997e-05 2024-09-11T05:34:40.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780779+0000", 2024-09-11T05:34:40.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8473000000000002e-05 2024-09-11T05:34:40.659 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.659 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.659 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.660 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183601 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6791168~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.660 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:40.660 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.899850205, 2024-09-11T05:34:40.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038869364000000003, 2024-09-11T05:34:40.660 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.660 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.660 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.660 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.660 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.661 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.661 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183601 2024-09-11T05:34:40.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.661 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:40.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:40.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:40.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9900000000000002e-07 2024-09-11T05:34:40.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742099+0000", 2024-09-11T05:34:40.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:34:40.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742105+0000", 2024-09-11T05:34:40.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0759999999999999e-06 2024-09-11T05:34:40.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742110+0000", 2024-09-11T05:34:40.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6600000000000003e-06 2024-09-11T05:34:40.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780809+0000", 2024-09-11T05:34:40.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038698681999999998 2024-09-11T05:34:40.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780886+0000", 2024-09-11T05:34:40.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7888999999999999e-05 2024-09-11T05:34:40.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780966+0000", 2024-09-11T05:34:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9797999999999997e-05 2024-09-11T05:34:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183602 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8179712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.899831385999999, 2024-09-11T05:34:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038955028000000003, 2024-09-11T05:34:40.666 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.666 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.666 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.666 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.666 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.666 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.666 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183602 2024-09-11T05:34:40.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.666 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.666 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.666 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.667 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:40.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.667 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.667 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:40.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.667 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.667 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:40.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:34:40.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.668 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.668 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742122+0000", 2024-09-11T05:34:40.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9880000000000001e-06 2024-09-11T05:34:40.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.668 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.668 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742128+0000", 2024-09-11T05:34:40.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2600000000000002e-06 2024-09-11T05:34:40.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742133+0000", 2024-09-11T05:34:40.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9010000000000002e-06 2024-09-11T05:34:40.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780981+0000", 2024-09-11T05:34:40.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038848102000000002 2024-09-11T05:34:40.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781024+0000", 2024-09-11T05:34:40.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2231000000000003e-05 2024-09-11T05:34:40.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781071+0000", 2024-09-11T05:34:40.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7215000000000001e-05 2024-09-11T05:34:40.670 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.670 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.670 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.670 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183603 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6832128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.671 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:40.671 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.899807760000002, 2024-09-11T05:34:40.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039121378999999998, 2024-09-11T05:34:40.671 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.671 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.671 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.671 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.671 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.671 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.671 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183603 2024-09-11T05:34:40.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.671 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:40.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:40.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742215+0000", 2024-09-11T05:34:40.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5419000000000004e-05 2024-09-11T05:34:40.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742218+0000", 2024-09-11T05:34:40.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0989999999999999e-06 2024-09-11T05:34:40.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742225+0000", 2024-09-11T05:34:40.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4019999999999996e-06 2024-09-11T05:34:40.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742231+0000", 2024-09-11T05:34:40.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6969999999999998e-06 2024-09-11T05:34:40.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781102+0000", 2024-09-11T05:34:40.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038871348 2024-09-11T05:34:40.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781187+0000", 2024-09-11T05:34:40.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4719e-05 2024-09-11T05:34:40.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781261+0000", 2024-09-11T05:34:40.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3695000000000005e-05 2024-09-11T05:34:40.675 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.676 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.676 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.676 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183604 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8220672~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.676 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:40.676 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.899707200000002, 2024-09-11T05:34:40.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039154538000000003, 2024-09-11T05:34:40.676 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.676 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.676 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183604 2024-09-11T05:34:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:40.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743491+0000", 2024-09-11T05:34:40.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0012514620000000001 2024-09-11T05:34:40.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743496+0000", 2024-09-11T05:34:40.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2910000000000001e-06 2024-09-11T05:34:40.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743506+0000", 2024-09-11T05:34:40.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0039e-05 2024-09-11T05:34:40.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743513+0000", 2024-09-11T05:34:40.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:34:40.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781296+0000", 2024-09-11T05:34:40.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037783187000000003 2024-09-11T05:34:40.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781347+0000", 2024-09-11T05:34:40.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1375000000000002e-05 2024-09-11T05:34:40.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781394+0000", 2024-09-11T05:34:40.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119000000000001e-05 2024-09-11T05:34:40.681 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.681 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.681 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.681 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183609 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6955008~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.681 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:40.681 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.898312345000001, 2024-09-11T05:34:40.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038553630999999998, 2024-09-11T05:34:40.682 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.682 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.682 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.682 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.682 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.682 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.682 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183609 2024-09-11T05:34:40.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.682 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:40.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:40.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:40.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.15e-07 2024-09-11T05:34:40.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743637+0000", 2024-09-11T05:34:40.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.86e-06 2024-09-11T05:34:40.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743641+0000", 2024-09-11T05:34:40.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7000000000000002e-06 2024-09-11T05:34:40.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743645+0000", 2024-09-11T05:34:40.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9600000000000002e-06 2024-09-11T05:34:40.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782023+0000", 2024-09-11T05:34:40.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038378520999999999 2024-09-11T05:34:40.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782119+0000", 2024-09-11T05:34:40.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5665e-05 2024-09-11T05:34:40.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782188+0000", 2024-09-11T05:34:40.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9610000000000006e-05 2024-09-11T05:34:40.686 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.686 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.686 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.686 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183610 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8343552~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.686 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:40.687 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.898298767, 2024-09-11T05:34:40.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038675859, 2024-09-11T05:34:40.687 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.687 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.687 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.687 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.687 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.687 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.687 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183610 2024-09-11T05:34:40.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.687 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:40.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:40.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743649+0000", 2024-09-11T05:34:40.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-07 2024-09-11T05:34:40.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743650+0000", 2024-09-11T05:34:40.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5799999999999999e-06 2024-09-11T05:34:40.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743656+0000", 2024-09-11T05:34:40.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:40.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743660+0000", 2024-09-11T05:34:40.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4259999999999999e-06 2024-09-11T05:34:40.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782218+0000", 2024-09-11T05:34:40.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038558508999999998 2024-09-11T05:34:40.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782270+0000", 2024-09-11T05:34:40.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.168e-05 2024-09-11T05:34:40.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.695 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.695 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782324+0000", 2024-09-11T05:34:40.695 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4388999999999997e-05 2024-09-11T05:34:40.695 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.695 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.695 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.695 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.695 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183611 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6995968~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.695 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:40.695 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.898283875000001, 2024-09-11T05:34:40.696 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038861554999999999, 2024-09-11T05:34:40.696 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.696 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.696 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.696 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.696 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.696 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.696 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183611 2024-09-11T05:34:40.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.696 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.696 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.697 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:40.697 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.697 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.697 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:40.697 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.697 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.697 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:40.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4299999999999999e-07 2024-09-11T05:34:40.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743665+0000", 2024-09-11T05:34:40.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5060000000000001e-06 2024-09-11T05:34:40.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743668+0000", 2024-09-11T05:34:40.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1549999999999999e-06 2024-09-11T05:34:40.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743671+0000", 2024-09-11T05:34:40.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7599999999999998e-06 2024-09-11T05:34:40.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782359+0000", 2024-09-11T05:34:40.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038687946000000001 2024-09-11T05:34:40.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.700 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782437+0000", 2024-09-11T05:34:40.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8539000000000001e-05 2024-09-11T05:34:40.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.700 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.700 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.700 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782525+0000", 2024-09-11T05:34:40.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7405999999999996e-05 2024-09-11T05:34:40.700 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.700 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.700 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.700 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.701 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183612 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8384512~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.701 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:40.701 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.898272706, 2024-09-11T05:34:40.701 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039040111000000002, 2024-09-11T05:34:40.701 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.701 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.701 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.701 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.701 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.701 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.701 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183612 2024-09-11T05:34:40.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.702 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:40.702 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:40.702 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.703 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743675+0000", 2024-09-11T05:34:40.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2100000000000001e-07 2024-09-11T05:34:40.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.703 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743676+0000", 2024-09-11T05:34:40.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.212e-06 2024-09-11T05:34:40.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.703 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743679+0000", 2024-09-11T05:34:40.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:34:40.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.704 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.704 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743681+0000", 2024-09-11T05:34:40.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.604e-06 2024-09-11T05:34:40.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.704 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.704 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782560+0000", 2024-09-11T05:34:40.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038878687000000002 2024-09-11T05:34:40.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.705 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782644+0000", 2024-09-11T05:34:40.705 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3733000000000006e-05 2024-09-11T05:34:40.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.705 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782714+0000", 2024-09-11T05:34:40.705 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0655999999999996e-05 2024-09-11T05:34:40.705 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.705 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.705 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.706 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183613 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7036928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.706 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:40.706 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.898262673000001, 2024-09-11T05:34:40.706 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039233924000000003, 2024-09-11T05:34:40.706 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.706 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.706 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.706 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.706 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.706 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.707 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183613 2024-09-11T05:34:40.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.707 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.707 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.707 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.707 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:40.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.707 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.707 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.707 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:40.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.708 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.708 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745489+0000", 2024-09-11T05:34:40.708 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0018047549999999999 2024-09-11T05:34:40.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.708 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.708 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745493+0000", 2024-09-11T05:34:40.708 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0439999999999997e-06 2024-09-11T05:34:40.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.709 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745501+0000", 2024-09-11T05:34:40.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:34:40.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.709 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745507+0000", 2024-09-11T05:34:40.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9490000000000001e-06 2024-09-11T05:34:40.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.709 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.710 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782756+0000", 2024-09-11T05:34:40.710 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037249522 2024-09-11T05:34:40.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.710 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.710 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782839+0000", 2024-09-11T05:34:40.710 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3133999999999994e-05 2024-09-11T05:34:40.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.710 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.710 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782918+0000", 2024-09-11T05:34:40.710 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9167999999999998e-05 2024-09-11T05:34:40.711 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.711 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.711 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.711 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.711 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183622 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7323648~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.711 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:40.711 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.896304258000001, 2024-09-11T05:34:40.711 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038618008000000002, 2024-09-11T05:34:40.711 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.711 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.711 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.712 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.712 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.712 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.712 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183622 2024-09-11T05:34:40.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.712 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.712 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.712 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.712 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:40.712 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.712 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:40.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:40.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4900000000000001e-07 2024-09-11T05:34:40.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745645+0000", 2024-09-11T05:34:40.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9709999999999998e-06 2024-09-11T05:34:40.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.714 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745651+0000", 2024-09-11T05:34:40.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.251e-06 2024-09-11T05:34:40.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.714 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745657+0000", 2024-09-11T05:34:40.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:34:40.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.715 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784095+0000", 2024-09-11T05:34:40.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038437791999999998 2024-09-11T05:34:40.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.715 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784201+0000", 2024-09-11T05:34:40.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000106801 2024-09-11T05:34:40.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.716 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784261+0000", 2024-09-11T05:34:40.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9475999999999998e-05 2024-09-11T05:34:40.716 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.716 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.716 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.716 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183623 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4296704~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.716 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:40.716 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.896284074, 2024-09-11T05:34:40.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038730705999999997, 2024-09-11T05:34:40.717 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.717 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.717 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.717 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.717 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.717 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.717 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183623 2024-09-11T05:34:40.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.717 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.717 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.717 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:40.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.718 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.718 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.718 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:40.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.718 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.718 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.718 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:40.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.39e-07 2024-09-11T05:34:40.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.719 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.719 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745665+0000", 2024-09-11T05:34:40.719 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9860000000000001e-06 2024-09-11T05:34:40.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.719 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.720 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745671+0000", 2024-09-11T05:34:40.720 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.818e-06 2024-09-11T05:34:40.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.720 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.720 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745676+0000", 2024-09-11T05:34:40.720 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.972e-06 2024-09-11T05:34:40.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.720 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.720 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784296+0000", 2024-09-11T05:34:40.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038620131000000002 2024-09-11T05:34:40.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.721 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.721 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784353+0000", 2024-09-11T05:34:40.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6644999999999997e-05 2024-09-11T05:34:40.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.721 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.721 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784394+0000", 2024-09-11T05:34:40.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0815000000000001e-05 2024-09-11T05:34:40.721 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.722 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.722 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.722 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.722 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183624 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7364608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.722 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:40.722 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.896265196999998, 2024-09-11T05:34:40.722 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038826315, 2024-09-11T05:34:40.722 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.722 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.722 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.723 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.723 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.723 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.723 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183624 2024-09-11T05:34:40.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.723 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:40.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.724 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.724 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:40.724 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.724 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.724 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:40.724 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:34:40.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.725 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745684+0000", 2024-09-11T05:34:40.725 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0980000000000001e-06 2024-09-11T05:34:40.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.725 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.725 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745690+0000", 2024-09-11T05:34:40.725 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.733e-06 2024-09-11T05:34:40.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.725 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.725 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745695+0000", 2024-09-11T05:34:40.726 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:34:40.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.726 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.726 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.726 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784418+0000", 2024-09-11T05:34:40.726 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038722813000000002 2024-09-11T05:34:40.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.726 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.726 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.726 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784460+0000", 2024-09-11T05:34:40.726 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2222999999999999e-05 2024-09-11T05:34:40.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.727 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.727 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.727 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784508+0000", 2024-09-11T05:34:40.727 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8349000000000001e-05 2024-09-11T05:34:40.727 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.727 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.727 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.727 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.727 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183625 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4337664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.727 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:40.727 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.896245489000002, 2024-09-11T05:34:40.728 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923776, 2024-09-11T05:34:40.728 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.728 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.728 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:40.728 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.728 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.728 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.728 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183625 2024-09-11T05:34:40.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.728 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.729 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:40.729 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.729 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.729 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.729 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:40.729 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.729 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.729 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.729 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:40.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.41e-07 2024-09-11T05:34:40.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.730 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745713+0000", 2024-09-11T05:34:40.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0579e-05 2024-09-11T05:34:40.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.730 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745719+0000", 2024-09-11T05:34:40.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4540000000000004e-06 2024-09-11T05:34:40.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.731 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.731 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745724+0000", 2024-09-11T05:34:40.731 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1170000000000003e-06 2024-09-11T05:34:40.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.731 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.731 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784532+0000", 2024-09-11T05:34:40.731 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038807618000000002 2024-09-11T05:34:40.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.732 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:40.732 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784586+0000", 2024-09-11T05:34:40.732 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4432999999999999e-05 2024-09-11T05:34:40.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.732 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.732 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.732 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784625+0000", 2024-09-11T05:34:40.732 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9233999999999997e-05 2024-09-11T05:34:40.732 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.732 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.732 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.733 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.733 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.733 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183626 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.733 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:40.733 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.896215826999999, 2024-09-11T05:34:40.733 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038934147000000002, 2024-09-11T05:34:40.733 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.733 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.733 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:40.733 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.733 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.734 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.734 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183626 2024-09-11T05:34:40.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.734 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.734 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.734 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.734 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:40.734 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.734 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.734 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.734 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:40.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.735 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.735 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745732+0000", 2024-09-11T05:34:40.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:34:40.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.735 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.735 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745734+0000", 2024-09-11T05:34:40.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9649999999999998e-06 2024-09-11T05:34:40.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.736 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745739+0000", 2024-09-11T05:34:40.736 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.806e-06 2024-09-11T05:34:40.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.736 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745744+0000", 2024-09-11T05:34:40.736 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5210000000000004e-06 2024-09-11T05:34:40.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.737 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.737 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.737 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784660+0000", 2024-09-11T05:34:40.737 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038916077 2024-09-11T05:34:40.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.737 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.737 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.737 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784665+0000", 2024-09-11T05:34:40.737 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3929999999999999e-06 2024-09-11T05:34:40.737 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.737 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.738 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.738 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.738 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.738 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183627 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.738 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:40.738 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.896197309000001, 2024-09-11T05:34:40.738 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038942282000000002, 2024-09-11T05:34:40.738 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.738 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.738 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:40.738 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.739 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.739 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.739 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183627 2024-09-11T05:34:40.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.739 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.739 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.739 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.739 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:40.739 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.739 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.740 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.740 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:40.740 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.740 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.740 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.740 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:40.740 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:40.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.740 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.740 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.741 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745752+0000", 2024-09-11T05:34:40.741 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9e-06 2024-09-11T05:34:40.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.741 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.741 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.741 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745758+0000", 2024-09-11T05:34:40.741 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6899999999999997e-06 2024-09-11T05:34:40.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.741 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.741 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.741 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745763+0000", 2024-09-11T05:34:40.742 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9169999999999997e-06 2024-09-11T05:34:40.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.742 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.742 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.742 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784686+0000", 2024-09-11T05:34:40.742 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923874999999997 2024-09-11T05:34:40.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.742 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.742 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.742 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784692+0000", 2024-09-11T05:34:40.742 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5600000000000001e-06 2024-09-11T05:34:40.742 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.743 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.743 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.743 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.743 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.743 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183628 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.743 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:40.743 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.896158698000001, 2024-09-11T05:34:40.743 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038927438000000002, 2024-09-11T05:34:40.743 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.743 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.743 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:40.743 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.744 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.744 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.744 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183628 2024-09-11T05:34:40.744 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.744 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.744 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.744 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.744 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:40.744 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.744 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.744 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.744 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.745 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:40.745 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.745 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.745 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.745 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745789+0000", 2024-09-11T05:34:40.745 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3000000000000002e-07 2024-09-11T05:34:40.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.745 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.745 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.745 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745791+0000", 2024-09-11T05:34:40.746 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0209999999999998e-06 2024-09-11T05:34:40.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.746 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.746 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.746 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745802+0000", 2024-09-11T05:34:40.746 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0886e-05 2024-09-11T05:34:40.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.746 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.746 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.746 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745806+0000", 2024-09-11T05:34:40.746 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0289999999999999e-06 2024-09-11T05:34:40.747 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.747 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.747 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.747 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784712+0000", 2024-09-11T05:34:40.747 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038905922000000003 2024-09-11T05:34:40.747 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.747 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.747 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.747 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784716+0000", 2024-09-11T05:34:40.747 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.25e-06 2024-09-11T05:34:40.747 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.748 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.748 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.748 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.748 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183629 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:40.748 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:40.748 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 28.896136981000001, 2024-09-11T05:34:40.748 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038954874, 2024-09-11T05:34:40.748 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:40.748 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:40.748 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:40.748 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:40.749 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:40.749 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:40.749 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183629 2024-09-11T05:34:40.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.749 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:40.749 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.749 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:40.749 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:40.749 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.749 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.749 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:40.750 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:40.750 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:40.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.750 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.750 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:40.750 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747489+0000", 2024-09-11T05:34:40.750 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0016785529999999999 2024-09-11T05:34:40.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.750 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.750 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:40.750 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747493+0000", 2024-09-11T05:34:40.751 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0600000000000001e-06 2024-09-11T05:34:40.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.751 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:40.751 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747501+0000", 2024-09-11T05:34:40.751 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9109999999999993e-06 2024-09-11T05:34:40.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.751 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:40.751 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747507+0000", 2024-09-11T05:34:40.751 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3899999999999998e-06 2024-09-11T05:34:40.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.752 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.752 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:40.752 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784760+0000", 2024-09-11T05:34:40.752 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037253197000000002 2024-09-11T05:34:40.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:40.752 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:40.752 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:40.752 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784765+0000", 2024-09-11T05:34:40.752 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.763e-06 2024-09-11T05:34:40.752 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.752 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.753 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.753 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:40.753 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:40.753 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:40.754 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T05:34:40.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:40.755 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:40.753+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:40.855 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:40.854+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:40.909 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:40.909 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:40.918 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:40.956 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:34:40.962 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:40.961+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:41.022 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:41.022 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:41.022 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:41.023 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:41.023 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:41.031 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:41.057 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:41.057+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:41.075 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:41.075 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:41.091 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:41.092 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:41.107 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:41.108 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:41.123 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:41.123 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:41.142 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:41.142 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:34:41.157 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:41.158 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:41.158 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:41.157+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:41.173 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:41.174 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:41.176 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:41.177 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:41.186 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:41.189 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:41.189 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:41.259 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:41.258+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:41.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:41.359 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:41.358+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:41.399 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:41.399 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:41.408 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:41.460 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:41.460+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:41.551 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:41.551 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:41.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:34:41.561 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:41.559+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:41.661 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:41.661+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:41.662 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:41.662 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:41.671 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:34:41.762 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:41.761+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:41.775 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:41.775 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:41.784 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:34:41.862 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:41.862+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:41.928 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:41.928 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:41.937 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:41.963 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:41.962+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:42.039 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:42.040 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:42.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:42.091 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:42.091+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:42.150 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:42.150 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:42.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:42.201 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:42.200+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:42.266 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:42.266+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:42.303 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:42.303 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:42.312 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:42.367 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:42.367+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:42.455 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:42.455 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:42.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:42.468 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:42.467+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:42.566 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:42.567 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:42.569 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:42.568+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:42.576 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:42.671 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:42.670+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:42.718 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:42.718 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:42.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:42.750 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 5, 6] out_osds: [4, 3, 7] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-09-11T05:34:42.750 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:34:42.750 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 2, 5, 6] 2024-09-11T05:34:42.751 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 1 2024-09-11T05:34:42.763 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:34:42.771 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:42.770+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:42.855 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:42.855 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:42.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:42.908 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:42.908+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:42.972 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:42.971+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:42.979 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:42.979 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:42.988 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:43.073 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:43.072+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:43.085 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-11T05:34:43.084+0000 7fc03b8fe640 -1 mon.a@0(leader).osd e117 definitely_dead 0 2024-09-11T05:34:43.133 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:43.133 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:43.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:43.185 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:43.185+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:43.201 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:34:43.247 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:43.247 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:43.256 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:43.299 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:43.299+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:43.325 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:43.325 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:43.342 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:43.343 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:43.360 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:43.360 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:43.364 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:43.364 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:43.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:43.377 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:43.377 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:43.378 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:43.377+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:43.394 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:43.394 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:34:43.412 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:43.412 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:43.429 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:43.429 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:43.446 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:43.446 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:43.483 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:43.483 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:43.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:43.484 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:43.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.484 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:34:43.484 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:43.484 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 117.892000225, 2024-09-11T05:34:43.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:34:43.484 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:43.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:34:43.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:34:43.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:34:43.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.485 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:43.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:34:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:34:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:34:43.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:34:43.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:34:43.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:34:43.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:34:43.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:34:43.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:34:43.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:34:43.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:43.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:34:43.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:34:43.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:34:43.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:34:43.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:34:43.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:34:43.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.489 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.489 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.489 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.315064965000005, 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:34:43.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:34:43.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:34:43.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:34:43.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:34:43.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:34:43.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:34:43.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.315046166000002, 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:34:43.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.495 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:43.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:43.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:34:43.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:34:43.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:34:43.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:34:43.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.498 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.315022135000007, 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:43.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:43.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:43.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:34:43.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:34:43.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:34:43.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:34:43.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:34:43.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:34:43.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:34:43.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.314945347000005, 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.504 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:34:43.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.504 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:43.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:43.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:43.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:43.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:34:43.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:34:43.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:34:43.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:34:43.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:34:43.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:34:43.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:34:43.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:34:43.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:34:43.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:34:43.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:34:43.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:34:43.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.508 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.508 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.508 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:43.508 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.314918023999994, 2024-09-11T05:34:43.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:34:43.508 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:34:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:43.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:34:43.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:34:43.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:34:43.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:34:43.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.512 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.512 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.513 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:43.513 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.314899475999994, 2024-09-11T05:34:43.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:34:43.513 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:34:43.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.514 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:43.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:43.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:34:43.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:34:43.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:34:43.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:34:43.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:34:43.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:34:43.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:34:43.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:34:43.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.517 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.517 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.517 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:43.518 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.314881404999994, 2024-09-11T05:34:43.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:34:43.518 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.518 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:34:43.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.518 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:34:43.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:34:43.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:34:43.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:34:43.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:34:43.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:34:43.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:34:43.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.522 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.522 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.522 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:43.522 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.313283761999998, 2024-09-11T05:34:43.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:34:43.522 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:34:43.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:34:43.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:34:43.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:34:43.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:34:43.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:34:43.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.527 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.527 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:43.527 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.313263436, 2024-09-11T05:34:43.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:34:43.527 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:34:43.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.527 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:43.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:43.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:43.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:43.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:34:43.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:34:43.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:34:43.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:43.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:34:43.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:34:43.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:34:43.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:34:43.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.532 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.532 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:43.532 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.313224438000006, 2024-09-11T05:34:43.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:34:43.532 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:34:43.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.532 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:43.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:34:43.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:34:43.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:34:43.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:34:43.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:34:43.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:34:43.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:34:43.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:34:43.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:34:43.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:34:43.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:34:43.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:34:43.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:34:43.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.536 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.536 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.536 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:43.536 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.313203795999996, 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:43.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:43.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:34:43.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:34:43.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:34:43.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:34:43.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:34:43.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:34:43.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:34:43.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:43.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:34:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:34:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:34:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:34:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:34:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:34:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.313080932999995, 2024-09-11T05:34:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:34:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:43.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:34:43.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:34:43.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:34:43.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:34:43.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:34:43.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:34:43.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:34:43.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:34:43.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:34:43.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:34:43.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:34:43.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:34:43.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:34:43.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:34:43.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.545 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.312921376000006, 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:34:43.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:34:43.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:34:43.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:34:43.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:34:43.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:34:43.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:34:43.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.311236708999999, 2024-09-11T05:34:43.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:43.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:34:43.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:34:43.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:34:43.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:34:43.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:34:43.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:34:43.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:34:43.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:34:43.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.311208703999995, 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:34:43.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.556 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:43.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:43.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:34:43.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:34:43.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:34:43.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:34:43.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:34:43.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:34:43.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44388 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8118272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.559 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:43.560 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.309817370999994, 2024-09-11T05:34:43.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044546074999999997, 2024-09-11T05:34:43.560 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.560 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44388 2024-09-11T05:34:43.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.560 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:43.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172436+0000", 2024-09-11T05:34:43.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172487+0000", 2024-09-11T05:34:43.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-11T05:34:43.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172490+0000", 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5090000000000002e-06 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172497+0000", 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172502+0000", 2024-09-11T05:34:43.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2000000000000002e-06 2024-09-11T05:34:43.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216878+0000", 2024-09-11T05:34:43.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044375900000000003 2024-09-11T05:34:43.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216925+0000", 2024-09-11T05:34:43.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7058999999999998e-05 2024-09-11T05:34:43.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.216982+0000", 2024-09-11T05:34:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6932000000000003e-05 2024-09-11T05:34:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.309742240999995, 2024-09-11T05:34:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:34:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:43.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:34:43.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:34:43.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:34:43.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:34:43.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:34:43.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:34:43.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:34:43.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:34:43.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:34:43.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:34:43.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:34:43.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:34:43.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:34:43.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:34:43.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.569 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.569 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.569 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:43.569 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.309556939999993, 2024-09-11T05:34:43.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:34:43.569 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:34:43.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:34:43.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:34:43.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:34:43.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:34:43.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:34:43.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:34:43.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:34:43.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:34:43.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:34:43.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.573 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.573 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:43.574 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:43.574 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.309385485000007, 2024-09-11T05:34:43.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:34:43.574 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:43.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:43.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:43.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:43.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:43.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:43.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:34:43.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.574 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:43.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:43.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:43.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:43.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:43.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:43.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:43.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:34:43.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:34:43.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:43.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:34:43.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:34:43.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:43.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:34:43.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:34:43.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:43.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:43.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:43.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:34:43.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:34:43.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.578 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:43.578 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:43.578 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:43.578 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:43.482+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:43.580 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:43.620 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:43.620+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:43.682 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:43.681+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:43.695 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:43.695 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:43.695 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:43.695 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:43.705 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:43.757 INFO:teuthology.orchestra.run.smithi070.stderr:marked out osd.1. 2024-09-11T05:34:43.760 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T05:34:43.789 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:43.788+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:43.853 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:43.854 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:43.854 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:43.854 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:43.854 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:43.863 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:43.884 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:43.884+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:43.985 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:43.984+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:44.008 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:44.008 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:44.008 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:44.009 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:44.009 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.009 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183598 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8097792~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.009 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:44.009 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.265196557000003, 2024-09-11T05:34:44.009 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038436577999999999, 2024-09-11T05:34:44.009 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.009 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.009 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.009 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.009 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.010 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.010 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183598 2024-09-11T05:34:44.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.010 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.010 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.010 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.010 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:44.010 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.010 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.010 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.011 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:44.011 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.011 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.011 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.011 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742042+0000", 2024-09-11T05:34:44.011 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:34:44.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.011 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.011 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.012 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742044+0000", 2024-09-11T05:34:44.012 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.119e-06 2024-09-11T05:34:44.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.012 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.012 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.012 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742049+0000", 2024-09-11T05:34:44.012 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6710000000000004e-06 2024-09-11T05:34:44.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.012 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.012 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.012 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742054+0000", 2024-09-11T05:34:44.013 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:34:44.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.013 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.013 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.013 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780385+0000", 2024-09-11T05:34:44.013 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038330831000000003 2024-09-11T05:34:44.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.013 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.013 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.013 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780435+0000", 2024-09-11T05:34:44.013 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0018999999999997e-05 2024-09-11T05:34:44.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.014 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.014 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.014 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780478+0000", 2024-09-11T05:34:44.014 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2823e-05 2024-09-11T05:34:44.014 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.014 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.014 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.014 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.014 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183599 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6750208~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.015 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:44.015 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.265177764000001, 2024-09-11T05:34:44.015 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038610453000000003, 2024-09-11T05:34:44.015 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.015 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.015 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.015 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.015 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.015 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.015 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183599 2024-09-11T05:34:44.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.016 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.016 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.016 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.016 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:44.016 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.016 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.016 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.016 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:44.016 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.017 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.017 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.017 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742061+0000", 2024-09-11T05:34:44.017 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2200000000000004e-07 2024-09-11T05:34:44.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.017 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.017 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.017 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742063+0000", 2024-09-11T05:34:44.017 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:34:44.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.017 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.018 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.018 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742068+0000", 2024-09-11T05:34:44.018 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6389999999999997e-06 2024-09-11T05:34:44.018 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.018 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.018 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.018 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742073+0000", 2024-09-11T05:34:44.018 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6990000000000002e-06 2024-09-11T05:34:44.018 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.018 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.018 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.019 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780516+0000", 2024-09-11T05:34:44.019 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038443428000000002 2024-09-11T05:34:44.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.019 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.019 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.019 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780601+0000", 2024-09-11T05:34:44.019 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4618999999999997e-05 2024-09-11T05:34:44.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.019 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.019 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.019 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780670+0000", 2024-09-11T05:34:44.019 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9593999999999998e-05 2024-09-11T05:34:44.020 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.020 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.020 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.020 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.020 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183600 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8138752~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.020 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:44.020 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.265158949000003, 2024-09-11T05:34:44.020 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038699900000000002, 2024-09-11T05:34:44.020 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.021 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.021 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.021 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.021 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.021 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.021 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183600 2024-09-11T05:34:44.021 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.021 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.021 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.021 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.021 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:44.021 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.022 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742081+0000", 2024-09-11T05:34:44.023 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.086e-06 2024-09-11T05:34:44.023 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.023 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.023 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.023 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742087+0000", 2024-09-11T05:34:44.023 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4770000000000002e-06 2024-09-11T05:34:44.023 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.023 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.023 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.023 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742092+0000", 2024-09-11T05:34:44.023 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7190000000000001e-06 2024-09-11T05:34:44.023 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.024 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.024 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.024 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780697+0000", 2024-09-11T05:34:44.024 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038605577000000002 2024-09-11T05:34:44.024 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.024 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.024 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.024 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780740+0000", 2024-09-11T05:34:44.024 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3139999999999997e-05 2024-09-11T05:34:44.024 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.024 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.024 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780779+0000", 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8473000000000002e-05 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183601 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6791168~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.26514092, 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038869364000000003, 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183601 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.026 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:44.027 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.027 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.027 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:44.027 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9900000000000002e-07 2024-09-11T05:34:44.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.027 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.027 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742099+0000", 2024-09-11T05:34:44.027 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:34:44.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.027 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.028 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.028 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742105+0000", 2024-09-11T05:34:44.028 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0759999999999999e-06 2024-09-11T05:34:44.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.028 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.028 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.028 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742110+0000", 2024-09-11T05:34:44.028 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6600000000000003e-06 2024-09-11T05:34:44.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.029 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.029 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.029 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780809+0000", 2024-09-11T05:34:44.029 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038698681999999998 2024-09-11T05:34:44.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.029 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.029 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.029 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780886+0000", 2024-09-11T05:34:44.029 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7888999999999999e-05 2024-09-11T05:34:44.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.030 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.030 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780966+0000", 2024-09-11T05:34:44.030 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9797999999999997e-05 2024-09-11T05:34:44.030 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.030 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.030 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.030 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.030 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183602 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8179712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.030 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:44.031 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.265122101000003, 2024-09-11T05:34:44.031 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038955028000000003, 2024-09-11T05:34:44.031 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.031 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.031 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.031 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.031 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.031 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.031 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183602 2024-09-11T05:34:44.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.031 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.031 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.031 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:44.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.032 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.032 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:44.032 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.032 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.032 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.032 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:44.033 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:34:44.033 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.033 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.033 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.033 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742122+0000", 2024-09-11T05:34:44.033 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9880000000000001e-06 2024-09-11T05:34:44.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.034 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.034 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.034 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742128+0000", 2024-09-11T05:34:44.034 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2600000000000002e-06 2024-09-11T05:34:44.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.034 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.034 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.034 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742133+0000", 2024-09-11T05:34:44.034 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9010000000000002e-06 2024-09-11T05:34:44.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.034 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.035 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.035 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780981+0000", 2024-09-11T05:34:44.035 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038848102000000002 2024-09-11T05:34:44.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.035 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.035 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.035 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781024+0000", 2024-09-11T05:34:44.035 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2231000000000003e-05 2024-09-11T05:34:44.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.035 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.035 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.036 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781071+0000", 2024-09-11T05:34:44.036 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7215000000000001e-05 2024-09-11T05:34:44.036 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.036 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.036 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.036 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.036 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.036 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183603 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6832128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.036 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:44.036 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.265098475000002, 2024-09-11T05:34:44.036 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039121378999999998, 2024-09-11T05:34:44.037 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.037 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.037 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.037 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.037 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.037 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.037 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183603 2024-09-11T05:34:44.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.037 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.037 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.037 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.038 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:44.038 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.038 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.038 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.038 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:44.038 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.038 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.038 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.038 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742215+0000", 2024-09-11T05:34:44.038 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5419000000000004e-05 2024-09-11T05:34:44.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.039 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.039 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.039 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742218+0000", 2024-09-11T05:34:44.039 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0989999999999999e-06 2024-09-11T05:34:44.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.039 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.039 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.039 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742225+0000", 2024-09-11T05:34:44.039 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4019999999999996e-06 2024-09-11T05:34:44.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.040 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.040 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.040 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742231+0000", 2024-09-11T05:34:44.040 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6969999999999998e-06 2024-09-11T05:34:44.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.040 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.040 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.040 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781102+0000", 2024-09-11T05:34:44.040 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038871348 2024-09-11T05:34:44.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.040 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.041 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.041 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781187+0000", 2024-09-11T05:34:44.041 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4719e-05 2024-09-11T05:34:44.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.041 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.041 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.041 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781261+0000", 2024-09-11T05:34:44.041 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3695000000000005e-05 2024-09-11T05:34:44.041 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.041 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.041 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.042 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.042 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.042 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183604 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8220672~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.042 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:44.042 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.264997915000002, 2024-09-11T05:34:44.042 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039154538000000003, 2024-09-11T05:34:44.042 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.042 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.042 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.042 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.042 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.043 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.043 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183604 2024-09-11T05:34:44.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.043 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.043 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.043 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.043 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:44.043 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.043 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.043 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.044 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:44.044 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.044 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.044 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.044 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743491+0000", 2024-09-11T05:34:44.044 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0012514620000000001 2024-09-11T05:34:44.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.044 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.044 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.045 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743496+0000", 2024-09-11T05:34:44.045 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2910000000000001e-06 2024-09-11T05:34:44.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.045 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.045 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.045 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743506+0000", 2024-09-11T05:34:44.045 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0039e-05 2024-09-11T05:34:44.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.045 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.046 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.046 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743513+0000", 2024-09-11T05:34:44.046 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:34:44.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.046 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.046 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.046 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781296+0000", 2024-09-11T05:34:44.046 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037783187000000003 2024-09-11T05:34:44.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.047 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.047 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.047 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781347+0000", 2024-09-11T05:34:44.047 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1375000000000002e-05 2024-09-11T05:34:44.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.047 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.047 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.047 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781394+0000", 2024-09-11T05:34:44.047 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119000000000001e-05 2024-09-11T05:34:44.048 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.048 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.048 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.048 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.048 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183609 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6955008~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.048 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:44.048 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.263603060000001, 2024-09-11T05:34:44.049 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038553630999999998, 2024-09-11T05:34:44.049 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.049 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.049 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.049 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.049 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.049 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.049 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183609 2024-09-11T05:34:44.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.15e-07 2024-09-11T05:34:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743637+0000", 2024-09-11T05:34:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.86e-06 2024-09-11T05:34:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743641+0000", 2024-09-11T05:34:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7000000000000002e-06 2024-09-11T05:34:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743645+0000", 2024-09-11T05:34:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9600000000000002e-06 2024-09-11T05:34:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782023+0000", 2024-09-11T05:34:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038378520999999999 2024-09-11T05:34:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782119+0000", 2024-09-11T05:34:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5665e-05 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782188+0000", 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9610000000000006e-05 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183610 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8343552~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.263589482, 2024-09-11T05:34:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038675859, 2024-09-11T05:34:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183610 2024-09-11T05:34:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.056 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.056 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.056 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:44.056 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.056 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.056 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.056 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743649+0000", 2024-09-11T05:34:44.056 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-07 2024-09-11T05:34:44.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.057 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.057 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.057 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743650+0000", 2024-09-11T05:34:44.057 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5799999999999999e-06 2024-09-11T05:34:44.057 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.057 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.057 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.057 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743656+0000", 2024-09-11T05:34:44.057 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:44.057 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.057 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.058 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.058 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743660+0000", 2024-09-11T05:34:44.058 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4259999999999999e-06 2024-09-11T05:34:44.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.058 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.058 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.058 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782218+0000", 2024-09-11T05:34:44.058 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038558508999999998 2024-09-11T05:34:44.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.058 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.059 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.059 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782270+0000", 2024-09-11T05:34:44.059 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.168e-05 2024-09-11T05:34:44.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.059 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.059 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.059 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782324+0000", 2024-09-11T05:34:44.059 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4388999999999997e-05 2024-09-11T05:34:44.059 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.059 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.059 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.060 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.060 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.060 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183611 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6995968~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.060 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:44.060 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.263574589999997, 2024-09-11T05:34:44.060 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038861554999999999, 2024-09-11T05:34:44.060 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.060 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.060 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.061 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.061 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.061 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.061 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183611 2024-09-11T05:34:44.061 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.061 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.061 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.061 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.061 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:44.062 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.062 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.062 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.062 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.062 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:44.062 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.062 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.062 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.063 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.063 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:44.063 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4299999999999999e-07 2024-09-11T05:34:44.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.063 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.063 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.063 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743665+0000", 2024-09-11T05:34:44.063 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5060000000000001e-06 2024-09-11T05:34:44.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.064 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.064 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743668+0000", 2024-09-11T05:34:44.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1549999999999999e-06 2024-09-11T05:34:44.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.064 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.064 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743671+0000", 2024-09-11T05:34:44.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7599999999999998e-06 2024-09-11T05:34:44.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.065 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.065 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.065 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782359+0000", 2024-09-11T05:34:44.065 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038687946000000001 2024-09-11T05:34:44.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.065 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.065 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.066 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782437+0000", 2024-09-11T05:34:44.066 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8539000000000001e-05 2024-09-11T05:34:44.066 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.066 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.066 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.066 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782525+0000", 2024-09-11T05:34:44.066 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7405999999999996e-05 2024-09-11T05:34:44.066 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.067 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.067 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.067 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.067 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183612 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8384512~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.067 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:44.067 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.263563421000001, 2024-09-11T05:34:44.067 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039040111000000002, 2024-09-11T05:34:44.068 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.068 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.068 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.068 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.068 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.068 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.068 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183612 2024-09-11T05:34:44.068 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.068 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.069 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.069 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.069 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:44.069 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.069 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.069 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.069 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:44.070 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.070 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.070 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.070 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743675+0000", 2024-09-11T05:34:44.070 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2100000000000001e-07 2024-09-11T05:34:44.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.070 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.070 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.070 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743676+0000", 2024-09-11T05:34:44.070 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.212e-06 2024-09-11T05:34:44.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.071 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.071 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.071 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743679+0000", 2024-09-11T05:34:44.071 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:34:44.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.071 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.071 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.071 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743681+0000", 2024-09-11T05:34:44.071 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.604e-06 2024-09-11T05:34:44.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.072 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.072 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.072 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782560+0000", 2024-09-11T05:34:44.072 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038878687000000002 2024-09-11T05:34:44.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.072 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.072 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.072 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782644+0000", 2024-09-11T05:34:44.073 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3733000000000006e-05 2024-09-11T05:34:44.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.073 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.073 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.073 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782714+0000", 2024-09-11T05:34:44.073 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0655999999999996e-05 2024-09-11T05:34:44.073 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.073 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.073 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.074 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.074 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183613 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7036928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.074 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:44.074 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.263553387999998, 2024-09-11T05:34:44.074 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039233924000000003, 2024-09-11T05:34:44.074 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.074 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.074 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.075 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.075 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.075 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.075 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183613 2024-09-11T05:34:44.075 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.075 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.075 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.075 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.075 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:44.076 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.076 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.076 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.076 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:44.076 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.077 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.077 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.077 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745489+0000", 2024-09-11T05:34:44.077 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0018047549999999999 2024-09-11T05:34:44.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.077 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.077 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.077 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745493+0000", 2024-09-11T05:34:44.077 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0439999999999997e-06 2024-09-11T05:34:44.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.078 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.078 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.078 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745501+0000", 2024-09-11T05:34:44.078 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:34:44.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.078 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.078 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.079 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745507+0000", 2024-09-11T05:34:44.079 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9490000000000001e-06 2024-09-11T05:34:44.079 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.079 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.079 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.079 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782756+0000", 2024-09-11T05:34:44.079 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037249522 2024-09-11T05:34:44.079 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.079 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.080 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.080 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782839+0000", 2024-09-11T05:34:44.080 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3133999999999994e-05 2024-09-11T05:34:44.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.080 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.080 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.080 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782918+0000", 2024-09-11T05:34:44.080 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9167999999999998e-05 2024-09-11T05:34:44.080 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.080 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.081 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.081 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.081 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183622 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7323648~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.081 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:44.081 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.261594973000001, 2024-09-11T05:34:44.081 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038618008000000002, 2024-09-11T05:34:44.081 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.082 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.082 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.082 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.082 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.082 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.082 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183622 2024-09-11T05:34:44.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.082 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.083 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.083 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.083 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:44.083 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.083 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.083 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.083 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:44.083 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.083 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.084 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.084 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:44.084 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4900000000000001e-07 2024-09-11T05:34:44.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.084 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.084 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.084 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745645+0000", 2024-09-11T05:34:44.084 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9709999999999998e-06 2024-09-11T05:34:44.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.085 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.085 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.085 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745651+0000", 2024-09-11T05:34:44.085 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.251e-06 2024-09-11T05:34:44.085 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.085 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.085 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.085 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745657+0000", 2024-09-11T05:34:44.085 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:34:44.085 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.086 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.086 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.086 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784095+0000", 2024-09-11T05:34:44.086 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038437791999999998 2024-09-11T05:34:44.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.086 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.086 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.086 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784201+0000", 2024-09-11T05:34:44.086 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000106801 2024-09-11T05:34:44.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.087 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.087 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784261+0000", 2024-09-11T05:34:44.087 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9475999999999998e-05 2024-09-11T05:34:44.087 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.087 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.087 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.088 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183623 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4296704~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.088 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:44.088 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.261574789000001, 2024-09-11T05:34:44.088 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038730705999999997, 2024-09-11T05:34:44.088 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.088 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.088 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.088 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.088 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.089 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.089 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183623 2024-09-11T05:34:44.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.089 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.089 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.089 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.089 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:44.089 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.089 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.089 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.090 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:44.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.090 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.090 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:44.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.39e-07 2024-09-11T05:34:44.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.091 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.091 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745665+0000", 2024-09-11T05:34:44.091 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9860000000000001e-06 2024-09-11T05:34:44.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.091 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.091 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.091 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745671+0000", 2024-09-11T05:34:44.091 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.818e-06 2024-09-11T05:34:44.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.091 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.092 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.092 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745676+0000", 2024-09-11T05:34:44.092 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.972e-06 2024-09-11T05:34:44.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.092 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.092 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.092 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784296+0000", 2024-09-11T05:34:44.092 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038620131000000002 2024-09-11T05:34:44.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.092 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.093 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.093 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784353+0000", 2024-09-11T05:34:44.093 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6644999999999997e-05 2024-09-11T05:34:44.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.093 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.093 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.093 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784394+0000", 2024-09-11T05:34:44.093 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0815000000000001e-05 2024-09-11T05:34:44.093 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.093 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.093 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.094 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.094 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.094 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183624 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7364608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.094 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:44.094 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.261555911999999, 2024-09-11T05:34:44.094 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038826315, 2024-09-11T05:34:44.094 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.094 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.094 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.095 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.095 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.095 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.095 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183624 2024-09-11T05:34:44.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.095 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.095 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.095 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.095 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:44.095 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.096 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.096 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.096 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:44.096 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.096 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.096 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.097 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:44.097 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:34:44.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.097 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.097 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.097 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745684+0000", 2024-09-11T05:34:44.097 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0980000000000001e-06 2024-09-11T05:34:44.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.097 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.097 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.098 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745690+0000", 2024-09-11T05:34:44.098 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.733e-06 2024-09-11T05:34:44.098 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.098 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.098 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.098 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745695+0000", 2024-09-11T05:34:44.098 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:34:44.098 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.098 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.098 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.099 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784418+0000", 2024-09-11T05:34:44.099 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038722813000000002 2024-09-11T05:34:44.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.099 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.099 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.099 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784460+0000", 2024-09-11T05:34:44.099 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2222999999999999e-05 2024-09-11T05:34:44.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.099 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.099 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.100 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784508+0000", 2024-09-11T05:34:44.100 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8349000000000001e-05 2024-09-11T05:34:44.100 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.100 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.100 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.100 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183625 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4337664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.100 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:44.100 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.261536204000002, 2024-09-11T05:34:44.100 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923776, 2024-09-11T05:34:44.101 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.101 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.101 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.101 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.101 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.101 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.101 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183625 2024-09-11T05:34:44.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.101 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.101 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.101 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:44.103 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.41e-07 2024-09-11T05:34:44.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.103 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.103 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.103 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745713+0000", 2024-09-11T05:34:44.103 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0579e-05 2024-09-11T05:34:44.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.103 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.103 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.103 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745719+0000", 2024-09-11T05:34:44.103 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4540000000000004e-06 2024-09-11T05:34:44.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.104 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.104 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745724+0000", 2024-09-11T05:34:44.104 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1170000000000003e-06 2024-09-11T05:34:44.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.104 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.105 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784532+0000", 2024-09-11T05:34:44.105 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038807618000000002 2024-09-11T05:34:44.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.105 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.105 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.105 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784586+0000", 2024-09-11T05:34:44.105 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4432999999999999e-05 2024-09-11T05:34:44.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.105 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.106 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.106 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784625+0000", 2024-09-11T05:34:44.106 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9233999999999997e-05 2024-09-11T05:34:44.106 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.106 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.106 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.106 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.107 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183626 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.107 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:44.107 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.261506541999999, 2024-09-11T05:34:44.107 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038934147000000002, 2024-09-11T05:34:44.107 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.107 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.107 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:44.107 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.107 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.107 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.107 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183626 2024-09-11T05:34:44.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.108 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.108 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.108 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.108 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:44.108 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.108 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.108 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.108 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:44.109 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.109 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.109 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.109 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745732+0000", 2024-09-11T05:34:44.109 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:34:44.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.109 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.109 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.109 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745734+0000", 2024-09-11T05:34:44.109 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9649999999999998e-06 2024-09-11T05:34:44.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.110 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.110 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745739+0000", 2024-09-11T05:34:44.110 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.806e-06 2024-09-11T05:34:44.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.110 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.110 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745744+0000", 2024-09-11T05:34:44.110 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5210000000000004e-06 2024-09-11T05:34:44.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.111 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.111 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784660+0000", 2024-09-11T05:34:44.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038916077 2024-09-11T05:34:44.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.111 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.111 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784665+0000", 2024-09-11T05:34:44.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3929999999999999e-06 2024-09-11T05:34:44.111 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.111 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.111 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.112 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183627 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.112 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:44.112 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.261488024000002, 2024-09-11T05:34:44.112 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038942282000000002, 2024-09-11T05:34:44.112 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.112 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.112 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:44.113 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.113 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.113 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.113 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183627 2024-09-11T05:34:44.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.113 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.113 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.113 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.113 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:44.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.114 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.114 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:44.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.114 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.114 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:44.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:44.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745752+0000", 2024-09-11T05:34:44.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9e-06 2024-09-11T05:34:44.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745758+0000", 2024-09-11T05:34:44.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6899999999999997e-06 2024-09-11T05:34:44.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.116 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745763+0000", 2024-09-11T05:34:44.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9169999999999997e-06 2024-09-11T05:34:44.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.116 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784686+0000", 2024-09-11T05:34:44.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923874999999997 2024-09-11T05:34:44.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.117 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784692+0000", 2024-09-11T05:34:44.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5600000000000001e-06 2024-09-11T05:34:44.117 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.117 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.117 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.117 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183628 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.118 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:44.118 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.261449413000001, 2024-09-11T05:34:44.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038927438000000002, 2024-09-11T05:34:44.118 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.118 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.118 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:44.118 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.118 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.118 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.118 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183628 2024-09-11T05:34:44.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.119 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:44.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:44.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745789+0000", 2024-09-11T05:34:44.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3000000000000002e-07 2024-09-11T05:34:44.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745791+0000", 2024-09-11T05:34:44.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0209999999999998e-06 2024-09-11T05:34:44.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745802+0000", 2024-09-11T05:34:44.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0886e-05 2024-09-11T05:34:44.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745806+0000", 2024-09-11T05:34:44.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0289999999999999e-06 2024-09-11T05:34:44.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784712+0000", 2024-09-11T05:34:44.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038905922000000003 2024-09-11T05:34:44.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784716+0000", 2024-09-11T05:34:44.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.25e-06 2024-09-11T05:34:44.123 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.123 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.123 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.123 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183629 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:44.123 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:44.123 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 32.261427695999998, 2024-09-11T05:34:44.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038954874, 2024-09-11T05:34:44.123 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.123 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.124 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:44.124 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.124 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.124 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.124 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183629 2024-09-11T05:34:44.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.124 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.124 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747489+0000", 2024-09-11T05:34:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0016785529999999999 2024-09-11T05:34:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747493+0000", 2024-09-11T05:34:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0600000000000001e-06 2024-09-11T05:34:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747501+0000", 2024-09-11T05:34:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9109999999999993e-06 2024-09-11T05:34:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747507+0000", 2024-09-11T05:34:44.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3899999999999998e-06 2024-09-11T05:34:44.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784760+0000", 2024-09-11T05:34:44.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037253197000000002 2024-09-11T05:34:44.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784765+0000", 2024-09-11T05:34:44.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.763e-06 2024-09-11T05:34:44.128 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.128 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.128 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.128 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.128 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.128 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:44.130 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:44.131 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:44.129+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:44.230 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:44.230+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:44.273 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:44.274 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:44.274 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:44.274 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:44.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:44.331 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:44.330+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:44.384 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:44.384 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:44.384 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:44.384 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:44.385 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:44.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:44.434 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:44.433+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:44.534 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:44.532+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:44.538 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:44.538 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:44.538 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:44.538 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:44.538 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.538 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116713 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13060096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.538 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:44.538 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.722956135000004, 2024-09-11T05:34:44.538 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599235, 2024-09-11T05:34:44.538 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.538 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.538 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.539 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.539 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.539 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.539 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116713 2024-09-11T05:34:44.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.539 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.539 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.539 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.539 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:44.539 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.539 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.540 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.540 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:44.540 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.540 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.540 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.540 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813321+0000", 2024-09-11T05:34:44.540 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000005e-07 2024-09-11T05:34:44.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.540 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.540 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.540 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813323+0000", 2024-09-11T05:34:44.540 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.667e-06 2024-09-11T05:34:44.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.541 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.541 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.541 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813331+0000", 2024-09-11T05:34:44.541 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6529999999999994e-06 2024-09-11T05:34:44.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.541 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.542 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.542 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813336+0000", 2024-09-11T05:34:44.542 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:34:44.542 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.542 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.542 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.542 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813688+0000", 2024-09-11T05:34:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035143199999999999 2024-09-11T05:34:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813692+0000", 2024-09-11T05:34:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5120000000000002e-06 2024-09-11T05:34:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816304+0000", 2024-09-11T05:34:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026115449999999998 2024-09-11T05:34:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.544 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.544 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816308+0000", 2024-09-11T05:34:44.544 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2370000000000003e-06 2024-09-11T05:34:44.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.544 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.544 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.544 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821720+0000", 2024-09-11T05:34:44.544 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0054114869999999 2024-09-11T05:34:44.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.544 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.544 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.545 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821724+0000", 2024-09-11T05:34:44.545 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:34:44.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.545 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.545 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.545 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873101+0000", 2024-09-11T05:34:44.545 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0513774279999999 2024-09-11T05:34:44.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.545 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.545 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.545 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873159+0000", 2024-09-11T05:34:44.545 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819000000000003e-05 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873244+0000", 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4300000000000003e-05 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116714 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.722913500000004, 2024-09-11T05:34:44.546 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600505999999998, 2024-09-11T05:34:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116714 2024-09-11T05:34:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.548 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.548 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.548 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:44.548 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.548 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.548 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.548 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:44.548 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:34:44.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.548 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.549 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.549 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813366+0000", 2024-09-11T05:34:44.549 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6919999999999998e-06 2024-09-11T05:34:44.549 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.549 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813373+0000", 2024-09-11T05:34:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8689999999999998e-06 2024-09-11T05:34:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813378+0000", 2024-09-11T05:34:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2159999999999997e-06 2024-09-11T05:34:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813733+0000", 2024-09-11T05:34:44.551 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035530300000000001 2024-09-11T05:34:44.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.551 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.551 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:44.551 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813739+0000", 2024-09-11T05:34:44.551 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8819999999999998e-06 2024-09-11T05:34:44.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.551 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.551 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.551 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816340+0000", 2024-09-11T05:34:44.552 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002600598 2024-09-11T05:34:44.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.552 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.552 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.552 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816349+0000", 2024-09-11T05:34:44.552 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9169999999999995e-06 2024-09-11T05:34:44.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.552 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.552 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.552 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821745+0000", 2024-09-11T05:34:44.552 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005396416 2024-09-11T05:34:44.553 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.553 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.553 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.553 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821750+0000", 2024-09-11T05:34:44.553 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:34:44.553 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.553 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.553 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.553 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873269+0000", 2024-09-11T05:34:44.553 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0515195159999999 2024-09-11T05:34:44.553 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.554 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.554 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.554 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873328+0000", 2024-09-11T05:34:44.554 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9222999999999999e-05 2024-09-11T05:34:44.554 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.554 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.554 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.554 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873413+0000", 2024-09-11T05:34:44.554 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4983999999999998e-05 2024-09-11T05:34:44.554 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.555 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.555 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.555 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116715 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13109248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.555 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:44.555 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.722872018999993, 2024-09-11T05:34:44.555 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0602519180000001, 2024-09-11T05:34:44.555 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.555 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.555 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.556 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.556 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.556 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.556 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116715 2024-09-11T05:34:44.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.556 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.556 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.556 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:44.556 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.557 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:44.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.557 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813405+0000", 2024-09-11T05:34:44.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.51e-07 2024-09-11T05:34:44.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.557 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.557 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813407+0000", 2024-09-11T05:34:44.557 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:34:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813414+0000", 2024-09-11T05:34:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.686e-06 2024-09-11T05:34:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813419+0000", 2024-09-11T05:34:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4249999999999997e-06 2024-09-11T05:34:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813774+0000", 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035460800000000002 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813778+0000", 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816375+0000", 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025967730000000001 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816379+0000", 2024-09-11T05:34:44.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3780000000000003e-06 2024-09-11T05:34:44.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821770+0000", 2024-09-11T05:34:44.560 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053903040000001 2024-09-11T05:34:44.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.560 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.560 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821774+0000", 2024-09-11T05:34:44.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:34:44.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873437+0000", 2024-09-11T05:34:44.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051663155 2024-09-11T05:34:44.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.561 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.561 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873500+0000", 2024-09-11T05:34:44.561 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3027000000000005e-05 2024-09-11T05:34:44.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.562 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.562 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873656+0000", 2024-09-11T05:34:44.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015580800000000001 2024-09-11T05:34:44.562 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.562 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.562 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.562 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116716 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13133824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.562 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:44.562 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.722829562000001, 2024-09-11T05:34:44.562 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0605170350000002, 2024-09-11T05:34:44.562 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.563 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.563 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.563 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.563 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.563 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.563 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116716 2024-09-11T05:34:44.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.563 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.563 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.563 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:44.563 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:44.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.564 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.564 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:44.564 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5799999999999999e-07 2024-09-11T05:34:44.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813450+0000", 2024-09-11T05:34:44.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7659999999999999e-06 2024-09-11T05:34:44.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813458+0000", 2024-09-11T05:34:44.565 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7430000000000002e-06 2024-09-11T05:34:44.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.565 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.565 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813464+0000", 2024-09-11T05:34:44.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:34:44.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.566 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.566 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813814+0000", 2024-09-11T05:34:44.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035073199999999998 2024-09-11T05:34:44.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.566 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:44.566 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813819+0000", 2024-09-11T05:34:44.566 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:34:44.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816410+0000", 2024-09-11T05:34:44.567 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025904349999999999 2024-09-11T05:34:44.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.567 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.567 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816418+0000", 2024-09-11T05:34:44.567 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1610000000000003e-06 2024-09-11T05:34:44.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.568 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.568 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821794+0000", 2024-09-11T05:34:44.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005376391 2024-09-11T05:34:44.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.568 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.568 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821799+0000", 2024-09-11T05:34:44.568 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4870000000000004e-06 2024-09-11T05:34:44.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.568 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.568 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.568 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873697+0000", 2024-09-11T05:34:44.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051898843 2024-09-11T05:34:44.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.569 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.569 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873810+0000", 2024-09-11T05:34:44.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112187 2024-09-11T05:34:44.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.569 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.569 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873964+0000", 2024-09-11T05:34:44.569 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015412800000000001 2024-09-11T05:34:44.569 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.570 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.570 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.570 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116717 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13158400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.570 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:44.570 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.722804478, 2024-09-11T05:34:44.570 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606806560000002, 2024-09-11T05:34:44.570 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.570 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.570 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.570 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.570 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116717 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:44.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:34:44.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.572 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.572 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813474+0000", 2024-09-11T05:34:44.572 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1830000000000001e-06 2024-09-11T05:34:44.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813481+0000", 2024-09-11T05:34:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5540000000000003e-06 2024-09-11T05:34:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813491+0000", 2024-09-11T05:34:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0472000000000001e-05 2024-09-11T05:34:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813867+0000", 2024-09-11T05:34:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00037606 2024-09-11T05:34:44.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:44.574 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813873+0000", 2024-09-11T05:34:44.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.254e-06 2024-09-11T05:34:44.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.574 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816443+0000", 2024-09-11T05:34:44.574 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025701769999999999 2024-09-11T05:34:44.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.574 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816446+0000", 2024-09-11T05:34:44.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:34:44.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.575 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821818+0000", 2024-09-11T05:34:44.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053719830000001 2024-09-11T05:34:44.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.575 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.575 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821823+0000", 2024-09-11T05:34:44.575 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5560000000000001e-06 2024-09-11T05:34:44.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874006+0000", 2024-09-11T05:34:44.576 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05218342 2024-09-11T05:34:44.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.576 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.576 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874071+0000", 2024-09-11T05:34:44.576 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4369999999999995e-05 2024-09-11T05:34:44.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.577 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.577 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874152+0000", 2024-09-11T05:34:44.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1658999999999999e-05 2024-09-11T05:34:44.577 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.577 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.577 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.577 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116718 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13182976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.577 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:44.577 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.72277296, 2024-09-11T05:34:44.577 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0609185380000001, 2024-09-11T05:34:44.578 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.578 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.578 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.578 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.578 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.578 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.578 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116718 2024-09-11T05:34:44.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.578 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.578 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.578 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:44.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:44.579 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.579 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.579 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.579 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813504+0000", 2024-09-11T05:34:44.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7999999999999996e-07 2024-09-11T05:34:44.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813506+0000", 2024-09-11T05:34:44.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2989999999999999e-06 2024-09-11T05:34:44.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.580 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.580 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.580 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813513+0000", 2024-09-11T05:34:44.580 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8020000000000003e-06 2024-09-11T05:34:44.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813517+0000", 2024-09-11T05:34:44.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5639999999999998e-06 2024-09-11T05:34:44.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813916+0000", 2024-09-11T05:34:44.581 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039859800000000001 2024-09-11T05:34:44.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.581 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:44.581 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813922+0000", 2024-09-11T05:34:44.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:34:44.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.582 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.582 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.582 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816476+0000", 2024-09-11T05:34:44.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025538359999999999 2024-09-11T05:34:44.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.582 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.582 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.582 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816481+0000", 2024-09-11T05:34:44.582 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819999999999999e-06 2024-09-11T05:34:44.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.582 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.583 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.583 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821843+0000", 2024-09-11T05:34:44.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053620299999999 2024-09-11T05:34:44.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.583 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.583 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.583 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821848+0000", 2024-09-11T05:34:44.583 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:34:44.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.583 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.583 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.583 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874191+0000", 2024-09-11T05:34:44.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052342935 2024-09-11T05:34:44.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874300+0000", 2024-09-11T05:34:44.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000108764 2024-09-11T05:34:44.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.584 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.584 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874422+0000", 2024-09-11T05:34:44.584 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012221399999999999 2024-09-11T05:34:44.584 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.585 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.585 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.585 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116719 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13207552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.585 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:44.585 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.722732162, 2024-09-11T05:34:44.585 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0611734350000002, 2024-09-11T05:34:44.585 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.585 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.585 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.586 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.586 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.586 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.586 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116719 2024-09-11T05:34:44.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.586 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.586 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.586 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:44.586 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.586 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.587 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.587 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:44.587 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.587 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.587 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.587 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813545+0000", 2024-09-11T05:34:44.588 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2600000000000002e-07 2024-09-11T05:34:44.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.588 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.588 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.588 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813547+0000", 2024-09-11T05:34:44.588 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3329999999999999e-06 2024-09-11T05:34:44.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.588 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.588 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813553+0000", 2024-09-11T05:34:44.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4640000000000003e-06 2024-09-11T05:34:44.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813558+0000", 2024-09-11T05:34:44.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:34:44.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.589 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.589 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.589 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813952+0000", 2024-09-11T05:34:44.589 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039390999999999997 2024-09-11T05:34:44.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:44.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813955+0000", 2024-09-11T05:34:44.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.858e-06 2024-09-11T05:34:44.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.590 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.590 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816524+0000", 2024-09-11T05:34:44.590 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002568847 2024-09-11T05:34:44.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816533+0000", 2024-09-11T05:34:44.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1749999999999994e-06 2024-09-11T05:34:44.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.591 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.591 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821869+0000", 2024-09-11T05:34:44.591 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053358939999999 2024-09-11T05:34:44.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821876+0000", 2024-09-11T05:34:44.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:34:44.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.592 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874454+0000", 2024-09-11T05:34:44.592 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052577621 2024-09-11T05:34:44.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.592 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.592 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874546+0000", 2024-09-11T05:34:44.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2151999999999995e-05 2024-09-11T05:34:44.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.593 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.593 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874718+0000", 2024-09-11T05:34:44.593 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017183399999999999 2024-09-11T05:34:44.593 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.593 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.593 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.594 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116720 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13232128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.594 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:44.594 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.722710276000001, 2024-09-11T05:34:44.594 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0614845590000002, 2024-09-11T05:34:44.594 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.594 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.594 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.594 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.594 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.594 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.594 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116720 2024-09-11T05:34:44.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.595 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.595 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:44.595 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.595 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.595 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:44.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:44.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5600000000000002e-07 2024-09-11T05:34:44.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.596 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.596 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813568+0000", 2024-09-11T05:34:44.596 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9089999999999998e-06 2024-09-11T05:34:44.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.596 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.597 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813573+0000", 2024-09-11T05:34:44.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2059999999999998e-06 2024-09-11T05:34:44.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.597 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.597 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813577+0000", 2024-09-11T05:34:44.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1489999999999996e-06 2024-09-11T05:34:44.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.597 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.597 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.597 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813987+0000", 2024-09-11T05:34:44.597 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040977800000000002 2024-09-11T05:34:44.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:44.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813992+0000", 2024-09-11T05:34:44.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1540000000000001e-06 2024-09-11T05:34:44.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.598 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816560+0000", 2024-09-11T05:34:44.598 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025680389999999998 2024-09-11T05:34:44.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.598 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.598 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816566+0000", 2024-09-11T05:34:44.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0679999999999996e-06 2024-09-11T05:34:44.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821907+0000", 2024-09-11T05:34:44.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005341735 2024-09-11T05:34:44.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.599 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.599 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821916+0000", 2024-09-11T05:34:44.599 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3659999999999992e-06 2024-09-11T05:34:44.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.600 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.600 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874760+0000", 2024-09-11T05:34:44.600 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052844713 2024-09-11T05:34:44.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.600 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.600 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.600 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874878+0000", 2024-09-11T05:34:44.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000117321 2024-09-11T05:34:44.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.601 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.601 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875051+0000", 2024-09-11T05:34:44.601 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017286499999999999 2024-09-11T05:34:44.601 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.601 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.601 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.601 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.601 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116721 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13256704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.602 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:44.602 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.722692921999993, 2024-09-11T05:34:44.602 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0616932019999998, 2024-09-11T05:34:44.602 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.602 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.602 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.602 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.602 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.602 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.602 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116721 2024-09-11T05:34:44.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.602 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813584+0000", 2024-09-11T05:34:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2e-07 2024-09-11T05:34:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813586+0000", 2024-09-11T05:34:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.277e-06 2024-09-11T05:34:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813592+0000", 2024-09-11T05:34:44.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5840000000000002e-06 2024-09-11T05:34:44.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813597+0000", 2024-09-11T05:34:44.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2839999999999997e-06 2024-09-11T05:34:44.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.605 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.605 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.605 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814028+0000", 2024-09-11T05:34:44.605 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000430689 2024-09-11T05:34:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814032+0000", 2024-09-11T05:34:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3850000000000004e-06 2024-09-11T05:34:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816597+0000", 2024-09-11T05:34:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00256485 2024-09-11T05:34:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.607 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816606+0000", 2024-09-11T05:34:44.607 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:34:44.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.607 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.607 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.607 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821949+0000", 2024-09-11T05:34:44.607 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005342752 2024-09-11T05:34:44.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.607 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.607 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.607 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821954+0000", 2024-09-11T05:34:44.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2270000000000001e-06 2024-09-11T05:34:44.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.608 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.608 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.608 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875095+0000", 2024-09-11T05:34:44.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.053140669 2024-09-11T05:34:44.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.608 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.608 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.608 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875186+0000", 2024-09-11T05:34:44.608 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1391999999999995e-05 2024-09-11T05:34:44.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.608 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.609 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.609 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875277+0000", 2024-09-11T05:34:44.609 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0556000000000005e-05 2024-09-11T05:34:44.609 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.609 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.609 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.609 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.609 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116722 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13281280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.609 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:44.609 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.722655923000005, 2024-09-11T05:34:44.609 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.061825491, 2024-09-11T05:34:44.610 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.610 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.610 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.610 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.610 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.610 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.610 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116722 2024-09-11T05:34:44.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.610 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.610 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.610 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.610 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:44.610 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.611 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.611 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.611 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:44.611 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.611 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.611 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.611 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813621+0000", 2024-09-11T05:34:44.611 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:34:44.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.611 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.611 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.612 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813625+0000", 2024-09-11T05:34:44.612 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.228e-06 2024-09-11T05:34:44.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.612 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.612 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.612 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813635+0000", 2024-09-11T05:34:44.612 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5179999999999993e-06 2024-09-11T05:34:44.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.612 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.612 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.612 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813641+0000", 2024-09-11T05:34:44.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4710000000000004e-06 2024-09-11T05:34:44.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.613 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.613 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.613 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814057+0000", 2024-09-11T05:34:44.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00041530099999999997 2024-09-11T05:34:44.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.613 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.613 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:44.613 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814060+0000", 2024-09-11T05:34:44.613 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-06 2024-09-11T05:34:44.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.614 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.614 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.614 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816632+0000", 2024-09-11T05:34:44.614 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00257186 2024-09-11T05:34:44.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.614 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.614 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.614 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816636+0000", 2024-09-11T05:34:44.614 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2150000000000003e-06 2024-09-11T05:34:44.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.614 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.614 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.614 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821977+0000", 2024-09-11T05:34:44.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053407110000001 2024-09-11T05:34:44.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.615 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821982+0000", 2024-09-11T05:34:44.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:34:44.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.615 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.615 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875307+0000", 2024-09-11T05:34:44.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0533247000000001 2024-09-11T05:34:44.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.616 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875366+0000", 2024-09-11T05:34:44.616 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8628999999999997e-05 2024-09-11T05:34:44.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.616 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.616 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875446+0000", 2024-09-11T05:34:44.616 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0026999999999998e-05 2024-09-11T05:34:44.616 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.616 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.616 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.617 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116723 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13305856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.617 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:44.617 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.722622944999998, 2024-09-11T05:34:44.617 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0619630779999998, 2024-09-11T05:34:44.617 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.617 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.617 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.617 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.617 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.617 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.618 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116723 2024-09-11T05:34:44.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.618 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.618 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.618 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.618 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:44.618 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.618 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.618 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.618 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:44.618 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813654+0000", 2024-09-11T05:34:44.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:34:44.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.620 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.620 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813661+0000", 2024-09-11T05:34:44.620 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1890000000000001e-06 2024-09-11T05:34:44.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.620 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.620 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813675+0000", 2024-09-11T05:34:44.620 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3878e-05 2024-09-11T05:34:44.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813682+0000", 2024-09-11T05:34:44.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.063e-06 2024-09-11T05:34:44.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816666+0000", 2024-09-11T05:34:44.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029845679999999999 2024-09-11T05:34:44.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816671+0000", 2024-09-11T05:34:44.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:34:44.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.622 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822024+0000", 2024-09-11T05:34:44.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053534660000001 2024-09-11T05:34:44.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.622 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822028+0000", 2024-09-11T05:34:44.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7799999999999998e-06 2024-09-11T05:34:44.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875471+0000", 2024-09-11T05:34:44.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05344306 2024-09-11T05:34:44.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875531+0000", 2024-09-11T05:34:44.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0019000000000003e-05 2024-09-11T05:34:44.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875616+0000", 2024-09-11T05:34:44.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5304999999999997e-05 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116724 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13330432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.722583455999995, 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0620902609999998, 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.624 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.625 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.625 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116724 2024-09-11T05:34:44.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.625 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.625 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.625 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.625 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:44.625 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.625 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.625 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:44.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:44.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.99e-07 2024-09-11T05:34:44.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813697+0000", 2024-09-11T05:34:44.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2430000000000001e-06 2024-09-11T05:34:44.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813704+0000", 2024-09-11T05:34:44.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2980000000000003e-06 2024-09-11T05:34:44.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813709+0000", 2024-09-11T05:34:44.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8130000000000003e-06 2024-09-11T05:34:44.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816702+0000", 2024-09-11T05:34:44.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002992864 2024-09-11T05:34:44.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816711+0000", 2024-09-11T05:34:44.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1840000000000005e-06 2024-09-11T05:34:44.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822050+0000", 2024-09-11T05:34:44.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.00533864 2024-09-11T05:34:44.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822055+0000", 2024-09-11T05:34:44.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:34:44.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875642+0000", 2024-09-11T05:34:44.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0535874220000001 2024-09-11T05:34:44.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875698+0000", 2024-09-11T05:34:44.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5707e-05 2024-09-11T05:34:44.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.630 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.630 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875783+0000", 2024-09-11T05:34:44.631 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5362e-05 2024-09-11T05:34:44.631 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.631 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.631 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.631 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116725 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13355008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.631 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:44.631 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.722549267999995, 2024-09-11T05:34:44.631 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.06220984, 2024-09-11T05:34:44.631 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.632 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.632 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.632 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.632 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.632 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.632 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116725 2024-09-11T05:34:44.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.632 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:44.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:44.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813728+0000", 2024-09-11T05:34:44.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:34:44.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813730+0000", 2024-09-11T05:34:44.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6730000000000001e-06 2024-09-11T05:34:44.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813743+0000", 2024-09-11T05:34:44.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2833000000000001e-05 2024-09-11T05:34:44.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813749+0000", 2024-09-11T05:34:44.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:34:44.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816726+0000", 2024-09-11T05:34:44.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029772090000000002 2024-09-11T05:34:44.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.636 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816730+0000", 2024-09-11T05:34:44.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.518e-06 2024-09-11T05:34:44.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.636 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822074+0000", 2024-09-11T05:34:44.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053444030000001 2024-09-11T05:34:44.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822079+0000", 2024-09-11T05:34:44.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:34:44.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875807+0000", 2024-09-11T05:34:44.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0537284410000001 2024-09-11T05:34:44.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875858+0000", 2024-09-11T05:34:44.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0574000000000001e-05 2024-09-11T05:34:44.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875937+0000", 2024-09-11T05:34:44.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9268000000000001e-05 2024-09-11T05:34:44.639 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.639 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.639 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.639 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.639 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116974 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13185024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.639 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:44.640 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.714605431999999, 2024-09-11T05:34:44.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598649249999998, 2024-09-11T05:34:44.640 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.640 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.640 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.640 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.640 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.640 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.640 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116974 2024-09-11T05:34:44.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.640 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.641 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:44.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.641 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:44.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:44.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:34:44.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821673+0000", 2024-09-11T05:34:44.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.722e-06 2024-09-11T05:34:44.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821686+0000", 2024-09-11T05:34:44.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2974e-05 2024-09-11T05:34:44.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821692+0000", 2024-09-11T05:34:44.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:34:44.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822089+0000", 2024-09-11T05:34:44.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039611699999999998 2024-09-11T05:34:44.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.644 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822099+0000", 2024-09-11T05:34:44.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0029e-05 2024-09-11T05:34:44.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.644 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822803+0000", 2024-09-11T05:34:44.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000704507 2024-09-11T05:34:44.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822808+0000", 2024-09-11T05:34:44.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6460000000000001e-06 2024-09-11T05:34:44.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881361+0000", 2024-09-11T05:34:44.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0585529680000001 2024-09-11T05:34:44.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881432+0000", 2024-09-11T05:34:44.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:34:44.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881536+0000", 2024-09-11T05:34:44.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000103243 2024-09-11T05:34:44.646 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116975 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13209600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.714577098000007, 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.060124761, 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.647 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.648 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116975 2024-09-11T05:34:44.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.648 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:44.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:44.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821700+0000", 2024-09-11T05:34:44.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:34:44.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821701+0000", 2024-09-11T05:34:44.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8369999999999999e-06 2024-09-11T05:34:44.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821708+0000", 2024-09-11T05:34:44.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5520000000000001e-06 2024-09-11T05:34:44.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821713+0000", 2024-09-11T05:34:44.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.091e-06 2024-09-11T05:34:44.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822135+0000", 2024-09-11T05:34:44.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00042166399999999998 2024-09-11T05:34:44.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822143+0000", 2024-09-11T05:34:44.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3089999999999996e-06 2024-09-11T05:34:44.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822820+0000", 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000677145 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822824+0000", 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.641e-06 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881569+0000", 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.058744785 2024-09-11T05:34:44.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881674+0000", 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000105111 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881824+0000", 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000150197 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.654 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116976 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13234176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.654 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:44.654 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.714548119, 2024-09-11T05:34:44.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0603909900000001, 2024-09-11T05:34:44.654 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.654 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.654 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.654 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.654 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.654 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.654 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116976 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.655 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821729+0000", 2024-09-11T05:34:44.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:34:44.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821731+0000", 2024-09-11T05:34:44.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0250000000000001e-06 2024-09-11T05:34:44.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821737+0000", 2024-09-11T05:34:44.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8839999999999997e-06 2024-09-11T05:34:44.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821743+0000", 2024-09-11T05:34:44.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1050000000000003e-06 2024-09-11T05:34:44.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822194+0000", 2024-09-11T05:34:44.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000451574 2024-09-11T05:34:44.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822203+0000", 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9449999999999999e-06 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822835+0000", 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000632019 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822839+0000", 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8229999999999997e-06 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881861+0000", 2024-09-11T05:34:44.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.059021776 2024-09-11T05:34:44.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881976+0000", 2024-09-11T05:34:44.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00011531699999999999 2024-09-11T05:34:44.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882119+0000", 2024-09-11T05:34:44.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000143077 2024-09-11T05:34:44.660 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.660 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.660 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.660 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116977 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13258752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.660 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:44.660 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.714496885000003, 2024-09-11T05:34:44.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606236920000001, 2024-09-11T05:34:44.661 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.661 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.661 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.661 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.661 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.661 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.661 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116977 2024-09-11T05:34:44.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.661 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:44.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:44.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821782+0000", 2024-09-11T05:34:44.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7719999999999999e-06 2024-09-11T05:34:44.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821785+0000", 2024-09-11T05:34:44.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9409999999999999e-06 2024-09-11T05:34:44.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821793+0000", 2024-09-11T05:34:44.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:34:44.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821799+0000", 2024-09-11T05:34:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4609999999999999e-06 2024-09-11T05:34:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822246+0000", 2024-09-11T05:34:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044669000000000002 2024-09-11T05:34:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822254+0000", 2024-09-11T05:34:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1859999999999992e-06 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822850+0000", 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005962340000001 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822854+0000", 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5310000000000002e-06 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882149+0000", 2024-09-11T05:34:44.666 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0592958729999999 2024-09-11T05:34:44.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.666 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.666 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.666 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882253+0000", 2024-09-11T05:34:44.666 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104058 2024-09-11T05:34:44.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.666 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.666 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.666 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882403+0000", 2024-09-11T05:34:44.666 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014958800000000001 2024-09-11T05:34:44.666 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116978 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13283328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.714466662000007, 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0608297769999999, 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.667 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.668 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116978 2024-09-11T05:34:44.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.668 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.668 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.668 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:44.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.668 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.668 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:44.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:44.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:34:44.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821813+0000", 2024-09-11T05:34:44.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:34:44.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821820+0000", 2024-09-11T05:34:44.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3669999999999999e-06 2024-09-11T05:34:44.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821825+0000", 2024-09-11T05:34:44.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5119999999999999e-06 2024-09-11T05:34:44.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822273+0000", 2024-09-11T05:34:44.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044727900000000003 2024-09-11T05:34:44.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822278+0000", 2024-09-11T05:34:44.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7529999999999998e-06 2024-09-11T05:34:44.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822865+0000", 2024-09-11T05:34:44.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005861579999999 2024-09-11T05:34:44.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822868+0000", 2024-09-11T05:34:44.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4659999999999999e-06 2024-09-11T05:34:44.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882434+0000", 2024-09-11T05:34:44.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0595660170000001 2024-09-11T05:34:44.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882502+0000", 2024-09-11T05:34:44.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7442999999999998e-05 2024-09-11T05:34:44.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882639+0000", 2024-09-11T05:34:44.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013779999999999999 2024-09-11T05:34:44.673 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.674 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.674 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.674 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116980 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13332480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.674 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:44.674 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.712927140000005, 2024-09-11T05:34:44.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598269180000002, 2024-09-11T05:34:44.674 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.674 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.675 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.675 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.675 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.675 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.675 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116980 2024-09-11T05:34:44.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.675 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:44.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:44.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823350+0000", 2024-09-11T05:34:44.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:34:44.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823352+0000", 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5459999999999998e-06 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823360+0000", 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4359999999999996e-06 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823365+0000", 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3079999999999998e-06 2024-09-11T05:34:44.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823418+0000", 2024-09-11T05:34:44.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2735999999999998e-05 2024-09-11T05:34:44.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823423+0000", 2024-09-11T05:34:44.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3410000000000002e-06 2024-09-11T05:34:44.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822895+0000", 2024-09-11T05:34:44.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99947249000000005 2024-09-11T05:34:44.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822899+0000", 2024-09-11T05:34:44.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6169999999999998e-06 2024-09-11T05:34:44.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882964+0000", 2024-09-11T05:34:44.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0600650840000001 2024-09-11T05:34:44.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883020+0000", 2024-09-11T05:34:44.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5563000000000003e-05 2024-09-11T05:34:44.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883176+0000", 2024-09-11T05:34:44.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015629500000000001 2024-09-11T05:34:44.680 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.680 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.680 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116981 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13357056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 65.712903159999996, 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600075910000002, 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116981 2024-09-11T05:34:44.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.01e-07 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823376+0000", 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823381+0000", 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000001e-06 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823386+0000", 2024-09-11T05:34:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5349999999999998e-06 2024-09-11T05:34:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823447+0000", 2024-09-11T05:34:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1277000000000003e-05 2024-09-11T05:34:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823456+0000", 2024-09-11T05:34:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8859999999999993e-06 2024-09-11T05:34:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822914+0000", 2024-09-11T05:34:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99945797999999997 2024-09-11T05:34:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822918+0000", 2024-09-11T05:34:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5810000000000001e-06 2024-09-11T05:34:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883209+0000", 2024-09-11T05:34:44.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0602916899999999 2024-09-11T05:34:44.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:44.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883292+0000", 2024-09-11T05:34:44.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2849000000000006e-05 2024-09-11T05:34:44.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:44.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:44.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:44.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883381+0000", 2024-09-11T05:34:44.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8585000000000007e-05 2024-09-11T05:34:44.686 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.686 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.687 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.687 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:44.687 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:44.687 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:44.689 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:44.689 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:44.688+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:44.789 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:44.789+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:44.836 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:44.836 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:44.844 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:44.890 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:44.890+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:44.947 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:44.947 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:44.947 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:44.948 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:44.948 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:44.957 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:44.992 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:44.991+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:45.061 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:45.062 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:45.062 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:45.062 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:45.062 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.062 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:34:45.062 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:45.062 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.411973883000002, 2024-09-11T05:34:45.062 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:34:45.062 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.062 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.063 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:45.063 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.063 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.063 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.063 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:34:45.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.063 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.063 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.063 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:45.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.064 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.064 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:45.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.064 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.064 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.064 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:34:45.064 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:34:45.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.065 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.065 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.065 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:34:45.065 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:34:45.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.065 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.065 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.065 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:34:45.065 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:34:45.066 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.066 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.066 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.066 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:34:45.066 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:34:45.066 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.066 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.066 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.066 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:34:45.066 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:34:45.066 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.067 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.067 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.067 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:34:45.067 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:34:45.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.067 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.067 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:34:45.067 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:34:45.067 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:34:45.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.067 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.067 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:45.068 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:34:45.068 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:34:45.068 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.068 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.068 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:45.068 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:34:45.068 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:34:45.068 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.068 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.068 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:45.068 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:34:45.069 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:34:45.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.069 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.069 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.069 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:34:45.069 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:34:45.069 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.069 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.069 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.069 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.069 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:146253 3.6 3:64dbadcf:::rbd_data.112d55d87bfc.0000000000000332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-11T05:34:45.070 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:45.070 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 59.223158974999997, 2024-09-11T05:34:45.070 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4166483809999999, 2024-09-11T05:34:45.070 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.070 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.070 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:45.070 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.070 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.070 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.070 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 146253 2024-09-11T05:34:45.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.070 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.070 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.071 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.071 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:45.071 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.071 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.071 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.071 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:45.071 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.071 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.071 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.071 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837090+0000", 2024-09-11T05:34:45.071 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.73e-06 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837096+0000", 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3500000000000002e-06 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837115+0000", 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8556e-05 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.072 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837124+0000", 2024-09-11T05:34:45.073 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6739999999999992e-06 2024-09-11T05:34:45.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.073 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.073 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.073 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837184+0000", 2024-09-11T05:34:45.073 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9960000000000002e-05 2024-09-11T05:34:45.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.073 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.073 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:34:45.073 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837188+0000", 2024-09-11T05:34:45.073 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:45.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.073 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.074 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.074 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840481+0000", 2024-09-11T05:34:45.074 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032924080000000001 2024-09-11T05:34:45.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.074 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.074 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:45.074 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840497+0000", 2024-09-11T05:34:45.074 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6140000000000001e-05 2024-09-11T05:34:45.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.074 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.074 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.075 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850737+0000", 2024-09-11T05:34:45.075 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0102404119999999 2024-09-11T05:34:45.075 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.075 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.075 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:45.075 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850747+0000", 2024-09-11T05:34:45.075 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7969999999999995e-06 2024-09-11T05:34:45.075 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.075 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.075 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.075 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252495+0000", 2024-09-11T05:34:45.076 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.401748131 2024-09-11T05:34:45.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.076 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.076 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.076 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252636+0000", 2024-09-11T05:34:45.076 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014118900000000001 2024-09-11T05:34:45.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.076 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.076 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:45.076 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252737+0000", 2024-09-11T05:34:45.077 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00010058 2024-09-11T05:34:45.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.077 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.077 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:45.077 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253433+0000", 2024-09-11T05:34:45.077 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00069601999999999999 2024-09-11T05:34:45.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.077 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.077 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:45.078 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253604+0000", 2024-09-11T05:34:45.078 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000170824 2024-09-11T05:34:45.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.078 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.078 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:45.078 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253649+0000", 2024-09-11T05:34:45.078 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5050999999999999e-05 2024-09-11T05:34:45.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.078 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.078 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.078 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253736+0000", 2024-09-11T05:34:45.078 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7509000000000005e-05 2024-09-11T05:34:45.079 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.079 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.079 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.079 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.079 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.079 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:147298 3.6 3:652e51de:::rbd_data.112d55d87bfc.0000000000000377:head [set-alloc-hint object_size 262144 write_size 262144,write 122880~2839] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-11T05:34:45.079 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:45.079 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 55.826618398999997, 2024-09-11T05:34:45.079 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62981612099999995, 2024-09-11T05:34:45.079 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.079 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.079 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:45.079 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.080 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.080 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.080 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 147298 2024-09-11T05:34:45.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.080 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.080 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.080 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.080 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:45.080 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.080 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.080 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.080 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233630+0000", 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5489999999999999e-06 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233637+0000", 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.272e-06 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.081 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233654+0000", 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6283999999999999e-05 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233662+0000", 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.875e-06 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233723+0000", 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1501000000000006e-05 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.082 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233732+0000", 2024-09-11T05:34:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0699999999999996e-06 2024-09-11T05:34:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862055+0000", 2024-09-11T05:34:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62832274799999999 2024-09-11T05:34:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862219+0000", 2024-09-11T05:34:45.083 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016404899999999999 2024-09-11T05:34:45.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.084 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.084 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:45.084 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862313+0000", 2024-09-11T05:34:45.084 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4105999999999997e-05 2024-09-11T05:34:45.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.084 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.084 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:45.084 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862981+0000", 2024-09-11T05:34:45.084 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00066744199999999997 2024-09-11T05:34:45.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.084 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.084 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:45.085 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863382+0000", 2024-09-11T05:34:45.085 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040111200000000002 2024-09-11T05:34:45.085 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.085 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.085 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:45.085 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863419+0000", 2024-09-11T05:34:45.085 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6974000000000002e-05 2024-09-11T05:34:45.085 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.085 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.085 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.085 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863445+0000", 2024-09-11T05:34:45.085 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6139000000000002e-05 2024-09-11T05:34:45.085 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.086 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.086 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.086 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.086 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151292 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.086 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:45.086 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103967003999998, 2024-09-11T05:34:45.086 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054346481000000002, 2024-09-11T05:34:45.086 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.086 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.086 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.086 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.086 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.087 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.087 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151292 2024-09-11T05:34:45.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.087 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.087 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.087 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:45.087 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.087 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.088 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.088 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:45.088 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.088 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.088 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.088 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:45.088 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:34:45.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.088 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.088 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.089 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956283+0000", 2024-09-11T05:34:45.089 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2450000000000001e-06 2024-09-11T05:34:45.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.089 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.089 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.089 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956290+0000", 2024-09-11T05:34:45.089 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0910000000000004e-06 2024-09-11T05:34:45.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.090 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.090 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956296+0000", 2024-09-11T05:34:45.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.947e-06 2024-09-11T05:34:45.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.090 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.090 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010460+0000", 2024-09-11T05:34:45.090 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054164165 2024-09-11T05:34:45.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.091 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.091 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010537+0000", 2024-09-11T05:34:45.091 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6965000000000006e-05 2024-09-11T05:34:45.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.091 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.091 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.091 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010626+0000", 2024-09-11T05:34:45.091 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9628000000000003e-05 2024-09-11T05:34:45.091 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.091 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.091 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.092 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.092 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151293 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1933312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.092 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:45.092 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103944161000001, 2024-09-11T05:34:45.092 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054563858999999999, 2024-09-11T05:34:45.092 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.092 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.092 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.092 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.093 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.093 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.093 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151293 2024-09-11T05:34:45.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.093 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.093 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.093 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.093 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:45.093 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.094 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.094 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.094 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:45.094 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.094 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.094 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.094 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.094 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:45.094 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.46e-07 2024-09-11T05:34:45.094 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.094 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.095 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.095 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956306+0000", 2024-09-11T05:34:45.095 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2259999999999999e-06 2024-09-11T05:34:45.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.095 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.095 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.095 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956312+0000", 2024-09-11T05:34:45.096 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:34:45.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.096 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.096 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.096 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956317+0000", 2024-09-11T05:34:45.096 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:34:45.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.096 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.096 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.097 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010671+0000", 2024-09-11T05:34:45.097 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054353830999999998 2024-09-11T05:34:45.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.097 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.097 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.097 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010757+0000", 2024-09-11T05:34:45.097 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6120999999999998e-05 2024-09-11T05:34:45.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.097 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.097 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.097 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010867+0000", 2024-09-11T05:34:45.097 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000109687 2024-09-11T05:34:45.097 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.098 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.098 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.098 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.098 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.098 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151294 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2179072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.098 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:45.098 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103922298999997, 2024-09-11T05:34:45.098 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054741825000000001, 2024-09-11T05:34:45.098 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.098 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.098 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.098 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.098 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.099 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.099 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151294 2024-09-11T05:34:45.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.099 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.099 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.099 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.099 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:45.099 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.099 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.099 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.099 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:45.099 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.100 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.100 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:45.100 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.84e-07 2024-09-11T05:34:45.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.100 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.100 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956326+0000", 2024-09-11T05:34:45.100 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.483e-06 2024-09-11T05:34:45.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.101 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.101 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.101 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956330+0000", 2024-09-11T05:34:45.101 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8519999999999997e-06 2024-09-11T05:34:45.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.101 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.101 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.101 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956334+0000", 2024-09-11T05:34:45.101 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4139999999999998e-06 2024-09-11T05:34:45.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.101 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.102 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.102 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010894+0000", 2024-09-11T05:34:45.102 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054560243000000001 2024-09-11T05:34:45.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.103 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.103 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.103 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010970+0000", 2024-09-11T05:34:45.103 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6138999999999997e-05 2024-09-11T05:34:45.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.103 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.104 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.104 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011067+0000", 2024-09-11T05:34:45.104 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6409999999999993e-05 2024-09-11T05:34:45.104 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.104 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.104 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.104 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151295 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2392064~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.104 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:45.104 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103909627999997, 2024-09-11T05:34:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054949748999999999, 2024-09-11T05:34:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151295 2024-09-11T05:34:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956338+0000", 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.23e-07 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.106 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956339+0000", 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.243e-06 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956342+0000", 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.473e-06 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956345+0000", 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.108 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.108 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011109+0000", 2024-09-11T05:34:45.108 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054763698999999999 2024-09-11T05:34:45.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.108 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.108 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.108 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011188+0000", 2024-09-11T05:34:45.108 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8887999999999994e-05 2024-09-11T05:34:45.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.108 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.108 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.108 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011287+0000", 2024-09-11T05:34:45.108 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9504000000000001e-05 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151296 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103898518000001, 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055045187000000002, 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.109 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.110 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.110 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151296 2024-09-11T05:34:45.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.110 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.110 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.110 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:45.110 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.110 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.110 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:45.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.111 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.111 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956349+0000", 2024-09-11T05:34:45.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:45.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.111 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.111 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956350+0000", 2024-09-11T05:34:45.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:34:45.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.112 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.112 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956353+0000", 2024-09-11T05:34:45.112 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.016e-06 2024-09-11T05:34:45.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.112 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.112 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956355+0000", 2024-09-11T05:34:45.112 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5509999999999998e-06 2024-09-11T05:34:45.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011303+0000", 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054947306000000001 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011342+0000", 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9057999999999998e-05 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011394+0000", 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1925999999999997e-05 2024-09-11T05:34:45.113 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151297 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2818048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103888587, 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055238158000000002, 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.114 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151297 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.116 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956359+0000", 2024-09-11T05:34:45.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:45.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.116 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956360+0000", 2024-09-11T05:34:45.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1030000000000001e-06 2024-09-11T05:34:45.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956363+0000", 2024-09-11T05:34:45.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.021e-06 2024-09-11T05:34:45.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.117 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956365+0000", 2024-09-11T05:34:45.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4770000000000002e-06 2024-09-11T05:34:45.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.117 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011425+0000", 2024-09-11T05:34:45.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055059967000000001 2024-09-11T05:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011506+0000", 2024-09-11T05:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1063000000000006e-05 2024-09-11T05:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011597+0000", 2024-09-11T05:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0299999999999999e-05 2024-09-11T05:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151298 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3031040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103878621, 2024-09-11T05:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055425825999999997, 2024-09-11T05:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151298 2024-09-11T05:34:45.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.120 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:45.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:45.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956369+0000", 2024-09-11T05:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4400000000000001e-07 2024-09-11T05:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956370+0000", 2024-09-11T05:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.068e-06 2024-09-11T05:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956373+0000", 2024-09-11T05:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0419999999999998e-06 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956375+0000", 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011631+0000", 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055255116999999999 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011703+0000", 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2554999999999999e-05 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011794+0000", 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1119999999999995e-05 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151299 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3276800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:45.123 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103867319000003, 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055567477999999997, 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151299 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:45.124 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:45.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:45.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:34:45.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956382+0000", 2024-09-11T05:34:45.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.72e-06 2024-09-11T05:34:45.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956386+0000", 2024-09-11T05:34:45.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0990000000000001e-06 2024-09-11T05:34:45.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956390+0000", 2024-09-11T05:34:45.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.318e-06 2024-09-11T05:34:45.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011823+0000", 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055432976000000002 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011882+0000", 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8656999999999998e-05 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011947+0000", 2024-09-11T05:34:45.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5177000000000003e-05 2024-09-11T05:34:45.128 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.128 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.128 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.128 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151300 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3489792~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.128 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:45.128 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103850852000001, 2024-09-11T05:34:45.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055745232999999998, 2024-09-11T05:34:45.128 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.128 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.128 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.128 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.129 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.129 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.129 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151300 2024-09-11T05:34:45.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.129 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:45.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956397+0000", 2024-09-11T05:34:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:34:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956398+0000", 2024-09-11T05:34:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.869e-06 2024-09-11T05:34:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956404+0000", 2024-09-11T05:34:45.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:34:45.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956407+0000", 2024-09-11T05:34:45.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.191e-06 2024-09-11T05:34:45.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.132 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011981+0000", 2024-09-11T05:34:45.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055573553999999997 2024-09-11T05:34:45.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.132 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.132 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012051+0000", 2024-09-11T05:34:45.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9542999999999995e-05 2024-09-11T05:34:45.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.132 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.132 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012141+0000", 2024-09-11T05:34:45.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0845000000000002e-05 2024-09-11T05:34:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151301 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3702784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103835922999998, 2024-09-11T05:34:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055834747999999997, 2024-09-11T05:34:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151301 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:45.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956413+0000", 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2810000000000001e-06 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956416+0000", 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1559999999999999e-06 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956418+0000", 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012155+0000", 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055736651999999998 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012193+0000", 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7848000000000001e-05 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012246+0000", 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3041000000000003e-05 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151302 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3915776~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.137 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103825819999997, 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056035532999999998, 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151302 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956426+0000", 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.853e-06 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956430+0000", 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3699999999999999e-06 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956432+0000", 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5979999999999999e-06 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012281+0000", 2024-09-11T05:34:45.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055848644000000003 2024-09-11T05:34:45.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012358+0000", 2024-09-11T05:34:45.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6662000000000006e-05 2024-09-11T05:34:45.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012457+0000", 2024-09-11T05:34:45.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9197999999999995e-05 2024-09-11T05:34:45.142 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.142 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.142 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.142 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151303 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4128768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.142 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:45.142 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103811237999999, 2024-09-11T05:34:45.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056186709000000001, 2024-09-11T05:34:45.142 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.142 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.142 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.142 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.143 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.143 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.143 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151303 2024-09-11T05:34:45.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.143 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:45.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:45.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.144 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.144 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.144 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:45.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:45.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.144 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.144 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.144 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956437+0000", 2024-09-11T05:34:45.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.201e-06 2024-09-11T05:34:45.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.145 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.145 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956440+0000", 2024-09-11T05:34:45.145 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-06 2024-09-11T05:34:45.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.145 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.145 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956443+0000", 2024-09-11T05:34:45.145 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5909999999999998e-06 2024-09-11T05:34:45.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012494+0000", 2024-09-11T05:34:45.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056051541000000003 2024-09-11T05:34:45.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012558+0000", 2024-09-11T05:34:45.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3347000000000002e-05 2024-09-11T05:34:45.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012622+0000", 2024-09-11T05:34:45.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4760999999999999e-05 2024-09-11T05:34:45.147 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.147 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.147 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.147 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151304 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.147 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:45.147 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103801181000001, 2024-09-11T05:34:45.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056360149999999998, 2024-09-11T05:34:45.147 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.147 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.147 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.148 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.148 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.148 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.148 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151304 2024-09-11T05:34:45.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.148 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:45.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.149 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.149 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:45.149 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.149 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.149 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:45.149 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:45.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.149 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.149 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956447+0000", 2024-09-11T05:34:45.149 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.153e-06 2024-09-11T05:34:45.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956450+0000", 2024-09-11T05:34:45.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9909999999999998e-06 2024-09-11T05:34:45.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956453+0000", 2024-09-11T05:34:45.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.447e-06 2024-09-11T05:34:45.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012660+0000", 2024-09-11T05:34:45.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056207510000000002 2024-09-11T05:34:45.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.151 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012741+0000", 2024-09-11T05:34:45.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0734000000000003e-05 2024-09-11T05:34:45.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.151 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012806+0000", 2024-09-11T05:34:45.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5087999999999998e-05 2024-09-11T05:34:45.152 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.152 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.152 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.152 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151305 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4587520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.152 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:45.152 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.10379142, 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056476407999999999, 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151305 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:45.153 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956457+0000", 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.353e-06 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956460+0000", 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0060000000000001e-06 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956463+0000", 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.452e-06 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012834+0000", 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056370917999999999 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012877+0000", 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000999999999997e-05 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012932+0000", 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5470000000000003e-05 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.157 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.157 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.157 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151306 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4800512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.157 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:45.157 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103781439999999, 2024-09-11T05:34:45.157 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056579203000000002, 2024-09-11T05:34:45.157 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.157 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.157 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.157 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.157 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.158 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.158 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151306 2024-09-11T05:34:45.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.158 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.158 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.158 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:45.158 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.158 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.158 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:45.158 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.28e-07 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956467+0000", 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.088e-06 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.159 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956470+0000", 2024-09-11T05:34:45.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0240000000000002e-06 2024-09-11T05:34:45.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.160 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956472+0000", 2024-09-11T05:34:45.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4609999999999998e-06 2024-09-11T05:34:45.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.160 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012953+0000", 2024-09-11T05:34:45.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056480524999999997 2024-09-11T05:34:45.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012994+0000", 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1394999999999999e-05 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013045+0000", 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0482000000000002e-05 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.161 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151307 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5013504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103771770999998, 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056680525000000002, 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151307 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.162 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.164 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.164 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956476+0000", 2024-09-11T05:34:45.164 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0359999999999999e-06 2024-09-11T05:34:45.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.164 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.164 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956479+0000", 2024-09-11T05:34:45.164 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8899999999999999e-06 2024-09-11T05:34:45.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.164 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.164 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956482+0000", 2024-09-11T05:34:45.164 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5380000000000001e-06 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013065+0000", 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056582983000000003 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013104+0000", 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9119999999999998e-05 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013156+0000", 2024-09-11T05:34:45.166 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1743999999999998e-05 2024-09-11T05:34:45.166 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.166 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.166 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.166 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.166 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151308 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5226496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:45.166 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:45.166 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 51.103754440000003, 2024-09-11T05:34:45.166 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056772738000000003, 2024-09-11T05:34:45.166 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:45.166 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:45.166 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:45.167 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:45.167 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:45.167 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:45.167 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151308 2024-09-11T05:34:45.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.167 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:45.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:45.167 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:45.167 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2599999999999998e-07 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956495+0000", 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9750000000000001e-06 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:45.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956499+0000", 2024-09-11T05:34:45.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5179999999999998e-06 2024-09-11T05:34:45.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:45.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956502+0000", 2024-09-11T05:34:45.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7530000000000002e-06 2024-09-11T05:34:45.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:45.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013177+0000", 2024-09-11T05:34:45.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056674536999999997 2024-09-11T05:34:45.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:45.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013215+0000", 2024-09-11T05:34:45.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8578999999999998e-05 2024-09-11T05:34:45.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:45.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:45.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:45.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013265+0000", 2024-09-11T05:34:45.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0049999999999997e-05 2024-09-11T05:34:45.170 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.170 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.170 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.171 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:45.171 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:45.171 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:45.172 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:34:45.173 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:45.171+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:45.273 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:45.272+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:45.276 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:45.276 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:45.276 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:45.276 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:45.285 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:34:45.374 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:45.373+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:45.428 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:45.428 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:45.428 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:45.428 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:45.428 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:45.437 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:34:45.458 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:34:45.481 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:45.481+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:45.540 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:45.540 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:45.540 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:45.541 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:34:45.541 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:45.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:45.592 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:45.593 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:45.593 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:45.592+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:45.610 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:45.610 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:45.648 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:45.677 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:45.675+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:45.678 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:45.678 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:45.683 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:45.683 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:45.694 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:45.700 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:45.700 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:34:45.722 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:45.722 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:45.744 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:45.745 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:45.767 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:45.768 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:45.778 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:45.777+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:45.781 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:34:45.830 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:45.830 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:45.841 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:45.883 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:45.882+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:45.979 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:45.979+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:46.001 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:46.001 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:46.011 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:46.081 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:46.079+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:46.161 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:46.161 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:46.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:46.181 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:46.181+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:46.282 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:46.281+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:46.294 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:46.294 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:46.304 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:46.383 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:46.382+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:46.453 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:46.453 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:46.462 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:46.484 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:46.483+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:46.584 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:46.583+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:46.588 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:46.588 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:46.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:46.619 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T05:34:46.685 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:46.685+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:46.723 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:46.723 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:46.732 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:46.816 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:46.816+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:46.877 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:46.877 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:46.885 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:46.887 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:46.887+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:46.987 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:46.987+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:47.029 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:47.029 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:47.038 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:47.088 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:47.088+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:47.143 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:47.143 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:47.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:47.189 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:47.188+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:47.254 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:47.254 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:47.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:47.289 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:47.289+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:47.369 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:47.369 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:47.378 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:47.392 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:47.391+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:47.479 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:47.480 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:47.488 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:47.532 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:47.532+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:47.589 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:47.590 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:47.593 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:47.593+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:47.598 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:47.694 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:47.693+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:47.742 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:47.742 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:47.751 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:47.783 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:34:47.794 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:47.794+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:47.894 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:47.962 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:47.963 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:47.963 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:47.894+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:47.963 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:47.964 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:47.964 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:47.965 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:47.965 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:47.966 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:47.966 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:47.966 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:47.969 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:47.969 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:34:47.986 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:47.987 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:48.003 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:48.003 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:48.006 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:48.006+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:48.020 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:48.020 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:48.096 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:48.095+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:48.110 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:48.110 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:48.110 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:48.110 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:48.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.111 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116713 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13060096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.111 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:48.111 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.295436960000004, 2024-09-11T05:34:48.111 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599235, 2024-09-11T05:34:48.111 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.111 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.111 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.111 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.111 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.111 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.111 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116713 2024-09-11T05:34:48.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.112 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.112 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.112 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:48.112 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.112 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.112 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:34:48.112 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.112 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813321+0000", 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000005e-07 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813323+0000", 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.667e-06 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813331+0000", 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6529999999999994e-06 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.113 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813336+0000", 2024-09-11T05:34:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:34:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813688+0000", 2024-09-11T05:34:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035143199999999999 2024-09-11T05:34:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813692+0000", 2024-09-11T05:34:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5120000000000002e-06 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816304+0000", 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026115449999999998 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816308+0000", 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2370000000000003e-06 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.115 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821720+0000", 2024-09-11T05:34:48.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0054114869999999 2024-09-11T05:34:48.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.116 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821724+0000", 2024-09-11T05:34:48.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:34:48.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.116 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.116 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873101+0000", 2024-09-11T05:34:48.116 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0513774279999999 2024-09-11T05:34:48.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.117 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873159+0000", 2024-09-11T05:34:48.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819000000000003e-05 2024-09-11T05:34:48.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.117 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.117 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873244+0000", 2024-09-11T05:34:48.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4300000000000003e-05 2024-09-11T05:34:48.117 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.117 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.117 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116714 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.295394325000004, 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600505999999998, 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116714 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:48.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:48.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:34:48.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813366+0000", 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6919999999999998e-06 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813373+0000", 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8689999999999998e-06 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813378+0000", 2024-09-11T05:34:48.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2159999999999997e-06 2024-09-11T05:34:48.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813733+0000", 2024-09-11T05:34:48.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035530300000000001 2024-09-11T05:34:48.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:48.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813739+0000", 2024-09-11T05:34:48.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8819999999999998e-06 2024-09-11T05:34:48.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816340+0000", 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002600598 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816349+0000", 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9169999999999995e-06 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821745+0000", 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005396416 2024-09-11T05:34:48.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821750+0000", 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873269+0000", 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0515195159999999 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873328+0000", 2024-09-11T05:34:48.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9222999999999999e-05 2024-09-11T05:34:48.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.124 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873413+0000", 2024-09-11T05:34:48.124 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4983999999999998e-05 2024-09-11T05:34:48.124 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.124 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.124 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.124 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116715 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13109248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.124 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:48.125 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.295352844000007, 2024-09-11T05:34:48.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0602519180000001, 2024-09-11T05:34:48.125 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.125 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.125 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.125 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.125 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.125 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.125 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116715 2024-09-11T05:34:48.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.125 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:48.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:34:48.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813405+0000", 2024-09-11T05:34:48.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.51e-07 2024-09-11T05:34:48.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813407+0000", 2024-09-11T05:34:48.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:34:48.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813414+0000", 2024-09-11T05:34:48.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.686e-06 2024-09-11T05:34:48.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813419+0000", 2024-09-11T05:34:48.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4249999999999997e-06 2024-09-11T05:34:48.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.128 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813774+0000", 2024-09-11T05:34:48.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035460800000000002 2024-09-11T05:34:48.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:48.128 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813778+0000", 2024-09-11T05:34:48.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:34:48.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816375+0000", 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025967730000000001 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816379+0000", 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3780000000000003e-06 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821770+0000", 2024-09-11T05:34:48.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053903040000001 2024-09-11T05:34:48.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821774+0000", 2024-09-11T05:34:48.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:34:48.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873437+0000", 2024-09-11T05:34:48.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051663155 2024-09-11T05:34:48.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873500+0000", 2024-09-11T05:34:48.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3027000000000005e-05 2024-09-11T05:34:48.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873656+0000", 2024-09-11T05:34:48.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015580800000000001 2024-09-11T05:34:48.131 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.131 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.131 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.131 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116716 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13133824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.132 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:48.132 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.295310387000001, 2024-09-11T05:34:48.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0605170350000002, 2024-09-11T05:34:48.132 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.132 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.132 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.132 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.132 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.132 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.132 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116716 2024-09-11T05:34:48.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.132 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:48.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:48.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:34:48.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5799999999999999e-07 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813450+0000", 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7659999999999999e-06 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813458+0000", 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7430000000000002e-06 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813464+0000", 2024-09-11T05:34:48.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:34:48.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813814+0000", 2024-09-11T05:34:48.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035073199999999998 2024-09-11T05:34:48.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:48.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813819+0000", 2024-09-11T05:34:48.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:34:48.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816410+0000", 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025904349999999999 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816418+0000", 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1610000000000003e-06 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821794+0000", 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005376391 2024-09-11T05:34:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821799+0000", 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4870000000000004e-06 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873697+0000", 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051898843 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873810+0000", 2024-09-11T05:34:48.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112187 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873964+0000", 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015412800000000001 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116717 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13158400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.295285303, 2024-09-11T05:34:48.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606806560000002, 2024-09-11T05:34:48.139 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.139 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.139 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.139 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.139 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.139 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.139 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116717 2024-09-11T05:34:48.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.139 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.139 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.139 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:48.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.140 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:48.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.140 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:34:48.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:34:48.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813474+0000", 2024-09-11T05:34:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1830000000000001e-06 2024-09-11T05:34:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813481+0000", 2024-09-11T05:34:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5540000000000003e-06 2024-09-11T05:34:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813491+0000", 2024-09-11T05:34:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0472000000000001e-05 2024-09-11T05:34:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813867+0000", 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00037606 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813873+0000", 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.254e-06 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816443+0000", 2024-09-11T05:34:48.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025701769999999999 2024-09-11T05:34:48.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816446+0000", 2024-09-11T05:34:48.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:34:48.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821818+0000", 2024-09-11T05:34:48.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053719830000001 2024-09-11T05:34:48.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.144 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821823+0000", 2024-09-11T05:34:48.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5560000000000001e-06 2024-09-11T05:34:48.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.144 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.144 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.144 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874006+0000", 2024-09-11T05:34:48.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05218342 2024-09-11T05:34:48.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.144 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.144 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.144 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874071+0000", 2024-09-11T05:34:48.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4369999999999995e-05 2024-09-11T05:34:48.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874152+0000", 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1658999999999999e-05 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116718 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13182976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.295253785, 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0609185380000001, 2024-09-11T05:34:48.145 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.146 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.146 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.146 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.146 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.146 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.146 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116718 2024-09-11T05:34:48.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.146 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:48.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:34:48.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813504+0000", 2024-09-11T05:34:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7999999999999996e-07 2024-09-11T05:34:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813506+0000", 2024-09-11T05:34:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2989999999999999e-06 2024-09-11T05:34:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813513+0000", 2024-09-11T05:34:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8020000000000003e-06 2024-09-11T05:34:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.149 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.149 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813517+0000", 2024-09-11T05:34:48.149 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5639999999999998e-06 2024-09-11T05:34:48.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.149 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.149 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813916+0000", 2024-09-11T05:34:48.149 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039859800000000001 2024-09-11T05:34:48.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.149 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:48.149 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813922+0000", 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816476+0000", 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025538359999999999 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816481+0000", 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819999999999999e-06 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821843+0000", 2024-09-11T05:34:48.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053620299999999 2024-09-11T05:34:48.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.151 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821848+0000", 2024-09-11T05:34:48.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:34:48.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.151 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874191+0000", 2024-09-11T05:34:48.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052342935 2024-09-11T05:34:48.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.152 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.152 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874300+0000", 2024-09-11T05:34:48.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000108764 2024-09-11T05:34:48.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.152 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.152 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874422+0000", 2024-09-11T05:34:48.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012221399999999999 2024-09-11T05:34:48.152 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.152 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.152 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116719 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13207552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.295212986999999, 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0611734350000002, 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116719 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.153 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:48.154 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:34:48.154 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.154 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.154 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813545+0000", 2024-09-11T05:34:48.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2600000000000002e-07 2024-09-11T05:34:48.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813547+0000", 2024-09-11T05:34:48.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3329999999999999e-06 2024-09-11T05:34:48.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813553+0000", 2024-09-11T05:34:48.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4640000000000003e-06 2024-09-11T05:34:48.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813558+0000", 2024-09-11T05:34:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:34:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813952+0000", 2024-09-11T05:34:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039390999999999997 2024-09-11T05:34:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813955+0000", 2024-09-11T05:34:48.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.858e-06 2024-09-11T05:34:48.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.157 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.157 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.157 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816524+0000", 2024-09-11T05:34:48.157 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002568847 2024-09-11T05:34:48.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.157 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.157 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.157 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816533+0000", 2024-09-11T05:34:48.157 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1749999999999994e-06 2024-09-11T05:34:48.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.157 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.157 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.158 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821869+0000", 2024-09-11T05:34:48.158 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053358939999999 2024-09-11T05:34:48.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.158 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.158 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821876+0000", 2024-09-11T05:34:48.158 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:34:48.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.158 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.158 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874454+0000", 2024-09-11T05:34:48.158 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052577621 2024-09-11T05:34:48.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.159 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.159 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874546+0000", 2024-09-11T05:34:48.159 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2151999999999995e-05 2024-09-11T05:34:48.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.159 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.159 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874718+0000", 2024-09-11T05:34:48.159 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017183399999999999 2024-09-11T05:34:48.159 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.159 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.159 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.160 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116720 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13232128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.160 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:48.160 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.295191101, 2024-09-11T05:34:48.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0614845590000002, 2024-09-11T05:34:48.160 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.160 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.160 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.160 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.160 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.160 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.160 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116720 2024-09-11T05:34:48.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.161 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.161 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:48.161 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.161 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:48.161 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5600000000000002e-07 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813568+0000", 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9089999999999998e-06 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813573+0000", 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2059999999999998e-06 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.162 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.163 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813577+0000", 2024-09-11T05:34:48.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1489999999999996e-06 2024-09-11T05:34:48.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.163 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813987+0000", 2024-09-11T05:34:48.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040977800000000002 2024-09-11T05:34:48.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.163 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:48.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813992+0000", 2024-09-11T05:34:48.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1540000000000001e-06 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816560+0000", 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025680389999999998 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816566+0000", 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0679999999999996e-06 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.164 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821907+0000", 2024-09-11T05:34:48.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005341735 2024-09-11T05:34:48.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821916+0000", 2024-09-11T05:34:48.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3659999999999992e-06 2024-09-11T05:34:48.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874760+0000", 2024-09-11T05:34:48.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052844713 2024-09-11T05:34:48.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.166 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.166 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874878+0000", 2024-09-11T05:34:48.166 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000117321 2024-09-11T05:34:48.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.166 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.166 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.166 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875051+0000", 2024-09-11T05:34:48.166 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017286499999999999 2024-09-11T05:34:48.166 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.166 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.166 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116721 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13256704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.295173747000007, 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0616932019999998, 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116721 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.167 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.168 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:48.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.168 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:34:48.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.168 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813584+0000", 2024-09-11T05:34:48.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2e-07 2024-09-11T05:34:48.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813586+0000", 2024-09-11T05:34:48.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.277e-06 2024-09-11T05:34:48.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.169 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813592+0000", 2024-09-11T05:34:48.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5840000000000002e-06 2024-09-11T05:34:48.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813597+0000", 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2839999999999997e-06 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814028+0000", 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000430689 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814032+0000", 2024-09-11T05:34:48.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3850000000000004e-06 2024-09-11T05:34:48.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.171 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.171 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.171 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816597+0000", 2024-09-11T05:34:48.171 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00256485 2024-09-11T05:34:48.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.171 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.171 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.171 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816606+0000", 2024-09-11T05:34:48.171 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:34:48.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.171 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.171 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.172 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821949+0000", 2024-09-11T05:34:48.172 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005342752 2024-09-11T05:34:48.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.172 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.172 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.172 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821954+0000", 2024-09-11T05:34:48.172 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2270000000000001e-06 2024-09-11T05:34:48.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.172 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.172 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.172 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875095+0000", 2024-09-11T05:34:48.172 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.053140669 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875186+0000", 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1391999999999995e-05 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875277+0000", 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0556000000000005e-05 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.174 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116722 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13281280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.174 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:48.174 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.295136748000004, 2024-09-11T05:34:48.174 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.061825491, 2024-09-11T05:34:48.174 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.174 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.174 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.174 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.174 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.174 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.174 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116722 2024-09-11T05:34:48.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.175 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:48.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:34:48.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813621+0000", 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813625+0000", 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.228e-06 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813635+0000", 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5179999999999993e-06 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813641+0000", 2024-09-11T05:34:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4710000000000004e-06 2024-09-11T05:34:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814057+0000", 2024-09-11T05:34:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00041530099999999997 2024-09-11T05:34:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814060+0000", 2024-09-11T05:34:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-06 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816632+0000", 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00257186 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816636+0000", 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2150000000000003e-06 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.178 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821977+0000", 2024-09-11T05:34:48.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053407110000001 2024-09-11T05:34:48.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821982+0000", 2024-09-11T05:34:48.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:34:48.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875307+0000", 2024-09-11T05:34:48.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0533247000000001 2024-09-11T05:34:48.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875366+0000", 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8628999999999997e-05 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875446+0000", 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0026999999999998e-05 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116723 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13305856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.181 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:48.181 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.295103769999997, 2024-09-11T05:34:48.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0619630779999998, 2024-09-11T05:34:48.181 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.181 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.181 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.181 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.181 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.181 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.181 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116723 2024-09-11T05:34:48.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.181 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813654+0000", 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:34:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813661+0000", 2024-09-11T05:34:48.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1890000000000001e-06 2024-09-11T05:34:48.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813675+0000", 2024-09-11T05:34:48.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3878e-05 2024-09-11T05:34:48.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813682+0000", 2024-09-11T05:34:48.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.063e-06 2024-09-11T05:34:48.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.184 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.184 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816666+0000", 2024-09-11T05:34:48.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029845679999999999 2024-09-11T05:34:48.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.184 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.184 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816671+0000", 2024-09-11T05:34:48.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:34:48.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822024+0000", 2024-09-11T05:34:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053534660000001 2024-09-11T05:34:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822028+0000", 2024-09-11T05:34:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7799999999999998e-06 2024-09-11T05:34:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875471+0000", 2024-09-11T05:34:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05344306 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875531+0000", 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0019000000000003e-05 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875616+0000", 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5304999999999997e-05 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116724 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13330432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.295064280999995, 2024-09-11T05:34:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0620902609999998, 2024-09-11T05:34:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116724 2024-09-11T05:34:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.188 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.188 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.188 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:48.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.188 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.188 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:48.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.188 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.99e-07 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813697+0000", 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2430000000000001e-06 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813704+0000", 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2980000000000003e-06 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813709+0000", 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8130000000000003e-06 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816702+0000", 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002992864 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816711+0000", 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1840000000000005e-06 2024-09-11T05:34:48.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822050+0000", 2024-09-11T05:34:48.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.00533864 2024-09-11T05:34:48.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822055+0000", 2024-09-11T05:34:48.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:34:48.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875642+0000", 2024-09-11T05:34:48.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0535874220000001 2024-09-11T05:34:48.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.192 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875698+0000", 2024-09-11T05:34:48.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5707e-05 2024-09-11T05:34:48.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.192 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875783+0000", 2024-09-11T05:34:48.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5362e-05 2024-09-11T05:34:48.192 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.193 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.193 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.193 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116725 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13355008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.193 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:48.193 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.295030092999994, 2024-09-11T05:34:48.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.06220984, 2024-09-11T05:34:48.193 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.193 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.193 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.193 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.193 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.194 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.194 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116725 2024-09-11T05:34:48.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.194 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:48.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:34:48.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813728+0000", 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813730+0000", 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6730000000000001e-06 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813743+0000", 2024-09-11T05:34:48.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2833000000000001e-05 2024-09-11T05:34:48.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813749+0000", 2024-09-11T05:34:48.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:34:48.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816726+0000", 2024-09-11T05:34:48.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029772090000000002 2024-09-11T05:34:48.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816730+0000", 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.518e-06 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822074+0000", 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053444030000001 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822079+0000", 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:34:48.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875807+0000", 2024-09-11T05:34:48.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0537284410000001 2024-09-11T05:34:48.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875858+0000", 2024-09-11T05:34:48.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0574000000000001e-05 2024-09-11T05:34:48.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875937+0000", 2024-09-11T05:34:48.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9268000000000001e-05 2024-09-11T05:34:48.199 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.199 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.199 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.199 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116974 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13185024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.199 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:48.199 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.287086256999999, 2024-09-11T05:34:48.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598649249999998, 2024-09-11T05:34:48.199 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.199 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.199 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.200 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.200 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.200 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.200 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116974 2024-09-11T05:34:48.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.200 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:48.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:34:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:34:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821673+0000", 2024-09-11T05:34:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.722e-06 2024-09-11T05:34:48.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.202 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.202 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821686+0000", 2024-09-11T05:34:48.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2974e-05 2024-09-11T05:34:48.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.202 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.202 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821692+0000", 2024-09-11T05:34:48.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:34:48.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.202 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822089+0000", 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039611699999999998 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822099+0000", 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0029e-05 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822803+0000", 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000704507 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822808+0000", 2024-09-11T05:34:48.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6460000000000001e-06 2024-09-11T05:34:48.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881361+0000", 2024-09-11T05:34:48.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0585529680000001 2024-09-11T05:34:48.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881432+0000", 2024-09-11T05:34:48.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:34:48.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881536+0000", 2024-09-11T05:34:48.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000103243 2024-09-11T05:34:48.205 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.205 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.205 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.205 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116975 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13209600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.205 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:48.205 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.287057923000006, 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.060124761, 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116975 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:48.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:34:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821700+0000", 2024-09-11T05:34:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:34:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821701+0000", 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8369999999999999e-06 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821708+0000", 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5520000000000001e-06 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821713+0000", 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.091e-06 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822135+0000", 2024-09-11T05:34:48.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00042166399999999998 2024-09-11T05:34:48.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822143+0000", 2024-09-11T05:34:48.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3089999999999996e-06 2024-09-11T05:34:48.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822820+0000", 2024-09-11T05:34:48.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000677145 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822824+0000", 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.641e-06 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881569+0000", 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.058744785 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881674+0000", 2024-09-11T05:34:48.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000105111 2024-09-11T05:34:48.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881824+0000", 2024-09-11T05:34:48.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000150197 2024-09-11T05:34:48.211 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.211 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.211 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.211 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116976 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13234176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.211 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:48.212 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.287028943999999, 2024-09-11T05:34:48.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0603909900000001, 2024-09-11T05:34:48.212 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.212 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.212 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.212 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.212 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.212 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.212 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116976 2024-09-11T05:34:48.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.212 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:48.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:34:48.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821729+0000", 2024-09-11T05:34:48.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:34:48.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821731+0000", 2024-09-11T05:34:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0250000000000001e-06 2024-09-11T05:34:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821737+0000", 2024-09-11T05:34:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8839999999999997e-06 2024-09-11T05:34:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821743+0000", 2024-09-11T05:34:48.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1050000000000003e-06 2024-09-11T05:34:48.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822194+0000", 2024-09-11T05:34:48.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000451574 2024-09-11T05:34:48.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822203+0000", 2024-09-11T05:34:48.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9449999999999999e-06 2024-09-11T05:34:48.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.216 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.216 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822835+0000", 2024-09-11T05:34:48.216 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000632019 2024-09-11T05:34:48.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.216 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.216 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.216 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822839+0000", 2024-09-11T05:34:48.216 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8229999999999997e-06 2024-09-11T05:34:48.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.216 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.216 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.216 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881861+0000", 2024-09-11T05:34:48.216 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.059021776 2024-09-11T05:34:48.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881976+0000", 2024-09-11T05:34:48.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00011531699999999999 2024-09-11T05:34:48.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882119+0000", 2024-09-11T05:34:48.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000143077 2024-09-11T05:34:48.217 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.217 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.217 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116977 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13258752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.286977710000002, 2024-09-11T05:34:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606236920000001, 2024-09-11T05:34:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116977 2024-09-11T05:34:48.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.219 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:48.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:34:48.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821782+0000", 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7719999999999999e-06 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821785+0000", 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9409999999999999e-06 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821793+0000", 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:34:48.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.221 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821799+0000", 2024-09-11T05:34:48.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4609999999999999e-06 2024-09-11T05:34:48.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.221 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822246+0000", 2024-09-11T05:34:48.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044669000000000002 2024-09-11T05:34:48.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822254+0000", 2024-09-11T05:34:48.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1859999999999992e-06 2024-09-11T05:34:48.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.224 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.224 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822850+0000", 2024-09-11T05:34:48.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005962340000001 2024-09-11T05:34:48.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.224 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.224 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822854+0000", 2024-09-11T05:34:48.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5310000000000002e-06 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882149+0000", 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0592958729999999 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882253+0000", 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104058 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882403+0000", 2024-09-11T05:34:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014958800000000001 2024-09-11T05:34:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116978 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13283328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.286947487000006, 2024-09-11T05:34:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0608297769999999, 2024-09-11T05:34:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116978 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:48.228 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.228 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.228 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:34:48.228 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:34:48.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.228 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.228 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821813+0000", 2024-09-11T05:34:48.228 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:34:48.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821820+0000", 2024-09-11T05:34:48.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3669999999999999e-06 2024-09-11T05:34:48.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821825+0000", 2024-09-11T05:34:48.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5119999999999999e-06 2024-09-11T05:34:48.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822273+0000", 2024-09-11T05:34:48.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044727900000000003 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822278+0000", 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7529999999999998e-06 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822865+0000", 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005861579999999 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822868+0000", 2024-09-11T05:34:48.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4659999999999999e-06 2024-09-11T05:34:48.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.231 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.231 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882434+0000", 2024-09-11T05:34:48.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0595660170000001 2024-09-11T05:34:48.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.231 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.231 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882502+0000", 2024-09-11T05:34:48.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7442999999999998e-05 2024-09-11T05:34:48.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.232 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.232 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882639+0000", 2024-09-11T05:34:48.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013779999999999999 2024-09-11T05:34:48.232 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.232 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.232 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.232 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.232 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116980 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13332480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.232 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:48.232 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.285407965000005, 2024-09-11T05:34:48.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598269180000002, 2024-09-11T05:34:48.232 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116980 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.234 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:34:48.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.234 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823350+0000", 2024-09-11T05:34:48.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:34:48.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.234 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823352+0000", 2024-09-11T05:34:48.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5459999999999998e-06 2024-09-11T05:34:48.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.235 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.235 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.235 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823360+0000", 2024-09-11T05:34:48.235 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4359999999999996e-06 2024-09-11T05:34:48.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.235 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.235 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.235 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823365+0000", 2024-09-11T05:34:48.235 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3079999999999998e-06 2024-09-11T05:34:48.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.235 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.235 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823418+0000", 2024-09-11T05:34:48.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2735999999999998e-05 2024-09-11T05:34:48.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.236 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823423+0000", 2024-09-11T05:34:48.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3410000000000002e-06 2024-09-11T05:34:48.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.236 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822895+0000", 2024-09-11T05:34:48.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99947249000000005 2024-09-11T05:34:48.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822899+0000", 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6169999999999998e-06 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882964+0000", 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0600650840000001 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883020+0000", 2024-09-11T05:34:48.237 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5563000000000003e-05 2024-09-11T05:34:48.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.238 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.238 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.238 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883176+0000", 2024-09-11T05:34:48.238 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015629500000000001 2024-09-11T05:34:48.238 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.238 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.238 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.238 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.238 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116981 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13357056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:48.238 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:48.238 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.285383984999996, 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600075910000002, 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116981 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:48.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.240 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.240 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.240 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:48.240 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.240 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.240 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.240 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:34:48.240 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.01e-07 2024-09-11T05:34:48.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.240 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.240 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823376+0000", 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823381+0000", 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000001e-06 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823386+0000", 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5349999999999998e-06 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.241 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823447+0000", 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1277000000000003e-05 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823456+0000", 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8859999999999993e-06 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822914+0000", 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99945797999999997 2024-09-11T05:34:48.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.243 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822918+0000", 2024-09-11T05:34:48.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5810000000000001e-06 2024-09-11T05:34:48.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.243 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883209+0000", 2024-09-11T05:34:48.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0602916899999999 2024-09-11T05:34:48.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.243 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883292+0000", 2024-09-11T05:34:48.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2849000000000006e-05 2024-09-11T05:34:48.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.244 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883381+0000", 2024-09-11T05:34:48.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8585000000000007e-05 2024-09-11T05:34:48.244 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.244 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.244 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.244 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.244 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.244 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:48.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:48.246 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:48.245+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:48.347 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:48.347+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:48.391 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:48.391 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:48.391 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:48.391 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:48.399 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:48.448 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:48.447+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:48.542 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:48.542 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:48.542 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:48.542 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:48.542 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:48.549 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:48.548+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:48.551 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:48.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:34:48.650 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:48.650+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:48.659 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:48.660 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:48.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:48.660 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:48.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.660 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:34:48.660 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:48.660 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 98.009675701000006, 2024-09-11T05:34:48.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:34:48.660 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.660 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:34:48.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:34:48.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:34:48.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:34:48.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:34:48.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:34:48.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:34:48.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:34:48.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:34:48.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.664 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:34:48.664 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:34:48.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.664 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:34:48.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:34:48.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:34:48.665 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:34:48.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:34:48.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.665 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.665 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:48.666 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:34:48.666 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:34:48.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.666 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.666 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:48.666 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:34:48.666 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:34:48.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.666 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.666 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:48.666 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:34:48.666 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:34:48.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.667 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.667 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:34:48.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:34:48.667 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.667 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.667 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.667 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:146253 3.6 3:64dbadcf:::rbd_data.112d55d87bfc.0000000000000332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-11T05:34:48.667 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:48.667 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 62.820860793000001, 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4166483809999999, 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 146253 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:48.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:34:48.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837090+0000", 2024-09-11T05:34:48.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.73e-06 2024-09-11T05:34:48.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837096+0000", 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3500000000000002e-06 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837115+0000", 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8556e-05 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837124+0000", 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6739999999999992e-06 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837184+0000", 2024-09-11T05:34:48.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9960000000000002e-05 2024-09-11T05:34:48.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:34:48.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837188+0000", 2024-09-11T05:34:48.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:48.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840481+0000", 2024-09-11T05:34:48.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032924080000000001 2024-09-11T05:34:48.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840497+0000", 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6140000000000001e-05 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850737+0000", 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0102404119999999 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850747+0000", 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7969999999999995e-06 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252495+0000", 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.401748131 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252636+0000", 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014118900000000001 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252737+0000", 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00010058 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.674 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:48.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253433+0000", 2024-09-11T05:34:48.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00069601999999999999 2024-09-11T05:34:48.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:48.675 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253604+0000", 2024-09-11T05:34:48.675 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000170824 2024-09-11T05:34:48.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.675 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:48.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253649+0000", 2024-09-11T05:34:48.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5050999999999999e-05 2024-09-11T05:34:48.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.676 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.676 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.676 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253736+0000", 2024-09-11T05:34:48.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7509000000000005e-05 2024-09-11T05:34:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:147298 3.6 3:652e51de:::rbd_data.112d55d87bfc.0000000000000377:head [set-alloc-hint object_size 262144 write_size 262144,write 122880~2839] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-11T05:34:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 59.424320217000002, 2024-09-11T05:34:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62981612099999995, 2024-09-11T05:34:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:48.677 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 147298 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:34:48.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233630+0000", 2024-09-11T05:34:48.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5489999999999999e-06 2024-09-11T05:34:48.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233637+0000", 2024-09-11T05:34:48.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.272e-06 2024-09-11T05:34:48.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233654+0000", 2024-09-11T05:34:48.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6283999999999999e-05 2024-09-11T05:34:48.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233662+0000", 2024-09-11T05:34:48.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.875e-06 2024-09-11T05:34:48.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233723+0000", 2024-09-11T05:34:48.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1501000000000006e-05 2024-09-11T05:34:48.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:34:48.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233732+0000", 2024-09-11T05:34:48.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0699999999999996e-06 2024-09-11T05:34:48.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862055+0000", 2024-09-11T05:34:48.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62832274799999999 2024-09-11T05:34:48.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862219+0000", 2024-09-11T05:34:48.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016404899999999999 2024-09-11T05:34:48.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.683 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:48.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862313+0000", 2024-09-11T05:34:48.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4105999999999997e-05 2024-09-11T05:34:48.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:34:48.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862981+0000", 2024-09-11T05:34:48.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00066744199999999997 2024-09-11T05:34:48.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.684 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:48.684 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863382+0000", 2024-09-11T05:34:48.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040111200000000002 2024-09-11T05:34:48.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:34:48.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863419+0000", 2024-09-11T05:34:48.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6974000000000002e-05 2024-09-11T05:34:48.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.685 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.685 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863445+0000", 2024-09-11T05:34:48.685 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6139000000000002e-05 2024-09-11T05:34:48.685 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.685 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.686 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.686 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151292 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.686 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:48.686 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701668822000002, 2024-09-11T05:34:48.686 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054346481000000002, 2024-09-11T05:34:48.686 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.686 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.686 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.686 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.686 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.687 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.687 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151292 2024-09-11T05:34:48.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.687 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:48.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:48.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:34:48.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:34:48.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956283+0000", 2024-09-11T05:34:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2450000000000001e-06 2024-09-11T05:34:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956290+0000", 2024-09-11T05:34:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0910000000000004e-06 2024-09-11T05:34:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956296+0000", 2024-09-11T05:34:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.947e-06 2024-09-11T05:34:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010460+0000", 2024-09-11T05:34:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054164165 2024-09-11T05:34:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010537+0000", 2024-09-11T05:34:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6965000000000006e-05 2024-09-11T05:34:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010626+0000", 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9628000000000003e-05 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151293 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1933312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701645978999998, 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054563858999999999, 2024-09-11T05:34:48.691 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.692 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.692 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.692 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.692 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.692 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.692 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151293 2024-09-11T05:34:48.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.692 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.692 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.692 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.46e-07 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956306+0000", 2024-09-11T05:34:48.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2259999999999999e-06 2024-09-11T05:34:48.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956312+0000", 2024-09-11T05:34:48.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:34:48.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.695 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.695 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.695 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956317+0000", 2024-09-11T05:34:48.695 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:34:48.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.695 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.695 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.695 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010671+0000", 2024-09-11T05:34:48.695 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054353830999999998 2024-09-11T05:34:48.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.696 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.696 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010757+0000", 2024-09-11T05:34:48.696 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6120999999999998e-05 2024-09-11T05:34:48.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.696 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.696 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010867+0000", 2024-09-11T05:34:48.696 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000109687 2024-09-11T05:34:48.696 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.697 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.697 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.697 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151294 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2179072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.697 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:48.697 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701624117000001, 2024-09-11T05:34:48.697 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054741825000000001, 2024-09-11T05:34:48.697 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.698 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.698 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.698 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.698 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.698 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.698 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151294 2024-09-11T05:34:48.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.698 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:48.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:48.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:34:48.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.84e-07 2024-09-11T05:34:48.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956326+0000", 2024-09-11T05:34:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.483e-06 2024-09-11T05:34:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956330+0000", 2024-09-11T05:34:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8519999999999997e-06 2024-09-11T05:34:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956334+0000", 2024-09-11T05:34:48.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4139999999999998e-06 2024-09-11T05:34:48.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.701 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.701 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.701 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010894+0000", 2024-09-11T05:34:48.701 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054560243000000001 2024-09-11T05:34:48.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.701 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.701 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.701 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010970+0000", 2024-09-11T05:34:48.701 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6138999999999997e-05 2024-09-11T05:34:48.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.701 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011067+0000", 2024-09-11T05:34:48.702 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6409999999999993e-05 2024-09-11T05:34:48.702 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.702 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.702 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.702 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151295 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2392064~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.702 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:48.702 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701611446000001, 2024-09-11T05:34:48.702 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054949748999999999, 2024-09-11T05:34:48.703 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.703 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.703 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.703 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.703 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.703 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.703 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151295 2024-09-11T05:34:48.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.703 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.703 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.703 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:48.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.704 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.704 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:34:48.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.704 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.704 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956338+0000", 2024-09-11T05:34:48.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.23e-07 2024-09-11T05:34:48.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.705 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956339+0000", 2024-09-11T05:34:48.705 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.243e-06 2024-09-11T05:34:48.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.705 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956342+0000", 2024-09-11T05:34:48.705 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.473e-06 2024-09-11T05:34:48.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.706 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956345+0000", 2024-09-11T05:34:48.706 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:34:48.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.706 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.706 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011109+0000", 2024-09-11T05:34:48.706 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054763698999999999 2024-09-11T05:34:48.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.706 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.707 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011188+0000", 2024-09-11T05:34:48.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8887999999999994e-05 2024-09-11T05:34:48.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.707 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.707 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.707 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011287+0000", 2024-09-11T05:34:48.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9504000000000001e-05 2024-09-11T05:34:48.707 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.707 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.707 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.707 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.708 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151296 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.708 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:48.708 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701600335999998, 2024-09-11T05:34:48.708 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055045187000000002, 2024-09-11T05:34:48.708 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.708 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.708 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.708 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.709 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.709 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.709 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151296 2024-09-11T05:34:48.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.709 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.709 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:48.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.710 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.710 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:34:48.710 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.710 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.710 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956349+0000", 2024-09-11T05:34:48.710 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:48.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.710 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.710 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956350+0000", 2024-09-11T05:34:48.711 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:34:48.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.711 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.711 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.711 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956353+0000", 2024-09-11T05:34:48.711 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.016e-06 2024-09-11T05:34:48.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.711 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.711 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.711 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956355+0000", 2024-09-11T05:34:48.711 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5509999999999998e-06 2024-09-11T05:34:48.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.712 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.712 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.712 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011303+0000", 2024-09-11T05:34:48.712 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054947306000000001 2024-09-11T05:34:48.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.712 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.712 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.712 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011342+0000", 2024-09-11T05:34:48.712 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9057999999999998e-05 2024-09-11T05:34:48.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.712 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011394+0000", 2024-09-11T05:34:48.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1925999999999997e-05 2024-09-11T05:34:48.713 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.713 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.713 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.713 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151297 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2818048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.713 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:48.713 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701590404999997, 2024-09-11T05:34:48.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055238158000000002, 2024-09-11T05:34:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151297 2024-09-11T05:34:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:48.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:34:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956359+0000", 2024-09-11T05:34:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956360+0000", 2024-09-11T05:34:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1030000000000001e-06 2024-09-11T05:34:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956363+0000", 2024-09-11T05:34:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.021e-06 2024-09-11T05:34:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956365+0000", 2024-09-11T05:34:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4770000000000002e-06 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011425+0000", 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055059967000000001 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011506+0000", 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1063000000000006e-05 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.717 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011597+0000", 2024-09-11T05:34:48.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0299999999999999e-05 2024-09-11T05:34:48.718 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.718 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.718 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.718 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.718 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151298 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3031040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.718 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:48.718 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701580438999997, 2024-09-11T05:34:48.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055425825999999997, 2024-09-11T05:34:48.719 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.719 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.719 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.719 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.719 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.719 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.719 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151298 2024-09-11T05:34:48.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.719 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.720 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.720 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:48.720 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.720 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:34:48.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.721 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.721 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956369+0000", 2024-09-11T05:34:48.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4400000000000001e-07 2024-09-11T05:34:48.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.722 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.722 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.722 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956370+0000", 2024-09-11T05:34:48.722 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.068e-06 2024-09-11T05:34:48.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.722 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.722 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956373+0000", 2024-09-11T05:34:48.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0419999999999998e-06 2024-09-11T05:34:48.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956375+0000", 2024-09-11T05:34:48.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:48.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.724 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.724 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011631+0000", 2024-09-11T05:34:48.724 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055255116999999999 2024-09-11T05:34:48.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.724 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.724 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011703+0000", 2024-09-11T05:34:48.724 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2554999999999999e-05 2024-09-11T05:34:48.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.725 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.725 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011794+0000", 2024-09-11T05:34:48.725 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1119999999999995e-05 2024-09-11T05:34:48.725 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.725 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.725 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.726 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.726 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151299 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3276800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.726 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:48.726 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701569137, 2024-09-11T05:34:48.726 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055567477999999997, 2024-09-11T05:34:48.727 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.727 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.727 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.727 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.727 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.727 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.727 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151299 2024-09-11T05:34:48.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.728 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.728 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:48.728 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.729 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:48.729 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.729 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.729 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.729 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:34:48.729 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:34:48.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.729 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956382+0000", 2024-09-11T05:34:48.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.72e-06 2024-09-11T05:34:48.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.730 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956386+0000", 2024-09-11T05:34:48.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0990000000000001e-06 2024-09-11T05:34:48.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.731 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.731 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956390+0000", 2024-09-11T05:34:48.731 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.318e-06 2024-09-11T05:34:48.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.731 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.731 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011823+0000", 2024-09-11T05:34:48.732 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055432976000000002 2024-09-11T05:34:48.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.732 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.732 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.732 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011882+0000", 2024-09-11T05:34:48.732 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8656999999999998e-05 2024-09-11T05:34:48.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.733 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.733 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.733 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011947+0000", 2024-09-11T05:34:48.733 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5177000000000003e-05 2024-09-11T05:34:48.733 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.733 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.734 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.734 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.734 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151300 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3489792~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.734 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:48.734 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701552669999998, 2024-09-11T05:34:48.734 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055745232999999998, 2024-09-11T05:34:48.734 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.734 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.734 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.734 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.734 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.735 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.735 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151300 2024-09-11T05:34:48.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.735 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.735 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.735 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:48.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.735 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.735 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956397+0000", 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956398+0000", 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.869e-06 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.737 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956404+0000", 2024-09-11T05:34:48.737 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:34:48.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.737 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.737 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.737 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956407+0000", 2024-09-11T05:34:48.737 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.191e-06 2024-09-11T05:34:48.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.737 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.737 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.737 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011981+0000", 2024-09-11T05:34:48.737 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055573553999999997 2024-09-11T05:34:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012051+0000", 2024-09-11T05:34:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9542999999999995e-05 2024-09-11T05:34:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012141+0000", 2024-09-11T05:34:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0845000000000002e-05 2024-09-11T05:34:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151301 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3702784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701537741000003, 2024-09-11T05:34:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055834747999999997, 2024-09-11T05:34:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151301 2024-09-11T05:34:48.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.740 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.740 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.740 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.740 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:48.740 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.740 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.740 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.740 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:48.740 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.740 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.741 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.741 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:34:48.741 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:34:48.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.741 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.741 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.741 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956413+0000", 2024-09-11T05:34:48.741 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2810000000000001e-06 2024-09-11T05:34:48.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.741 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.741 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.741 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956416+0000", 2024-09-11T05:34:48.742 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1559999999999999e-06 2024-09-11T05:34:48.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.742 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.742 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.742 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956418+0000", 2024-09-11T05:34:48.742 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:34:48.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.742 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.742 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.742 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012155+0000", 2024-09-11T05:34:48.742 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055736651999999998 2024-09-11T05:34:48.743 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.743 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.743 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.743 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012193+0000", 2024-09-11T05:34:48.743 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7848000000000001e-05 2024-09-11T05:34:48.743 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.743 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.743 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.743 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012246+0000", 2024-09-11T05:34:48.743 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3041000000000003e-05 2024-09-11T05:34:48.743 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.743 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.743 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.744 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.744 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.744 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151302 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3915776~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.744 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:48.744 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701527638000002, 2024-09-11T05:34:48.744 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056035532999999998, 2024-09-11T05:34:48.744 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.744 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.744 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.744 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.745 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.745 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.745 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151302 2024-09-11T05:34:48.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.745 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.745 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.745 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.745 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:48.746 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.746 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.746 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.746 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:48.746 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.747 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.747 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.747 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:34:48.747 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:48.747 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.747 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.748 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.748 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956426+0000", 2024-09-11T05:34:48.748 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.853e-06 2024-09-11T05:34:48.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.748 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.748 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.748 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956430+0000", 2024-09-11T05:34:48.748 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3699999999999999e-06 2024-09-11T05:34:48.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.749 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.749 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.749 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956432+0000", 2024-09-11T05:34:48.749 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5979999999999999e-06 2024-09-11T05:34:48.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.750 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.750 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.750 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012281+0000", 2024-09-11T05:34:48.750 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055848644000000003 2024-09-11T05:34:48.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.750 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.750 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.750 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012358+0000", 2024-09-11T05:34:48.750 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6662000000000006e-05 2024-09-11T05:34:48.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.751 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.751 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012457+0000", 2024-09-11T05:34:48.751 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9197999999999995e-05 2024-09-11T05:34:48.751 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.751 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.751 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.751 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151303 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4128768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.752 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:48.752 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701513056000003, 2024-09-11T05:34:48.752 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056186709000000001, 2024-09-11T05:34:48.752 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.752 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.752 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.752 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.752 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.752 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.752 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151303 2024-09-11T05:34:48.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.753 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.753 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.753 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:48.753 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.753 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.753 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:48.753 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.753 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956437+0000", 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.201e-06 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956440+0000", 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-06 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.755 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.755 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956443+0000", 2024-09-11T05:34:48.755 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5909999999999998e-06 2024-09-11T05:34:48.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.755 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.755 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.755 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012494+0000", 2024-09-11T05:34:48.755 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056051541000000003 2024-09-11T05:34:48.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.755 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.755 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.755 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012558+0000", 2024-09-11T05:34:48.755 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3347000000000002e-05 2024-09-11T05:34:48.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.756 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.756 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012622+0000", 2024-09-11T05:34:48.756 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4760999999999999e-05 2024-09-11T05:34:48.756 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.756 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.756 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.757 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151304 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.757 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:48.757 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701502998999999, 2024-09-11T05:34:48.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056360149999999998, 2024-09-11T05:34:48.757 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.757 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.757 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.757 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.757 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.757 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.757 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151304 2024-09-11T05:34:48.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.757 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:34:48.758 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:48.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.759 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.759 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.759 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956447+0000", 2024-09-11T05:34:48.759 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.153e-06 2024-09-11T05:34:48.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.759 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.759 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.759 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956450+0000", 2024-09-11T05:34:48.759 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9909999999999998e-06 2024-09-11T05:34:48.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.759 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.760 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.760 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956453+0000", 2024-09-11T05:34:48.760 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.447e-06 2024-09-11T05:34:48.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.760 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.760 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012660+0000", 2024-09-11T05:34:48.760 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056207510000000002 2024-09-11T05:34:48.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.760 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.760 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012741+0000", 2024-09-11T05:34:48.760 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0734000000000003e-05 2024-09-11T05:34:48.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.761 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.761 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.761 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012806+0000", 2024-09-11T05:34:48.761 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5087999999999998e-05 2024-09-11T05:34:48.762 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.762 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.762 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.762 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151305 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4587520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.762 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:48.762 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701493237999998, 2024-09-11T05:34:48.763 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056476407999999999, 2024-09-11T05:34:48.763 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.763 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.763 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.763 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.763 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.763 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.763 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151305 2024-09-11T05:34:48.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.763 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.764 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.764 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.764 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:48.764 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.764 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.764 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.764 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:48.764 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.765 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.765 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:34:48.765 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:48.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.766 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.766 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956457+0000", 2024-09-11T05:34:48.766 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.353e-06 2024-09-11T05:34:48.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.767 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.767 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956460+0000", 2024-09-11T05:34:48.767 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0060000000000001e-06 2024-09-11T05:34:48.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.767 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.767 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.768 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956463+0000", 2024-09-11T05:34:48.768 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.452e-06 2024-09-11T05:34:48.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.768 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.768 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.768 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012834+0000", 2024-09-11T05:34:48.769 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056370917999999999 2024-09-11T05:34:48.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.769 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.769 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012877+0000", 2024-09-11T05:34:48.769 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000999999999997e-05 2024-09-11T05:34:48.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.770 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.770 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.770 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012932+0000", 2024-09-11T05:34:48.770 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5470000000000003e-05 2024-09-11T05:34:48.770 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.770 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.771 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.771 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.771 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151306 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4800512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.771 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:48.772 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701483258000003, 2024-09-11T05:34:48.772 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056579203000000002, 2024-09-11T05:34:48.772 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.772 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.772 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.772 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.773 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.773 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.773 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151306 2024-09-11T05:34:48.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.773 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.773 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.774 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.774 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:48.774 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.774 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.774 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.775 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:48.775 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.775 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.775 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.776 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:34:48.776 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.28e-07 2024-09-11T05:34:48.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.776 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.776 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.776 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956467+0000", 2024-09-11T05:34:48.777 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.088e-06 2024-09-11T05:34:48.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.777 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.777 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.777 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956470+0000", 2024-09-11T05:34:48.777 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0240000000000002e-06 2024-09-11T05:34:48.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.778 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.778 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.778 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956472+0000", 2024-09-11T05:34:48.778 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4609999999999998e-06 2024-09-11T05:34:48.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.779 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.779 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012953+0000", 2024-09-11T05:34:48.779 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056480524999999997 2024-09-11T05:34:48.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.780 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.780 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.780 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012994+0000", 2024-09-11T05:34:48.780 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1394999999999999e-05 2024-09-11T05:34:48.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.781 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.781 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.781 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013045+0000", 2024-09-11T05:34:48.781 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0482000000000002e-05 2024-09-11T05:34:48.781 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.781 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.782 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.782 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.782 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151307 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5013504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.782 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:48.782 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701473589000003, 2024-09-11T05:34:48.783 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056680525000000002, 2024-09-11T05:34:48.783 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.783 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.783 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.783 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.783 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.784 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.784 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151307 2024-09-11T05:34:48.784 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.784 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.784 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.784 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.784 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:48.784 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.785 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.785 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.785 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:48.785 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.785 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.785 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.785 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:34:48.785 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:34:48.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.786 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.786 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.786 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956476+0000", 2024-09-11T05:34:48.786 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0359999999999999e-06 2024-09-11T05:34:48.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.786 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.786 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.786 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956479+0000", 2024-09-11T05:34:48.786 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8899999999999999e-06 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956482+0000", 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5380000000000001e-06 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013065+0000", 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056582983000000003 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.787 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013104+0000", 2024-09-11T05:34:48.788 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9119999999999998e-05 2024-09-11T05:34:48.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.788 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.788 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013156+0000", 2024-09-11T05:34:48.788 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1743999999999998e-05 2024-09-11T05:34:48.788 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.788 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.788 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.788 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151308 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5226496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:34:48.788 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:48.789 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 54.701456258, 2024-09-11T05:34:48.789 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056772738000000003, 2024-09-11T05:34:48.789 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:48.789 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:48.789 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:48.789 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:48.789 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:48.789 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:48.790 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151308 2024-09-11T05:34:48.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.790 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:48.790 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.790 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:48.790 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:48.790 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.790 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.791 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:48.791 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:48.791 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:48.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.791 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.791 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:48.791 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:34:48.791 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2599999999999998e-07 2024-09-11T05:34:48.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.792 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.792 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:48.792 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956495+0000", 2024-09-11T05:34:48.792 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9750000000000001e-06 2024-09-11T05:34:48.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.792 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.792 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:48.793 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956499+0000", 2024-09-11T05:34:48.793 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5179999999999998e-06 2024-09-11T05:34:48.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.793 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.793 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:48.793 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956502+0000", 2024-09-11T05:34:48.793 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7530000000000002e-06 2024-09-11T05:34:48.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.794 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.794 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:48.794 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013177+0000", 2024-09-11T05:34:48.794 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056674536999999997 2024-09-11T05:34:48.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.794 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.794 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:48.794 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013215+0000", 2024-09-11T05:34:48.794 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8578999999999998e-05 2024-09-11T05:34:48.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:48.795 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:48.795 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:48.795 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013265+0000", 2024-09-11T05:34:48.795 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0049999999999997e-05 2024-09-11T05:34:48.795 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.795 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.795 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.795 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:48.796 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:48.796 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:48.796 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 5, 6] out_osds: [4, 3, 7, 1] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-09-11T05:34:48.796 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:34:48.797 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-11T05:34:48.797 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-11T05:34:48.798 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:48.796+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:48.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:34:48.898 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:48.897+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:48.944 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:48.945 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:48.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:34:49.037 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:49.037+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:49.086 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-11T05:34:49.085+0000 7fc03b8fe640 -1 mon.a@0(leader).osd e123 definitely_dead 0 2024-09-11T05:34:49.097 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:49.097 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:49.097 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:49.097 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:49.097 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:49.100 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:49.099+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:49.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:34:49.200 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:49.200+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:49.250 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:49.250 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:49.250 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:49.250 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:34:49.250 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:49.259 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:49.303 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:49.303+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:49.363 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:49.363 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:49.363 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:49.363 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:49.371 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:49.402 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:49.402+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:49.503 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:49.503+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:49.514 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:49.514 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:49.514 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:49.514 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:49.514 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:49.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:49.606 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:49.606+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:49.622 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T05:34:49.622 INFO:teuthology.orchestra.run.smithi070.stderr:marked in osd.3. 2024-09-11T05:34:49.655 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-11T05:34:49.688 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:49.688 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:49.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:49.688 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:49.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.689 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116524 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.689 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:49.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874391567999993, 2024-09-11T05:34:49.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344630100000001, 2024-09-11T05:34:49.689 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116524 2024-09-11T05:34:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811270+0000", 2024-09-11T05:34:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:34:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811272+0000", 2024-09-11T05:34:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:34:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811278+0000", 2024-09-11T05:34:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1970000000000001e-06 2024-09-11T05:34:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811283+0000", 2024-09-11T05:34:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-09-11T05:34:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813113+0000", 2024-09-11T05:34:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001830302 2024-09-11T05:34:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813117+0000", 2024-09-11T05:34:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0810000000000004e-06 2024-09-11T05:34:49.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814661+0000", 2024-09-11T05:34:49.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015436969999999999 2024-09-11T05:34:49.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814667+0000", 2024-09-11T05:34:49.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6370000000000002e-06 2024-09-11T05:34:49.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826115+0000", 2024-09-11T05:34:49.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114479059999999 2024-09-11T05:34:49.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826123+0000", 2024-09-11T05:34:49.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000004e-06 2024-09-11T05:34:49.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845722+0000", 2024-09-11T05:34:49.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195993000000001 2024-09-11T05:34:49.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845732+0000", 2024-09-11T05:34:49.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T05:34:49.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.699 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.700 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116525 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.700 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:49.700 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874371686000003, 2024-09-11T05:34:49.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344747700000001, 2024-09-11T05:34:49.700 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116525 2024-09-11T05:34:49.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.701 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:49.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:49.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811290+0000", 2024-09-11T05:34:49.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:34:49.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811295+0000", 2024-09-11T05:34:49.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8969999999999999e-06 2024-09-11T05:34:49.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811301+0000", 2024-09-11T05:34:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4919999999999998e-06 2024-09-11T05:34:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811306+0000", 2024-09-11T05:34:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999998e-06 2024-09-11T05:34:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813138+0000", 2024-09-11T05:34:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001832078 2024-09-11T05:34:49.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:49.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813142+0000", 2024-09-11T05:34:49.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0380000000000001e-06 2024-09-11T05:34:49.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814689+0000", 2024-09-11T05:34:49.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546799 2024-09-11T05:34:49.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814695+0000", 2024-09-11T05:34:49.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8739999999999997e-06 2024-09-11T05:34:49.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826148+0000", 2024-09-11T05:34:49.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114527259999999 2024-09-11T05:34:49.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826166+0000", 2024-09-11T05:34:49.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7484999999999999e-05 2024-09-11T05:34:49.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845756+0000", 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019590609 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845764+0000", 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7020000000000001e-06 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.708 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116526 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.708 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:49.708 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874348888, 2024-09-11T05:34:49.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344863210000002, 2024-09-11T05:34:49.708 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.708 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.708 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116526 2024-09-11T05:34:49.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.709 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:49.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:49.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:49.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:34:49.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811315+0000", 2024-09-11T05:34:49.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079999999999999e-06 2024-09-11T05:34:49.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811320+0000", 2024-09-11T05:34:49.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8619999999999999e-06 2024-09-11T05:34:49.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811325+0000", 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814736+0000", 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034115780000000002 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814744+0000", 2024-09-11T05:34:49.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5340000000000002e-06 2024-09-11T05:34:49.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826212+0000", 2024-09-11T05:34:49.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114682749999999 2024-09-11T05:34:49.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826225+0000", 2024-09-11T05:34:49.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:34:49.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845789+0000", 2024-09-11T05:34:49.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195649200000001 2024-09-11T05:34:49.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845798+0000", 2024-09-11T05:34:49.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9269999999999994e-06 2024-09-11T05:34:49.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.713 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.714 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116527 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.714 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:49.714 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874329955999997, 2024-09-11T05:34:49.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345095849999999, 2024-09-11T05:34:49.714 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.714 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.714 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116527 2024-09-11T05:34:49.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.715 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:49.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:49.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:49.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:34:49.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811334+0000", 2024-09-11T05:34:49.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:34:49.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811340+0000", 2024-09-11T05:34:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.691e-06 2024-09-11T05:34:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811345+0000", 2024-09-11T05:34:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5480000000000003e-06 2024-09-11T05:34:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814767+0000", 2024-09-11T05:34:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034223190000000001 2024-09-11T05:34:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814774+0000", 2024-09-11T05:34:49.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:34:49.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826265+0000", 2024-09-11T05:34:49.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114912460000001 2024-09-11T05:34:49.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826274+0000", 2024-09-11T05:34:49.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3909999999999998e-06 2024-09-11T05:34:49.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845831+0000", 2024-09-11T05:34:49.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195574080000001 2024-09-11T05:34:49.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845841+0000", 2024-09-11T05:34:49.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3610000000000007e-06 2024-09-11T05:34:49.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.719 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.720 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116528 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.720 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:49.720 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874310516999998, 2024-09-11T05:34:49.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345287679999999, 2024-09-11T05:34:49.720 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116528 2024-09-11T05:34:49.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.721 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:49.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:49.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811351+0000", 2024-09-11T05:34:49.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T05:34:49.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811353+0000", 2024-09-11T05:34:49.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:34:49.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811359+0000", 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811364+0000", 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000001e-06 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814795+0000", 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034316569999999998 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814826+0000", 2024-09-11T05:34:49.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0587999999999999e-05 2024-09-11T05:34:49.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826309+0000", 2024-09-11T05:34:49.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011483444 2024-09-11T05:34:49.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826319+0000", 2024-09-11T05:34:49.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6849999999999996e-06 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845868+0000", 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195487110000001 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845879+0000", 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1428e-05 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116529 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874291882999998, 2024-09-11T05:34:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034542531, 2024-09-11T05:34:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116529 2024-09-11T05:34:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.727 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:49.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:49.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:49.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:34:49.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811371+0000", 2024-09-11T05:34:49.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T05:34:49.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811377+0000", 2024-09-11T05:34:49.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1580000000000002e-06 2024-09-11T05:34:49.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811383+0000", 2024-09-11T05:34:49.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.135e-06 2024-09-11T05:34:49.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814851+0000", 2024-09-11T05:34:49.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034684690000000001 2024-09-11T05:34:49.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814858+0000", 2024-09-11T05:34:49.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6969999999999996e-06 2024-09-11T05:34:49.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826354+0000", 2024-09-11T05:34:49.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114962359999999 2024-09-11T05:34:49.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826364+0000", 2024-09-11T05:34:49.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0047999999999999e-05 2024-09-11T05:34:49.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845903+0000", 2024-09-11T05:34:49.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195393610000001 2024-09-11T05:34:49.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845912+0000", 2024-09-11T05:34:49.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2269999999999993e-06 2024-09-11T05:34:49.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.732 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.732 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116530 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.732 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:49.732 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874272970999996, 2024-09-11T05:34:49.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345557429999999, 2024-09-11T05:34:49.733 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116530 2024-09-11T05:34:49.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.733 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:49.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:49.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:49.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:34:49.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811390+0000", 2024-09-11T05:34:49.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:34:49.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811396+0000", 2024-09-11T05:34:49.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:34:49.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811402+0000", 2024-09-11T05:34:49.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:34:49.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814879+0000", 2024-09-11T05:34:49.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034769290000000001 2024-09-11T05:34:49.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814885+0000", 2024-09-11T05:34:49.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.156e-06 2024-09-11T05:34:49.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826389+0000", 2024-09-11T05:34:49.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115041140000001 2024-09-11T05:34:49.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826397+0000", 2024-09-11T05:34:49.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:34:49.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845935+0000", 2024-09-11T05:34:49.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195381370000001 2024-09-11T05:34:49.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845944+0000", 2024-09-11T05:34:49.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4540000000000007e-06 2024-09-11T05:34:49.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.739 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.739 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116531 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.739 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:49.739 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874252912000003, 2024-09-11T05:34:49.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345764630000001, 2024-09-11T05:34:49.740 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.740 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.740 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116531 2024-09-11T05:34:49.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.740 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:49.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:49.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:49.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:34:49.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811411+0000", 2024-09-11T05:34:49.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:49.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811417+0000", 2024-09-11T05:34:49.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:34:49.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811422+0000", 2024-09-11T05:34:49.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3229999999999997e-06 2024-09-11T05:34:49.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814906+0000", 2024-09-11T05:34:49.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034835389999999999 2024-09-11T05:34:49.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814913+0000", 2024-09-11T05:34:49.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309999999999996e-06 2024-09-11T05:34:49.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826423+0000", 2024-09-11T05:34:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115109019999999 2024-09-11T05:34:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826431+0000", 2024-09-11T05:34:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9410000000000007e-06 2024-09-11T05:34:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845975+0000", 2024-09-11T05:34:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019543767 2024-09-11T05:34:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845984+0000", 2024-09-11T05:34:49.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3530000000000001e-06 2024-09-11T05:34:49.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.745 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.745 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116532 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.745 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:49.745 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874232714000001, 2024-09-11T05:34:49.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034588131, 2024-09-11T05:34:49.745 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116532 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:49.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811429+0000", 2024-09-11T05:34:49.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:34:49.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811431+0000", 2024-09-11T05:34:49.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9910000000000001e-06 2024-09-11T05:34:49.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811437+0000", 2024-09-11T05:34:49.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.049e-06 2024-09-11T05:34:49.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811441+0000", 2024-09-11T05:34:49.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8289999999999998e-06 2024-09-11T05:34:49.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814934+0000", 2024-09-11T05:34:49.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034927220000000002 2024-09-11T05:34:49.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814941+0000", 2024-09-11T05:34:49.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.844e-06 2024-09-11T05:34:49.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826480+0000", 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115393260000001 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826496+0000", 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5406000000000001e-05 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846008+0000", 2024-09-11T05:34:49.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.01951214 2024-09-11T05:34:49.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846016+0000", 2024-09-11T05:34:49.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4440000000000008e-06 2024-09-11T05:34:49.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.751 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.751 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116533 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.751 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:49.751 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874213159999996, 2024-09-11T05:34:49.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345994049999998, 2024-09-11T05:34:49.752 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116533 2024-09-11T05:34:49.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.752 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:49.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:49.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:49.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:49.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811450+0000", 2024-09-11T05:34:49.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0940000000000002e-06 2024-09-11T05:34:49.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811457+0000", 2024-09-11T05:34:49.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2729999999999999e-06 2024-09-11T05:34:49.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811461+0000", 2024-09-11T05:34:49.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.673e-06 2024-09-11T05:34:49.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814962+0000", 2024-09-11T05:34:49.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035012530000000002 2024-09-11T05:34:49.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814970+0000", 2024-09-11T05:34:49.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0539999999999997e-06 2024-09-11T05:34:49.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826536+0000", 2024-09-11T05:34:49.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011566049 2024-09-11T05:34:49.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826542+0000", 2024-09-11T05:34:49.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1709999999999999e-06 2024-09-11T05:34:49.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846039+0000", 2024-09-11T05:34:49.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019497168 2024-09-11T05:34:49.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846047+0000", 2024-09-11T05:34:49.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-11T05:34:49.757 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.757 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.757 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.757 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116534 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.758 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:49.758 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874194252999999, 2024-09-11T05:34:49.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034610979, 2024-09-11T05:34:49.758 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.758 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.758 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.758 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116534 2024-09-11T05:34:49.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.758 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:34:49.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811469+0000", 2024-09-11T05:34:49.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.871e-06 2024-09-11T05:34:49.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811475+0000", 2024-09-11T05:34:49.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1689999999999997e-06 2024-09-11T05:34:49.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811480+0000", 2024-09-11T05:34:49.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5990000000000004e-06 2024-09-11T05:34:49.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814990+0000", 2024-09-11T05:34:49.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003510876 2024-09-11T05:34:49.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814997+0000", 2024-09-11T05:34:49.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T05:34:49.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826571+0000", 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115740230000001 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826576+0000", 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846070+0000", 2024-09-11T05:34:49.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194937660000001 2024-09-11T05:34:49.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846078+0000", 2024-09-11T05:34:49.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.038e-06 2024-09-11T05:34:49.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.763 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.763 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116535 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.763 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:49.764 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874175093999995, 2024-09-11T05:34:49.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346218060000001, 2024-09-11T05:34:49.764 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116535 2024-09-11T05:34:49.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.764 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:49.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:49.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:49.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:34:49.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811488+0000", 2024-09-11T05:34:49.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:34:49.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811495+0000", 2024-09-11T05:34:49.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3960000000000003e-06 2024-09-11T05:34:49.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811500+0000", 2024-09-11T05:34:49.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9910000000000002e-06 2024-09-11T05:34:49.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815019+0000", 2024-09-11T05:34:49.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035190479999999999 2024-09-11T05:34:49.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815025+0000", 2024-09-11T05:34:49.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2550000000000003e-06 2024-09-11T05:34:49.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826604+0000", 2024-09-11T05:34:49.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115789959999999 2024-09-11T05:34:49.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826611+0000", 2024-09-11T05:34:49.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:34:49.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846100+0000", 2024-09-11T05:34:49.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194890569999999 2024-09-11T05:34:49.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846108+0000", 2024-09-11T05:34:49.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4089999999999997e-06 2024-09-11T05:34:49.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.769 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.769 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116536 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.769 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:49.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874155572999996, 2024-09-11T05:34:49.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034634724, 2024-09-11T05:34:49.770 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116536 2024-09-11T05:34:49.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.770 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:49.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:49.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811506+0000", 2024-09-11T05:34:49.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:49.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811508+0000", 2024-09-11T05:34:49.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T05:34:49.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811514+0000", 2024-09-11T05:34:49.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0610000000000001e-06 2024-09-11T05:34:49.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811519+0000", 2024-09-11T05:34:49.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0340000000000004e-06 2024-09-11T05:34:49.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815049+0000", 2024-09-11T05:34:49.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035296440000000002 2024-09-11T05:34:49.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815055+0000", 2024-09-11T05:34:49.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:34:49.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826642+0000", 2024-09-11T05:34:49.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011586375 2024-09-11T05:34:49.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826649+0000", 2024-09-11T05:34:49.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-09-11T05:34:49.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846131+0000", 2024-09-11T05:34:49.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194814569999999 2024-09-11T05:34:49.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846140+0000", 2024-09-11T05:34:49.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2240000000000001e-06 2024-09-11T05:34:49.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.776 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.776 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116537 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.776 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:49.776 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874136003999993, 2024-09-11T05:34:49.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346492180000002, 2024-09-11T05:34:49.776 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.777 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.777 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116537 2024-09-11T05:34:49.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.777 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:49.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811532+0000", 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:34:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811538+0000", 2024-09-11T05:34:49.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7259999999999996e-06 2024-09-11T05:34:49.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811543+0000", 2024-09-11T05:34:49.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.164e-06 2024-09-11T05:34:49.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815078+0000", 2024-09-11T05:34:49.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003534428 2024-09-11T05:34:49.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815086+0000", 2024-09-11T05:34:49.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8210000000000002e-06 2024-09-11T05:34:49.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826736+0000", 2024-09-11T05:34:49.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116503429999999 2024-09-11T05:34:49.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826751+0000", 2024-09-11T05:34:49.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4895999999999999e-05 2024-09-11T05:34:49.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846165+0000", 2024-09-11T05:34:49.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019413854 2024-09-11T05:34:49.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846174+0000", 2024-09-11T05:34:49.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3149999999999998e-06 2024-09-11T05:34:49.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.782 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.782 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116538 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.782 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:49.782 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874111314999993, 2024-09-11T05:34:49.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346557729999999, 2024-09-11T05:34:49.782 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116538 2024-09-11T05:34:49.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.783 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:49.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:49.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:49.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:34:49.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811552+0000", 2024-09-11T05:34:49.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2869999999999999e-06 2024-09-11T05:34:49.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811559+0000", 2024-09-11T05:34:49.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3820000000000001e-06 2024-09-11T05:34:49.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811564+0000", 2024-09-11T05:34:49.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:34:49.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815109+0000", 2024-09-11T05:34:49.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035450989999999999 2024-09-11T05:34:49.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815115+0000", 2024-09-11T05:34:49.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:49.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826780+0000", 2024-09-11T05:34:49.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116645799999999 2024-09-11T05:34:49.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826787+0000", 2024-09-11T05:34:49.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3880000000000002e-06 2024-09-11T05:34:49.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846196+0000", 2024-09-11T05:34:49.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194094069999999 2024-09-11T05:34:49.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846205+0000", 2024-09-11T05:34:49.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.884e-06 2024-09-11T05:34:49.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.788 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.788 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116539 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.788 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:49.788 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874091269000004, 2024-09-11T05:34:49.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346668399999999, 2024-09-11T05:34:49.788 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.788 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.789 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116539 2024-09-11T05:34:49.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.789 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:49.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:49.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:49.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:34:49.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811572+0000", 2024-09-11T05:34:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:34:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811578+0000", 2024-09-11T05:34:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T05:34:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811583+0000", 2024-09-11T05:34:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:34:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815137+0000", 2024-09-11T05:34:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035540210000000001 2024-09-11T05:34:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815144+0000", 2024-09-11T05:34:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5969999999999997e-06 2024-09-11T05:34:49.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826851+0000", 2024-09-11T05:34:49.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117072149999999 2024-09-11T05:34:49.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826860+0000", 2024-09-11T05:34:49.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4200000000000007e-06 2024-09-11T05:34:49.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846228+0000", 2024-09-11T05:34:49.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019368287 2024-09-11T05:34:49.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846236+0000", 2024-09-11T05:34:49.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.541e-06 2024-09-11T05:34:49.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.794 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.794 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116540 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874071845000003, 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346767830000001, 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116540 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:49.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:49.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:49.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:49.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811591+0000", 2024-09-11T05:34:49.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:34:49.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811598+0000", 2024-09-11T05:34:49.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T05:34:49.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811603+0000", 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9470000000000002e-06 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815168+0000", 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035651810000000002 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815174+0000", 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826883+0000", 2024-09-11T05:34:49.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117088830000001 2024-09-11T05:34:49.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826891+0000", 2024-09-11T05:34:49.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7179999999999996e-06 2024-09-11T05:34:49.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846258+0000", 2024-09-11T05:34:49.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019367328 2024-09-11T05:34:49.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846266+0000", 2024-09-11T05:34:49.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4880000000000001e-06 2024-09-11T05:34:49.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.800 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116541 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.800 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:49.800 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874052551000005, 2024-09-11T05:34:49.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346837, 2024-09-11T05:34:49.801 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116541 2024-09-11T05:34:49.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.801 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:49.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811609+0000", 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811611+0000", 2024-09-11T05:34:49.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8679999999999999e-06 2024-09-11T05:34:49.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811617+0000", 2024-09-11T05:34:49.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:49.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811622+0000", 2024-09-11T05:34:49.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9370000000000003e-06 2024-09-11T05:34:49.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815201+0000", 2024-09-11T05:34:49.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035788679999999998 2024-09-11T05:34:49.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815207+0000", 2024-09-11T05:34:49.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7530000000000004e-06 2024-09-11T05:34:49.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826988+0000", 2024-09-11T05:34:49.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117802300000001 2024-09-11T05:34:49.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826996+0000", 2024-09-11T05:34:49.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.259e-06 2024-09-11T05:34:49.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846285+0000", 2024-09-11T05:34:49.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192892090000001 2024-09-11T05:34:49.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846292+0000", 2024-09-11T05:34:49.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9399999999999996e-06 2024-09-11T05:34:49.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.806 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.806 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116542 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.806 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:49.806 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874033640999997, 2024-09-11T05:34:49.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034697618, 2024-09-11T05:34:49.807 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116542 2024-09-11T05:34:49.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.807 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:49.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811628+0000", 2024-09-11T05:34:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:34:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811629+0000", 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8059999999999999e-06 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811636+0000", 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0990000000000004e-06 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811640+0000", 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6630000000000001e-06 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815230+0000", 2024-09-11T05:34:49.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035897009999999998 2024-09-11T05:34:49.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815237+0000", 2024-09-11T05:34:49.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6590000000000001e-06 2024-09-11T05:34:49.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827019+0000", 2024-09-11T05:34:49.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011782261 2024-09-11T05:34:49.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827026+0000", 2024-09-11T05:34:49.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.605e-06 2024-09-11T05:34:49.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846317+0000", 2024-09-11T05:34:49.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192904270000001 2024-09-11T05:34:49.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846325+0000", 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0530000000000007e-06 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116543 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.874014966999994, 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0347097559999998, 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:49.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116543 2024-09-11T05:34:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811648+0000", 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:49.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811654+0000", 2024-09-11T05:34:49.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T05:34:49.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:49.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811659+0000", 2024-09-11T05:34:49.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9409999999999998e-06 2024-09-11T05:34:49.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815259+0000", 2024-09-11T05:34:49.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035993980000000002 2024-09-11T05:34:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815265+0000", 2024-09-11T05:34:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-11T05:34:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827049+0000", 2024-09-11T05:34:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117836019999999 2024-09-11T05:34:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827056+0000", 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3919999999999997e-06 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846348+0000", 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192919039999999 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846356+0000", 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7449999999999995e-06 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.818 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.818 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:49.818 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:49.818 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:49.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:49.820 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:49.819+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:49.919 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:49.919+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:49.962 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:49.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:49.962 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:49.962 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:49.971 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:50.020 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:50.020+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:50.031 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:34:50.075 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:50.076 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:50.076 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:50.076 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:50.076 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:50.085 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:50.121 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:50.121+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:50.156 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:50.156 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:50.173 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:50.173 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:50.189 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:50.189 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:50.192 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:50.192 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:50.201 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:50.205 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:50.206 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:50.222 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:50.221+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:50.223 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:50.223 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:34:50.240 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:50.240 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:50.257 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:50.273 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:50.274 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:50.306 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:50.307 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:50.315 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:50.357 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:50.356+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:50.424 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:50.423+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:50.459 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:50.459 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:50.468 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:50.553 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:50.553+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:50.611 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:50.611 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:50.622 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:50.663 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:50.662+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:50.727 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:50.726+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:50.765 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:50.765 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:50.774 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:50.827 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:50.827+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:50.878 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:50.878 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:50.886 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:50.928 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:50.927+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:51.028 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:51.028+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:51.030 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:51.030 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:51.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:51.129 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:51.129+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:51.154 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:51.154 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:51.164 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:51.230 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:51.229+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:51.307 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:51.307 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:51.315 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:51.331 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:51.330+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:51.417 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:51.417 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:51.425 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:51.431 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:51.432+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:51.528 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:51.528 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:51.533 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:51.532+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:51.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:51.634 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:51.633+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:51.647 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:34:51.683 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:51.683 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:51.692 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:51.735 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:51.735+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:51.834 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:51.834+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:51.835 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:51.836 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:51.844 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:51.935 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:51.935+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:51.991 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:51.991 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:52.000 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:52.042 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:52.042+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:52.137 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:52.137+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:52.145 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:52.145 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:52.154 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:52.238 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:52.237+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:52.285 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:34:52.300 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:52.300 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:52.309 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:34:52.338 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:52.338+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:52.412 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:52.412 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:52.420 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:34:52.421 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:52.421 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:52.439 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:52.439+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:52.440 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:52.440 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:52.458 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:52.458 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:52.476 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:52.476 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:52.495 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:52.495 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:34:52.514 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:52.514 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:52.531 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:52.531 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:52.536 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:52.536 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:52.540 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:52.540+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:52.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:34:52.548 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:52.548 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:52.641 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:52.641+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:52.689 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:52.690 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:52.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:52.690 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:34:52.690 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:52.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:52.743 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:52.742+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:52.776 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T05:34:52.823 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:52.824 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:52.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:52.843 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:52.843+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:52.944 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:52.944+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:53.000 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:53.000 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:53.000 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:53.011 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:53.057 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:53.052+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:53.140 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:53.140 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:53.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:53.140 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:53.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.140 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116524 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.140 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:53.141 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323361409, 2024-09-11T05:34:53.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344630100000001, 2024-09-11T05:34:53.141 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.141 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.141 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116524 2024-09-11T05:34:53.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.141 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:53.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:34:53.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811270+0000", 2024-09-11T05:34:53.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811272+0000", 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811278+0000", 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1970000000000001e-06 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811283+0000", 2024-09-11T05:34:53.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-09-11T05:34:53.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813113+0000", 2024-09-11T05:34:53.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001830302 2024-09-11T05:34:53.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:53.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813117+0000", 2024-09-11T05:34:53.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0810000000000004e-06 2024-09-11T05:34:53.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814661+0000", 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015436969999999999 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814667+0000", 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6370000000000002e-06 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826115+0000", 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114479059999999 2024-09-11T05:34:53.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826123+0000", 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000004e-06 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845722+0000", 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195993000000001 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845732+0000", 2024-09-11T05:34:53.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T05:34:53.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.147 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.147 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116525 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.147 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:53.147 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323341526999997, 2024-09-11T05:34:53.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344747700000001, 2024-09-11T05:34:53.147 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116525 2024-09-11T05:34:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:34:53.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811290+0000", 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811295+0000", 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8969999999999999e-06 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811301+0000", 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4919999999999998e-06 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811306+0000", 2024-09-11T05:34:53.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999998e-06 2024-09-11T05:34:53.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813138+0000", 2024-09-11T05:34:53.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001832078 2024-09-11T05:34:53.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:34:53.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813142+0000", 2024-09-11T05:34:53.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0380000000000001e-06 2024-09-11T05:34:53.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814689+0000", 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546799 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814695+0000", 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8739999999999997e-06 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826148+0000", 2024-09-11T05:34:53.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114527259999999 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826166+0000", 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7484999999999999e-05 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845756+0000", 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019590609 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845764+0000", 2024-09-11T05:34:53.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7020000000000001e-06 2024-09-11T05:34:53.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.154 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.154 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116526 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.154 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:53.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323318728999993, 2024-09-11T05:34:53.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344863210000002, 2024-09-11T05:34:53.155 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116526 2024-09-11T05:34:53.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.155 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:53.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:53.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811315+0000", 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079999999999999e-06 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811320+0000", 2024-09-11T05:34:53.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8619999999999999e-06 2024-09-11T05:34:53.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811325+0000", 2024-09-11T05:34:53.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T05:34:53.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814736+0000", 2024-09-11T05:34:53.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034115780000000002 2024-09-11T05:34:53.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814744+0000", 2024-09-11T05:34:53.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5340000000000002e-06 2024-09-11T05:34:53.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826212+0000", 2024-09-11T05:34:53.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114682749999999 2024-09-11T05:34:53.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826225+0000", 2024-09-11T05:34:53.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:34:53.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845789+0000", 2024-09-11T05:34:53.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195649200000001 2024-09-11T05:34:53.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845798+0000", 2024-09-11T05:34:53.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9269999999999994e-06 2024-09-11T05:34:53.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.161 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.161 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116527 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.161 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:53.161 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323299797000004, 2024-09-11T05:34:53.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345095849999999, 2024-09-11T05:34:53.162 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116527 2024-09-11T05:34:53.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.162 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811334+0000", 2024-09-11T05:34:53.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:34:53.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811340+0000", 2024-09-11T05:34:53.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.691e-06 2024-09-11T05:34:53.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811345+0000", 2024-09-11T05:34:53.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5480000000000003e-06 2024-09-11T05:34:53.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814767+0000", 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034223190000000001 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814774+0000", 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826265+0000", 2024-09-11T05:34:53.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114912460000001 2024-09-11T05:34:53.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826274+0000", 2024-09-11T05:34:53.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3909999999999998e-06 2024-09-11T05:34:53.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845831+0000", 2024-09-11T05:34:53.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195574080000001 2024-09-11T05:34:53.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845841+0000", 2024-09-11T05:34:53.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3610000000000007e-06 2024-09-11T05:34:53.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.167 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.167 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116528 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.167 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:53.167 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323280358000005, 2024-09-11T05:34:53.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345287679999999, 2024-09-11T05:34:53.168 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116528 2024-09-11T05:34:53.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.168 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811351+0000", 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811353+0000", 2024-09-11T05:34:53.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:34:53.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811359+0000", 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811364+0000", 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000001e-06 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814795+0000", 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034316569999999998 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814826+0000", 2024-09-11T05:34:53.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0587999999999999e-05 2024-09-11T05:34:53.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826309+0000", 2024-09-11T05:34:53.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011483444 2024-09-11T05:34:53.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826319+0000", 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6849999999999996e-06 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845868+0000", 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195487110000001 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845879+0000", 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1428e-05 2024-09-11T05:34:53.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116529 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323261724000005, 2024-09-11T05:34:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034542531, 2024-09-11T05:34:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116529 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:34:53.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:34:53.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811371+0000", 2024-09-11T05:34:53.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T05:34:53.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811377+0000", 2024-09-11T05:34:53.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1580000000000002e-06 2024-09-11T05:34:53.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811383+0000", 2024-09-11T05:34:53.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.135e-06 2024-09-11T05:34:53.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814851+0000", 2024-09-11T05:34:53.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034684690000000001 2024-09-11T05:34:53.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814858+0000", 2024-09-11T05:34:53.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6969999999999996e-06 2024-09-11T05:34:53.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826354+0000", 2024-09-11T05:34:53.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114962359999999 2024-09-11T05:34:53.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826364+0000", 2024-09-11T05:34:53.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0047999999999999e-05 2024-09-11T05:34:53.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845903+0000", 2024-09-11T05:34:53.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195393610000001 2024-09-11T05:34:53.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845912+0000", 2024-09-11T05:34:53.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2269999999999993e-06 2024-09-11T05:34:53.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.180 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.180 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116530 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.181 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:53.181 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323242812000004, 2024-09-11T05:34:53.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345557429999999, 2024-09-11T05:34:53.181 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116530 2024-09-11T05:34:53.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.182 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:53.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:53.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:34:53.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:34:53.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811390+0000", 2024-09-11T05:34:53.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:34:53.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811396+0000", 2024-09-11T05:34:53.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:34:53.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811402+0000", 2024-09-11T05:34:53.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:34:53.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814879+0000", 2024-09-11T05:34:53.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034769290000000001 2024-09-11T05:34:53.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814885+0000", 2024-09-11T05:34:53.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.156e-06 2024-09-11T05:34:53.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826389+0000", 2024-09-11T05:34:53.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115041140000001 2024-09-11T05:34:53.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826397+0000", 2024-09-11T05:34:53.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:34:53.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845935+0000", 2024-09-11T05:34:53.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195381370000001 2024-09-11T05:34:53.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845944+0000", 2024-09-11T05:34:53.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4540000000000007e-06 2024-09-11T05:34:53.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.187 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.187 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116531 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.187 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:53.188 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323222752999996, 2024-09-11T05:34:53.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345764630000001, 2024-09-11T05:34:53.188 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.189 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116531 2024-09-11T05:34:53.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.189 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:53.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:53.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:34:53.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:34:53.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811411+0000", 2024-09-11T05:34:53.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:53.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811417+0000", 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811422+0000", 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3229999999999997e-06 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814906+0000", 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034835389999999999 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814913+0000", 2024-09-11T05:34:53.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309999999999996e-06 2024-09-11T05:34:53.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826423+0000", 2024-09-11T05:34:53.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115109019999999 2024-09-11T05:34:53.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826431+0000", 2024-09-11T05:34:53.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9410000000000007e-06 2024-09-11T05:34:53.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845975+0000", 2024-09-11T05:34:53.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019543767 2024-09-11T05:34:53.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845984+0000", 2024-09-11T05:34:53.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3530000000000001e-06 2024-09-11T05:34:53.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.194 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.195 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116532 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.195 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:53.195 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323202554999995, 2024-09-11T05:34:53.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034588131, 2024-09-11T05:34:53.196 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.196 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116532 2024-09-11T05:34:53.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.196 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:53.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:34:53.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811429+0000", 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811431+0000", 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9910000000000001e-06 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811437+0000", 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.049e-06 2024-09-11T05:34:53.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811441+0000", 2024-09-11T05:34:53.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8289999999999998e-06 2024-09-11T05:34:53.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814934+0000", 2024-09-11T05:34:53.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034927220000000002 2024-09-11T05:34:53.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814941+0000", 2024-09-11T05:34:53.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.844e-06 2024-09-11T05:34:53.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826480+0000", 2024-09-11T05:34:53.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115393260000001 2024-09-11T05:34:53.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826496+0000", 2024-09-11T05:34:53.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5406000000000001e-05 2024-09-11T05:34:53.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846008+0000", 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.01951214 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846016+0000", 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4440000000000008e-06 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.201 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116533 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323183001000004, 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345994049999998, 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116533 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811450+0000", 2024-09-11T05:34:53.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0940000000000002e-06 2024-09-11T05:34:53.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811457+0000", 2024-09-11T05:34:53.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2729999999999999e-06 2024-09-11T05:34:53.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811461+0000", 2024-09-11T05:34:53.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.673e-06 2024-09-11T05:34:53.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814962+0000", 2024-09-11T05:34:53.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035012530000000002 2024-09-11T05:34:53.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814970+0000", 2024-09-11T05:34:53.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0539999999999997e-06 2024-09-11T05:34:53.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826536+0000", 2024-09-11T05:34:53.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011566049 2024-09-11T05:34:53.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826542+0000", 2024-09-11T05:34:53.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1709999999999999e-06 2024-09-11T05:34:53.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846039+0000", 2024-09-11T05:34:53.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019497168 2024-09-11T05:34:53.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846047+0000", 2024-09-11T05:34:53.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-11T05:34:53.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.209 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.209 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116534 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.209 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:53.209 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323164094000006, 2024-09-11T05:34:53.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034610979, 2024-09-11T05:34:53.209 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116534 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:53.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:34:53.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:34:53.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811469+0000", 2024-09-11T05:34:53.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.871e-06 2024-09-11T05:34:53.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811475+0000", 2024-09-11T05:34:53.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1689999999999997e-06 2024-09-11T05:34:53.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811480+0000", 2024-09-11T05:34:53.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5990000000000004e-06 2024-09-11T05:34:53.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814990+0000", 2024-09-11T05:34:53.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003510876 2024-09-11T05:34:53.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814997+0000", 2024-09-11T05:34:53.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T05:34:53.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826571+0000", 2024-09-11T05:34:53.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115740230000001 2024-09-11T05:34:53.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826576+0000", 2024-09-11T05:34:53.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-11T05:34:53.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846070+0000", 2024-09-11T05:34:53.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194937660000001 2024-09-11T05:34:53.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846078+0000", 2024-09-11T05:34:53.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.038e-06 2024-09-11T05:34:53.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.215 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.215 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116535 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.215 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:53.215 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323144935000002, 2024-09-11T05:34:53.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346218060000001, 2024-09-11T05:34:53.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.216 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116535 2024-09-11T05:34:53.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.216 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:53.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:53.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:34:53.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:34:53.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811488+0000", 2024-09-11T05:34:53.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:34:53.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811495+0000", 2024-09-11T05:34:53.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3960000000000003e-06 2024-09-11T05:34:53.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811500+0000", 2024-09-11T05:34:53.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9910000000000002e-06 2024-09-11T05:34:53.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815019+0000", 2024-09-11T05:34:53.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035190479999999999 2024-09-11T05:34:53.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815025+0000", 2024-09-11T05:34:53.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2550000000000003e-06 2024-09-11T05:34:53.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826604+0000", 2024-09-11T05:34:53.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115789959999999 2024-09-11T05:34:53.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826611+0000", 2024-09-11T05:34:53.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:34:53.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846100+0000", 2024-09-11T05:34:53.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194890569999999 2024-09-11T05:34:53.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846108+0000", 2024-09-11T05:34:53.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4089999999999997e-06 2024-09-11T05:34:53.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.221 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.221 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116536 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323125414000003, 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034634724, 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116536 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811506+0000", 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811508+0000", 2024-09-11T05:34:53.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T05:34:53.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811514+0000", 2024-09-11T05:34:53.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0610000000000001e-06 2024-09-11T05:34:53.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811519+0000", 2024-09-11T05:34:53.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0340000000000004e-06 2024-09-11T05:34:53.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815049+0000", 2024-09-11T05:34:53.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035296440000000002 2024-09-11T05:34:53.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815055+0000", 2024-09-11T05:34:53.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:34:53.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826642+0000", 2024-09-11T05:34:53.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011586375 2024-09-11T05:34:53.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826649+0000", 2024-09-11T05:34:53.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-09-11T05:34:53.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846131+0000", 2024-09-11T05:34:53.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194814569999999 2024-09-11T05:34:53.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846140+0000", 2024-09-11T05:34:53.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2240000000000001e-06 2024-09-11T05:34:53.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.227 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.227 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116537 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.227 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:53.228 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323105845000001, 2024-09-11T05:34:53.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346492180000002, 2024-09-11T05:34:53.228 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.228 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.228 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.228 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.228 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.228 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116537 2024-09-11T05:34:53.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.228 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:53.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:53.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:34:53.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:53.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811532+0000", 2024-09-11T05:34:53.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:34:53.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811538+0000", 2024-09-11T05:34:53.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7259999999999996e-06 2024-09-11T05:34:53.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811543+0000", 2024-09-11T05:34:53.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.164e-06 2024-09-11T05:34:53.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815078+0000", 2024-09-11T05:34:53.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003534428 2024-09-11T05:34:53.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815086+0000", 2024-09-11T05:34:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8210000000000002e-06 2024-09-11T05:34:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826736+0000", 2024-09-11T05:34:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116503429999999 2024-09-11T05:34:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826751+0000", 2024-09-11T05:34:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4895999999999999e-05 2024-09-11T05:34:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846165+0000", 2024-09-11T05:34:53.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019413854 2024-09-11T05:34:53.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846174+0000", 2024-09-11T05:34:53.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3149999999999998e-06 2024-09-11T05:34:53.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.233 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.234 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116538 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.234 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:53.234 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323081156000001, 2024-09-11T05:34:53.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346557729999999, 2024-09-11T05:34:53.234 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116538 2024-09-11T05:34:53.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.235 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:53.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:53.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:34:53.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:34:53.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811552+0000", 2024-09-11T05:34:53.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2869999999999999e-06 2024-09-11T05:34:53.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811559+0000", 2024-09-11T05:34:53.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3820000000000001e-06 2024-09-11T05:34:53.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811564+0000", 2024-09-11T05:34:53.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:34:53.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815109+0000", 2024-09-11T05:34:53.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035450989999999999 2024-09-11T05:34:53.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815115+0000", 2024-09-11T05:34:53.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:53.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826780+0000", 2024-09-11T05:34:53.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116645799999999 2024-09-11T05:34:53.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826787+0000", 2024-09-11T05:34:53.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3880000000000002e-06 2024-09-11T05:34:53.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846196+0000", 2024-09-11T05:34:53.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194094069999999 2024-09-11T05:34:53.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846205+0000", 2024-09-11T05:34:53.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.884e-06 2024-09-11T05:34:53.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.240 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.240 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116539 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.240 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:53.240 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323061109999998, 2024-09-11T05:34:53.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346668399999999, 2024-09-11T05:34:53.240 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116539 2024-09-11T05:34:53.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.241 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:53.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:34:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:34:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811572+0000", 2024-09-11T05:34:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811578+0000", 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811583+0000", 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815137+0000", 2024-09-11T05:34:53.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035540210000000001 2024-09-11T05:34:53.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815144+0000", 2024-09-11T05:34:53.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5969999999999997e-06 2024-09-11T05:34:53.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826851+0000", 2024-09-11T05:34:53.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117072149999999 2024-09-11T05:34:53.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826860+0000", 2024-09-11T05:34:53.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4200000000000007e-06 2024-09-11T05:34:53.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846228+0000", 2024-09-11T05:34:53.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019368287 2024-09-11T05:34:53.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846236+0000", 2024-09-11T05:34:53.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.541e-06 2024-09-11T05:34:53.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.246 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.246 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116540 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.246 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:53.246 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323041685999996, 2024-09-11T05:34:53.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346767830000001, 2024-09-11T05:34:53.246 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116540 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:53.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:34:53.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:34:53.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811591+0000", 2024-09-11T05:34:53.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811598+0000", 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811603+0000", 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9470000000000002e-06 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815168+0000", 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035651810000000002 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815174+0000", 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826883+0000", 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117088830000001 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826891+0000", 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7179999999999996e-06 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846258+0000", 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019367328 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846266+0000", 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4880000000000001e-06 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.251 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.252 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.252 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116541 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.252 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:53.252 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323022391999999, 2024-09-11T05:34:53.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346837, 2024-09-11T05:34:53.252 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116541 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811609+0000", 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811611+0000", 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8679999999999999e-06 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811617+0000", 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:34:53.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811622+0000", 2024-09-11T05:34:53.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9370000000000003e-06 2024-09-11T05:34:53.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815201+0000", 2024-09-11T05:34:53.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035788679999999998 2024-09-11T05:34:53.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815207+0000", 2024-09-11T05:34:53.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7530000000000004e-06 2024-09-11T05:34:53.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826988+0000", 2024-09-11T05:34:53.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117802300000001 2024-09-11T05:34:53.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826996+0000", 2024-09-11T05:34:53.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.259e-06 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846285+0000", 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192892090000001 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846292+0000", 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9399999999999996e-06 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.258 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116542 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.258 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:53.258 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.323003482000004, 2024-09-11T05:34:53.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034697618, 2024-09-11T05:34:53.258 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116542 2024-09-11T05:34:53.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.259 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:53.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:34:53.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811628+0000", 2024-09-11T05:34:53.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:34:53.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811629+0000", 2024-09-11T05:34:53.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8059999999999999e-06 2024-09-11T05:34:53.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811636+0000", 2024-09-11T05:34:53.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0990000000000004e-06 2024-09-11T05:34:53.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811640+0000", 2024-09-11T05:34:53.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6630000000000001e-06 2024-09-11T05:34:53.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815230+0000", 2024-09-11T05:34:53.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035897009999999998 2024-09-11T05:34:53.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815237+0000", 2024-09-11T05:34:53.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6590000000000001e-06 2024-09-11T05:34:53.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827019+0000", 2024-09-11T05:34:53.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011782261 2024-09-11T05:34:53.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827026+0000", 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.605e-06 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846317+0000", 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192904270000001 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846325+0000", 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0530000000000007e-06 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.263 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.264 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116543 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:53.264 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:53.264 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.322984808000001, 2024-09-11T05:34:53.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0347097559999998, 2024-09-11T05:34:53.264 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.264 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:53.264 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.264 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.264 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116543 2024-09-11T05:34:53.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.265 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:53.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:34:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:34:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811648+0000", 2024-09-11T05:34:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:34:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811654+0000", 2024-09-11T05:34:53.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T05:34:53.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811659+0000", 2024-09-11T05:34:53.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9409999999999998e-06 2024-09-11T05:34:53.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815259+0000", 2024-09-11T05:34:53.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035993980000000002 2024-09-11T05:34:53.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815265+0000", 2024-09-11T05:34:53.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-11T05:34:53.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827049+0000", 2024-09-11T05:34:53.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117836019999999 2024-09-11T05:34:53.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:53.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827056+0000", 2024-09-11T05:34:53.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3919999999999997e-06 2024-09-11T05:34:53.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846348+0000", 2024-09-11T05:34:53.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192919039999999 2024-09-11T05:34:53.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846356+0000", 2024-09-11T05:34:53.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7449999999999995e-06 2024-09-11T05:34:53.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.270 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.270 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.270 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:53.270 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:53.271 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:53.213+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:53.311 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:53.310+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:53.387 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:53.388 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:53.388 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:53.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:53.410 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:53.410+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:53.508 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:53.509 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:53.509 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:53.509 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:53.509 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:53.511 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:53.511+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:53.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:53.612 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:53.612+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:53.623 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:53.623 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:53.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:53.623 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:53.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.623 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:184170 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.623 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:53.623 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.701933967999999, 2024-09-11T05:34:53.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047293133000000001, 2024-09-11T05:34:53.624 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.624 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.624 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.624 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.624 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 184170 2024-09-11T05:34:53.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.624 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:53.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:53.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921808+0000", 2024-09-11T05:34:53.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001805868 2024-09-11T05:34:53.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921819+0000", 2024-09-11T05:34:53.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0458e-05 2024-09-11T05:34:53.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921830+0000", 2024-09-11T05:34:53.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1482e-05 2024-09-11T05:34:53.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921837+0000", 2024-09-11T05:34:53.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3709999999999996e-06 2024-09-11T05:34:53.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967150+0000", 2024-09-11T05:34:53.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045313402000000003 2024-09-11T05:34:53.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967216+0000", 2024-09-11T05:34:53.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6322999999999995e-05 2024-09-11T05:34:53.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967296+0000", 2024-09-11T05:34:53.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9228999999999996e-05 2024-09-11T05:34:53.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.628 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.628 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185733 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3309568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.628 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:53.628 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.347900955999997, 2024-09-11T05:34:53.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047365106999999997, 2024-09-11T05:34:53.628 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.629 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.629 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.629 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.629 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.629 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185733 2024-09-11T05:34:53.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.629 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:53.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:53.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275806+0000", 2024-09-11T05:34:53.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001769966 2024-09-11T05:34:53.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275810+0000", 2024-09-11T05:34:53.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5539999999999999e-06 2024-09-11T05:34:53.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275821+0000", 2024-09-11T05:34:53.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1253999999999999e-05 2024-09-11T05:34:53.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275828+0000", 2024-09-11T05:34:53.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:53.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321211+0000", 2024-09-11T05:34:53.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045383053999999999 2024-09-11T05:34:53.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321306+0000", 2024-09-11T05:34:53.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4712999999999999e-05 2024-09-11T05:34:53.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321401+0000", 2024-09-11T05:34:53.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4825000000000001e-05 2024-09-11T05:34:53.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.633 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.633 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185743 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3719168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.633 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:53.634 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.345889120000002, 2024-09-11T05:34:53.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047361001999999999, 2024-09-11T05:34:53.634 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.634 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185743 2024-09-11T05:34:53.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.634 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276048+0000", 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276050+0000", 2024-09-11T05:34:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:34:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276056+0000", 2024-09-11T05:34:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:34:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276061+0000", 2024-09-11T05:34:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323215+0000", 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047153977999999999 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323278+0000", 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3053999999999996e-05 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323408+0000", 2024-09-11T05:34:53.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013012899999999999 2024-09-11T05:34:53.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.638 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.638 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185744 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3760128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.638 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:53.638 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.345868439999997, 2024-09-11T05:34:53.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047563095, 2024-09-11T05:34:53.638 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.638 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.638 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.639 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185744 2024-09-11T05:34:53.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.639 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:53.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277808+0000", 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001739652 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277816+0000", 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.208e-06 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277829+0000", 2024-09-11T05:34:53.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2848e-05 2024-09-11T05:34:53.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277837+0000", 2024-09-11T05:34:53.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6379999999999993e-06 2024-09-11T05:34:53.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323448+0000", 2024-09-11T05:34:53.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045610604999999999 2024-09-11T05:34:53.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323562+0000", 2024-09-11T05:34:53.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113706 2024-09-11T05:34:53.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323631+0000", 2024-09-11T05:34:53.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9437999999999995e-05 2024-09-11T05:34:53.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.642 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185753 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.343905393999997, 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047283944000000001, 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185753 2024-09-11T05:34:53.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.644 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:53.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:53.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278033+0000", 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.237e-06 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278036+0000", 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278038+0000", 2024-09-11T05:34:53.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5490000000000001e-06 2024-09-11T05:34:53.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325140+0000", 2024-09-11T05:34:53.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047101845000000003 2024-09-11T05:34:53.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325219+0000", 2024-09-11T05:34:53.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9444999999999996e-05 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325315+0000", 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.569e-05 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185754 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4169728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.343895496000002, 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047450697, 2024-09-11T05:34:53.647 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185754 2024-09-11T05:34:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278043+0000", 2024-09-11T05:34:53.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:34:53.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278045+0000", 2024-09-11T05:34:53.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:53.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278048+0000", 2024-09-11T05:34:53.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5679999999999998e-06 2024-09-11T05:34:53.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325359+0000", 2024-09-11T05:34:53.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047311262 2024-09-11T05:34:53.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325421+0000", 2024-09-11T05:34:53.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1717999999999994e-05 2024-09-11T05:34:53.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325492+0000", 2024-09-11T05:34:53.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0716000000000005e-05 2024-09-11T05:34:53.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185755 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2125824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.343885428999997, 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047669481999999999, 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185755 2024-09-11T05:34:53.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.653 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:53.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:53.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:53.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:34:53.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278052+0000", 2024-09-11T05:34:53.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-11T05:34:53.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278055+0000", 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8059999999999999e-06 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278058+0000", 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.503e-06 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325563+0000", 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047505316999999998 2024-09-11T05:34:53.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325645+0000", 2024-09-11T05:34:53.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2439000000000001e-05 2024-09-11T05:34:53.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325721+0000", 2024-09-11T05:34:53.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5092999999999994e-05 2024-09-11T05:34:53.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.656 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.657 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185756 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2166784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.657 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:53.657 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.343873099, 2024-09-11T05:34:53.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047861556, 2024-09-11T05:34:53.657 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.657 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185756 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279805+0000", 2024-09-11T05:34:53.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001741586 2024-09-11T05:34:53.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279809+0000", 2024-09-11T05:34:53.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0890000000000002e-06 2024-09-11T05:34:53.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279816+0000", 2024-09-11T05:34:53.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2060000000000001e-06 2024-09-11T05:34:53.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279821+0000", 2024-09-11T05:34:53.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6709999999999998e-06 2024-09-11T05:34:53.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325764+0000", 2024-09-11T05:34:53.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045942749999999997 2024-09-11T05:34:53.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325846+0000", 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2470000000000002e-05 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325925+0000", 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8783999999999997e-05 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185764 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2494464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:53.661 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.341909043000001, 2024-09-11T05:34:53.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308594000000002, 2024-09-11T05:34:53.662 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.662 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185764 2024-09-11T05:34:53.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.662 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280028+0000", 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.27e-07 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280030+0000", 2024-09-11T05:34:53.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3319999999999999e-06 2024-09-11T05:34:53.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280036+0000", 2024-09-11T05:34:53.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:34:53.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280041+0000", 2024-09-11T05:34:53.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7530000000000001e-06 2024-09-11T05:34:53.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327196+0000", 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047154967999999998 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327266+0000", 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0427999999999997e-05 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327336+0000", 2024-09-11T05:34:53.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9659000000000005e-05 2024-09-11T05:34:53.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.666 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.666 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185765 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2535424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.666 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:53.666 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.341889123999998, 2024-09-11T05:34:53.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047410790000000001, 2024-09-11T05:34:53.666 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.666 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185765 2024-09-11T05:34:53.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.667 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:53.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:53.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280048+0000", 2024-09-11T05:34:53.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T05:34:53.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280050+0000", 2024-09-11T05:34:53.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-11T05:34:53.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280056+0000", 2024-09-11T05:34:53.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:34:53.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280061+0000", 2024-09-11T05:34:53.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T05:34:53.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327369+0000", 2024-09-11T05:34:53.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308416999999998 2024-09-11T05:34:53.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327413+0000", 2024-09-11T05:34:53.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070999999999999e-05 2024-09-11T05:34:53.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327458+0000", 2024-09-11T05:34:53.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4836000000000002e-05 2024-09-11T05:34:53.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.671 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.671 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185766 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2576384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.671 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:53.671 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.341869134, 2024-09-11T05:34:53.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047571239000000001, 2024-09-11T05:34:53.671 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185766 2024-09-11T05:34:53.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.672 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:53.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280068+0000", 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280070+0000", 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280081+0000", 2024-09-11T05:34:53.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0951999999999999e-05 2024-09-11T05:34:53.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280086+0000", 2024-09-11T05:34:53.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5029999999999997e-06 2024-09-11T05:34:53.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327495+0000", 2024-09-11T05:34:53.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047408497000000001 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327568+0000", 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3450999999999999e-05 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327639+0000", 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0309999999999996e-05 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.676 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185767 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2617344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.676 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:53.676 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.341821996999997, 2024-09-11T05:34:53.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047672355, 2024-09-11T05:34:53.676 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185767 2024-09-11T05:34:53.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.677 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:53.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:53.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:53.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8999999999999996e-07 2024-09-11T05:34:53.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280121+0000", 2024-09-11T05:34:53.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0599999999999996e-06 2024-09-11T05:34:53.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280128+0000", 2024-09-11T05:34:53.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1029999999999996e-06 2024-09-11T05:34:53.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280133+0000", 2024-09-11T05:34:53.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T05:34:53.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327702+0000", 2024-09-11T05:34:53.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047568307999999997 2024-09-11T05:34:53.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327745+0000", 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3407e-05 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327787+0000", 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1749000000000003e-05 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185768 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2658304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.680 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:53.681 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.341794645999997, 2024-09-11T05:34:53.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047830091999999998, 2024-09-11T05:34:53.681 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.681 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.681 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185768 2024-09-11T05:34:53.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.681 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281805+0000", 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016635809999999999 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281810+0000", 2024-09-11T05:34:53.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3540000000000002e-06 2024-09-11T05:34:53.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281820+0000", 2024-09-11T05:34:53.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T05:34:53.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281828+0000", 2024-09-11T05:34:53.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:53.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327826+0000", 2024-09-11T05:34:53.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045998206999999999 2024-09-11T05:34:53.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327902+0000", 2024-09-11T05:34:53.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5761999999999997e-05 2024-09-11T05:34:53.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327972+0000", 2024-09-11T05:34:53.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0414999999999996e-05 2024-09-11T05:34:53.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.685 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.685 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185775 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2945024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.685 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:53.685 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.340000586999999, 2024-09-11T05:34:53.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047301277000000003, 2024-09-11T05:34:53.685 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185775 2024-09-11T05:34:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:53.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:53.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:34:53.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281938+0000", 2024-09-11T05:34:53.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5099999999999999e-06 2024-09-11T05:34:53.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281941+0000", 2024-09-11T05:34:53.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-06 2024-09-11T05:34:53.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281943+0000", 2024-09-11T05:34:53.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.751e-06 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329092+0000", 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047148177999999999 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329166+0000", 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4795000000000005e-05 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329237+0000", 2024-09-11T05:34:53.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0864000000000005e-05 2024-09-11T05:34:53.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.690 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.690 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185777 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2985984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.690 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:53.690 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.339990157999999, 2024-09-11T05:34:53.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047500597999999998, 2024-09-11T05:34:53.690 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185777 2024-09-11T05:34:53.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.691 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:53.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:53.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281947+0000", 2024-09-11T05:34:53.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:53.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281948+0000", 2024-09-11T05:34:53.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1429999999999999e-06 2024-09-11T05:34:53.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281951+0000", 2024-09-11T05:34:53.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-11T05:34:53.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281953+0000", 2024-09-11T05:34:53.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6709999999999999e-06 2024-09-11T05:34:53.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329280+0000", 2024-09-11T05:34:53.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047326857999999999 2024-09-11T05:34:53.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329364+0000", 2024-09-11T05:34:53.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3586999999999998e-05 2024-09-11T05:34:53.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329447+0000", 2024-09-11T05:34:53.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3314999999999998e-05 2024-09-11T05:34:53.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.695 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.695 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185778 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3026944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.695 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:53.696 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.339980345000001, 2024-09-11T05:34:53.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047668384000000001, 2024-09-11T05:34:53.696 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185778 2024-09-11T05:34:53.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.696 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:53.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:53.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283808+0000", 2024-09-11T05:34:53.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018518919999999999 2024-09-11T05:34:53.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283812+0000", 2024-09-11T05:34:53.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:53.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283820+0000", 2024-09-11T05:34:53.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3319999999999992e-06 2024-09-11T05:34:53.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283825+0000", 2024-09-11T05:34:53.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8729999999999998e-06 2024-09-11T05:34:53.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329484+0000", 2024-09-11T05:34:53.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045658404999999999 2024-09-11T05:34:53.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329554+0000", 2024-09-11T05:34:53.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0099999999999996e-05 2024-09-11T05:34:53.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329625+0000", 2024-09-11T05:34:53.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0732e-05 2024-09-11T05:34:53.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.700 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.701 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185790 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2170880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.701 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:53.701 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.337995392000003, 2024-09-11T05:34:53.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047276674999999997, 2024-09-11T05:34:53.701 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.702 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185790 2024-09-11T05:34:53.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.702 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:53.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:53.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283942+0000", 2024-09-11T05:34:53.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:53.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283944+0000", 2024-09-11T05:34:53.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9800000000000001e-06 2024-09-11T05:34:53.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283948+0000", 2024-09-11T05:34:53.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9729999999999999e-06 2024-09-11T05:34:53.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283950+0000", 2024-09-11T05:34:53.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7020000000000001e-06 2024-09-11T05:34:53.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331076+0000", 2024-09-11T05:34:53.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047126016 2024-09-11T05:34:53.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331147+0000", 2024-09-11T05:34:53.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0848999999999999e-05 2024-09-11T05:34:53.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331218+0000", 2024-09-11T05:34:53.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0621e-05 2024-09-11T05:34:53.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.706 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185791 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3395584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.706 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:53.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.337969342000001, 2024-09-11T05:34:53.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047372307000000002, 2024-09-11T05:34:53.706 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185791 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:53.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283968+0000", 2024-09-11T05:34:53.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:53.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283970+0000", 2024-09-11T05:34:53.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.199e-06 2024-09-11T05:34:53.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283976+0000", 2024-09-11T05:34:53.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T05:34:53.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283981+0000", 2024-09-11T05:34:53.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:34:53.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331252+0000", 2024-09-11T05:34:53.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047270999000000001 2024-09-11T05:34:53.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331299+0000", 2024-09-11T05:34:53.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7376999999999997e-05 2024-09-11T05:34:53.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331339+0000", 2024-09-11T05:34:53.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0428e-05 2024-09-11T05:34:53.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.711 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185792 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2211840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.711 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:53.711 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.337949445, 2024-09-11T05:34:53.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047522035999999997, 2024-09-11T05:34:53.711 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185792 2024-09-11T05:34:53.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.712 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:53.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:53.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283990+0000", 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283995+0000", 2024-09-11T05:34:53.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3329999999999996e-06 2024-09-11T05:34:53.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284002+0000", 2024-09-11T05:34:53.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6120000000000001e-06 2024-09-11T05:34:53.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331373+0000", 2024-09-11T05:34:53.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047370269999999999 2024-09-11T05:34:53.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331442+0000", 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8794999999999994e-05 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331509+0000", 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7570000000000005e-05 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.715 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185793 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3436544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:53.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:53.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.337927346000001, 2024-09-11T05:34:53.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047706692000000002, 2024-09-11T05:34:53.716 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:53.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:53.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:53.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:53.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:53.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:53.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185793 2024-09-11T05:34:53.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.716 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:53.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:53.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:53.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:53.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:53.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:53.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285808+0000", 2024-09-11T05:34:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001798352 2024-09-11T05:34:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285812+0000", 2024-09-11T05:34:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6399999999999996e-06 2024-09-11T05:34:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285823+0000", 2024-09-11T05:34:53.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0783e-05 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285831+0000", 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331550+0000", 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045719518000000001 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:53.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331633+0000", 2024-09-11T05:34:53.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2992999999999996e-05 2024-09-11T05:34:53.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:53.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:53.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:53.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331716+0000", 2024-09-11T05:34:53.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2455999999999998e-05 2024-09-11T05:34:53.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:53.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:53.720 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:53.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:53.723 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:53.721+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:53.822 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:53.822+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:53.881 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:53.881 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:53.881 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:53.890 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:53.923 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:53.923+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:53.992 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:53.992 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:53.993 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:53.993 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:54.001 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:54.024 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:54.024+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:54.105 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:54.106 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:54.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:54.106 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:54.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.106 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116623 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13477888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.106 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:54.106 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214474488999997, 2024-09-11T05:34:54.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9661491070000001, 2024-09-11T05:34:54.106 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.107 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116623 2024-09-11T05:34:54.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.107 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:54.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:54.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889573+0000", 2024-09-11T05:34:54.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:54.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889574+0000", 2024-09-11T05:34:54.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4810000000000001e-06 2024-09-11T05:34:54.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889578+0000", 2024-09-11T05:34:54.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T05:34:54.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889581+0000", 2024-09-11T05:34:54.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2380000000000002e-06 2024-09-11T05:34:54.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890367+0000", 2024-09-11T05:34:54.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078646599999999999 2024-09-11T05:34:54.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890377+0000", 2024-09-11T05:34:54.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5789999999999993e-06 2024-09-11T05:34:54.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829092+0000", 2024-09-11T05:34:54.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871527899999996 2024-09-11T05:34:54.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829101+0000", 2024-09-11T05:34:54.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:34:54.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854695+0000", 2024-09-11T05:34:54.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0255937369999999 2024-09-11T05:34:54.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854786+0000", 2024-09-11T05:34:54.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1831999999999998e-05 2024-09-11T05:34:54.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855721+0000", 2024-09-11T05:34:54.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093499800000000004 2024-09-11T05:34:54.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.112 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.113 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116624 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13502464~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.113 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:54.113 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214460642000006, 2024-09-11T05:34:54.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9664307189999999, 2024-09-11T05:34:54.113 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.113 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116624 2024-09-11T05:34:54.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889587+0000", 2024-09-11T05:34:54.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:34:54.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889588+0000", 2024-09-11T05:34:54.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T05:34:54.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889592+0000", 2024-09-11T05:34:54.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.472e-06 2024-09-11T05:34:54.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889594+0000", 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890405+0000", 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00081088199999999997 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890410+0000", 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999996e-06 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829131+0000", 2024-09-11T05:34:54.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93872118999999998 2024-09-11T05:34:54.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829138+0000", 2024-09-11T05:34:54.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1760000000000004e-06 2024-09-11T05:34:54.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855755+0000", 2024-09-11T05:34:54.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026616722 2024-09-11T05:34:54.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855872+0000", 2024-09-11T05:34:54.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116927 2024-09-11T05:34:54.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856017+0000", 2024-09-11T05:34:54.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145313 2024-09-11T05:34:54.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.118 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.119 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116625 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13527040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.119 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:54.119 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214449423000005, 2024-09-11T05:34:54.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9666986180000001, 2024-09-11T05:34:54.119 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116625 2024-09-11T05:34:54.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.120 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:54.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:54.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889598+0000", 2024-09-11T05:34:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:34:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889599+0000", 2024-09-11T05:34:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.144e-06 2024-09-11T05:34:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889602+0000", 2024-09-11T05:34:54.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:54.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889604+0000", 2024-09-11T05:34:54.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7640000000000001e-06 2024-09-11T05:34:54.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890442+0000", 2024-09-11T05:34:54.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083777099999999996 2024-09-11T05:34:54.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890452+0000", 2024-09-11T05:34:54.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5559999999999996e-06 2024-09-11T05:34:54.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829170+0000", 2024-09-11T05:34:54.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871818900000004 2024-09-11T05:34:54.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829177+0000", 2024-09-11T05:34:54.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7220000000000002e-06 2024-09-11T05:34:54.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856046+0000", 2024-09-11T05:34:54.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026868943 2024-09-11T05:34:54.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856144+0000", 2024-09-11T05:34:54.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8684999999999995e-05 2024-09-11T05:34:54.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856296+0000", 2024-09-11T05:34:54.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151667 2024-09-11T05:34:54.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.125 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.125 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116626 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13551616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.125 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:54.125 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214438653000002, 2024-09-11T05:34:54.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.96707056, 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116626 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:54.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:54.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:54.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889610+0000", 2024-09-11T05:34:54.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.186e-06 2024-09-11T05:34:54.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889613+0000", 2024-09-11T05:34:54.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T05:34:54.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889615+0000", 2024-09-11T05:34:54.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:34:54.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890487+0000", 2024-09-11T05:34:54.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087202600000000003 2024-09-11T05:34:54.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890492+0000", 2024-09-11T05:34:54.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:34:54.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829202+0000", 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871036299999999 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829209+0000", 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7669999999999998e-06 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856327+0000", 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027118465 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856525+0000", 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019825499999999999 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856679+0000", 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015328 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.131 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116627 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13576192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.132 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:54.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214428768000005, 2024-09-11T05:34:54.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9673406419999999, 2024-09-11T05:34:54.132 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116627 2024-09-11T05:34:54.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889619+0000", 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.093e-06 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889622+0000", 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889625+0000", 2024-09-11T05:34:54.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:34:54.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890528+0000", 2024-09-11T05:34:54.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000902804 2024-09-11T05:34:54.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890537+0000", 2024-09-11T05:34:54.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2029999999999998e-06 2024-09-11T05:34:54.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829232+0000", 2024-09-11T05:34:54.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93869459799999999 2024-09-11T05:34:54.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829238+0000", 2024-09-11T05:34:54.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6699999999999997e-06 2024-09-11T05:34:54.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856709+0000", 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027470925 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856815+0000", 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010566899999999999 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856959+0000", 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000143752 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.138 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116628 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13600768~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.138 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:54.138 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214404772999998, 2024-09-11T05:34:54.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9676105420000001, 2024-09-11T05:34:54.138 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116628 2024-09-11T05:34:54.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.139 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:54.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:54.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:54.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:34:54.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889644+0000", 2024-09-11T05:34:54.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:34:54.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889647+0000", 2024-09-11T05:34:54.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3950000000000001e-06 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889650+0000", 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890570+0000", 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092007999999999999 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890577+0000", 2024-09-11T05:34:54.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.764e-06 2024-09-11T05:34:54.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829261+0000", 2024-09-11T05:34:54.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93868468500000002 2024-09-11T05:34:54.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829268+0000", 2024-09-11T05:34:54.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857004+0000", 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027736043 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857102+0000", 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8066999999999995e-05 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857253+0000", 2024-09-11T05:34:54.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015050400000000001 2024-09-11T05:34:54.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.144 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.144 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116629 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13625344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.144 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:54.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214388262, 2024-09-11T05:34:54.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967906154, 2024-09-11T05:34:54.144 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116629 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:54.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:54.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-07 2024-09-11T05:34:54.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889660+0000", 2024-09-11T05:34:54.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5650000000000001e-06 2024-09-11T05:34:54.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889664+0000", 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4000000000000001e-06 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889666+0000", 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890614+0000", 2024-09-11T05:34:54.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00094762999999999998 2024-09-11T05:34:54.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890621+0000", 2024-09-11T05:34:54.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.379e-06 2024-09-11T05:34:54.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829291+0000", 2024-09-11T05:34:54.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866938499999997 2024-09-11T05:34:54.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829298+0000", 2024-09-11T05:34:54.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6610000000000003e-06 2024-09-11T05:34:54.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857284+0000", 2024-09-11T05:34:54.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027986522 2024-09-11T05:34:54.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857393+0000", 2024-09-11T05:34:54.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109054 2024-09-11T05:34:54.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857565+0000", 2024-09-11T05:34:54.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017160999999999999 2024-09-11T05:34:54.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.150 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.150 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116843 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12595200~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.150 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:54.151 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214377040000002, 2024-09-11T05:34:54.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9682605290000001, 2024-09-11T05:34:54.151 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116843 2024-09-11T05:34:54.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.151 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:54.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:54.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:54.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:54.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889671+0000", 2024-09-11T05:34:54.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-11T05:34:54.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889674+0000", 2024-09-11T05:34:54.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.005e-06 2024-09-11T05:34:54.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889677+0000", 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890648+0000", 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097103399999999996 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890652+0000", 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0790000000000002e-06 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829320+0000", 2024-09-11T05:34:54.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866793199999998 2024-09-11T05:34:54.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829327+0000", 2024-09-11T05:34:54.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5529999999999998e-06 2024-09-11T05:34:54.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857596+0000", 2024-09-11T05:34:54.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028269125 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857834+0000", 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023784300000000001 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857930+0000", 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6704000000000001e-05 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.157 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116844 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12619776~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.157 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:54.157 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214366849000001, 2024-09-11T05:34:54.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9685250679999999, 2024-09-11T05:34:54.157 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.157 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116844 2024-09-11T05:34:54.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.158 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:54.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:54.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889681+0000", 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.229e-06 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889684+0000", 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0130000000000002e-06 2024-09-11T05:34:54.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889687+0000", 2024-09-11T05:34:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7259999999999998e-06 2024-09-11T05:34:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890685+0000", 2024-09-11T05:34:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099783399999999996 2024-09-11T05:34:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890695+0000", 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829349+0000", 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865456300000005 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829356+0000", 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5130000000000002e-06 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857959+0000", 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0286034959999999 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858057+0000", 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8097999999999995e-05 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858205+0000", 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147732 2024-09-11T05:34:54.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116845 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12644352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214356616000003, 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968783033, 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116845 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:54.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:54.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889692+0000", 2024-09-11T05:34:54.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2330000000000001e-06 2024-09-11T05:34:54.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889695+0000", 2024-09-11T05:34:54.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9249999999999999e-06 2024-09-11T05:34:54.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889697+0000", 2024-09-11T05:34:54.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:34:54.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890719+0000", 2024-09-11T05:34:54.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010218429999999999 2024-09-11T05:34:54.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890723+0000", 2024-09-11T05:34:54.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:34:54.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829378+0000", 2024-09-11T05:34:54.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865562000000002 2024-09-11T05:34:54.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829385+0000", 2024-09-11T05:34:54.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4579999999999998e-06 2024-09-11T05:34:54.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858234+0000", 2024-09-11T05:34:54.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028849288 2024-09-11T05:34:54.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858337+0000", 2024-09-11T05:34:54.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102371 2024-09-11T05:34:54.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858473+0000", 2024-09-11T05:34:54.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013669299999999999 2024-09-11T05:34:54.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.169 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.169 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116846 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12668928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.169 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:54.170 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214333690999993, 2024-09-11T05:34:54.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.969056522, 2024-09-11T05:34:54.170 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.170 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116846 2024-09-11T05:34:54.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.170 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-07 2024-09-11T05:34:54.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889715+0000", 2024-09-11T05:34:54.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.482e-06 2024-09-11T05:34:54.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889718+0000", 2024-09-11T05:34:54.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:54.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889721+0000", 2024-09-11T05:34:54.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-11T05:34:54.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890762+0000", 2024-09-11T05:34:54.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010413659999999999 2024-09-11T05:34:54.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890772+0000", 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5750000000000007e-06 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829407+0000", 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93863550699999998 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829414+0000", 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5640000000000002e-06 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858502+0000", 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0290880099999999 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858634+0000", 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013173199999999999 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858770+0000", 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135943 2024-09-11T05:34:54.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.176 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.176 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116847 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12693504~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.176 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:54.176 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214304002999995, 2024-09-11T05:34:54.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9692923329999998, 2024-09-11T05:34:54.176 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.177 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116847 2024-09-11T05:34:54.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.177 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:54.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:54.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889747+0000", 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.501e-06 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889753+0000", 2024-09-11T05:34:54.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1360000000000002e-06 2024-09-11T05:34:54.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889756+0000", 2024-09-11T05:34:54.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3110000000000001e-06 2024-09-11T05:34:54.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890808+0000", 2024-09-11T05:34:54.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010523240000000001 2024-09-11T05:34:54.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890813+0000", 2024-09-11T05:34:54.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5650000000000003e-06 2024-09-11T05:34:54.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829436+0000", 2024-09-11T05:34:54.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93862351799999999 2024-09-11T05:34:54.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829443+0000", 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5220000000000004e-06 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858798+0000", 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029354903 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858899+0000", 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101414 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859035+0000", 2024-09-11T05:34:54.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013589 2024-09-11T05:34:54.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.182 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.182 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116848 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12718080~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.182 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:54.182 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214287318000004, 2024-09-11T05:34:54.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9695514759999999, 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116848 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889760+0000", 2024-09-11T05:34:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889761+0000", 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.189e-06 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889764+0000", 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889766+0000", 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890850+0000", 2024-09-11T05:34:54.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010835479999999999 2024-09-11T05:34:54.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890857+0000", 2024-09-11T05:34:54.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6299999999999998e-06 2024-09-11T05:34:54.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829465+0000", 2024-09-11T05:34:54.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860787000000001 2024-09-11T05:34:54.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829472+0000", 2024-09-11T05:34:54.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4420000000000003e-06 2024-09-11T05:34:54.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859062+0000", 2024-09-11T05:34:54.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0295903360000001 2024-09-11T05:34:54.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859169+0000", 2024-09-11T05:34:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010674400000000001 2024-09-11T05:34:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859311+0000", 2024-09-11T05:34:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014209499999999999 2024-09-11T05:34:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116849 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12742656~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214277531999997, 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9698160310000001, 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116849 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:54.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889771+0000", 2024-09-11T05:34:54.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:34:54.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889774+0000", 2024-09-11T05:34:54.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:34:54.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889776+0000", 2024-09-11T05:34:54.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.638e-06 2024-09-11T05:34:54.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890886+0000", 2024-09-11T05:34:54.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011102519999999999 2024-09-11T05:34:54.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890891+0000", 2024-09-11T05:34:54.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2200000000000003e-06 2024-09-11T05:34:54.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829494+0000", 2024-09-11T05:34:54.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860342500000005 2024-09-11T05:34:54.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829501+0000", 2024-09-11T05:34:54.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4829999999999996e-06 2024-09-11T05:34:54.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859339+0000", 2024-09-11T05:34:54.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0298381320000001 2024-09-11T05:34:54.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859440+0000", 2024-09-11T05:34:54.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010145 2024-09-11T05:34:54.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859585+0000", 2024-09-11T05:34:54.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014513300000000001 2024-09-11T05:34:54.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.195 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.195 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116850 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12767232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.195 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:54.195 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214256505999998, 2024-09-11T05:34:54.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970125645, 2024-09-11T05:34:54.195 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116850 2024-09-11T05:34:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889791+0000", 2024-09-11T05:34:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889792+0000", 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4899999999999999e-06 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889795+0000", 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889798+0000", 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7089999999999998e-06 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890924+0000", 2024-09-11T05:34:54.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001125685 2024-09-11T05:34:54.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890933+0000", 2024-09-11T05:34:54.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3340000000000008e-06 2024-09-11T05:34:54.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829523+0000", 2024-09-11T05:34:54.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858966099999996 2024-09-11T05:34:54.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829529+0000", 2024-09-11T05:34:54.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5740000000000001e-06 2024-09-11T05:34:54.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859614+0000", 2024-09-11T05:34:54.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0300843289999999 2024-09-11T05:34:54.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859743+0000", 2024-09-11T05:34:54.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129407 2024-09-11T05:34:54.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859916+0000", 2024-09-11T05:34:54.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017282500000000001 2024-09-11T05:34:54.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.201 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.201 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116851 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12791808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.201 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:54.202 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214216636000003, 2024-09-11T05:34:54.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970347268, 2024-09-11T05:34:54.202 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116851 2024-09-11T05:34:54.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.202 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889832+0000", 2024-09-11T05:34:54.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6819999999999999e-06 2024-09-11T05:34:54.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889838+0000", 2024-09-11T05:34:54.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:34:54.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889841+0000", 2024-09-11T05:34:54.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:34:54.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890957+0000", 2024-09-11T05:34:54.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001115956 2024-09-11T05:34:54.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890961+0000", 2024-09-11T05:34:54.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7050000000000001e-06 2024-09-11T05:34:54.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829552+0000", 2024-09-11T05:34:54.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93859101499999997 2024-09-11T05:34:54.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829558+0000", 2024-09-11T05:34:54.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5429999999999999e-06 2024-09-11T05:34:54.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859947+0000", 2024-09-11T05:34:54.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030388248 2024-09-11T05:34:54.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860043+0000", 2024-09-11T05:34:54.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5847999999999994e-05 2024-09-11T05:34:54.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860177+0000", 2024-09-11T05:34:54.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013484400000000001 2024-09-11T05:34:54.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.208 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116852 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12816384~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.208 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:54.208 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214202025000006, 2024-09-11T05:34:54.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970594859, 2024-09-11T05:34:54.208 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116852 2024-09-11T05:34:54.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.209 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:54.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:54.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:54.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:54.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889846+0000", 2024-09-11T05:34:54.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.204e-06 2024-09-11T05:34:54.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889849+0000", 2024-09-11T05:34:54.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.931e-06 2024-09-11T05:34:54.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889852+0000", 2024-09-11T05:34:54.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890993+0000", 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001141176 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891001+0000", 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5259999999999996e-06 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829582+0000", 2024-09-11T05:34:54.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858050800000004 2024-09-11T05:34:54.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829588+0000", 2024-09-11T05:34:54.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4980000000000003e-06 2024-09-11T05:34:54.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860207+0000", 2024-09-11T05:34:54.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030618713 2024-09-11T05:34:54.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860305+0000", 2024-09-11T05:34:54.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8209999999999997e-05 2024-09-11T05:34:54.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860440+0000", 2024-09-11T05:34:54.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134692 2024-09-11T05:34:54.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116853 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12840960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.217 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:54.217 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214191306999993, 2024-09-11T05:34:54.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.97084075, 2024-09-11T05:34:54.217 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116853 2024-09-11T05:34:54.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:54.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:54.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889856+0000", 2024-09-11T05:34:54.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889857+0000", 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.435e-06 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889860+0000", 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9620000000000002e-06 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889863+0000", 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891036+0000", 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011734580000000001 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891042+0000", 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3290000000000001e-06 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829611+0000", 2024-09-11T05:34:54.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856954299999995 2024-09-11T05:34:54.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829618+0000", 2024-09-11T05:34:54.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T05:34:54.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860465+0000", 2024-09-11T05:34:54.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0308472500000001 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860558+0000", 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3253999999999999e-05 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860696+0000", 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138169 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116854 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12865536~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214181116000006, 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9710979320000002, 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116854 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889867+0000", 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.155e-06 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889871+0000", 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9260000000000002e-06 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889875+0000", 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.262e-06 2024-09-11T05:34:54.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891070+0000", 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011945160000000001 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891079+0000", 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3759999999999997e-06 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829642+0000", 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856325900000004 2024-09-11T05:34:54.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829649+0000", 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860726+0000", 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.031076791 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860831+0000", 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105003 2024-09-11T05:34:54.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860964+0000", 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013285700000000001 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116855 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12890112~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.214166336000005, 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.971277814, 2024-09-11T05:34:54.228 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.229 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116855 2024-09-11T05:34:54.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.229 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:54.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817809+0000", 2024-09-11T05:34:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.92792850999999998 2024-09-11T05:34:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817815+0000", 2024-09-11T05:34:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4110000000000001e-06 2024-09-11T05:34:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817827+0000", 2024-09-11T05:34:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2031000000000001e-05 2024-09-11T05:34:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817837+0000", 2024-09-11T05:34:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2159999999999995e-06 2024-09-11T05:34:54.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829673+0000", 2024-09-11T05:34:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011836197 2024-09-11T05:34:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829679+0000", 2024-09-11T05:34:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5390000000000004e-06 2024-09-11T05:34:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861000+0000", 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0313209539999999 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861080+0000", 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9606999999999999e-05 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861158+0000", 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8349000000000005e-05 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.234 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.234 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:54.235 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:54.236 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:54.234+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:54.335 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:54.335+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:54.379 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:54.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:54.379 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:54.379 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:54.387 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:54.437 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:54.436+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:54.491 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:54.491 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:54.491 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:54.491 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:54.491 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:54.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:54.541 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:54.540+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:54.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:34:54.638 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:54.638+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:54.647 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:54.647 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:54.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:54.647 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:54.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.647 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:34:54.647 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:54.647 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 129.05528689600001, 2024-09-11T05:34:54.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:34:54.647 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.647 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:54.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:34:54.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:34:54.648 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:34:54.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.648 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:54.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:54.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:34:54.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:34:54.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:34:54.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:34:54.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:34:54.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:34:54.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:34:54.652 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.652 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.652 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.652 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.652 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:54.652 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.478351635999999, 2024-09-11T05:34:54.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:34:54.652 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:34:54.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.653 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:54.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:54.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:34:54.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:34:54.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:34:54.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.657 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.657 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:54.657 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.478332836999996, 2024-09-11T05:34:54.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:34:54.657 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.657 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:34:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:34:54.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:34:54.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:34:54.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:34:54.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:34:54.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:34:54.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:34:54.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:34:54.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.661 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.661 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.661 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:54.661 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.478308806000001, 2024-09-11T05:34:54.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:34:54.662 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.662 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:34:54.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.662 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:34:54.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:34:54.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:34:54.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:34:54.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:34:54.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.478232018, 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:34:54.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.667 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:54.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:54.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:54.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:54.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:34:54.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:34:54.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:34:54.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:34:54.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:34:54.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:34:54.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.671 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.671 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:54.671 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.478204695000002, 2024-09-11T05:34:54.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:34:54.671 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:34:54.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.671 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:54.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:54.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.478186147000002, 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:34:54.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.676 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:54.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:34:54.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:34:54.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.680 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.680 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:54.680 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.478168076000003, 2024-09-11T05:34:54.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:34:54.680 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:34:54.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:34:54.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:34:54.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:34:54.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:34:54.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:34:54.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:34:54.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:34:54.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:34:54.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.684 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.684 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.684 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:54.684 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.476570433000006, 2024-09-11T05:34:54.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:34:54.684 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.684 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:54.688 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.476550106999994, 2024-09-11T05:34:54.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:34:54.689 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:34:54.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.689 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:34:54.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:34:54.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:34:54.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:34:54.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:34:54.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:34:54.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.693 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.693 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.693 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:54.693 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.476511109, 2024-09-11T05:34:54.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:34:54.693 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:34:54.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.694 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:54.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:34:54.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:34:54.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:34:54.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:34:54.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:34:54.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:34:54.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:34:54.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:34:54.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:34:54.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:34:54.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.476490467000005, 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:34:54.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:34:54.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:34:54.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:34:54.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:34:54.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:34:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:34:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.476367604000004, 2024-09-11T05:34:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:34:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:34:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:34:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:34:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:34:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:34:54.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.476208047, 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:34:54.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:34:54.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:34:54.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:34:54.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:34:54.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:34:54.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:54.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:34:54.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:34:54.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:34:54.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:34:54.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:34:54.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:34:54.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.711 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.711 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.711 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:54.711 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.474523379999994, 2024-09-11T05:34:54.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:34:54.711 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:34:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:54.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:34:54.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:34:54.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.715 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.474495375000004, 2024-09-11T05:34:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:34:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:34:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:34:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:34:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:34:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:34:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:34:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:34:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:34:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:34:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:34:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:34:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:34:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:34:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:34:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:34:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.473028912000004, 2024-09-11T05:34:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:34:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:34:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:34:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:34:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:34:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:34:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:34:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:34:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:34:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:34:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.472843611000002, 2024-09-11T05:34:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:34:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:34:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:34:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:34:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:34:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:34:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:34:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:34:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:34:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:34:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:34:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:34:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.472672156000002, 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:34:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:34:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:34:54.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:34:54.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:34:54.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:34:54.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:34:54.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:194030 3.11 3:8c0c7139:::rbd_object_map.112d3507140b:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-11T05:34:54.734 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:52.789587+0000", 2024-09-11T05:34:54.735 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.855952458, 2024-09-11T05:34:54.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.002511178, 2024-09-11T05:34:54.735 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:54.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:54.735 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:54.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:54.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:54.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:54.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 194030 2024-09-11T05:34:54.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.735 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:54.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789587+0000", 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789587+0000", 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789589+0000", 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5120000000000001e-06 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789594+0000", 2024-09-11T05:34:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4920000000000001e-06 2024-09-11T05:34:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789605+0000", 2024-09-11T05:34:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0795000000000001e-05 2024-09-11T05:34:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789612+0000", 2024-09-11T05:34:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8340000000000001e-06 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.790925+0000", 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001312847 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.790938+0000", 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3192e-05 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:54.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.789344+0000", 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99840615499999996 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.789491+0000", 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014679299999999999 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.789679+0000", 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018818099999999999 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:34:54.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.790923+0000", 2024-09-11T05:34:54.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012436820000000001 2024-09-11T05:34:54.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:54.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.791981+0000", 2024-09-11T05:34:54.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010581570000000001 2024-09-11T05:34:54.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:34:54.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.792055+0000", 2024-09-11T05:34:54.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3749000000000002e-05 2024-09-11T05:34:54.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:54.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:54.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:54.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.792099+0000", 2024-09-11T05:34:54.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3788999999999997e-05 2024-09-11T05:34:54.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.741 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:54.741 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:54.741 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:54.742 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 5, 6, 3] out_osds: [4, 7, 1] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-09-11T05:34:54.742 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:34:54.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:34:54.744 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:54.744 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:54.744 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:54.745 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:54.745 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:54.745 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:54.746 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:54.746 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:54.743+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:54.753 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:54.753 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:54.770 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:54.770 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:34:54.789 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:54.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:34:54.820 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:54.840 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:54.840 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:54.845 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:54.844+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:54.867 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:54.867 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:54.877 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:54.946 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:54.946+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:54.981 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:54.981 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:54.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:55.047 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:55.046+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:55.059 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:34:55.059 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:34:55.071 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-09-11T05:34:54.784766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":334806166,"num_objects":948,"num_object_clones":333,"num_object_copies":1896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":317,"num_objects_misplaced":129,"num_objects_unfound":0,"num_objects_dirty":948,"num_whiteouts":374,"num_read":217341,"num_read_kb":575695,"num_write":21299,"num_write_kb":317989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3855,"num_bytes_recovered":171974058,"num_keys_recovered":238,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18265,"ondisk_log_size":18265,"up":82,"acting":77,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":446084,"kb_used_data":199880,"kb_used_omap":7,"kb_used_meta":246072,"kb_avail":471413116,"statfs":{"total":483183820800,"available":482727030784,"internally_reserved":0,"allocated":204677120,"data_stored":284554058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7972,"internal_metadata":251977948},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,1],"upper_bound":4096},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-132604239,"num_objects":-52,"num_object_clones":-24,"num_object_copies":-104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":317,"num_objects_misplaced":129,"num_objects_unfound":0,"num_objects_dirty":-52,"num_whiteouts":-7,"num_read":577,"num_read_kb":487,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":846,"num_bytes_recovered":30668770,"num_keys_recovered":9,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.165681"},"pg_stats":[{"pgid":"3.1f","version":"124'576","reported_seq":7261,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.783019+0000","last_change":"2024-09-11T05:34:52.783575+0000","last_active":"2024-09-11T05:34:52.783019+0000","last_peered":"2024-09-11T05:34:52.783019+0000","last_clean":"2024-09-11T05:34:52.783019+0000","last_became_active":"2024-09-11T05:34:48.625234+0000","last_became_peered":"2024-09-11T05:34:48.625234+0000","last_unstale":"2024-09-11T05:34:52.783019+0000","last_undegraded":"2024-09-11T05:34:52.783019+0000","last_fullsized":"2024-09-11T05:34:52.783019+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:07:06.103594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001106225,"stat_sum":{"num_bytes":3979507,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":9,"num_read":7688,"num_read_kb":22542,"num_write":733,"num_write_kb":11140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":4324235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"3.1e","version":"124'266","reported_seq":3597,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.781832+0000","last_change":"2024-09-11T05:34:52.782709+0000","last_active":"2024-09-11T05:34:52.781832+0000","last_peered":"2024-09-11T05:34:52.781832+0000","last_clean":"2024-09-11T05:34:52.781832+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:34:52.781832+0000","last_undegraded":"2024-09-11T05:34:52.781832+0000","last_fullsized":"2024-09-11T05:34:52.781832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:18:11.316792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097180699999999999,"stat_sum":{"num_bytes":18013811,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":15,"num_read":3027,"num_read_kb":23842,"num_write":221,"num_write_kb":6198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"3.1d","version":"126'880","reported_seq":21284,"reported_epoch":127,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-11T05:34:52.782388+0000","last_change":"2024-09-11T05:34:51.892154+0000","last_active":"2024-09-11T05:34:52.782388+0000","last_peered":"2024-09-11T05:34:52.782388+0000","last_clean":"2024-09-11T05:34:48.624613+0000","last_became_active":"2024-09-11T05:34:51.889531+0000","last_became_peered":"2024-09-11T05:34:51.889531+0000","last_unstale":"2024-09-11T05:34:52.782388+0000","last_undegraded":"2024-09-11T05:34:51.627868+0000","last_fullsized":"2024-09-11T05:34:51.624950+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0054044929999999998,"stat_sum":{"num_bytes":18812524,"num_objects":30,"num_object_clones":12,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":110,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":12,"num_read":16631,"num_read_kb":25382,"num_write":1106,"num_write_kb":7409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":4570874,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":1},{"shards":"0,2","objects":29}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"2"}]},{"pgid":"3.1c","version":"127'529","reported_seq":7420,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.800911+0000","last_change":"2024-09-11T05:34:52.801296+0000","last_active":"2024-09-11T05:34:52.800911+0000","last_peered":"2024-09-11T05:34:52.800911+0000","last_clean":"2024-09-11T05:34:52.800911+0000","last_became_active":"2024-09-11T05:34:47.624936+0000","last_became_peered":"2024-09-11T05:34:47.624936+0000","last_unstale":"2024-09-11T05:34:52.800911+0000","last_undegraded":"2024-09-11T05:34:52.800911+0000","last_fullsized":"2024-09-11T05:34:52.800911+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:29.410366+0000","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0.018104425,"stat_sum":{"num_bytes":19739288,"num_objects":29,"num_object_clones":9,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":11,"num_read":8724,"num_read_kb":27390,"num_write":610,"num_write_kb":16428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":13219858,"num_keys_recovered":56,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"3.1b","version":"116'529","reported_seq":7589,"reported_epoch":127,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-11T05:34:53.000229+0000","last_change":"2024-09-11T05:34:52.900928+0000","last_active":"2024-09-11T05:34:53.000229+0000","last_peered":"2024-09-11T05:34:53.000229+0000","last_clean":"2024-09-11T05:34:48.624529+0000","last_became_active":"2024-09-11T05:34:51.886271+0000","last_became_peered":"2024-09-11T05:34:51.886271+0000","last_unstale":"2024-09-11T05:34:53.000229+0000","last_undegraded":"2024-09-11T05:34:53.000229+0000","last_fullsized":"2024-09-11T05:34:51.626001+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049131510000000002,"stat_sum":{"num_bytes":5982508,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":13,"num_read":7304,"num_read_kb":17715,"num_write":634,"num_write_kb":7163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":274,"num_bytes_recovered":7543883,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0],"avail_no_missing":["0","5"],"object_location_counts":[{"shards":"0","objects":30}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"2"}]},{"pgid":"3.1a","version":"127'387","reported_seq":4663,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.785199+0000","last_change":"2024-09-11T05:34:52.785433+0000","last_active":"2024-09-11T05:34:52.785199+0000","last_peered":"2024-09-11T05:34:52.785199+0000","last_clean":"2024-09-11T05:34:52.785199+0000","last_became_active":"2024-09-11T05:34:47.624650+0000","last_became_peered":"2024-09-11T05:34:47.624650+0000","last_unstale":"2024-09-11T05:34:52.785199+0000","last_undegraded":"2024-09-11T05:34:52.785199+0000","last_fullsized":"2024-09-11T05:34:52.785199+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:23:32.267192+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0025141650000000001,"stat_sum":{"num_bytes":4291966,"num_objects":40,"num_object_clones":15,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":17,"num_read":5076,"num_read_kb":13952,"num_write":460,"num_write_kb":12830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":4852988,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"3.19","version":"122'1064","reported_seq":10893,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.784163+0000","last_change":"2024-09-11T05:34:52.787208+0000","last_active":"2024-09-11T05:34:52.784163+0000","last_peered":"2024-09-11T05:34:52.784163+0000","last_clean":"2024-09-11T05:34:52.784163+0000","last_became_active":"2024-09-11T05:34:47.628578+0000","last_became_peered":"2024-09-11T05:34:47.628578+0000","last_unstale":"2024-09-11T05:34:52.784163+0000","last_undegraded":"2024-09-11T05:34:52.784163+0000","last_fullsized":"2024-09-11T05:34:52.784163+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1064,"log_dups_size":0,"ondisk_log_size":1064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:55.377272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005297792,"stat_sum":{"num_bytes":4260663,"num_objects":26,"num_object_clones":9,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":9,"num_read":13693,"num_read_kb":13410,"num_write":1641,"num_write_kb":8532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":1269861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"3.18","version":"120'494","reported_seq":2995,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.782681+0000","last_change":"2024-09-11T05:34:52.783234+0000","last_active":"2024-09-11T05:34:52.782681+0000","last_peered":"2024-09-11T05:34:52.782681+0000","last_clean":"2024-09-11T05:34:52.782681+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:34:52.782681+0000","last_undegraded":"2024-09-11T05:34:52.782681+0000","last_fullsized":"2024-09-11T05:34:52.782681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:35:24.175785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014472720000000001,"stat_sum":{"num_bytes":4313007,"num_objects":24,"num_object_clones":9,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":10,"num_read":3334,"num_read_kb":10068,"num_write":590,"num_write_kb":6210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"3.17","version":"126'1107","reported_seq":3128,"reported_epoch":127,"state":"active+undersized+remapped","last_fresh":"2024-09-11T05:34:52.899438+0000","last_change":"2024-09-11T05:34:52.899611+0000","last_active":"2024-09-11T05:34:52.899438+0000","last_peered":"2024-09-11T05:34:52.899438+0000","last_clean":"2024-09-11T05:34:48.629396+0000","last_became_active":"2024-09-11T05:34:51.892083+0000","last_became_peered":"2024-09-11T05:34:51.892083+0000","last_unstale":"2024-09-11T05:34:52.899438+0000","last_undegraded":"2024-09-11T05:34:51.627063+0000","last_fullsized":"2024-09-11T05:34:51.623875+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1107,"log_dups_size":0,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0027112460000000001,"stat_sum":{"num_bytes":32409736,"num_objects":27,"num_object_clones":11,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":10,"num_read":5096,"num_read_kb":28578,"num_write":1674,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":292,"num_bytes_recovered":48701806,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5],"avail_no_missing":["5","0","3"],"object_location_counts":[{"shards":"5","objects":27}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"2"}]},{"pgid":"3.16","version":"117'266","reported_seq":3502,"reported_epoch":127,"state":"peering","last_fresh":"2024-09-11T05:34:51.993453+0000","last_change":"2024-09-11T05:34:52.989171+0000","last_active":"2024-09-11T05:34:52.989171+0000","last_peered":"2024-09-11T05:34:51.993453+0000","last_clean":"2024-09-11T05:34:42.756134+0000","last_became_active":"2024-09-11T05:34:51.874416+0000","last_became_peered":"2024-09-11T05:34:51.874416+0000","last_unstale":"2024-09-11T05:34:51.993453+0000","last_undegraded":"2024-09-11T05:34:51.993453+0000","last_fullsized":"2024-09-11T05:34:51.622139+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078275299999999996,"stat_sum":{"num_bytes":7110656,"num_objects":19,"num_object_clones":8,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":7,"num_read":2863,"num_read_kb":14884,"num_write":217,"num_write_kb":7375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":1456269,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"2"}]},{"pgid":"3.15","version":"126'695","reported_seq":3670,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.793804+0000","last_change":"2024-09-11T05:34:52.794210+0000","last_active":"2024-09-11T05:34:52.793804+0000","last_peered":"2024-09-11T05:34:52.793804+0000","last_clean":"2024-09-11T05:34:52.793804+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:34:52.793804+0000","last_undegraded":"2024-09-11T05:34:52.793804+0000","last_fullsized":"2024-09-11T05:34:52.793804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:05.492208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0094201560000000007,"stat_sum":{"num_bytes":6390127,"num_objects":33,"num_object_clones":12,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":15,"num_read":5390,"num_read_kb":12737,"num_write":869,"num_write_kb":9766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"3.14","version":"121'337","reported_seq":11812,"reported_epoch":127,"state":"peering","last_fresh":"2024-09-11T05:34:52.709040+0000","last_change":"2024-09-11T05:34:52.989141+0000","last_active":"2024-09-11T05:34:52.989141+0000","last_peered":"2024-09-11T05:34:52.709040+0000","last_clean":"2024-09-11T05:34:48.624352+0000","last_became_active":"2024-09-11T05:34:51.883880+0000","last_became_peered":"2024-09-11T05:34:51.883880+0000","last_unstale":"2024-09-11T05:34:52.709040+0000","last_undegraded":"2024-09-11T05:34:52.709040+0000","last_fullsized":"2024-09-11T05:34:52.709040+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.011963187,"stat_sum":{"num_bytes":7985328,"num_objects":32,"num_object_clones":12,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":12,"num_read":5061,"num_read_kb":14756,"num_write":292,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":7503668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.779569+0000","last_change":"2024-09-11T05:34:50.627854+0000","last_active":"2024-09-11T05:34:52.779569+0000","last_peered":"2024-09-11T05:34:52.779569+0000","last_clean":"2024-09-11T05:34:52.779569+0000","last_became_active":"2024-09-11T05:34:50.627529+0000","last_became_peered":"2024-09-11T05:34:50.627529+0000","last_unstale":"2024-09-11T05:34:52.779569+0000","last_undegraded":"2024-09-11T05:34:52.779569+0000","last_fullsized":"2024-09-11T05:34:52.779569+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:35.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"126'668","reported_seq":4273,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.780259+0000","last_change":"2024-09-11T05:34:52.780691+0000","last_active":"2024-09-11T05:34:52.780259+0000","last_peered":"2024-09-11T05:34:52.780259+0000","last_clean":"2024-09-11T05:34:52.780259+0000","last_became_active":"2024-09-11T05:34:47.626611+0000","last_became_peered":"2024-09-11T05:34:47.626611+0000","last_unstale":"2024-09-11T05:34:52.780259+0000","last_undegraded":"2024-09-11T05:34:52.780259+0000","last_fullsized":"2024-09-11T05:34:52.780259+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:02:22.645500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066360900000000001,"stat_sum":{"num_bytes":1654132,"num_objects":24,"num_object_clones":10,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":13,"num_read":5183,"num_read_kb":4253,"num_write":903,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":1655489,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"2.6","version":"0'0","reported_seq":219,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.782322+0000","last_change":"2024-09-11T05:32:55.614406+0000","last_active":"2024-09-11T05:34:52.782322+0000","last_peered":"2024-09-11T05:34:52.782322+0000","last_clean":"2024-09-11T05:34:52.782322+0000","last_became_active":"2024-09-11T05:32:55.614125+0000","last_became_peered":"2024-09-11T05:32:55.614125+0000","last_unstale":"2024-09-11T05:34:52.782322+0000","last_undegraded":"2024-09-11T05:34:52.782322+0000","last_fullsized":"2024-09-11T05:34:52.782322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:06:59.971006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"127'414","reported_seq":5857,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.787269+0000","last_change":"2024-09-11T05:34:52.787507+0000","last_active":"2024-09-11T05:34:52.787269+0000","last_peered":"2024-09-11T05:34:52.787269+0000","last_clean":"2024-09-11T05:34:52.787269+0000","last_became_active":"2024-09-11T05:34:47.624881+0000","last_became_peered":"2024-09-11T05:34:47.624881+0000","last_unstale":"2024-09-11T05:34:52.787269+0000","last_undegraded":"2024-09-11T05:34:52.787269+0000","last_fullsized":"2024-09-11T05:34:52.787269+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:15.033112+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0074317920000000004,"stat_sum":{"num_bytes":4097589,"num_objects":34,"num_object_clones":14,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":16,"num_read":6775,"num_read_kb":15844,"num_write":329,"num_write_kb":6379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":1715668,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.779384+0000","last_change":"2024-09-11T05:34:50.625911+0000","last_active":"2024-09-11T05:34:52.779384+0000","last_peered":"2024-09-11T05:34:52.779384+0000","last_clean":"2024-09-11T05:34:52.779384+0000","last_became_active":"2024-09-11T05:34:50.625595+0000","last_became_peered":"2024-09-11T05:34:50.625595+0000","last_unstale":"2024-09-11T05:34:52.779384+0000","last_undegraded":"2024-09-11T05:34:52.779384+0000","last_fullsized":"2024-09-11T05:34:52.779384+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:53:14.794842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"126'1557","reported_seq":7814,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.792015+0000","last_change":"2024-09-11T05:34:52.792505+0000","last_active":"2024-09-11T05:34:52.792015+0000","last_peered":"2024-09-11T05:34:52.792015+0000","last_clean":"2024-09-11T05:34:52.792015+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:34:52.792015+0000","last_undegraded":"2024-09-11T05:34:52.792015+0000","last_fullsized":"2024-09-11T05:34:52.792015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1557,"log_dups_size":0,"ondisk_log_size":1557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:00.106582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012021736,"stat_sum":{"num_bytes":6221728,"num_objects":35,"num_object_clones":12,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":15,"num_read":14798,"num_read_kb":37543,"num_write":2251,"num_write_kb":19401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"2.4","version":"0'0","reported_seq":242,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.780824+0000","last_change":"2024-09-11T05:34:44.768103+0000","last_active":"2024-09-11T05:34:52.780824+0000","last_peered":"2024-09-11T05:34:52.780824+0000","last_clean":"2024-09-11T05:34:52.780824+0000","last_became_active":"2024-09-11T05:34:44.767862+0000","last_became_peered":"2024-09-11T05:34:44.767862+0000","last_unstale":"2024-09-11T05:34:52.780824+0000","last_undegraded":"2024-09-11T05:34:52.780824+0000","last_fullsized":"2024-09-11T05:34:52.780824+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:15:05.574617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"122'791","reported_seq":12409,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.792105+0000","last_change":"2024-09-11T05:34:52.792532+0000","last_active":"2024-09-11T05:34:52.792105+0000","last_peered":"2024-09-11T05:34:52.792105+0000","last_clean":"2024-09-11T05:34:52.792105+0000","last_became_active":"2024-09-11T05:34:38.741666+0000","last_became_peered":"2024-09-11T05:34:38.741666+0000","last_unstale":"2024-09-11T05:34:52.792105+0000","last_undegraded":"2024-09-11T05:34:52.792105+0000","last_fullsized":"2024-09-11T05:34:52.792105+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:02:58.868990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011551689,"stat_sum":{"num_bytes":9189186,"num_objects":35,"num_object_clones":11,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":14975,"num_read_kb":18042,"num_write":797,"num_write_kb":8800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"3.3","version":"126'586","reported_seq":4077,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.793346+0000","last_change":"2024-09-11T05:34:52.793740+0000","last_active":"2024-09-11T05:34:52.793346+0000","last_peered":"2024-09-11T05:34:52.793346+0000","last_clean":"2024-09-11T05:34:52.793346+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:34:52.793346+0000","last_undegraded":"2024-09-11T05:34:52.793346+0000","last_fullsized":"2024-09-11T05:34:52.793346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:33.001133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0094321519999999992,"stat_sum":{"num_bytes":9429078,"num_objects":24,"num_object_clones":7,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":4196,"num_read_kb":22764,"num_write":641,"num_write_kb":8226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"2.2","version":"21'2","reported_seq":201,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.779946+0000","last_change":"2024-09-11T05:34:50.629913+0000","last_active":"2024-09-11T05:34:52.779946+0000","last_peered":"2024-09-11T05:34:52.779946+0000","last_clean":"2024-09-11T05:34:52.779946+0000","last_became_active":"2024-09-11T05:34:50.626576+0000","last_became_peered":"2024-09-11T05:34:50.626576+0000","last_unstale":"2024-09-11T05:34:52.779946+0000","last_undegraded":"2024-09-11T05:34:52.779946+0000","last_fullsized":"2024-09-11T05:34:52.779946+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:31.184793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"115'317","reported_seq":2477,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.781766+0000","last_change":"2024-09-11T05:34:52.782631+0000","last_active":"2024-09-11T05:34:52.781766+0000","last_peered":"2024-09-11T05:34:52.781766+0000","last_clean":"2024-09-11T05:34:52.781766+0000","last_became_active":"2024-09-11T05:34:13.624034+0000","last_became_peered":"2024-09-11T05:34:13.624034+0000","last_unstale":"2024-09-11T05:34:52.781766+0000","last_undegraded":"2024-09-11T05:34:52.781766+0000","last_fullsized":"2024-09-11T05:34:52.781766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:40.261822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010977230000000001,"stat_sum":{"num_bytes":11507031,"num_objects":31,"num_object_clones":10,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":13,"num_read":2055,"num_read_kb":16418,"num_write":303,"num_write_kb":9397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3410911,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.781351+0000","last_change":"2024-09-11T05:34:10.619317+0000","last_active":"2024-09-11T05:34:52.781351+0000","last_peered":"2024-09-11T05:34:52.781351+0000","last_clean":"2024-09-11T05:34:52.781351+0000","last_became_active":"2024-09-11T05:34:10.619012+0000","last_became_peered":"2024-09-11T05:34:10.619012+0000","last_unstale":"2024-09-11T05:34:52.781351+0000","last_undegraded":"2024-09-11T05:34:52.781351+0000","last_fullsized":"2024-09-11T05:34:52.781351+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:19.646689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"127'657","reported_seq":8281,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.791556+0000","last_change":"2024-09-11T05:34:52.791961+0000","last_active":"2024-09-11T05:34:52.791556+0000","last_peered":"2024-09-11T05:34:52.791556+0000","last_clean":"2024-09-11T05:34:52.791556+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:34:52.791556+0000","last_undegraded":"2024-09-11T05:34:52.791556+0000","last_fullsized":"2024-09-11T05:34:52.791556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:50.454570+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011464853000000001,"stat_sum":{"num_bytes":4886933,"num_objects":31,"num_object_clones":11,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":11450,"num_read_kb":20394,"num_write":621,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.778280+0000","last_change":"2024-09-11T05:34:50.626273+0000","last_active":"2024-09-11T05:34:52.778280+0000","last_peered":"2024-09-11T05:34:52.778280+0000","last_clean":"2024-09-11T05:34:52.778280+0000","last_became_active":"2024-09-11T05:34:50.625970+0000","last_became_peered":"2024-09-11T05:34:50.625970+0000","last_unstale":"2024-09-11T05:34:52.778280+0000","last_undegraded":"2024-09-11T05:34:52.778280+0000","last_fullsized":"2024-09-11T05:34:52.778280+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:45.970895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"127'528","reported_seq":3544,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.793549+0000","last_change":"2024-09-11T05:34:52.793284+0000","last_active":"2024-09-11T05:34:52.793549+0000","last_peered":"2024-09-11T05:34:52.793549+0000","last_clean":"2024-09-11T05:34:52.793549+0000","last_became_active":"2024-09-11T05:34:38.742487+0000","last_became_peered":"2024-09-11T05:34:38.742487+0000","last_unstale":"2024-09-11T05:34:52.793549+0000","last_undegraded":"2024-09-11T05:34:52.793549+0000","last_fullsized":"2024-09-11T05:34:52.793549+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:34:40.048853+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.010766492000000001,"stat_sum":{"num_bytes":12804720,"num_objects":28,"num_object_clones":6,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":10,"num_read":5572,"num_read_kb":14827,"num_write":583,"num_write_kb":14343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"2.3","version":"19'1","reported_seq":18,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.778736+0000","last_change":"2024-09-11T05:34:50.628817+0000","last_active":"2024-09-11T05:34:52.778736+0000","last_peered":"2024-09-11T05:34:52.778736+0000","last_clean":"2024-09-11T05:34:52.778736+0000","last_became_active":"2024-09-11T05:34:50.625495+0000","last_became_peered":"2024-09-11T05:34:50.625495+0000","last_unstale":"2024-09-11T05:34:52.778736+0000","last_undegraded":"2024-09-11T05:34:52.778736+0000","last_fullsized":"2024-09-11T05:34:52.778736+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:38.332373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.781907+0000","last_change":"2024-09-11T05:34:47.626929+0000","last_active":"2024-09-11T05:34:52.781907+0000","last_peered":"2024-09-11T05:34:52.781907+0000","last_clean":"2024-09-11T05:34:52.781907+0000","last_became_active":"2024-09-11T05:34:47.626561+0000","last_became_peered":"2024-09-11T05:34:47.626561+0000","last_unstale":"2024-09-11T05:34:52.781907+0000","last_undegraded":"2024-09-11T05:34:52.781907+0000","last_fullsized":"2024-09-11T05:34:52.781907+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:09.689444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"127'601","reported_seq":20781,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.790473+0000","last_change":"2024-09-11T05:34:52.792140+0000","last_active":"2024-09-11T05:34:52.790473+0000","last_peered":"2024-09-11T05:34:52.790473+0000","last_clean":"2024-09-11T05:34:52.790473+0000","last_became_active":"2024-09-11T05:34:38.742709+0000","last_became_peered":"2024-09-11T05:34:38.742709+0000","last_unstale":"2024-09-11T05:34:52.790473+0000","last_undegraded":"2024-09-11T05:34:52.790473+0000","last_fullsized":"2024-09-11T05:34:52.790473+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:52.213726+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.010393693000000001,"stat_sum":{"num_bytes":7728451,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":11,"num_read":21529,"num_read_kb":26937,"num_write":591,"num_write_kb":9647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":6098347,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"3.9","version":"126'377","reported_seq":10257,"reported_epoch":127,"state":"active+recovery_wait+remapped","last_fresh":"2024-09-11T05:34:52.782542+0000","last_change":"2024-09-11T05:34:51.887739+0000","last_active":"2024-09-11T05:34:52.782542+0000","last_peered":"2024-09-11T05:34:52.782542+0000","last_clean":"2024-09-11T05:34:48.624408+0000","last_became_active":"2024-09-11T05:34:51.885371+0000","last_became_peered":"2024-09-11T05:34:51.885371+0000","last_unstale":"2024-09-11T05:34:52.782542+0000","last_undegraded":"2024-09-11T05:34:52.782542+0000","last_fullsized":"2024-09-11T05:34:52.782542+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0048314129999999997,"stat_sum":{"num_bytes":11602113,"num_objects":33,"num_object_clones":14,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":129,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":13,"num_read":9328,"num_read_kb":19500,"num_write":330,"num_write_kb":14817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":70,"num_bytes_recovered":6553756,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0,2","objects":33}],"blocked_by":[],"up_primary":3,"acting_primary":0,"purged_snaps":[{"start":"12","length":"2"}]},{"pgid":"3.a","version":"126'388","reported_seq":3203,"reported_epoch":126,"state":"peering","last_fresh":"2024-09-11T05:34:52.587469+0000","last_change":"2024-09-11T05:34:52.781500+0000","last_active":"2024-09-11T05:34:52.781500+0000","last_peered":"2024-09-11T05:34:52.587469+0000","last_clean":"2024-09-11T05:34:48.623004+0000","last_became_active":"2024-09-11T05:34:51.881182+0000","last_became_peered":"2024-09-11T05:34:51.881182+0000","last_unstale":"2024-09-11T05:34:52.587469+0000","last_undegraded":"2024-09-11T05:34:52.587469+0000","last_fullsized":"2024-09-11T05:34:51.623473+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014807609999999999,"stat_sum":{"num_bytes":7697415,"num_objects":32,"num_object_clones":12,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":8,"num_read":1785,"num_read_kb":9393,"num_write":392,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":396,"num_bytes_recovered":10914094,"num_keys_recovered":66,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"2"}]},{"pgid":"3.b","version":"127'306","reported_seq":2449,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.791734+0000","last_change":"2024-09-11T05:34:52.792058+0000","last_active":"2024-09-11T05:34:52.791734+0000","last_peered":"2024-09-11T05:34:52.791734+0000","last_clean":"2024-09-11T05:34:52.791734+0000","last_became_active":"2024-09-11T05:34:13.622810+0000","last_became_peered":"2024-09-11T05:34:13.622810+0000","last_unstale":"2024-09-11T05:34:52.791734+0000","last_undegraded":"2024-09-11T05:34:52.791734+0000","last_fullsized":"2024-09-11T05:34:52.791734+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:17.920510+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.012055695,"stat_sum":{"num_bytes":13581172,"num_objects":22,"num_object_clones":5,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":9,"num_read":2261,"num_read_kb":23618,"num_write":297,"num_write_kb":16916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":14087582,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"3.c","version":"126'366","reported_seq":2726,"reported_epoch":126,"state":"peering","last_fresh":"2024-09-11T05:34:52.205836+0000","last_change":"2024-09-11T05:34:52.782653+0000","last_active":"2024-09-11T05:34:52.782653+0000","last_peered":"2024-09-11T05:34:52.205836+0000","last_clean":"2024-09-11T05:34:48.624590+0000","last_became_active":"2024-09-11T05:34:51.881359+0000","last_became_peered":"2024-09-11T05:34:51.881359+0000","last_unstale":"2024-09-11T05:34:52.205836+0000","last_undegraded":"2024-09-11T05:34:52.205836+0000","last_fullsized":"2024-09-11T05:34:51.625498+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010287961,"stat_sum":{"num_bytes":19337834,"num_objects":41,"num_object_clones":16,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":14,"num_read":1979,"num_read_kb":12030,"num_write":372,"num_write_kb":5272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":6119775,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,6],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"2"}]},{"pgid":"3.d","version":"126'450","reported_seq":5583,"reported_epoch":127,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-11T05:34:52.781890+0000","last_change":"2024-09-11T05:34:51.887645+0000","last_active":"2024-09-11T05:34:52.781890+0000","last_peered":"2024-09-11T05:34:52.781890+0000","last_clean":"2024-09-11T05:34:48.681579+0000","last_became_active":"2024-09-11T05:34:51.886325+0000","last_became_peered":"2024-09-11T05:34:51.886325+0000","last_unstale":"2024-09-11T05:34:52.781890+0000","last_undegraded":"2024-09-11T05:34:51.628553+0000","last_fullsized":"2024-09-11T05:34:51.625582+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0057718769999999999,"stat_sum":{"num_bytes":10305576,"num_objects":25,"num_object_clones":10,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":7,"num_read":5865,"num_read_kb":13697,"num_write":395,"num_write_kb":10315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":8883652,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":3},{"shards":"0,2","objects":22}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"2"}]},{"pgid":"3.e","version":"123'369","reported_seq":2711,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.789203+0000","last_change":"2024-09-11T05:34:52.789635+0000","last_active":"2024-09-11T05:34:52.789203+0000","last_peered":"2024-09-11T05:34:52.789203+0000","last_clean":"2024-09-11T05:34:52.789203+0000","last_became_active":"2024-09-11T05:34:38.742784+0000","last_became_peered":"2024-09-11T05:34:38.742784+0000","last_unstale":"2024-09-11T05:34:52.789203+0000","last_undegraded":"2024-09-11T05:34:52.789203+0000","last_fullsized":"2024-09-11T05:34:52.789203+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:03:58.953072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0074435489999999998,"stat_sum":{"num_bytes":14345825,"num_objects":33,"num_object_clones":11,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":12,"num_read":2125,"num_read_kb":12621,"num_write":321,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"3.f","version":"124'562","reported_seq":4606,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-11T05:34:52.787272+0000","last_change":"2024-09-11T05:34:52.789140+0000","last_active":"2024-09-11T05:34:52.787272+0000","last_peered":"2024-09-11T05:34:52.787272+0000","last_clean":"2024-09-11T05:34:52.787272+0000","last_became_active":"2024-09-11T05:34:48.626675+0000","last_became_peered":"2024-09-11T05:34:48.626675+0000","last_unstale":"2024-09-11T05:34:52.787272+0000","last_undegraded":"2024-09-11T05:34:52.787272+0000","last_fullsized":"2024-09-11T05:34:52.787272+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:40.294591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070740569999999999,"stat_sum":{"num_bytes":16777859,"num_objects":24,"num_object_clones":6,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":8,"num_read":5626,"num_read_kb":12054,"num_write":558,"num_write_kb":8278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":2111260,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"4"}]},{"pgid":"3.10","version":"117'345","reported_seq":5382,"reported_epoch":126,"state":"peering","last_fresh":"2024-09-11T05:34:52.092415+0000","last_change":"2024-09-11T05:34:52.781117+0000","last_active":"2024-09-11T05:34:52.781117+0000","last_peered":"2024-09-11T05:34:52.092415+0000","last_clean":"2024-09-11T05:34:48.622622+0000","last_became_active":"2024-09-11T05:34:51.878310+0000","last_became_peered":"2024-09-11T05:34:51.878310+0000","last_unstale":"2024-09-11T05:34:52.092415+0000","last_undegraded":"2024-09-11T05:34:52.092415+0000","last_fullsized":"2024-09-11T05:34:51.623525+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001575803,"stat_sum":{"num_bytes":16256667,"num_objects":34,"num_object_clones":15,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":17,"num_read":4943,"num_read_kb":12354,"num_write":291,"num_write_kb":4874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":3066244,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,6],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"2"}]},{"pgid":"3.11","version":"126'619","reported_seq":2090,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-11T05:34:52.456560+0000","last_change":"2024-09-11T05:34:52.989096+0000","last_active":"2024-09-11T05:34:52.989096+0000","last_peered":"2024-09-11T05:34:52.456560+0000","last_clean":"2024-09-11T05:34:41.828505+0000","last_became_active":"2024-09-11T05:34:51.889632+0000","last_became_peered":"2024-09-11T05:34:51.889632+0000","last_unstale":"2024-09-11T05:34:52.456560+0000","last_undegraded":"2024-09-11T05:34:52.456560+0000","last_fullsized":"2024-09-11T05:34:51.621826+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079830799999999996,"stat_sum":{"num_bytes":4864493,"num_objects":29,"num_object_clones":11,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":15,"num_read":2864,"num_read_kb":10990,"num_write":783,"num_write_kb":7583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":3434090,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"2"}]},{"pgid":"3.12","version":"121'595","reported_seq":11012,"reported_epoch":126,"state":"peering","last_fresh":"2024-09-11T05:34:52.329564+0000","last_change":"2024-09-11T05:34:52.782168+0000","last_active":"2024-09-11T05:34:52.782168+0000","last_peered":"2024-09-11T05:34:52.329564+0000","last_clean":"2024-09-11T05:34:48.631878+0000","last_became_active":"2024-09-11T05:34:51.884691+0000","last_became_peered":"2024-09-11T05:34:51.884691+0000","last_unstale":"2024-09-11T05:34:52.329564+0000","last_undegraded":"2024-09-11T05:34:52.329564+0000","last_fullsized":"2024-09-11T05:34:51.625109+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0044277830000000002,"stat_sum":{"num_bytes":8640825,"num_objects":20,"num_object_clones":7,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":9,"num_read":3076,"num_read_kb":7989,"num_write":734,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":6984484,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"2"}]},{"pgid":"3.13","version":"117'519","reported_seq":6199,"reported_epoch":127,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-11T05:34:52.783508+0000","last_change":"2024-09-11T05:34:51.888168+0000","last_active":"2024-09-11T05:34:52.783508+0000","last_peered":"2024-09-11T05:34:52.783508+0000","last_clean":"2024-09-11T05:34:48.624341+0000","last_became_active":"2024-09-11T05:34:51.886810+0000","last_became_peered":"2024-09-11T05:34:51.886810+0000","last_unstale":"2024-09-11T05:34:52.783508+0000","last_undegraded":"2024-09-11T05:34:51.625631+0000","last_fullsized":"2024-09-11T05:34:51.623743+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043461359999999996,"stat_sum":{"num_bytes":9998031,"num_objects":34,"num_object_clones":12,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":103,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":13,"num_read":6953,"num_read_kb":39071,"num_write":599,"num_write_kb":9923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":2904839,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0,2","objects":34}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"2"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":334215779,"num_objects":944,"num_object_clones":333,"num_object_copies":1888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":317,"num_objects_misplaced":129,"num_objects_unfound":0,"num_objects_dirty":944,"num_whiteouts":374,"num_read":217225,"num_read_kb":575595,"num_write":21138,"num_write_kb":315571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3848,"num_bytes_recovered":171383633,"num_keys_recovered":238,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":250503168,"data_stored":319632249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18145,"ondisk_log_size":18145,"up":64,"acting":59,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":60129542175,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542175,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84828,"kb_used_data":31424,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94287012,"statfs":{"total":96636764160,"available":96549900288,"internally_reserved":0,"allocated":32178176,"data_stored":46717763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94280,"kb_used_data":40876,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94277560,"statfs":{"total":96636764160,"available":96540221440,"internally_reserved":0,"allocated":41857024,"data_stored":64255854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,1],"upper_bound":4096},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":0,"seq":442381631495,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80772,"kb_used_data":31540,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94291068,"statfs":{"total":96636764160,"available":96554053632,"internally_reserved":0,"allocated":32296960,"data_stored":33927508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542173,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76512,"kb_used_data":31432,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94295328,"statfs":{"total":96636764160,"available":96558415872,"internally_reserved":0,"allocated":32186368,"data_stored":39963036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":60129542173,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542174,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109692,"kb_used_data":64608,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94262148,"statfs":{"total":96636764160,"available":96524439552,"internally_reserved":0,"allocated":66158592,"data_stored":99689897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60059648,"data_stored":75755086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19644416,"data_stored":29719696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29954048,"data_stored":38541469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31764480,"data_stored":34204121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":37314560,"data_stored":51224786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28262400,"data_stored":34268418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":43503616,"data_stored":55918673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:34:55.074 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg force-recovery 3.1d 3.1b 3.d 3.13 2024-09-11T05:34:55.093 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:55.093 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:55.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:55.148 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:55.147+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:55.204 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:55.204 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:55.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:55.255 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:55.254+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:55.350 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:55.349+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:55.356 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:55.357 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:55.366 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:55.389 INFO:teuthology.orchestra.run.smithi070.stderr:instructing pg(s) [3.d,3.13,3.1b,3.1d] on osd.0 to force-recovery; 2024-09-11T05:34:55.389 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T05:34:55.451 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:55.451+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:55.469 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:55.470 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:55.478 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:55.562 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:55.562+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:55.619 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T05:34:55.623 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:55.623 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:55.632 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:55.652 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:55.652+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:55.753 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:55.753+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:55.778 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:55.778 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:55.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:55.854 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:55.853+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:55.891 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:55.891 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:55.899 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:34:55.955 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:55.954+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:56.003 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:56.004 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:56.012 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:34:56.055 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:56.054+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:56.155 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:56.155 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:56.156 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:56.156+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:56.163 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:34:56.257 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:56.257+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:56.265 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:56.265 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:56.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:34:56.358 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:56.358+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:56.379 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:56.380 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:56.388 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:34:56.472 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:56.472+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:56.532 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:56.532 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:56.540 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:34:56.560 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:56.560+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:56.661 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:56.661+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:56.701 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:56.701 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:56.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:34:56.761 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:56.761+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:56.853 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:34:56.857 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:56.857 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:56.862 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:56.862+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:56.866 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:34:56.963 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:56.963+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:56.977 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:56.994 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:56.995 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:57.010 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:57.011 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:57.014 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:57.014 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:57.014 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:57.014 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:57.014 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:57.023 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:34:57.027 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:57.027 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:57.044 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:34:57.061 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:57.061 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:57.064 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:57.064+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:57.078 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:57.079 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:57.096 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:57.096 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:57.130 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:184170 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.208995063000003, 2024-09-11T05:34:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047293133000000001, 2024-09-11T05:34:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 184170 2024-09-11T05:34:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:34:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921808+0000", 2024-09-11T05:34:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001805868 2024-09-11T05:34:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921819+0000", 2024-09-11T05:34:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0458e-05 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921830+0000", 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1482e-05 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921837+0000", 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3709999999999996e-06 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967150+0000", 2024-09-11T05:34:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045313402000000003 2024-09-11T05:34:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967216+0000", 2024-09-11T05:34:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6322999999999995e-05 2024-09-11T05:34:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967296+0000", 2024-09-11T05:34:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9228999999999996e-05 2024-09-11T05:34:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185733 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3309568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.854962051000001, 2024-09-11T05:34:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047365106999999997, 2024-09-11T05:34:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185733 2024-09-11T05:34:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:34:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275806+0000", 2024-09-11T05:34:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001769966 2024-09-11T05:34:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275810+0000", 2024-09-11T05:34:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5539999999999999e-06 2024-09-11T05:34:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275821+0000", 2024-09-11T05:34:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1253999999999999e-05 2024-09-11T05:34:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275828+0000", 2024-09-11T05:34:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321211+0000", 2024-09-11T05:34:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045383053999999999 2024-09-11T05:34:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321306+0000", 2024-09-11T05:34:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4712999999999999e-05 2024-09-11T05:34:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321401+0000", 2024-09-11T05:34:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4825000000000001e-05 2024-09-11T05:34:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185743 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3719168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.852950215, 2024-09-11T05:34:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047361001999999999, 2024-09-11T05:34:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185743 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276048+0000", 2024-09-11T05:34:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:34:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276050+0000", 2024-09-11T05:34:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:34:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276056+0000", 2024-09-11T05:34:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:34:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276061+0000", 2024-09-11T05:34:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T05:34:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323215+0000", 2024-09-11T05:34:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047153977999999999 2024-09-11T05:34:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323278+0000", 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3053999999999996e-05 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323408+0000", 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013012899999999999 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185744 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3760128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.852929535000001, 2024-09-11T05:34:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047563095, 2024-09-11T05:34:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185744 2024-09-11T05:34:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:34:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277808+0000", 2024-09-11T05:34:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001739652 2024-09-11T05:34:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277816+0000", 2024-09-11T05:34:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.208e-06 2024-09-11T05:34:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277829+0000", 2024-09-11T05:34:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2848e-05 2024-09-11T05:34:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277837+0000", 2024-09-11T05:34:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6379999999999993e-06 2024-09-11T05:34:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323448+0000", 2024-09-11T05:34:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045610604999999999 2024-09-11T05:34:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323562+0000", 2024-09-11T05:34:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113706 2024-09-11T05:34:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323631+0000", 2024-09-11T05:34:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9437999999999995e-05 2024-09-11T05:34:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185753 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.850966489000001, 2024-09-11T05:34:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047283944000000001, 2024-09-11T05:34:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185753 2024-09-11T05:34:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:34:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:34:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278033+0000", 2024-09-11T05:34:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.237e-06 2024-09-11T05:34:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278036+0000", 2024-09-11T05:34:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:34:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278038+0000", 2024-09-11T05:34:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5490000000000001e-06 2024-09-11T05:34:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325140+0000", 2024-09-11T05:34:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047101845000000003 2024-09-11T05:34:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325219+0000", 2024-09-11T05:34:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9444999999999996e-05 2024-09-11T05:34:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325315+0000", 2024-09-11T05:34:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.569e-05 2024-09-11T05:34:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185754 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4169728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.850956590999999, 2024-09-11T05:34:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047450697, 2024-09-11T05:34:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185754 2024-09-11T05:34:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:34:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:34:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278043+0000", 2024-09-11T05:34:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:34:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278045+0000", 2024-09-11T05:34:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278048+0000", 2024-09-11T05:34:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5679999999999998e-06 2024-09-11T05:34:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325359+0000", 2024-09-11T05:34:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047311262 2024-09-11T05:34:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325421+0000", 2024-09-11T05:34:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1717999999999994e-05 2024-09-11T05:34:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325492+0000", 2024-09-11T05:34:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0716000000000005e-05 2024-09-11T05:34:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185755 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2125824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.850946524000001, 2024-09-11T05:34:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047669481999999999, 2024-09-11T05:34:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185755 2024-09-11T05:34:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:34:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:34:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278052+0000", 2024-09-11T05:34:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-11T05:34:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278055+0000", 2024-09-11T05:34:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8059999999999999e-06 2024-09-11T05:34:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278058+0000", 2024-09-11T05:34:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.503e-06 2024-09-11T05:34:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325563+0000", 2024-09-11T05:34:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047505316999999998 2024-09-11T05:34:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325645+0000", 2024-09-11T05:34:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2439000000000001e-05 2024-09-11T05:34:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325721+0000", 2024-09-11T05:34:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5092999999999994e-05 2024-09-11T05:34:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185756 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2166784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.850934193999997, 2024-09-11T05:34:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047861556, 2024-09-11T05:34:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185756 2024-09-11T05:34:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:34:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279805+0000", 2024-09-11T05:34:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001741586 2024-09-11T05:34:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279809+0000", 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0890000000000002e-06 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279816+0000", 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2060000000000001e-06 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279821+0000", 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6709999999999998e-06 2024-09-11T05:34:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325764+0000", 2024-09-11T05:34:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045942749999999997 2024-09-11T05:34:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325846+0000", 2024-09-11T05:34:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2470000000000002e-05 2024-09-11T05:34:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325925+0000", 2024-09-11T05:34:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8783999999999997e-05 2024-09-11T05:34:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185764 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2494464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.848970137999999, 2024-09-11T05:34:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308594000000002, 2024-09-11T05:34:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185764 2024-09-11T05:34:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:34:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280028+0000", 2024-09-11T05:34:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.27e-07 2024-09-11T05:34:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280030+0000", 2024-09-11T05:34:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3319999999999999e-06 2024-09-11T05:34:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280036+0000", 2024-09-11T05:34:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:34:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280041+0000", 2024-09-11T05:34:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7530000000000001e-06 2024-09-11T05:34:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327196+0000", 2024-09-11T05:34:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047154967999999998 2024-09-11T05:34:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327266+0000", 2024-09-11T05:34:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0427999999999997e-05 2024-09-11T05:34:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327336+0000", 2024-09-11T05:34:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9659000000000005e-05 2024-09-11T05:34:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185765 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2535424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.848950219000002, 2024-09-11T05:34:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047410790000000001, 2024-09-11T05:34:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185765 2024-09-11T05:34:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:34:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280048+0000", 2024-09-11T05:34:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T05:34:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280050+0000", 2024-09-11T05:34:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280056+0000", 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280061+0000", 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327369+0000", 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308416999999998 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327413+0000", 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070999999999999e-05 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327458+0000", 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4836000000000002e-05 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185766 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2576384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.848930228999997, 2024-09-11T05:34:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047571239000000001, 2024-09-11T05:34:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185766 2024-09-11T05:34:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:34:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280068+0000", 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280070+0000", 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280081+0000", 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0951999999999999e-05 2024-09-11T05:34:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280086+0000", 2024-09-11T05:34:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5029999999999997e-06 2024-09-11T05:34:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327495+0000", 2024-09-11T05:34:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047408497000000001 2024-09-11T05:34:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327568+0000", 2024-09-11T05:34:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3450999999999999e-05 2024-09-11T05:34:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327639+0000", 2024-09-11T05:34:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0309999999999996e-05 2024-09-11T05:34:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185767 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2617344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.848883092000001, 2024-09-11T05:34:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047672355, 2024-09-11T05:34:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185767 2024-09-11T05:34:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:34:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8999999999999996e-07 2024-09-11T05:34:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280121+0000", 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0599999999999996e-06 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280128+0000", 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1029999999999996e-06 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280133+0000", 2024-09-11T05:34:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T05:34:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327702+0000", 2024-09-11T05:34:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047568307999999997 2024-09-11T05:34:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327745+0000", 2024-09-11T05:34:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3407e-05 2024-09-11T05:34:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327787+0000", 2024-09-11T05:34:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1749000000000003e-05 2024-09-11T05:34:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185768 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2658304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.848855741000001, 2024-09-11T05:34:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047830091999999998, 2024-09-11T05:34:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185768 2024-09-11T05:34:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:34:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281805+0000", 2024-09-11T05:34:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016635809999999999 2024-09-11T05:34:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281810+0000", 2024-09-11T05:34:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3540000000000002e-06 2024-09-11T05:34:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281820+0000", 2024-09-11T05:34:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T05:34:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281828+0000", 2024-09-11T05:34:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327826+0000", 2024-09-11T05:34:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045998206999999999 2024-09-11T05:34:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327902+0000", 2024-09-11T05:34:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5761999999999997e-05 2024-09-11T05:34:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327972+0000", 2024-09-11T05:34:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0414999999999996e-05 2024-09-11T05:34:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185775 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2945024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.847061682000003, 2024-09-11T05:34:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047301277000000003, 2024-09-11T05:34:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185775 2024-09-11T05:34:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:34:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:34:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281938+0000", 2024-09-11T05:34:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5099999999999999e-06 2024-09-11T05:34:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281941+0000", 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-06 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281943+0000", 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.751e-06 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329092+0000", 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047148177999999999 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329166+0000", 2024-09-11T05:34:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4795000000000005e-05 2024-09-11T05:34:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329237+0000", 2024-09-11T05:34:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0864000000000005e-05 2024-09-11T05:34:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185777 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2985984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.847051252999997, 2024-09-11T05:34:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047500597999999998, 2024-09-11T05:34:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185777 2024-09-11T05:34:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:34:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281947+0000", 2024-09-11T05:34:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:34:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281948+0000", 2024-09-11T05:34:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1429999999999999e-06 2024-09-11T05:34:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281951+0000", 2024-09-11T05:34:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-11T05:34:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281953+0000", 2024-09-11T05:34:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6709999999999999e-06 2024-09-11T05:34:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329280+0000", 2024-09-11T05:34:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047326857999999999 2024-09-11T05:34:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329364+0000", 2024-09-11T05:34:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3586999999999998e-05 2024-09-11T05:34:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329447+0000", 2024-09-11T05:34:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3314999999999998e-05 2024-09-11T05:34:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185778 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3026944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.847041439999998, 2024-09-11T05:34:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047668384000000001, 2024-09-11T05:34:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185778 2024-09-11T05:34:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:34:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283808+0000", 2024-09-11T05:34:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018518919999999999 2024-09-11T05:34:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283812+0000", 2024-09-11T05:34:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:34:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283820+0000", 2024-09-11T05:34:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3319999999999992e-06 2024-09-11T05:34:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283825+0000", 2024-09-11T05:34:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8729999999999998e-06 2024-09-11T05:34:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329484+0000", 2024-09-11T05:34:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045658404999999999 2024-09-11T05:34:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329554+0000", 2024-09-11T05:34:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0099999999999996e-05 2024-09-11T05:34:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329625+0000", 2024-09-11T05:34:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0732e-05 2024-09-11T05:34:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185790 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2170880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.845056487000001, 2024-09-11T05:34:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047276674999999997, 2024-09-11T05:34:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185790 2024-09-11T05:34:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:34:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283942+0000", 2024-09-11T05:34:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283944+0000", 2024-09-11T05:34:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9800000000000001e-06 2024-09-11T05:34:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283948+0000", 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9729999999999999e-06 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283950+0000", 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7020000000000001e-06 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331076+0000", 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047126016 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331147+0000", 2024-09-11T05:34:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0848999999999999e-05 2024-09-11T05:34:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331218+0000", 2024-09-11T05:34:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0621e-05 2024-09-11T05:34:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185791 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3395584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.845030436999998, 2024-09-11T05:34:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047372307000000002, 2024-09-11T05:34:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185791 2024-09-11T05:34:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:34:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283968+0000", 2024-09-11T05:34:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:34:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283970+0000", 2024-09-11T05:34:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.199e-06 2024-09-11T05:34:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283976+0000", 2024-09-11T05:34:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T05:34:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283981+0000", 2024-09-11T05:34:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:34:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331252+0000", 2024-09-11T05:34:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047270999000000001 2024-09-11T05:34:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331299+0000", 2024-09-11T05:34:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7376999999999997e-05 2024-09-11T05:34:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331339+0000", 2024-09-11T05:34:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0428e-05 2024-09-11T05:34:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185792 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2211840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.845010539999997, 2024-09-11T05:34:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047522035999999997, 2024-09-11T05:34:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185792 2024-09-11T05:34:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:34:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T05:34:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283990+0000", 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283995+0000", 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3329999999999996e-06 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284002+0000", 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6120000000000001e-06 2024-09-11T05:34:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331373+0000", 2024-09-11T05:34:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047370269999999999 2024-09-11T05:34:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331442+0000", 2024-09-11T05:34:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8794999999999994e-05 2024-09-11T05:34:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331509+0000", 2024-09-11T05:34:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7570000000000005e-05 2024-09-11T05:34:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185793 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3436544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.844988440999998, 2024-09-11T05:34:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047706692000000002, 2024-09-11T05:34:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185793 2024-09-11T05:34:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285808+0000", 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001798352 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285812+0000", 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6399999999999996e-06 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285823+0000", 2024-09-11T05:34:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0783e-05 2024-09-11T05:34:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285831+0000", 2024-09-11T05:34:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:34:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331550+0000", 2024-09-11T05:34:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045719518000000001 2024-09-11T05:34:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331633+0000", 2024-09-11T05:34:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2992999999999996e-05 2024-09-11T05:34:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331716+0000", 2024-09-11T05:34:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2455999999999998e-05 2024-09-11T05:34:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.249 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:57.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:34:57.252 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:34:57.250+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:34:57.352 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:57.351+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:57.396 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:57.397 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:57.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:34:57.490 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:57.490+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:57.548 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:57.549 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:57.553 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:57.553+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:57.557 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:34:57.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:34:57.688 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:57.688+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:57.720 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116623 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13477888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829360206999993, 2024-09-11T05:34:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9661491070000001, 2024-09-11T05:34:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116623 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:34:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889573+0000", 2024-09-11T05:34:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889574+0000", 2024-09-11T05:34:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4810000000000001e-06 2024-09-11T05:34:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889578+0000", 2024-09-11T05:34:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T05:34:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889581+0000", 2024-09-11T05:34:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2380000000000002e-06 2024-09-11T05:34:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890367+0000", 2024-09-11T05:34:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078646599999999999 2024-09-11T05:34:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890377+0000", 2024-09-11T05:34:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5789999999999993e-06 2024-09-11T05:34:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829092+0000", 2024-09-11T05:34:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871527899999996 2024-09-11T05:34:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829101+0000", 2024-09-11T05:34:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:34:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854695+0000", 2024-09-11T05:34:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0255937369999999 2024-09-11T05:34:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854786+0000", 2024-09-11T05:34:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1831999999999998e-05 2024-09-11T05:34:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855721+0000", 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093499800000000004 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116624 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13502464~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829346360000002, 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9664307189999999, 2024-09-11T05:34:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116624 2024-09-11T05:34:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:34:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889587+0000", 2024-09-11T05:34:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:34:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889588+0000", 2024-09-11T05:34:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T05:34:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889592+0000", 2024-09-11T05:34:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.472e-06 2024-09-11T05:34:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889594+0000", 2024-09-11T05:34:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T05:34:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890405+0000", 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00081088199999999997 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890410+0000", 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999996e-06 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829131+0000", 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93872118999999998 2024-09-11T05:34:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829138+0000", 2024-09-11T05:34:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1760000000000004e-06 2024-09-11T05:34:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855755+0000", 2024-09-11T05:34:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026616722 2024-09-11T05:34:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855872+0000", 2024-09-11T05:34:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116927 2024-09-11T05:34:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856017+0000", 2024-09-11T05:34:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145313 2024-09-11T05:34:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116625 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13527040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829335141000001, 2024-09-11T05:34:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9666986180000001, 2024-09-11T05:34:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116625 2024-09-11T05:34:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:34:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889598+0000", 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889599+0000", 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.144e-06 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889602+0000", 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889604+0000", 2024-09-11T05:34:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7640000000000001e-06 2024-09-11T05:34:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890442+0000", 2024-09-11T05:34:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083777099999999996 2024-09-11T05:34:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890452+0000", 2024-09-11T05:34:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5559999999999996e-06 2024-09-11T05:34:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829170+0000", 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871818900000004 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829177+0000", 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7220000000000002e-06 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856046+0000", 2024-09-11T05:34:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026868943 2024-09-11T05:34:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856144+0000", 2024-09-11T05:34:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8684999999999995e-05 2024-09-11T05:34:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856296+0000", 2024-09-11T05:34:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151667 2024-09-11T05:34:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116626 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13551616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829324370999998, 2024-09-11T05:34:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.96707056, 2024-09-11T05:34:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116626 2024-09-11T05:34:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:34:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889610+0000", 2024-09-11T05:34:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.186e-06 2024-09-11T05:34:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889613+0000", 2024-09-11T05:34:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T05:34:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889615+0000", 2024-09-11T05:34:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:34:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890487+0000", 2024-09-11T05:34:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087202600000000003 2024-09-11T05:34:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890492+0000", 2024-09-11T05:34:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:34:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829202+0000", 2024-09-11T05:34:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871036299999999 2024-09-11T05:34:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829209+0000", 2024-09-11T05:34:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7669999999999998e-06 2024-09-11T05:34:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856327+0000", 2024-09-11T05:34:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027118465 2024-09-11T05:34:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856525+0000", 2024-09-11T05:34:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019825499999999999 2024-09-11T05:34:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856679+0000", 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015328 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116627 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13576192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829314486000001, 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9673406419999999, 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116627 2024-09-11T05:34:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:34:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:34:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889619+0000", 2024-09-11T05:34:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.093e-06 2024-09-11T05:34:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889622+0000", 2024-09-11T05:34:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T05:34:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889625+0000", 2024-09-11T05:34:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:34:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890528+0000", 2024-09-11T05:34:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000902804 2024-09-11T05:34:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890537+0000", 2024-09-11T05:34:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2029999999999998e-06 2024-09-11T05:34:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829232+0000", 2024-09-11T05:34:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93869459799999999 2024-09-11T05:34:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829238+0000", 2024-09-11T05:34:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6699999999999997e-06 2024-09-11T05:34:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856709+0000", 2024-09-11T05:34:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027470925 2024-09-11T05:34:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856815+0000", 2024-09-11T05:34:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010566899999999999 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856959+0000", 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000143752 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116628 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13600768~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829290490999995, 2024-09-11T05:34:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9676105420000001, 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116628 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889644+0000", 2024-09-11T05:34:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:34:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889647+0000", 2024-09-11T05:34:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3950000000000001e-06 2024-09-11T05:34:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889650+0000", 2024-09-11T05:34:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:34:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890570+0000", 2024-09-11T05:34:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092007999999999999 2024-09-11T05:34:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890577+0000", 2024-09-11T05:34:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.764e-06 2024-09-11T05:34:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829261+0000", 2024-09-11T05:34:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93868468500000002 2024-09-11T05:34:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829268+0000", 2024-09-11T05:34:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T05:34:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857004+0000", 2024-09-11T05:34:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027736043 2024-09-11T05:34:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857102+0000", 2024-09-11T05:34:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8066999999999995e-05 2024-09-11T05:34:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857253+0000", 2024-09-11T05:34:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015050400000000001 2024-09-11T05:34:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116629 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13625344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829273979999996, 2024-09-11T05:34:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967906154, 2024-09-11T05:34:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116629 2024-09-11T05:34:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:34:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-07 2024-09-11T05:34:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889660+0000", 2024-09-11T05:34:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5650000000000001e-06 2024-09-11T05:34:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889664+0000", 2024-09-11T05:34:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4000000000000001e-06 2024-09-11T05:34:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889666+0000", 2024-09-11T05:34:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:34:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890614+0000", 2024-09-11T05:34:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00094762999999999998 2024-09-11T05:34:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890621+0000", 2024-09-11T05:34:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.379e-06 2024-09-11T05:34:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829291+0000", 2024-09-11T05:34:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866938499999997 2024-09-11T05:34:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829298+0000", 2024-09-11T05:34:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6610000000000003e-06 2024-09-11T05:34:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857284+0000", 2024-09-11T05:34:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027986522 2024-09-11T05:34:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857393+0000", 2024-09-11T05:34:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109054 2024-09-11T05:34:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857565+0000", 2024-09-11T05:34:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017160999999999999 2024-09-11T05:34:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116843 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12595200~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829262757999999, 2024-09-11T05:34:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9682605290000001, 2024-09-11T05:34:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116843 2024-09-11T05:34:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:34:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889671+0000", 2024-09-11T05:34:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-11T05:34:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889674+0000", 2024-09-11T05:34:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.005e-06 2024-09-11T05:34:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889677+0000", 2024-09-11T05:34:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T05:34:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890648+0000", 2024-09-11T05:34:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097103399999999996 2024-09-11T05:34:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890652+0000", 2024-09-11T05:34:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0790000000000002e-06 2024-09-11T05:34:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829320+0000", 2024-09-11T05:34:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866793199999998 2024-09-11T05:34:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829327+0000", 2024-09-11T05:34:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5529999999999998e-06 2024-09-11T05:34:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857596+0000", 2024-09-11T05:34:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028269125 2024-09-11T05:34:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857834+0000", 2024-09-11T05:34:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023784300000000001 2024-09-11T05:34:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857930+0000", 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6704000000000001e-05 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116844 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12619776~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829252566999997, 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9685250679999999, 2024-09-11T05:34:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116844 2024-09-11T05:34:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889681+0000", 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.229e-06 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889684+0000", 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0130000000000002e-06 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889687+0000", 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7259999999999998e-06 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890685+0000", 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099783399999999996 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890695+0000", 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829349+0000", 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865456300000005 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829356+0000", 2024-09-11T05:34:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5130000000000002e-06 2024-09-11T05:34:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857959+0000", 2024-09-11T05:34:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0286034959999999 2024-09-11T05:34:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858057+0000", 2024-09-11T05:34:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8097999999999995e-05 2024-09-11T05:34:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858205+0000", 2024-09-11T05:34:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147732 2024-09-11T05:34:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116845 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12644352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829242334, 2024-09-11T05:34:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968783033, 2024-09-11T05:34:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116845 2024-09-11T05:34:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:34:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889692+0000", 2024-09-11T05:34:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2330000000000001e-06 2024-09-11T05:34:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889695+0000", 2024-09-11T05:34:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9249999999999999e-06 2024-09-11T05:34:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889697+0000", 2024-09-11T05:34:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:34:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890719+0000", 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010218429999999999 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890723+0000", 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829378+0000", 2024-09-11T05:34:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865562000000002 2024-09-11T05:34:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829385+0000", 2024-09-11T05:34:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4579999999999998e-06 2024-09-11T05:34:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858234+0000", 2024-09-11T05:34:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028849288 2024-09-11T05:34:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858337+0000", 2024-09-11T05:34:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102371 2024-09-11T05:34:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858473+0000", 2024-09-11T05:34:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013669299999999999 2024-09-11T05:34:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116846 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12668928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829219409000004, 2024-09-11T05:34:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.969056522, 2024-09-11T05:34:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116846 2024-09-11T05:34:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:34:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-07 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889715+0000", 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.482e-06 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889718+0000", 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889721+0000", 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890762+0000", 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010413659999999999 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890772+0000", 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5750000000000007e-06 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829407+0000", 2024-09-11T05:34:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93863550699999998 2024-09-11T05:34:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829414+0000", 2024-09-11T05:34:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5640000000000002e-06 2024-09-11T05:34:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858502+0000", 2024-09-11T05:34:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0290880099999999 2024-09-11T05:34:57.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858634+0000", 2024-09-11T05:34:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013173199999999999 2024-09-11T05:34:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858770+0000", 2024-09-11T05:34:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135943 2024-09-11T05:34:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116847 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12693504~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829189721000006, 2024-09-11T05:34:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9692923329999998, 2024-09-11T05:34:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116847 2024-09-11T05:34:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889747+0000", 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.501e-06 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889753+0000", 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1360000000000002e-06 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889756+0000", 2024-09-11T05:34:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3110000000000001e-06 2024-09-11T05:34:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890808+0000", 2024-09-11T05:34:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010523240000000001 2024-09-11T05:34:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890813+0000", 2024-09-11T05:34:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5650000000000003e-06 2024-09-11T05:34:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829436+0000", 2024-09-11T05:34:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93862351799999999 2024-09-11T05:34:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829443+0000", 2024-09-11T05:34:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5220000000000004e-06 2024-09-11T05:34:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858798+0000", 2024-09-11T05:34:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029354903 2024-09-11T05:34:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858899+0000", 2024-09-11T05:34:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101414 2024-09-11T05:34:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859035+0000", 2024-09-11T05:34:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013589 2024-09-11T05:34:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116848 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12718080~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829173036, 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9695514759999999, 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116848 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889760+0000", 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889761+0000", 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.189e-06 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889764+0000", 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889766+0000", 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890850+0000", 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010835479999999999 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890857+0000", 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6299999999999998e-06 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829465+0000", 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860787000000001 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829472+0000", 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4420000000000003e-06 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859062+0000", 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0295903360000001 2024-09-11T05:34:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859169+0000", 2024-09-11T05:34:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010674400000000001 2024-09-11T05:34:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859311+0000", 2024-09-11T05:34:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014209499999999999 2024-09-11T05:34:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116849 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12742656~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829163249999993, 2024-09-11T05:34:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9698160310000001, 2024-09-11T05:34:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116849 2024-09-11T05:34:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:34:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889771+0000", 2024-09-11T05:34:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:34:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889774+0000", 2024-09-11T05:34:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:34:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889776+0000", 2024-09-11T05:34:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.638e-06 2024-09-11T05:34:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890886+0000", 2024-09-11T05:34:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011102519999999999 2024-09-11T05:34:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890891+0000", 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2200000000000003e-06 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829494+0000", 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860342500000005 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829501+0000", 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4829999999999996e-06 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859339+0000", 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0298381320000001 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859440+0000", 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010145 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859585+0000", 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014513300000000001 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116850 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12767232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829142223999995, 2024-09-11T05:34:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970125645, 2024-09-11T05:34:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116850 2024-09-11T05:34:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:34:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889791+0000", 2024-09-11T05:34:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:34:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889792+0000", 2024-09-11T05:34:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4899999999999999e-06 2024-09-11T05:34:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889795+0000", 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889798+0000", 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7089999999999998e-06 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890924+0000", 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001125685 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890933+0000", 2024-09-11T05:34:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3340000000000008e-06 2024-09-11T05:34:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829523+0000", 2024-09-11T05:34:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858966099999996 2024-09-11T05:34:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829529+0000", 2024-09-11T05:34:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5740000000000001e-06 2024-09-11T05:34:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859614+0000", 2024-09-11T05:34:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0300843289999999 2024-09-11T05:34:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859743+0000", 2024-09-11T05:34:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129407 2024-09-11T05:34:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859916+0000", 2024-09-11T05:34:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017282500000000001 2024-09-11T05:34:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116851 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12791808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829102354, 2024-09-11T05:34:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970347268, 2024-09-11T05:34:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116851 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:34:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:34:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889832+0000", 2024-09-11T05:34:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6819999999999999e-06 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889838+0000", 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889841+0000", 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890957+0000", 2024-09-11T05:34:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001115956 2024-09-11T05:34:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890961+0000", 2024-09-11T05:34:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7050000000000001e-06 2024-09-11T05:34:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829552+0000", 2024-09-11T05:34:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93859101499999997 2024-09-11T05:34:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829558+0000", 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5429999999999999e-06 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859947+0000", 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030388248 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860043+0000", 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5847999999999994e-05 2024-09-11T05:34:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860177+0000", 2024-09-11T05:34:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013484400000000001 2024-09-11T05:34:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116852 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12816384~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829087743000002, 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970594859, 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116852 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:34:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:34:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889846+0000", 2024-09-11T05:34:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.204e-06 2024-09-11T05:34:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889849+0000", 2024-09-11T05:34:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.931e-06 2024-09-11T05:34:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889852+0000", 2024-09-11T05:34:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:34:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890993+0000", 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001141176 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891001+0000", 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5259999999999996e-06 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829582+0000", 2024-09-11T05:34:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858050800000004 2024-09-11T05:34:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829588+0000", 2024-09-11T05:34:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4980000000000003e-06 2024-09-11T05:34:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860207+0000", 2024-09-11T05:34:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030618713 2024-09-11T05:34:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860305+0000", 2024-09-11T05:34:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8209999999999997e-05 2024-09-11T05:34:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860440+0000", 2024-09-11T05:34:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134692 2024-09-11T05:34:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116853 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12840960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829077025000004, 2024-09-11T05:34:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.97084075, 2024-09-11T05:34:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116853 2024-09-11T05:34:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:34:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889856+0000", 2024-09-11T05:34:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:34:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889857+0000", 2024-09-11T05:34:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.435e-06 2024-09-11T05:34:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889860+0000", 2024-09-11T05:34:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9620000000000002e-06 2024-09-11T05:34:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889863+0000", 2024-09-11T05:34:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T05:34:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891036+0000", 2024-09-11T05:34:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011734580000000001 2024-09-11T05:34:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891042+0000", 2024-09-11T05:34:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3290000000000001e-06 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829611+0000", 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856954299999995 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829618+0000", 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860465+0000", 2024-09-11T05:34:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0308472500000001 2024-09-11T05:34:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860558+0000", 2024-09-11T05:34:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3253999999999999e-05 2024-09-11T05:34:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860696+0000", 2024-09-11T05:34:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138169 2024-09-11T05:34:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116854 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12865536~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829066834000002, 2024-09-11T05:34:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9710979320000002, 2024-09-11T05:34:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116854 2024-09-11T05:34:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:34:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:34:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889867+0000", 2024-09-11T05:34:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.155e-06 2024-09-11T05:34:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889871+0000", 2024-09-11T05:34:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9260000000000002e-06 2024-09-11T05:34:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889875+0000", 2024-09-11T05:34:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.262e-06 2024-09-11T05:34:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891070+0000", 2024-09-11T05:34:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011945160000000001 2024-09-11T05:34:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891079+0000", 2024-09-11T05:34:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3759999999999997e-06 2024-09-11T05:34:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829642+0000", 2024-09-11T05:34:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856325900000004 2024-09-11T05:34:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829649+0000", 2024-09-11T05:34:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:34:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860726+0000", 2024-09-11T05:34:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.031076791 2024-09-11T05:34:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860831+0000", 2024-09-11T05:34:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105003 2024-09-11T05:34:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860964+0000", 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013285700000000001 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116855 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12890112~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.829052054000002, 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.971277814, 2024-09-11T05:34:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116855 2024-09-11T05:34:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817809+0000", 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.92792850999999998 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817815+0000", 2024-09-11T05:34:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4110000000000001e-06 2024-09-11T05:34:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817827+0000", 2024-09-11T05:34:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2031000000000001e-05 2024-09-11T05:34:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817837+0000", 2024-09-11T05:34:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2159999999999995e-06 2024-09-11T05:34:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829673+0000", 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011836197 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829679+0000", 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5390000000000004e-06 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861000+0000", 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0313209539999999 2024-09-11T05:34:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861080+0000", 2024-09-11T05:34:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9606999999999999e-05 2024-09-11T05:34:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861158+0000", 2024-09-11T05:34:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8349000000000005e-05 2024-09-11T05:34:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:57.845 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:57.846 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:34:57.847 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:57.845+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:57.947 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:57.947+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:57.992 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:57.992 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:57.993 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:34:57.993 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:58.001 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:34:58.048 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:34:58.048+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:34:58.145 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:58.145 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:34:58.145 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:34:58.145 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:34:58.145 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:58.148 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:58.148+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:58.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:34:58.249 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:58.249+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:58.299 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:34:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:34:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:34:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:34:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.299 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 132.707673723, 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:34:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:34:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:34:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:34:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:34:58.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:34:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:34:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:34:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:34:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.130738463, 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:34:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:34:58.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:34:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:34:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.130719663999997, 2024-09-11T05:34:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:34:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:34:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:34:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:34:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:34:58.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:34:58.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.130695633000002, 2024-09-11T05:34:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:34:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:34:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:34:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:34:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:34:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:34:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:34:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:34:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:34:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:34:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:34:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:34:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:34:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:34:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:34:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:34:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.130618845000001, 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.319 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:34:58.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:34:58.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:34:58.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:34:58.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:34:58.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:34:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:34:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:34:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:34:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:34:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:34:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:34:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:34:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:34:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.324 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:58.324 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.130591522000003, 2024-09-11T05:34:58.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:34:58.324 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:34:58.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.324 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:58.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:58.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:34:58.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:34:58.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:34:58.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:34:58.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:34:58.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:34:58.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:34:58.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:34:58.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:34:58.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:34:58.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:34:58.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:34:58.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:34:58.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:34:58.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.328 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.328 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.328 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:58.328 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.130572974000003, 2024-09-11T05:34:58.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:34:58.329 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:34:58.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.329 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:34:58.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:34:58.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:34:58.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:34:58.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:34:58.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:34:58.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:34:58.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:34:58.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:34:58.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:34:58.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:34:58.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:34:58.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:34:58.333 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.333 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.333 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.333 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.333 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:58.333 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.130554903000004, 2024-09-11T05:34:58.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:34:58.334 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.334 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:34:58.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.334 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:58.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:34:58.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:34:58.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:34:58.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:34:58.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:34:58.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:34:58.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:34:58.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:34:58.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:34:58.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:34:58.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.338 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.338 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.338 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:58.338 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.128957260000007, 2024-09-11T05:34:58.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:34:58.338 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.338 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.338 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.339 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:34:58.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.339 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:58.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:34:58.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:34:58.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:34:58.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:34:58.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:34:58.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:34:58.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:34:58.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:34:58.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:34:58.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:34:58.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:34:58.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:34:58.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:34:58.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:34:58.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:34:58.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.343 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.343 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.343 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:58.343 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.128936933999995, 2024-09-11T05:34:58.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:34:58.344 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:34:58.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.344 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:58.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:58.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:34:58.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:58.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:34:58.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:34:58.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:34:58.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:34:58.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:34:58.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:34:58.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:34:58.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:34:58.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:34:58.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:34:58.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:34:58.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:34:58.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.348 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.348 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.349 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:58.349 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.128897936000001, 2024-09-11T05:34:58.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:34:58.349 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:34:58.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.350 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:58.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:58.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:34:58.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:34:58.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:34:58.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:34:58.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:34:58.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:34:58.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:34:58.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:34:58.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:34:58.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:34:58.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:34:58.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:34:58.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:34:58.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:34:58.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.353 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.354 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.354 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:58.354 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.128877294000006, 2024-09-11T05:34:58.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:34:58.354 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.354 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.354 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.355 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:34:58.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.355 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:58.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:34:58.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:34:58.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:34:58.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:34:58.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:34:58.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:34:58.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:34:58.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:34:58.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:58.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:34:58.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:34:58.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:34:58.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:34:58.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:34:58.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:34:58.358 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.358 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.358 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.359 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.359 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:58.359 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.128754431000004, 2024-09-11T05:34:58.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:34:58.359 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.359 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.359 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.359 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.359 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.359 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.359 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:34:58.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.360 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:58.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:34:58.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:34:58.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:34:58.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:34:58.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:34:58.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:34:58.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:34:58.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:34:58.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:34:58.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:34:58.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:34:58.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.128594874000001, 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:58.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:34:58.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:34:58.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:34:58.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:34:58.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:34:58.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:34:58.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:34:58.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:34:58.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:34:58.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:34:58.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:34:58.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.368 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.368 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.368 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:58.368 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.126910206999995, 2024-09-11T05:34:58.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:34:58.368 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:34:58.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.369 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:58.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:34:58.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:34:58.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:34:58.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:34:58.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:34:58.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:34:58.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:34:58.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:34:58.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:34:58.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:34:58.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:34:58.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:34:58.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:34:58.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:34:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:34:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.126882202000004, 2024-09-11T05:34:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:34:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:34:58.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:34:58.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:34:58.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:34:58.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:34:58.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:34:58.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:34:58.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:34:58.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:34:58.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:34:58.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:34:58.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:34:58.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:34:58.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:34:58.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:34:58.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.377 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.378 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.378 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:58.378 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.125415739000005, 2024-09-11T05:34:58.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:34:58.378 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.378 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:34:58.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.379 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:58.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:34:58.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:34:58.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:34:58.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:34:58.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:34:58.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:34:58.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:34:58.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:34:58.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:34:58.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:34:58.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:34:58.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.125230438000003, 2024-09-11T05:34:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:34:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:34:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:58.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:34:58.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:34:58.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:34:58.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:34:58.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:34:58.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:34:58.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:34:58.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:34:58.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:34:58.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:34:58.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:34:58.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:34:58.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:34:58.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:34:58.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:34:58.387 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.387 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.387 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.388 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:34:58.388 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:58.388 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.125058983000002, 2024-09-11T05:34:58.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:34:58.388 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:34:58.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.388 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:34:58.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.389 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:58.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:34:58.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:34:58.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:34:58.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:34:58.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:34:58.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:34:58.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:34:58.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:34:58.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:34:58.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:34:58.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:34:58.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.392 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:194030 3.11 3:8c0c7139:::rbd_object_map.112d3507140b:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-11T05:34:58.393 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:52.789587+0000", 2024-09-11T05:34:58.393 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.5083392849999999, 2024-09-11T05:34:58.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.002511178, 2024-09-11T05:34:58.393 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:34:58.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:34:58.393 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:34:58.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:34:58.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:34:58.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 194030 2024-09-11T05:34:58.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.393 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:34:58.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:34:58.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789587+0000", 2024-09-11T05:34:58.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:34:58.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789587+0000", 2024-09-11T05:34:58.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:34:58.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:34:58.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789589+0000", 2024-09-11T05:34:58.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5120000000000001e-06 2024-09-11T05:34:58.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:34:58.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789594+0000", 2024-09-11T05:34:58.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4920000000000001e-06 2024-09-11T05:34:58.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:34:58.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789605+0000", 2024-09-11T05:34:58.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0795000000000001e-05 2024-09-11T05:34:58.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789612+0000", 2024-09-11T05:34:58.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8340000000000001e-06 2024-09-11T05:34:58.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.790925+0000", 2024-09-11T05:34:58.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001312847 2024-09-11T05:34:58.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:34:58.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.790938+0000", 2024-09-11T05:34:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3192e-05 2024-09-11T05:34:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:34:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.789344+0000", 2024-09-11T05:34:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99840615499999996 2024-09-11T05:34:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:34:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.789491+0000", 2024-09-11T05:34:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014679299999999999 2024-09-11T05:34:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T05:34:58.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.789679+0000", 2024-09-11T05:34:58.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018818099999999999 2024-09-11T05:34:58.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:34:58.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.790923+0000", 2024-09-11T05:34:58.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012436820000000001 2024-09-11T05:34:58.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:34:58.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.791981+0000", 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010581570000000001 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.792055+0000", 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3749000000000002e-05 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.792099+0000", 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3788999999999997e-05 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:34:58.400 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:34:58.400 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:34:58.401 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:34:58.401 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:58.401+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:58.502 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:58.502+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:58.513 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:58.513 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:58.514 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:58.522 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:34:58.603 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:58.603+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:58.623 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T05:34:58.686 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:58.686 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:58.686 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:58.686 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:58.686 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:58.696 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:34:58.704 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:58.704+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:58.805 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:34:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:34:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:34:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183598 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8097792~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.062081411999998, 2024-09-11T05:34:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038436577999999999, 2024-09-11T05:34:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.807 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183598 2024-09-11T05:34:58.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.807 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.807 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.807 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.807 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:58.807 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.807 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.807 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.807 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:34:58.807 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.808 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.808 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.808 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742042+0000", 2024-09-11T05:34:58.808 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:34:58.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.808 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.808 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.808 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742044+0000", 2024-09-11T05:34:58.808 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.119e-06 2024-09-11T05:34:58.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.808 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.808 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.808 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742049+0000", 2024-09-11T05:34:58.809 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6710000000000004e-06 2024-09-11T05:34:58.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.809 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.809 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.809 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742054+0000", 2024-09-11T05:34:58.809 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:34:58.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.809 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.809 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.810 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780385+0000", 2024-09-11T05:34:58.810 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038330831000000003 2024-09-11T05:34:58.810 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.810 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.810 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.810 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780435+0000", 2024-09-11T05:34:58.810 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0018999999999997e-05 2024-09-11T05:34:58.810 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.810 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.810 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.810 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780478+0000", 2024-09-11T05:34:58.810 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2823e-05 2024-09-11T05:34:58.810 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.811 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.811 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.811 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.811 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183599 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6750208~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.811 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:58.811 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.062062619000002, 2024-09-11T05:34:58.811 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038610453000000003, 2024-09-11T05:34:58.811 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.811 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.811 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.811 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.811 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.812 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.812 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183599 2024-09-11T05:34:58.812 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.812 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.812 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.812 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.812 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:58.812 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.812 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.812 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.812 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.812 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:34:58.812 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.813 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.813 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.813 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.813 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742061+0000", 2024-09-11T05:34:58.813 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2200000000000004e-07 2024-09-11T05:34:58.813 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.813 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.813 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.813 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742063+0000", 2024-09-11T05:34:58.814 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:34:58.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.814 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.814 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.814 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742068+0000", 2024-09-11T05:34:58.814 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6389999999999997e-06 2024-09-11T05:34:58.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.814 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.814 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.814 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742073+0000", 2024-09-11T05:34:58.814 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6990000000000002e-06 2024-09-11T05:34:58.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.814 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.815 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.815 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780516+0000", 2024-09-11T05:34:58.815 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038443428000000002 2024-09-11T05:34:58.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.815 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.815 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.815 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780601+0000", 2024-09-11T05:34:58.815 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4618999999999997e-05 2024-09-11T05:34:58.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.815 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.815 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.815 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780670+0000", 2024-09-11T05:34:58.816 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9593999999999998e-05 2024-09-11T05:34:58.816 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.816 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.816 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.816 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.816 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183600 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8138752~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.816 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:58.816 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.062043803999998, 2024-09-11T05:34:58.816 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038699900000000002, 2024-09-11T05:34:58.816 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.816 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.817 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.817 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.817 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.817 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.817 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183600 2024-09-11T05:34:58.817 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.817 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.817 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.817 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.817 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:58.817 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.817 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.817 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.818 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.818 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:58.818 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.818 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.818 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.818 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.818 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:34:58.818 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:34:58.818 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.818 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.818 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.818 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742081+0000", 2024-09-11T05:34:58.818 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.086e-06 2024-09-11T05:34:58.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.819 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.819 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.819 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742087+0000", 2024-09-11T05:34:58.819 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4770000000000002e-06 2024-09-11T05:34:58.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.819 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.819 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.819 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742092+0000", 2024-09-11T05:34:58.819 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7190000000000001e-06 2024-09-11T05:34:58.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.819 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.819 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.820 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780697+0000", 2024-09-11T05:34:58.820 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038605577000000002 2024-09-11T05:34:58.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.820 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.820 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.820 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780740+0000", 2024-09-11T05:34:58.820 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3139999999999997e-05 2024-09-11T05:34:58.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.820 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.820 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780779+0000", 2024-09-11T05:34:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8473000000000002e-05 2024-09-11T05:34:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183601 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6791168~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.062025775000002, 2024-09-11T05:34:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038869364000000003, 2024-09-11T05:34:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.822 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.822 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.822 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.822 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.822 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.823 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183601 2024-09-11T05:34:58.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.823 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.823 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.823 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.824 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:58.824 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.824 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.824 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.824 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.824 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:58.825 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.825 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.825 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.825 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:34:58.825 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9900000000000002e-07 2024-09-11T05:34:58.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.825 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.825 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.825 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742099+0000", 2024-09-11T05:34:58.825 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:34:58.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.825 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742105+0000", 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0759999999999999e-06 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742110+0000", 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6600000000000003e-06 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780809+0000", 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038698681999999998 2024-09-11T05:34:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.827 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.827 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.827 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780886+0000", 2024-09-11T05:34:58.827 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7888999999999999e-05 2024-09-11T05:34:58.827 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.827 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.827 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.827 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780966+0000", 2024-09-11T05:34:58.827 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9797999999999997e-05 2024-09-11T05:34:58.827 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.827 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.827 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.827 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183602 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8179712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.062006955999998, 2024-09-11T05:34:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038955028000000003, 2024-09-11T05:34:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183602 2024-09-11T05:34:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:34:58.830 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:34:58.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.830 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.830 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.830 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742122+0000", 2024-09-11T05:34:58.830 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9880000000000001e-06 2024-09-11T05:34:58.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.830 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.830 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.830 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742128+0000", 2024-09-11T05:34:58.830 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2600000000000002e-06 2024-09-11T05:34:58.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.830 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.831 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.831 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742133+0000", 2024-09-11T05:34:58.831 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9010000000000002e-06 2024-09-11T05:34:58.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.831 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.831 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.831 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780981+0000", 2024-09-11T05:34:58.831 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038848102000000002 2024-09-11T05:34:58.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.831 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.831 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.831 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781024+0000", 2024-09-11T05:34:58.831 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2231000000000003e-05 2024-09-11T05:34:58.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.832 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.832 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.832 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781071+0000", 2024-09-11T05:34:58.832 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7215000000000001e-05 2024-09-11T05:34:58.832 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.832 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.832 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.832 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.832 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183603 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6832128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.832 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:58.832 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.061983329999997, 2024-09-11T05:34:58.833 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039121378999999998, 2024-09-11T05:34:58.833 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.833 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.833 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.833 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.833 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.833 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.833 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183603 2024-09-11T05:34:58.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.833 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.833 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.833 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.833 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:58.834 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.834 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.834 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.834 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:34:58.834 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.834 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.834 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.834 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742215+0000", 2024-09-11T05:34:58.834 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5419000000000004e-05 2024-09-11T05:34:58.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.834 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.835 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.835 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742218+0000", 2024-09-11T05:34:58.835 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0989999999999999e-06 2024-09-11T05:34:58.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.835 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.835 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.835 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742225+0000", 2024-09-11T05:34:58.835 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4019999999999996e-06 2024-09-11T05:34:58.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.835 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.835 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.835 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742231+0000", 2024-09-11T05:34:58.835 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6969999999999998e-06 2024-09-11T05:34:58.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.836 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.836 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.836 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781102+0000", 2024-09-11T05:34:58.836 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038871348 2024-09-11T05:34:58.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.836 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.836 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.836 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781187+0000", 2024-09-11T05:34:58.836 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4719e-05 2024-09-11T05:34:58.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.836 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.836 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.837 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781261+0000", 2024-09-11T05:34:58.837 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3695000000000005e-05 2024-09-11T05:34:58.837 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.837 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.837 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.837 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.837 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183604 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8220672~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.837 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:58.837 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.061882769999997, 2024-09-11T05:34:58.837 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039154538000000003, 2024-09-11T05:34:58.837 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.837 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.838 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.838 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.838 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.838 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.838 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183604 2024-09-11T05:34:58.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.838 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.838 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.838 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.838 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:58.838 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743491+0000", 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0012514620000000001 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743496+0000", 2024-09-11T05:34:58.839 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2910000000000001e-06 2024-09-11T05:34:58.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.840 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.840 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743506+0000", 2024-09-11T05:34:58.840 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0039e-05 2024-09-11T05:34:58.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.840 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.840 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743513+0000", 2024-09-11T05:34:58.840 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:34:58.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.840 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781296+0000", 2024-09-11T05:34:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037783187000000003 2024-09-11T05:34:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781347+0000", 2024-09-11T05:34:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1375000000000002e-05 2024-09-11T05:34:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781394+0000", 2024-09-11T05:34:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119000000000001e-05 2024-09-11T05:34:58.841 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.842 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.842 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.842 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.842 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.842 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183609 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6955008~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.842 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:58.842 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.060487915000003, 2024-09-11T05:34:58.842 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038553630999999998, 2024-09-11T05:34:58.842 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.842 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.842 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.842 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.843 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.843 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.843 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183609 2024-09-11T05:34:58.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.843 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.843 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.843 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.843 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:58.843 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.843 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.843 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:58.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.844 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.844 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:34:58.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.15e-07 2024-09-11T05:34:58.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.844 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.844 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743637+0000", 2024-09-11T05:34:58.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.86e-06 2024-09-11T05:34:58.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743641+0000", 2024-09-11T05:34:58.845 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7000000000000002e-06 2024-09-11T05:34:58.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743645+0000", 2024-09-11T05:34:58.845 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9600000000000002e-06 2024-09-11T05:34:58.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.846 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782023+0000", 2024-09-11T05:34:58.846 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038378520999999999 2024-09-11T05:34:58.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.846 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.846 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.846 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782119+0000", 2024-09-11T05:34:58.846 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5665e-05 2024-09-11T05:34:58.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.846 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.846 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.846 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782188+0000", 2024-09-11T05:34:58.846 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9610000000000006e-05 2024-09-11T05:34:58.846 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.847 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.847 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.847 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.847 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183610 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8343552~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.847 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:58.847 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.060474337000002, 2024-09-11T05:34:58.847 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038675859, 2024-09-11T05:34:58.847 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.847 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.847 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.847 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.847 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.848 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.848 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183610 2024-09-11T05:34:58.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.848 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.848 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.848 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.848 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:58.848 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.848 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.848 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.848 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:34:58.848 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743649+0000", 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-07 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743650+0000", 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5799999999999999e-06 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743656+0000", 2024-09-11T05:34:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:34:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743660+0000", 2024-09-11T05:34:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4259999999999999e-06 2024-09-11T05:34:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782218+0000", 2024-09-11T05:34:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038558508999999998 2024-09-11T05:34:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782270+0000", 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.168e-05 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782324+0000", 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4388999999999997e-05 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183611 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6995968~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.060459444999999, 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038861554999999999, 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183611 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.852 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4299999999999999e-07 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.853 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743665+0000", 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5060000000000001e-06 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743668+0000", 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1549999999999999e-06 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743671+0000", 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7599999999999998e-06 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.854 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782359+0000", 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038687946000000001 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782437+0000", 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8539000000000001e-05 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782525+0000", 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7405999999999996e-05 2024-09-11T05:34:58.855 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183612 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8384512~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.060448276000002, 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039040111000000002, 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.856 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183612 2024-09-11T05:34:58.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.857 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.857 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.857 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.857 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:58.857 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.857 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.857 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.857 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:34:58.857 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.857 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743675+0000", 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2100000000000001e-07 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743676+0000", 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.212e-06 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743679+0000", 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.858 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.859 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743681+0000", 2024-09-11T05:34:58.859 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.604e-06 2024-09-11T05:34:58.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.859 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.859 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782560+0000", 2024-09-11T05:34:58.859 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038878687000000002 2024-09-11T05:34:58.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.859 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.859 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782644+0000", 2024-09-11T05:34:58.859 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3733000000000006e-05 2024-09-11T05:34:58.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.860 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.860 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782714+0000", 2024-09-11T05:34:58.860 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0655999999999996e-05 2024-09-11T05:34:58.860 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.860 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.860 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.860 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183613 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7036928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.860 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:58.860 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.060438243, 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039233924000000003, 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183613 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:58.861 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745489+0000", 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0018047549999999999 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.862 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745493+0000", 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0439999999999997e-06 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745501+0000", 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745507+0000", 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9490000000000001e-06 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782756+0000", 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037249522 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782839+0000", 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3133999999999994e-05 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782918+0000", 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9167999999999998e-05 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.864 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.865 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.865 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183622 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7323648~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.865 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:58.865 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.058479828000003, 2024-09-11T05:34:58.865 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038618008000000002, 2024-09-11T05:34:58.865 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.865 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.865 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.865 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.865 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.865 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.865 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183622 2024-09-11T05:34:58.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.866 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.866 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.866 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:58.866 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.866 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.866 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:58.866 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.867 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.867 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:34:58.867 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4900000000000001e-07 2024-09-11T05:34:58.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.867 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.867 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.867 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745645+0000", 2024-09-11T05:34:58.867 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9709999999999998e-06 2024-09-11T05:34:58.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.867 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.867 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.867 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745651+0000", 2024-09-11T05:34:58.868 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.251e-06 2024-09-11T05:34:58.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.868 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.868 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.868 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745657+0000", 2024-09-11T05:34:58.868 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:34:58.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.868 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.868 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.868 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784095+0000", 2024-09-11T05:34:58.868 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038437791999999998 2024-09-11T05:34:58.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.868 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784201+0000", 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000106801 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784261+0000", 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9475999999999998e-05 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.869 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183623 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4296704~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.870 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:58.870 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.058459644000003, 2024-09-11T05:34:58.870 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038730705999999997, 2024-09-11T05:34:58.870 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.870 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.870 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.870 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.870 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.870 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.870 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183623 2024-09-11T05:34:58.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.870 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.870 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.871 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.871 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:58.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.871 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.871 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:58.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.871 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.871 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:34:58.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.39e-07 2024-09-11T05:34:58.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.872 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.872 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.872 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745665+0000", 2024-09-11T05:34:58.872 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9860000000000001e-06 2024-09-11T05:34:58.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.872 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.872 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.872 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745671+0000", 2024-09-11T05:34:58.872 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.818e-06 2024-09-11T05:34:58.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.872 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.872 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.873 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745676+0000", 2024-09-11T05:34:58.873 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.972e-06 2024-09-11T05:34:58.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.873 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.873 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.873 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784296+0000", 2024-09-11T05:34:58.873 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038620131000000002 2024-09-11T05:34:58.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.873 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.873 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.873 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784353+0000", 2024-09-11T05:34:58.873 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6644999999999997e-05 2024-09-11T05:34:58.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784394+0000", 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0815000000000001e-05 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183624 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7364608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.058440767, 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038826315, 2024-09-11T05:34:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183624 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745684+0000", 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0980000000000001e-06 2024-09-11T05:34:58.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.877 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.877 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.877 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745690+0000", 2024-09-11T05:34:58.877 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.733e-06 2024-09-11T05:34:58.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.877 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.877 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.877 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745695+0000", 2024-09-11T05:34:58.877 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:34:58.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.877 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.877 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.877 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784418+0000", 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038722813000000002 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784460+0000", 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2222999999999999e-05 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784508+0000", 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8349000000000001e-05 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.878 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183625 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4337664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.058421058999997, 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923776, 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183625 2024-09-11T05:34:58.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:34:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.41e-07 2024-09-11T05:34:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745713+0000", 2024-09-11T05:34:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0579e-05 2024-09-11T05:34:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745719+0000", 2024-09-11T05:34:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4540000000000004e-06 2024-09-11T05:34:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745724+0000", 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1170000000000003e-06 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784532+0000", 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038807618000000002 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784586+0000", 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4432999999999999e-05 2024-09-11T05:34:58.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.883 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.883 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784625+0000", 2024-09-11T05:34:58.883 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9233999999999997e-05 2024-09-11T05:34:58.883 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.883 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.883 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.883 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183626 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.058391397000001, 2024-09-11T05:34:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038934147000000002, 2024-09-11T05:34:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183626 2024-09-11T05:34:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.884 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:58.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:34:58.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745732+0000", 2024-09-11T05:34:58.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745734+0000", 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9649999999999998e-06 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745739+0000", 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.806e-06 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745744+0000", 2024-09-11T05:34:58.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5210000000000004e-06 2024-09-11T05:34:58.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784660+0000", 2024-09-11T05:34:58.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038916077 2024-09-11T05:34:58.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784665+0000", 2024-09-11T05:34:58.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3929999999999999e-06 2024-09-11T05:34:58.887 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.887 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.888 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.888 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183627 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.888 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:58.888 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.058372878999997, 2024-09-11T05:34:58.888 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038942282000000002, 2024-09-11T05:34:58.888 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.888 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.888 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:58.888 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.888 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.888 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.889 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183627 2024-09-11T05:34:58.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.889 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:58.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:58.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:34:58.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:34:58.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745752+0000", 2024-09-11T05:34:58.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9e-06 2024-09-11T05:34:58.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745758+0000", 2024-09-11T05:34:58.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6899999999999997e-06 2024-09-11T05:34:58.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.891 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745763+0000", 2024-09-11T05:34:58.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9169999999999997e-06 2024-09-11T05:34:58.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.891 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784686+0000", 2024-09-11T05:34:58.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923874999999997 2024-09-11T05:34:58.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784692+0000", 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5600000000000001e-06 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183628 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.058334268000003, 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038927438000000002, 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.892 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.893 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:58.893 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.893 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.893 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.893 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183628 2024-09-11T05:34:58.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.893 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:58.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:34:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745789+0000", 2024-09-11T05:34:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3000000000000002e-07 2024-09-11T05:34:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745791+0000", 2024-09-11T05:34:58.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0209999999999998e-06 2024-09-11T05:34:58.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745802+0000", 2024-09-11T05:34:58.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0886e-05 2024-09-11T05:34:58.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745806+0000", 2024-09-11T05:34:58.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0289999999999999e-06 2024-09-11T05:34:58.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784712+0000", 2024-09-11T05:34:58.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038905922000000003 2024-09-11T05:34:58.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.896 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784716+0000", 2024-09-11T05:34:58.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.25e-06 2024-09-11T05:34:58.896 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.896 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.896 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.897 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183629 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:34:58.897 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:58.897 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 47.058312551, 2024-09-11T05:34:58.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038954874, 2024-09-11T05:34:58.897 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:34:58.897 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:34:58.897 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:34:58.897 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:34:58.897 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:34:58.897 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:34:58.897 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183629 2024-09-11T05:34:58.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.897 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747489+0000", 2024-09-11T05:34:58.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0016785529999999999 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747493+0000", 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0600000000000001e-06 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747501+0000", 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9109999999999993e-06 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:34:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747507+0000", 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3899999999999998e-06 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784760+0000", 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037253197000000002 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784765+0000", 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.763e-06 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.900 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.901 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:34:58.901 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:34:58.901 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:58.901 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:58.804+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:58.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:34:58.905 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:58.905+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:59.006 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:59.006+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:59.047 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:59.047 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:59.047 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:34:59.047 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:59.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:34:59.107 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:34:59.107 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:59.106+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:59.199 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:34:59.199 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:34:59.199 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:34:59.199 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:34:59.199 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:34:59.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:34:59.209 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:59.208+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:59.227 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:34:59.228 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:34:59.244 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:34:59.244 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:34:59.260 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:34:59.260 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:34:59.275 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:34:59.276 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:34:59.292 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:34:59.292 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:34:59.308 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:34:59.308 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:34:59.309 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:34:59.309+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:34:59.324 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:34:59.324 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:34:59.341 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:34:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:34:59.352 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:59.352 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:59.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:34:59.410 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:34:59.409+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:34:59.503 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:59.503 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:59.511 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:34:59.510+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:34:59.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:34:59.612 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:59.612+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:59.615 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:59.615 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:59.624 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:34:59.713 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:34:59.711+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:34:59.770 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:59.770 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:59.779 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:34:59.813 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:34:59.812+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:34:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:34:59.890 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:34:59.933 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:34:59.933+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:34:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:34:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:00.001 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:35:00.015 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:00.014+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:00.116 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:35:00.115+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:35:00.144 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:00.144 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:00.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:35:00.217 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:00.217+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:00.259 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:00.259 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:00.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:35:00.318 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:00.317+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:00.370 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:00.371 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:00.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:35:00.403 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 5, 6, 3] out_osds: [4, 7, 1] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-09-11T05:35:00.403 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:35:00.403 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T05:35:00.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T05:35:00.421 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:00.419+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:00.520 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:00.520+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:00.527 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:00.527 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:00.537 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:35:00.621 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:00.621+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:00.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:35:00.654 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:00.655 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:00.666 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:35:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:35:00.747 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 135, 2024-09-11T05:35:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "eb5ff116-0384-4170-94d3-d3ddcb9c254f", 2024-09-11T05:35:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T05:32:25.817911+0000", 2024-09-11T05:35:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T05:35:00.624610+0000", 2024-09-11T05:35:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T05:34:28.684725+0000", 2024-09-11T05:35:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T05:34:49.621078+0000", 2024-09-11T05:35:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T05:35:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5806080, 2024-09-11T05:35:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T05:35:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2024-09-11T05:35:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "noscrub", 2024-09-11T05:35:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T05:35:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T05:35:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T05:35:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T05:35:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:35:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 6, 2024-09-11T05:35:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T05:35:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T05:35:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T05:35:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T05:35:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T05:35:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T05:35:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T05:35:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "jewel", 2024-09-11T05:35:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T05:35:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T05:35:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T05:35:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T05:35:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T05:35:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:37.977484+0000", 2024-09-11T05:35:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T05:35:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T05:35:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:35:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:35:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:35:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:35:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:35:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:35:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:35:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:35:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:35:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:35:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:35:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T05:35:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "17", 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:35:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:35:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:35:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:35:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:35:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T05:35:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T05:35:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:35:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:35:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:35:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:35:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:35:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:35:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:35:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:35:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:35:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:35:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:35:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:35:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:35:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:35:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:35:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:35:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:35:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 6.9000000953674316, 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 6.9000000953674316, 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.28999999165534973, 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T05:35:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T05:35:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.76237106323242188, 2024-09-11T05:35:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-11T05:35:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.75999999046325684 2024-09-11T05:35:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T05:35:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T05:35:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:43.780723+0000", 2024-09-11T05:35:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T05:35:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:35:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:35:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:35:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:35:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:35:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:35:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:35:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:35:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:35:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:35:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:35:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:35:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T05:35:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T05:35:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T05:35:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T05:35:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T05:35:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:35:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:35:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:35:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:35:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:35:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:35:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:35:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "21", 2024-09-11T05:35:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:35:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:35:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 21, 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:35:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:35:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:35:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:35:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:35:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:35:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:35:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:35:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:35:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:35:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:35:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:35:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:35:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:35:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 3.5199999809265137, 2024-09-11T05:35:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 3.5199999809265137, 2024-09-11T05:35:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.70999997854232788, 2024-09-11T05:35:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2.5, 2024-09-11T05:35:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2.5, 2024-09-11T05:35:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.76237106323242188, 2024-09-11T05:35:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-11T05:35:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.75999999046325684 2024-09-11T05:35:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T05:32:53.728195+0000", 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T05:35:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T05:35:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T05:35:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T05:35:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T05:35:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T05:35:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T05:35:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T05:35:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T05:35:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T05:35:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T05:35:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T05:35:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T05:35:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "135", 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 44, 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 135, 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T05:35:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T05:35:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T05:35:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T05:35:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T05:35:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T05:35:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T05:35:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T05:35:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T05:35:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T05:35:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T05:35:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T05:35:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T05:35:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T05:35:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T05:35:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T05:35:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T05:35:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T05:35:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T05:35:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T05:35:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 2.8599998950958252, 2024-09-11T05:35:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 2.8599998950958252, 2024-09-11T05:35:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.70999997854232788, 2024-09-11T05:35:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2.0299999713897705, 2024-09-11T05:35:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2.0299999713897705, 2024-09-11T05:35:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.76237106323242188, 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.75999999046325684 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "6ef7487b-9326-4062-8fe4-ef39030252bd", 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:35:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:35:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:35:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:35:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 128, 2024-09-11T05:35:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:35:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:35:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:35:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T05:35:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:35:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T05:35:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:35:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:35:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T05:35:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:35:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T05:35:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:35:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:35:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T05:35:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:35:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T05:35:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:35:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:35:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T05:35:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:35:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T05:35:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108497907 2024-09-11T05:35:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6819/4108497907", 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6821/4108497907", 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6825/4108497907", 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6823/4108497907", 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "3e0d8348-6e1b-4d63-b0f1-c20d90d73760", 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 0, 2024-09-11T05:35:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0, 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 120, 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:35:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T05:35:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:35:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:35:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T05:35:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:35:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T05:35:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:35:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:35:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T05:35:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:35:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T05:35:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:35:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:35:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3979396531 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/3979396531", 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/3979396531", 2024-09-11T05:35:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/3979396531", 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/3979396531", 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "38bbb42f-85e2-4064-8f55-e0385aff07d4", 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0, 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:35:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 126, 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T05:35:00.785 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T05:35:00.786 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T05:35:00.787 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:35:00.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.788 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.788 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:35:00.788 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.788 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T05:35:00.788 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:35:00.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.788 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T05:35:00.789 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4053894977 2024-09-11T05:35:00.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.789 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.789 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6811/4053894977", 2024-09-11T05:35:00.789 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6813/4053894977", 2024-09-11T05:35:00.789 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6817/4053894977", 2024-09-11T05:35:00.789 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6815/4053894977", 2024-09-11T05:35:00.789 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:35:00.789 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:35:00.789 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:35:00.789 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "e96ca529-f3b3-4f7e-bd59-1e9872a5efab", 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.098968505859375, 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 128, 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:35:00.790 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:35:00.791 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.791 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T05:35:00.791 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:35:00.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.791 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T05:35:00.791 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:35:00.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.791 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.792 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:35:00.792 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.792 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T05:35:00.792 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:35:00.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.792 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T05:35:00.792 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:35:00.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.792 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.793 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:35:00.793 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.793 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6832", 2024-09-11T05:35:00.793 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:35:00.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.793 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6833", 2024-09-11T05:35:00.793 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:35:00.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.794 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.794 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:35:00.794 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.794 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.794 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T05:35:00.794 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:35:00.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.794 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.794 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T05:35:00.794 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2067624829 2024-09-11T05:35:00.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.795 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6827/2067624829", 2024-09-11T05:35:00.795 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6829/2067624829", 2024-09-11T05:35:00.795 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6833/2067624829", 2024-09-11T05:35:00.795 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6831/2067624829", 2024-09-11T05:35:00.795 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:35:00.795 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:35:00.795 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:35:00.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.796 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T05:35:00.796 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dbbde660-d90e-4e02-9a01-16b0f76aa2b8", 2024-09-11T05:35:00.796 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:35:00.796 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 0, 2024-09-11T05:35:00.796 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0, 2024-09-11T05:35:00.796 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:35:00.796 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 14, 2024-09-11T05:35:00.796 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 74, 2024-09-11T05:35:00.796 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 103, 2024-09-11T05:35:00.796 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 18, 2024-09-11T05:35:00.796 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 76, 2024-09-11T05:35:00.796 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:35:00.796 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6816", 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108789898 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6817", 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108789898 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.797 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:35:00.798 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.798 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.798 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6818", 2024-09-11T05:35:00.798 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108789898 2024-09-11T05:35:00.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.798 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.798 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6819", 2024-09-11T05:35:00.798 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108789898 2024-09-11T05:35:00.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.798 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6822", 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108789898 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6823", 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108789898 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6820", 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108789898 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6821", 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4108789898 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6817/4108789898", 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6819/4108789898", 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6823/4108789898", 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6821/4108789898", 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "2dc1a002-3ec0-4b4d-b84d-e684fa8a9131", 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:35:00.801 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 128, 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6824", 2024-09-11T05:35:00.802 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6825", 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6826", 2024-09-11T05:35:00.803 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:35:00.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.804 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.804 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6827", 2024-09-11T05:35:00.804 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:35:00.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.804 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.804 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:35:00.804 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.804 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.804 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6830", 2024-09-11T05:35:00.805 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:35:00.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.805 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6831", 2024-09-11T05:35:00.805 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:35:00.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.805 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.805 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:35:00.805 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.806 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6828", 2024-09-11T05:35:00.806 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:35:00.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.806 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.806 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6829", 2024-09-11T05:35:00.806 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2732588656 2024-09-11T05:35:00.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.806 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.806 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6825/2732588656", 2024-09-11T05:35:00.806 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6827/2732588656", 2024-09-11T05:35:00.806 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6831/2732588656", 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6829/2732588656", 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a", 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:35:00.807 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 127, 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6800", 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6801", 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6802", 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.810 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6803", 2024-09-11T05:35:00.810 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:35:00.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.810 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.810 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:35:00.810 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.810 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.810 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6806", 2024-09-11T05:35:00.810 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:35:00.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6807", 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6804", 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.812 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6805", 2024-09-11T05:35:00.812 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 372011645 2024-09-11T05:35:00.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.812 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.812 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6801/372011645", 2024-09-11T05:35:00.812 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6803/372011645", 2024-09-11T05:35:00.812 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6807/372011645", 2024-09-11T05:35:00.812 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6805/372011645", 2024-09-11T05:35:00.812 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:35:00.812 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:35:00.812 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:35:00.813 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.813 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T05:35:00.813 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "5fef4450-317c-4e1f-b05b-80740b9538f1", 2024-09-11T05:35:00.813 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T05:35:00.813 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 0, 2024-09-11T05:35:00.813 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0, 2024-09-11T05:35:00.813 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T05:35:00.813 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T05:35:00.813 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T05:35:00.813 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T05:35:00.813 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 66, 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6808", 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6809", 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:35:00.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6810", 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6811", 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:35:00.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.816 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.816 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T05:35:00.816 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.816 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6814", 2024-09-11T05:35:00.816 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:35:00.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.816 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6815", 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6812", 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T05:35:00.817 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.84:6813", 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 583221652 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.84:6809/583221652", 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.84:6811/583221652", 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.84:6815/583221652", 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.84:6813/583221652", 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.818 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:35:00.819 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T05:35:00.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.819 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T05:35:00.819 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:35:00.819 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:35:00.819 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:35:00.819 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:35:00.819 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:35:00.819 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.130019+0000", 2024-09-11T05:35:00.819 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:35:00.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.819 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T05:35:00.820 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:35:00.820 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:35:00.820 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:35:00.820 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:35:00.820 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 65536, 2024-09-11T05:35:00.820 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.339373+0000", 2024-09-11T05:35:00.820 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:35:00.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.820 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T05:35:00.820 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.204705+0000", 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:35:00.821 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:35:00.822 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.075490+0000", 2024-09-11T05:35:00.822 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:35:00.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.822 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T05:35:00.822 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:35:00.822 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:35:00.822 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:35:00.822 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:35:00.823 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 65536, 2024-09-11T05:35:00.823 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.279790+0000", 2024-09-11T05:35:00.823 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 76 2024-09-11T05:35:00.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.823 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T05:35:00.823 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:35:00.823 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:35:00.823 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:35:00.823 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:35:00.823 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:35:00.823 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:35.287168+0000", 2024-09-11T05:35:00.823 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:35:00.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.824 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T05:35:00.824 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:35:00.824 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:35:00.824 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:35:00.824 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:35:00.824 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T05:35:00.824 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:34.320448+0000", 2024-09-11T05:35:00.824 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:35:00.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.824 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T05:35:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T05:35:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T05:35:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T05:35:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T05:35:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 65536, 2024-09-11T05:35:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T05:32:34.838001+0000", 2024-09-11T05:35:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T05:35:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:35:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [], 2024-09-11T05:35:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [], 2024-09-11T05:35:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T05:35:00.825 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T05:35:00.826 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T05:35:00.826 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T05:35:00.826 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T05:35:00.826 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T05:35:00.826 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T05:35:00.826 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T05:35:00.826 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T05:35:00.826 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T05:35:00.826 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [ 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 10, 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 8 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.827 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [ 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 10, 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T05:35:00.828 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T05:35:00.829 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T05:35:00.829 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T05:35:00.829 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T05:35:00.829 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T05:35:00.829 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T05:35:00.829 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T05:35:00.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:00.829 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:00.829 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:00.745+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:00.831 INFO:tasks.thrashosds.thrasher:j is {'epoch': 135, 'fsid': 'eb5ff116-0384-4170-94d3-d3ddcb9c254f', 'created': '2024-09-11T05:32:25.817911+0000', 'modified': '2024-09-11T05:35:00.624610+0000', 'last_up_change': '2024-09-11T05:34:28.684725+0000', 'last_in_change': '2024-09-11T05:34:49.621078+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T05:32:37.977484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7623710632324219, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.7599999904632568}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T05:32:43.780723+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.5199999809265137, 'score_stable': 3.5199999809265137, 'optimal_score': 0.7099999785423279, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 0.7623710632324219, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.7599999904632568}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T05:32:53.728195+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 44, 'snap_epoch': 135, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.859999895095825, 'score_stable': 2.859999895095825, 'optimal_score': 0.7099999785423279, 'raw_score_acting': 2.0299999713897705, 'raw_score_stable': 2.0299999713897705, 'primary_affinity_weighted': 0.7623710632324219, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.7599999904632568}}], 'osds': [{'osd': 0, 'uuid': '6ef7487b-9326-4062-8fe4-ef39030252bd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 128, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 4108497907}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 4108497907}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 4108497907}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 4108497907}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 4108497907}]}, 'public_addr': '172.21.15.70:6819/4108497907', 'cluster_addr': '172.21.15.70:6821/4108497907', 'heartbeat_back_addr': '172.21.15.70:6825/4108497907', 'heartbeat_front_addr': '172.21.15.70:6823/4108497907', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '3e0d8348-6e1b-4d63-b0f1-c20d90d73760', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 120, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 3979396531}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 3979396531}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 3979396531}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 3979396531}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 3979396531}]}, 'public_addr': '172.21.15.70:6801/3979396531', 'cluster_addr': '172.21.15.70:6803/3979396531', 'heartbeat_back_addr': '172.21.15.70:6807/3979396531', 'heartbeat_front_addr': '172.21.15.70:6805/3979396531', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '38bbb42f-85e2-4064-8f55-e0385aff07d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 126, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 4053894977}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 4053894977}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 4053894977}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 4053894977}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 4053894977}]}, 'public_addr': '172.21.15.70:6811/4053894977', 'cluster_addr': '172.21.15.70:6813/4053894977', 'heartbeat_back_addr': '172.21.15.70:6817/4053894977', 'heartbeat_front_addr': '172.21.15.70:6815/4053894977', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e96ca529-f3b3-4f7e-bd59-1e9872a5efab', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.098968505859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 128, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2067624829}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2067624829}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6832', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6833', 'nonce': 2067624829}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2067624829}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2067624829}]}, 'public_addr': '172.21.15.70:6827/2067624829', 'cluster_addr': '172.21.15.70:6829/2067624829', 'heartbeat_back_addr': '172.21.15.70:6833/2067624829', 'heartbeat_front_addr': '172.21.15.70:6831/2067624829', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'dbbde660-d90e-4e02-9a01-16b0f76aa2b8', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 74, 'up_from': 103, 'up_thru': 18, 'down_at': 76, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6816', 'nonce': 4108789898}, {'type': 'v1', 'addr': '172.21.15.84:6817', 'nonce': 4108789898}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6818', 'nonce': 4108789898}, {'type': 'v1', 'addr': '172.21.15.84:6819', 'nonce': 4108789898}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6822', 'nonce': 4108789898}, {'type': 'v1', 'addr': '172.21.15.84:6823', 'nonce': 4108789898}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6820', 'nonce': 4108789898}, {'type': 'v1', 'addr': '172.21.15.84:6821', 'nonce': 4108789898}]}, 'public_addr': '172.21.15.84:6817/4108789898', 'cluster_addr': '172.21.15.84:6819/4108789898', 'heartbeat_back_addr': '172.21.15.84:6823/4108789898', 'heartbeat_front_addr': '172.21.15.84:6821/4108789898', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2dc1a002-3ec0-4b4d-b84d-e684fa8a9131', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 128, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6824', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6825', 'nonce': 2732588656}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6826', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6827', 'nonce': 2732588656}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6830', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6831', 'nonce': 2732588656}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6828', 'nonce': 2732588656}, {'type': 'v1', 'addr': '172.21.15.84:6829', 'nonce': 2732588656}]}, 'public_addr': '172.21.15.84:6825/2732588656', 'cluster_addr': '172.21.15.84:6827/2732588656', 'heartbeat_back_addr': '172.21.15.84:6831/2732588656', 'heartbeat_front_addr': '172.21.15.84:6829/2732588656', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 127, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6800', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6801', 'nonce': 372011645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6802', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6803', 'nonce': 372011645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6806', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6807', 'nonce': 372011645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6804', 'nonce': 372011645}, {'type': 'v1', 'addr': '172.21.15.84:6805', 'nonce': 372011645}]}, 'public_addr': '172.21.15.84:6801/372011645', 'cluster_addr': '172.21.15.84:6803/372011645', 'heartbeat_back_addr': '172.21.15.84:6807/372011645', 'heartbeat_front_addr': '172.21.15.84:6805/372011645', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '5fef4450-317c-4e1f-b05b-80740b9538f1', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6808', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6809', 'nonce': 583221652}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6810', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6811', 'nonce': 583221652}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6814', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6815', 'nonce': 583221652}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6812', 'nonce': 583221652}, {'type': 'v1', 'addr': '172.21.15.84:6813', 'nonce': 583221652}]}, 'public_addr': '172.21.15.84:6809/583221652', 'cluster_addr': '172.21.15.84:6811/583221652', 'heartbeat_back_addr': '172.21.15.84:6815/583221652', 'heartbeat_front_addr': '172.21.15.84:6813/583221652', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.130019+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.339373+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.204705+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.075490+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.279790+0000', 'dead_epoch': 76}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:35.287168+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T05:32:34.320448+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T05:32:34.838001+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 10, 'length': 8}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 10, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T05:35:00.831 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:35:00.844 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:00.845 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:00.845 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:35:00.843+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:35:00.854 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:35:00.934 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:00.934+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:01.002 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:01.002 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:01.011 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:35:01.035 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:01.035+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:01.114 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:01.114 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:01.123 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:35:01.132 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:35:01.132 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:35:01.136 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:35:01.134+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:35:01.143 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-09-11T05:35:00.626210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":210713832,"num_objects":798,"num_object_clones":279,"num_object_copies":1596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":798,"num_whiteouts":353,"num_read":218421,"num_read_kb":576617,"num_write":21514,"num_write_kb":318044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4328,"num_bytes_recovered":182103293,"num_keys_recovered":238,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18602,"ondisk_log_size":18602,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":338092,"kb_used_data":83564,"kb_used_omap":7,"kb_used_meta":254392,"kb_avail":471521108,"statfs":{"total":483183820800,"available":482837614592,"internally_reserved":0,"allocated":85569536,"data_stored":103806176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7972,"internal_metadata":260497628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-124092334,"num_objects":-150,"num_object_clones":-54,"num_object_copies":-300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-317,"num_objects_misplaced":-129,"num_objects_unfound":0,"num_objects_dirty":-150,"num_whiteouts":-21,"num_read":1080,"num_read_kb":922,"num_write":215,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":473,"num_bytes_recovered":10129235,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.005145"},"pg_stats":[{"pgid":"3.1f","version":"131'577","reported_seq":7290,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.635035+0000","last_change":"2024-09-11T05:34:57.635774+0000","last_active":"2024-09-11T05:34:57.635035+0000","last_peered":"2024-09-11T05:34:57.635035+0000","last_clean":"2024-09-11T05:34:57.635035+0000","last_became_active":"2024-09-11T05:34:48.625234+0000","last_became_peered":"2024-09-11T05:34:48.625234+0000","last_unstale":"2024-09-11T05:34:57.635035+0000","last_undegraded":"2024-09-11T05:34:57.635035+0000","last_fullsized":"2024-09-11T05:34:57.635035+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:19.728294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068564200000000002,"stat_sum":{"num_bytes":3979244,"num_objects":19,"num_object_clones":4,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":9,"num_read":7694,"num_read_kb":22545,"num_write":734,"num_write_kb":11140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":4324235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1e","version":"132'277","reported_seq":3633,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.702456+0000","last_change":"2024-09-11T05:34:57.636837+0000","last_active":"2024-09-11T05:34:57.702456+0000","last_peered":"2024-09-11T05:34:57.702456+0000","last_clean":"2024-09-11T05:34:57.702456+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:34:57.702456+0000","last_undegraded":"2024-09-11T05:34:57.702456+0000","last_fullsized":"2024-09-11T05:34:57.702456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:15:25.847108+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0079659459999999998,"stat_sum":{"num_bytes":16914488,"num_objects":27,"num_object_clones":7,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":15,"num_read":3027,"num_read_kb":23842,"num_write":226,"num_write_kb":6198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1d","version":"132'890","reported_seq":21554,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.628667+0000","last_change":"2024-09-11T05:34:57.628667+0000","last_active":"2024-09-11T05:34:57.628667+0000","last_peered":"2024-09-11T05:34:57.628667+0000","last_clean":"2024-09-11T05:34:57.628667+0000","last_became_active":"2024-09-11T05:34:54.792973+0000","last_became_peered":"2024-09-11T05:34:54.792973+0000","last_unstale":"2024-09-11T05:34:57.628667+0000","last_undegraded":"2024-09-11T05:34:57.628667+0000","last_fullsized":"2024-09-11T05:34:57.628667+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:48.374921+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0043816369999999999,"stat_sum":{"num_bytes":2474930,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":10,"num_read":16631,"num_read_kb":25382,"num_write":1108,"num_write_kb":7409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":6593091,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1c","version":"132'571","reported_seq":7580,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.736345+0000","last_change":"2024-09-11T05:34:57.630047+0000","last_active":"2024-09-11T05:34:57.736345+0000","last_peered":"2024-09-11T05:34:57.736345+0000","last_clean":"2024-09-11T05:34:57.736345+0000","last_became_active":"2024-09-11T05:34:47.624936+0000","last_became_peered":"2024-09-11T05:34:47.624936+0000","last_unstale":"2024-09-11T05:34:57.736345+0000","last_undegraded":"2024-09-11T05:34:57.736345+0000","last_fullsized":"2024-09-11T05:34:57.736345+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:02:55.758192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056115389999999996,"stat_sum":{"num_bytes":4797041,"num_objects":23,"num_object_clones":8,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":10,"num_read":8950,"num_read_kb":27586,"num_write":651,"num_write_kb":16439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":13219858,"num_keys_recovered":56,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1b","version":"131'544","reported_seq":7701,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.630068+0000","last_change":"2024-09-11T05:34:57.631216+0000","last_active":"2024-09-11T05:34:57.630068+0000","last_peered":"2024-09-11T05:34:57.630068+0000","last_clean":"2024-09-11T05:34:57.630068+0000","last_became_active":"2024-09-11T05:34:54.791166+0000","last_became_peered":"2024-09-11T05:34:54.791166+0000","last_unstale":"2024-09-11T05:34:57.630068+0000","last_undegraded":"2024-09-11T05:34:57.630068+0000","last_fullsized":"2024-09-11T05:34:57.630068+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:24:32.246993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056127579999999998,"stat_sum":{"num_bytes":4409601,"num_objects":27,"num_object_clones":10,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":13,"num_read":7335,"num_read_kb":17739,"num_write":649,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":7543883,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.1a","version":"132'417","reported_seq":4840,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.739142+0000","last_change":"2024-09-11T05:34:57.634962+0000","last_active":"2024-09-11T05:34:57.739142+0000","last_peered":"2024-09-11T05:34:57.739142+0000","last_clean":"2024-09-11T05:34:57.739142+0000","last_became_active":"2024-09-11T05:34:47.624650+0000","last_became_peered":"2024-09-11T05:34:47.624650+0000","last_unstale":"2024-09-11T05:34:57.739142+0000","last_undegraded":"2024-09-11T05:34:57.739142+0000","last_fullsized":"2024-09-11T05:34:57.739142+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:04.560269+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0063463149999999999,"stat_sum":{"num_bytes":2583983,"num_objects":33,"num_object_clones":13,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":17,"num_read":5351,"num_read_kb":14193,"num_write":481,"num_write_kb":12836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":4852988,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.19","version":"131'1069","reported_seq":10924,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.625729+0000","last_change":"2024-09-11T05:34:57.626139+0000","last_active":"2024-09-11T05:34:57.625729+0000","last_peered":"2024-09-11T05:34:57.625729+0000","last_clean":"2024-09-11T05:34:57.625729+0000","last_became_active":"2024-09-11T05:34:47.628578+0000","last_became_peered":"2024-09-11T05:34:47.628578+0000","last_unstale":"2024-09-11T05:34:57.625729+0000","last_undegraded":"2024-09-11T05:34:57.625729+0000","last_fullsized":"2024-09-11T05:34:57.625729+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1069,"log_dups_size":0,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:58.025492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019096359999999999,"stat_sum":{"num_bytes":2425606,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":9,"num_read":13695,"num_read_kb":13411,"num_write":1644,"num_write_kb":8532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":1269861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.18","version":"132'499","reported_seq":3027,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.634068+0000","last_change":"2024-09-11T05:34:57.634068+0000","last_active":"2024-09-11T05:34:57.634068+0000","last_peered":"2024-09-11T05:34:57.634068+0000","last_clean":"2024-09-11T05:34:57.634068+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:34:57.634068+0000","last_undegraded":"2024-09-11T05:34:57.634068+0000","last_fullsized":"2024-09-11T05:34:57.634068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:34.799246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052410820000000002,"stat_sum":{"num_bytes":3919699,"num_objects":20,"num_object_clones":8,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":10,"num_read":3338,"num_read_kb":10070,"num_write":593,"num_write_kb":6210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.17","version":"132'1135","reported_seq":3196,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.750819+0000","last_change":"2024-09-11T05:34:57.636449+0000","last_active":"2024-09-11T05:34:57.750819+0000","last_peered":"2024-09-11T05:34:57.750819+0000","last_clean":"2024-09-11T05:34:57.750819+0000","last_became_active":"2024-09-11T05:34:54.790407+0000","last_became_peered":"2024-09-11T05:34:54.790407+0000","last_unstale":"2024-09-11T05:34:57.750819+0000","last_undegraded":"2024-09-11T05:34:57.750819+0000","last_fullsized":"2024-09-11T05:34:57.750819+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1135,"log_dups_size":0,"ondisk_log_size":1135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:14:30.038124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007533362,"stat_sum":{"num_bytes":2242747,"num_objects":14,"num_object_clones":5,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":6,"num_read":5133,"num_read_kb":28606,"num_write":1692,"num_write_kb":20678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":292,"num_bytes_recovered":48701806,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.16","version":"132'273","reported_seq":3548,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.628562+0000","last_change":"2024-09-11T05:34:57.628562+0000","last_active":"2024-09-11T05:34:57.628562+0000","last_peered":"2024-09-11T05:34:57.628562+0000","last_clean":"2024-09-11T05:34:57.628562+0000","last_became_active":"2024-09-11T05:34:53.790235+0000","last_became_peered":"2024-09-11T05:34:53.790235+0000","last_unstale":"2024-09-11T05:34:57.628562+0000","last_undegraded":"2024-09-11T05:34:57.628562+0000","last_fullsized":"2024-09-11T05:34:57.628562+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:32:53.188863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001131146,"stat_sum":{"num_bytes":5079040,"num_objects":14,"num_object_clones":6,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":7,"num_read":2863,"num_read_kb":14884,"num_write":220,"num_write_kb":7375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":1456269,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.15","version":"132'697","reported_seq":3697,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.701783+0000","last_change":"2024-09-11T05:34:57.629351+0000","last_active":"2024-09-11T05:34:57.701783+0000","last_peered":"2024-09-11T05:34:57.701783+0000","last_clean":"2024-09-11T05:34:57.701783+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:34:57.701783+0000","last_undegraded":"2024-09-11T05:34:57.701783+0000","last_fullsized":"2024-09-11T05:34:57.701783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:19:08.180418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049044750000000002,"stat_sum":{"num_bytes":5991391,"num_objects":31,"num_object_clones":12,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":15,"num_read":5390,"num_read_kb":12737,"num_write":871,"num_write_kb":9766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.14","version":"132'343","reported_seq":11857,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.697500+0000","last_change":"2024-09-11T05:34:57.631846+0000","last_active":"2024-09-11T05:34:57.697500+0000","last_peered":"2024-09-11T05:34:57.697500+0000","last_clean":"2024-09-11T05:34:57.697500+0000","last_became_active":"2024-09-11T05:34:53.790227+0000","last_became_peered":"2024-09-11T05:34:53.790227+0000","last_unstale":"2024-09-11T05:34:57.697500+0000","last_undegraded":"2024-09-11T05:34:57.697500+0000","last_fullsized":"2024-09-11T05:34:57.697500+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:21:39.256280+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0044516540000000002,"stat_sum":{"num_bytes":7477516,"num_objects":27,"num_object_clones":10,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":11,"num_read":5061,"num_read_kb":14756,"num_write":294,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":7503668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.627703+0000","last_change":"2024-09-11T05:34:50.627854+0000","last_active":"2024-09-11T05:34:57.627703+0000","last_peered":"2024-09-11T05:34:57.627703+0000","last_clean":"2024-09-11T05:34:57.627703+0000","last_became_active":"2024-09-11T05:34:50.627529+0000","last_became_peered":"2024-09-11T05:34:50.627529+0000","last_unstale":"2024-09-11T05:34:57.627703+0000","last_undegraded":"2024-09-11T05:34:57.627703+0000","last_fullsized":"2024-09-11T05:34:57.627703+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:35.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"132'672","reported_seq":4302,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.634418+0000","last_change":"2024-09-11T05:34:57.634418+0000","last_active":"2024-09-11T05:34:57.634418+0000","last_peered":"2024-09-11T05:34:57.634418+0000","last_clean":"2024-09-11T05:34:57.634418+0000","last_became_active":"2024-09-11T05:34:47.626611+0000","last_became_peered":"2024-09-11T05:34:47.626611+0000","last_unstale":"2024-09-11T05:34:57.634418+0000","last_undegraded":"2024-09-11T05:34:57.634418+0000","last_fullsized":"2024-09-11T05:34:57.634418+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:22.470796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003317375,"stat_sum":{"num_bytes":1654132,"num_objects":24,"num_object_clones":10,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":13,"num_read":5183,"num_read_kb":4253,"num_write":903,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":1655489,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.624117+0000","last_change":"2024-09-11T05:32:55.614406+0000","last_active":"2024-09-11T05:34:57.624117+0000","last_peered":"2024-09-11T05:34:57.624117+0000","last_clean":"2024-09-11T05:34:57.624117+0000","last_became_active":"2024-09-11T05:32:55.614125+0000","last_became_peered":"2024-09-11T05:32:55.614125+0000","last_unstale":"2024-09-11T05:34:57.624117+0000","last_undegraded":"2024-09-11T05:34:57.624117+0000","last_fullsized":"2024-09-11T05:34:57.624117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:06:59.971006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"132'439","reported_seq":5988,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.636538+0000","last_change":"2024-09-11T05:34:57.636538+0000","last_active":"2024-09-11T05:34:57.636538+0000","last_peered":"2024-09-11T05:34:57.636538+0000","last_clean":"2024-09-11T05:34:57.636538+0000","last_became_active":"2024-09-11T05:34:47.624881+0000","last_became_peered":"2024-09-11T05:34:47.624881+0000","last_unstale":"2024-09-11T05:34:57.636538+0000","last_undegraded":"2024-09-11T05:34:57.636538+0000","last_fullsized":"2024-09-11T05:34:57.636538+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:30.628038+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0054218230000000001,"stat_sum":{"num_bytes":3835445,"num_objects":31,"num_object_clones":13,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":16,"num_read":6977,"num_read_kb":16019,"num_write":347,"num_write_kb":6385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":1715668,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.627896+0000","last_change":"2024-09-11T05:34:50.625911+0000","last_active":"2024-09-11T05:34:57.627896+0000","last_peered":"2024-09-11T05:34:57.627896+0000","last_clean":"2024-09-11T05:34:57.627896+0000","last_became_active":"2024-09-11T05:34:50.625595+0000","last_became_peered":"2024-09-11T05:34:50.625595+0000","last_unstale":"2024-09-11T05:34:57.627896+0000","last_undegraded":"2024-09-11T05:34:57.627896+0000","last_fullsized":"2024-09-11T05:34:57.627896+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:53:14.794842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"132'1561","reported_seq":7844,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.752847+0000","last_change":"2024-09-11T05:34:57.635126+0000","last_active":"2024-09-11T05:34:57.752847+0000","last_peered":"2024-09-11T05:34:57.752847+0000","last_clean":"2024-09-11T05:34:57.752847+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:34:57.752847+0000","last_undegraded":"2024-09-11T05:34:57.752847+0000","last_fullsized":"2024-09-11T05:34:57.752847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1561,"log_dups_size":0,"ondisk_log_size":1561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:41.163634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039747319999999999,"stat_sum":{"num_bytes":4779689,"num_objects":32,"num_object_clones":11,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":15,"num_read":14800,"num_read_kb":37544,"num_write":2253,"num_write_kb":19401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.4","version":"0'0","reported_seq":252,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.628662+0000","last_change":"2024-09-11T05:34:44.768103+0000","last_active":"2024-09-11T05:34:57.628662+0000","last_peered":"2024-09-11T05:34:57.628662+0000","last_clean":"2024-09-11T05:34:57.628662+0000","last_became_active":"2024-09-11T05:34:44.767862+0000","last_became_peered":"2024-09-11T05:34:44.767862+0000","last_unstale":"2024-09-11T05:34:57.628662+0000","last_undegraded":"2024-09-11T05:34:57.628662+0000","last_fullsized":"2024-09-11T05:34:57.628662+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:15:05.574617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"132'797","reported_seq":12439,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.699272+0000","last_change":"2024-09-11T05:34:57.638204+0000","last_active":"2024-09-11T05:34:57.699272+0000","last_peered":"2024-09-11T05:34:57.699272+0000","last_clean":"2024-09-11T05:34:57.699272+0000","last_became_active":"2024-09-11T05:34:38.741666+0000","last_became_peered":"2024-09-11T05:34:38.741666+0000","last_unstale":"2024-09-11T05:34:57.699272+0000","last_undegraded":"2024-09-11T05:34:57.699272+0000","last_fullsized":"2024-09-11T05:34:57.699272+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:28.387306+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0068434660000000003,"stat_sum":{"num_bytes":8664898,"num_objects":31,"num_object_clones":9,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":14,"num_read":14975,"num_read_kb":18042,"num_write":799,"num_write_kb":8800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.3","version":"132'603","reported_seq":4135,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.717697+0000","last_change":"2024-09-11T05:34:57.629859+0000","last_active":"2024-09-11T05:34:57.717697+0000","last_peered":"2024-09-11T05:34:57.717697+0000","last_clean":"2024-09-11T05:34:57.717697+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:34:57.717697+0000","last_undegraded":"2024-09-11T05:34:57.717697+0000","last_fullsized":"2024-09-11T05:34:57.717697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:20:28.514527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051798549999999997,"stat_sum":{"num_bytes":9220667,"num_objects":23,"num_object_clones":7,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":7,"num_read":4220,"num_read_kb":22788,"num_write":658,"num_write_kb":8238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.2","version":"21'2","reported_seq":211,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.631231+0000","last_change":"2024-09-11T05:34:50.629913+0000","last_active":"2024-09-11T05:34:57.631231+0000","last_peered":"2024-09-11T05:34:57.631231+0000","last_clean":"2024-09-11T05:34:57.631231+0000","last_became_active":"2024-09-11T05:34:50.626576+0000","last_became_peered":"2024-09-11T05:34:50.626576+0000","last_unstale":"2024-09-11T05:34:57.631231+0000","last_undegraded":"2024-09-11T05:34:57.631231+0000","last_fullsized":"2024-09-11T05:34:57.631231+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:31.184793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"132'321","reported_seq":2509,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.722387+0000","last_change":"2024-09-11T05:34:57.632031+0000","last_active":"2024-09-11T05:34:57.722387+0000","last_peered":"2024-09-11T05:34:57.722387+0000","last_clean":"2024-09-11T05:34:57.722387+0000","last_became_active":"2024-09-11T05:34:13.624034+0000","last_became_peered":"2024-09-11T05:34:13.624034+0000","last_unstale":"2024-09-11T05:34:57.722387+0000","last_undegraded":"2024-09-11T05:34:57.722387+0000","last_fullsized":"2024-09-11T05:34:57.722387+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:05.218671+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0034747440000000001,"stat_sum":{"num_bytes":11048279,"num_objects":28,"num_object_clones":9,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":13,"num_read":2058,"num_read_kb":16419,"num_write":305,"num_write_kb":9397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3410911,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.1","version":"0'0","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.628448+0000","last_change":"2024-09-11T05:34:10.619317+0000","last_active":"2024-09-11T05:34:57.628448+0000","last_peered":"2024-09-11T05:34:57.628448+0000","last_clean":"2024-09-11T05:34:57.628448+0000","last_became_active":"2024-09-11T05:34:10.619012+0000","last_became_peered":"2024-09-11T05:34:10.619012+0000","last_unstale":"2024-09-11T05:34:57.628448+0000","last_undegraded":"2024-09-11T05:34:57.628448+0000","last_fullsized":"2024-09-11T05:34:57.628448+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:19.646689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"132'667","reported_seq":8347,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.752260+0000","last_change":"2024-09-11T05:34:57.634074+0000","last_active":"2024-09-11T05:34:57.752260+0000","last_peered":"2024-09-11T05:34:57.752260+0000","last_clean":"2024-09-11T05:34:57.752260+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:34:57.752260+0000","last_undegraded":"2024-09-11T05:34:57.752260+0000","last_fullsized":"2024-09-11T05:34:57.752260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:30.946166+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0030530290000000001,"stat_sum":{"num_bytes":4596180,"num_objects":27,"num_object_clones":9,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":9,"num_read":11552,"num_read_kb":20480,"num_write":628,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.627013+0000","last_change":"2024-09-11T05:34:50.626273+0000","last_active":"2024-09-11T05:34:57.627013+0000","last_peered":"2024-09-11T05:34:57.627013+0000","last_clean":"2024-09-11T05:34:57.627013+0000","last_became_active":"2024-09-11T05:34:50.625970+0000","last_became_peered":"2024-09-11T05:34:50.625970+0000","last_unstale":"2024-09-11T05:34:57.627013+0000","last_undegraded":"2024-09-11T05:34:57.627013+0000","last_fullsized":"2024-09-11T05:34:57.627013+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:45.970895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"130'547","reported_seq":3647,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.739491+0000","last_change":"2024-09-11T05:34:57.625101+0000","last_active":"2024-09-11T05:34:57.739491+0000","last_peered":"2024-09-11T05:34:57.739491+0000","last_clean":"2024-09-11T05:34:57.739491+0000","last_became_active":"2024-09-11T05:34:38.742487+0000","last_became_peered":"2024-09-11T05:34:38.742487+0000","last_unstale":"2024-09-11T05:34:57.739491+0000","last_undegraded":"2024-09-11T05:34:57.739491+0000","last_fullsized":"2024-09-11T05:34:57.739491+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:18.416285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010749010000000001,"stat_sum":{"num_bytes":8390310,"num_objects":24,"num_object_clones":5,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":9,"num_read":5702,"num_read_kb":14941,"num_write":592,"num_write_kb":14343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"2.3","version":"19'1","reported_seq":28,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.627995+0000","last_change":"2024-09-11T05:34:50.628817+0000","last_active":"2024-09-11T05:34:57.627995+0000","last_peered":"2024-09-11T05:34:57.627995+0000","last_clean":"2024-09-11T05:34:57.627995+0000","last_became_active":"2024-09-11T05:34:50.625495+0000","last_became_peered":"2024-09-11T05:34:50.625495+0000","last_unstale":"2024-09-11T05:34:57.627995+0000","last_undegraded":"2024-09-11T05:34:57.627995+0000","last_fullsized":"2024-09-11T05:34:57.627995+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:38.332373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":201,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.628846+0000","last_change":"2024-09-11T05:34:47.626929+0000","last_active":"2024-09-11T05:34:57.628846+0000","last_peered":"2024-09-11T05:34:57.628846+0000","last_clean":"2024-09-11T05:34:57.628846+0000","last_became_active":"2024-09-11T05:34:47.626561+0000","last_became_peered":"2024-09-11T05:34:47.626561+0000","last_unstale":"2024-09-11T05:34:57.628846+0000","last_undegraded":"2024-09-11T05:34:57.628846+0000","last_fullsized":"2024-09-11T05:34:57.628846+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:09.689444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"127'601","reported_seq":20806,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.624486+0000","last_change":"2024-09-11T05:34:57.625127+0000","last_active":"2024-09-11T05:34:57.624486+0000","last_peered":"2024-09-11T05:34:57.624486+0000","last_clean":"2024-09-11T05:34:57.624486+0000","last_became_active":"2024-09-11T05:34:38.742709+0000","last_became_peered":"2024-09-11T05:34:38.742709+0000","last_unstale":"2024-09-11T05:34:57.624486+0000","last_undegraded":"2024-09-11T05:34:57.624486+0000","last_fullsized":"2024-09-11T05:34:57.624486+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:40:10.042831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011087200000000001,"stat_sum":{"num_bytes":7728451,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":11,"num_read":21529,"num_read_kb":26937,"num_write":591,"num_write_kb":9647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":6098347,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.9","version":"130'385","reported_seq":10300,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.628111+0000","last_change":"2024-09-11T05:34:57.628111+0000","last_active":"2024-09-11T05:34:57.628111+0000","last_peered":"2024-09-11T05:34:57.628111+0000","last_clean":"2024-09-11T05:34:57.628111+0000","last_became_active":"2024-09-11T05:34:54.788935+0000","last_became_peered":"2024-09-11T05:34:54.788935+0000","last_unstale":"2024-09-11T05:34:57.628111+0000","last_undegraded":"2024-09-11T05:34:57.628111+0000","last_fullsized":"2024-09-11T05:34:57.628111+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:44.422458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083491100000000003,"stat_sum":{"num_bytes":7735489,"num_objects":27,"num_object_clones":11,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":12,"num_read":9328,"num_read_kb":19500,"num_write":332,"num_write_kb":14817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":8961432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.a","version":"132'399","reported_seq":3253,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.697401+0000","last_change":"2024-09-11T05:34:57.633382+0000","last_active":"2024-09-11T05:34:57.697401+0000","last_peered":"2024-09-11T05:34:57.697401+0000","last_clean":"2024-09-11T05:34:57.697401+0000","last_became_active":"2024-09-11T05:34:53.789044+0000","last_became_peered":"2024-09-11T05:34:53.789044+0000","last_unstale":"2024-09-11T05:34:57.697401+0000","last_undegraded":"2024-09-11T05:34:57.697401+0000","last_fullsized":"2024-09-11T05:34:57.697401+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:58.092369+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0048287110000000003,"stat_sum":{"num_bytes":6976503,"num_objects":26,"num_object_clones":10,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":8,"num_read":1788,"num_read_kb":9396,"num_write":399,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":396,"num_bytes_recovered":10914094,"num_keys_recovered":66,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.b","version":"132'311","reported_seq":2481,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.633755+0000","last_change":"2024-09-11T05:34:57.633755+0000","last_active":"2024-09-11T05:34:57.633755+0000","last_peered":"2024-09-11T05:34:57.633755+0000","last_clean":"2024-09-11T05:34:57.633755+0000","last_became_active":"2024-09-11T05:34:13.622810+0000","last_became_peered":"2024-09-11T05:34:13.622810+0000","last_unstale":"2024-09-11T05:34:57.633755+0000","last_undegraded":"2024-09-11T05:34:57.633755+0000","last_fullsized":"2024-09-11T05:34:57.633755+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:35:14.488248+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.002738449,"stat_sum":{"num_bytes":2659101,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":9,"num_read":2264,"num_read_kb":23619,"num_write":300,"num_write_kb":16916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":14087582,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.c","version":"132'378","reported_seq":2777,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.632349+0000","last_change":"2024-09-11T05:34:57.632349+0000","last_active":"2024-09-11T05:34:57.632349+0000","last_peered":"2024-09-11T05:34:57.632349+0000","last_clean":"2024-09-11T05:34:57.632349+0000","last_became_active":"2024-09-11T05:34:53.791937+0000","last_became_peered":"2024-09-11T05:34:53.791937+0000","last_unstale":"2024-09-11T05:34:57.632349+0000","last_undegraded":"2024-09-11T05:34:57.632349+0000","last_fullsized":"2024-09-11T05:34:57.632349+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:06:24.423365+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0072739099999999998,"stat_sum":{"num_bytes":16061034,"num_objects":32,"num_object_clones":12,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":13,"num_read":1979,"num_read_kb":12030,"num_write":376,"num_write_kb":5272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":6119775,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.d","version":"132'465","reported_seq":5844,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.700498+0000","last_change":"2024-09-11T05:34:57.628650+0000","last_active":"2024-09-11T05:34:57.700498+0000","last_peered":"2024-09-11T05:34:57.700498+0000","last_clean":"2024-09-11T05:34:57.700498+0000","last_became_active":"2024-09-11T05:34:54.793037+0000","last_became_peered":"2024-09-11T05:34:54.793037+0000","last_unstale":"2024-09-11T05:34:57.700498+0000","last_undegraded":"2024-09-11T05:34:57.700498+0000","last_fullsized":"2024-09-11T05:34:57.700498+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:51.845233+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0045624380000000003,"stat_sum":{"num_bytes":4714112,"num_objects":12,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":3,"num_read":5865,"num_read_kb":13697,"num_write":398,"num_write_kb":10315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":13015515,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.e","version":"132'372","reported_seq":2739,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.704048+0000","last_change":"2024-09-11T05:34:57.625659+0000","last_active":"2024-09-11T05:34:57.704048+0000","last_peered":"2024-09-11T05:34:57.704048+0000","last_clean":"2024-09-11T05:34:57.704048+0000","last_became_active":"2024-09-11T05:34:38.742784+0000","last_became_peered":"2024-09-11T05:34:38.742784+0000","last_unstale":"2024-09-11T05:34:57.704048+0000","last_undegraded":"2024-09-11T05:34:57.704048+0000","last_fullsized":"2024-09-11T05:34:57.704048+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:31.514457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001530523,"stat_sum":{"num_bytes":13751985,"num_objects":30,"num_object_clones":11,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":12,"num_read":2125,"num_read_kb":12621,"num_write":324,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.f","version":"132'567","reported_seq":4636,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.703857+0000","last_change":"2024-09-11T05:34:57.631736+0000","last_active":"2024-09-11T05:34:57.703857+0000","last_peered":"2024-09-11T05:34:57.703857+0000","last_clean":"2024-09-11T05:34:57.703857+0000","last_became_active":"2024-09-11T05:34:48.626675+0000","last_became_peered":"2024-09-11T05:34:48.626675+0000","last_unstale":"2024-09-11T05:34:57.703857+0000","last_undegraded":"2024-09-11T05:34:57.703857+0000","last_fullsized":"2024-09-11T05:34:57.703857+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:36:08.794540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0064786799999999997,"stat_sum":{"num_bytes":15936116,"num_objects":19,"num_object_clones":5,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":7,"num_read":5626,"num_read_kb":12054,"num_write":561,"num_write_kb":8278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":2111260,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.10","version":"132'350","reported_seq":5426,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.629303+0000","last_change":"2024-09-11T05:34:57.629303+0000","last_active":"2024-09-11T05:34:57.629303+0000","last_peered":"2024-09-11T05:34:57.629303+0000","last_clean":"2024-09-11T05:34:57.629303+0000","last_became_active":"2024-09-11T05:34:53.791234+0000","last_became_peered":"2024-09-11T05:34:53.791234+0000","last_unstale":"2024-09-11T05:34:57.629303+0000","last_undegraded":"2024-09-11T05:34:57.629303+0000","last_fullsized":"2024-09-11T05:34:57.629303+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:26:13.521147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080941599999999998,"stat_sum":{"num_bytes":3069187,"num_objects":29,"num_object_clones":13,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":15,"num_read":4943,"num_read_kb":12354,"num_write":292,"num_write_kb":4874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":3066244,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.11","version":"130'632","reported_seq":2145,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.627154+0000","last_change":"2024-09-11T05:34:57.627601+0000","last_active":"2024-09-11T05:34:57.627154+0000","last_peered":"2024-09-11T05:34:57.627154+0000","last_clean":"2024-09-11T05:34:57.627154+0000","last_became_active":"2024-09-11T05:34:53.787385+0000","last_became_peered":"2024-09-11T05:34:53.787385+0000","last_unstale":"2024-09-11T05:34:57.627154+0000","last_undegraded":"2024-09-11T05:34:57.627154+0000","last_fullsized":"2024-09-11T05:34:57.627154+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:37:49.500878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056672299999999999,"stat_sum":{"num_bytes":3291594,"num_objects":26,"num_object_clones":10,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":15,"num_read":2889,"num_read_kb":11010,"num_write":796,"num_write_kb":7587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":3434090,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.12","version":"132'598","reported_seq":11054,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.637415+0000","last_change":"2024-09-11T05:34:57.637415+0000","last_active":"2024-09-11T05:34:57.637415+0000","last_peered":"2024-09-11T05:34:57.637415+0000","last_clean":"2024-09-11T05:34:57.637415+0000","last_became_active":"2024-09-11T05:34:53.789002+0000","last_became_peered":"2024-09-11T05:34:53.789002+0000","last_unstale":"2024-09-11T05:34:57.637415+0000","last_undegraded":"2024-09-11T05:34:57.637415+0000","last_fullsized":"2024-09-11T05:34:57.637415+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:32.753269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060423789999999996,"stat_sum":{"num_bytes":8173356,"num_objects":17,"num_object_clones":6,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":8,"num_read":3076,"num_read_kb":7989,"num_write":735,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":6984484,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"d","length":"5"}]},{"pgid":"3.13","version":"132'525","reported_seq":6454,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-11T05:34:57.677618+0000","last_change":"2024-09-11T05:34:57.629319+0000","last_active":"2024-09-11T05:34:57.677618+0000","last_peered":"2024-09-11T05:34:57.677618+0000","last_clean":"2024-09-11T05:34:57.677618+0000","last_became_active":"2024-09-11T05:34:54.791212+0000","last_became_peered":"2024-09-11T05:34:54.791212+0000","last_unstale":"2024-09-11T05:34:57.677618+0000","last_undegraded":"2024-09-11T05:34:57.677618+0000","last_fullsized":"2024-09-11T05:34:57.677618+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:44:07.322426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049026069999999998,"stat_sum":{"num_bytes":5541631,"num_objects":29,"num_object_clones":10,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":12,"num_read":6958,"num_read_kb":39073,"num_write":601,"num_write_kb":9923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":4472318,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"5"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":210123445,"num_objects":794,"num_object_clones":279,"num_object_copies":1588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":794,"num_whiteouts":353,"num_read":218305,"num_read_kb":576517,"num_write":21353,"num_write_kb":315626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4321,"num_bytes_recovered":181512868,"num_keys_recovered":238,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":133124096,"data_stored":173287347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18482,"ondisk_log_size":18482,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":60129542176,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542176,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67684,"kb_used_data":14288,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94304156,"statfs":{"total":96636764160,"available":96567455744,"internally_reserved":0,"allocated":14630912,"data_stored":18948966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67776,"kb_used_data":14368,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94304064,"statfs":{"total":96636764160,"available":96567361536,"internally_reserved":0,"allocated":14712832,"data_stored":17121359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":0,"seq":442381631496,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542175,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68632,"kb_used_data":15224,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94303208,"statfs":{"total":96636764160,"available":96566484992,"internally_reserved":0,"allocated":15589376,"data_stored":18164107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68392,"kb_used_data":19156,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94303448,"statfs":{"total":96636764160,"available":96566730752,"internally_reserved":0,"allocated":19615744,"data_stored":23640332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":60129542174,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542175,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65608,"kb_used_data":20528,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94306232,"statfs":{"total":96636764160,"available":96569581568,"internally_reserved":0,"allocated":21020672,"data_stored":25931412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18010112,"data_stored":22439510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19644416,"data_stored":29719696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15421440,"data_stored":18441815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14008320,"data_stored":17406980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11067392,"data_stored":14320471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11468800,"data_stored":15040202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":43503616,"data_stored":55918673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:35:01.146 INFO:tasks.thrashosds.thrasher:Setting 3.e to [7, 1, 2, 5] 2024-09-11T05:35:01.146 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.e', '7', '1', '2', '5'] 2024-09-11T05:35:01.146 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.e 7 1 2 5 2024-09-11T05:35:01.229 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:01.229 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:01.236 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:01.236+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:01.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:35:01.337 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:01.337+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:01.342 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:01.342 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:01.351 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:35:01.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:35:01.439 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:01.439+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:01.459 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:01.459 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:01.468 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:35:01.473 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:35:01.473 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:35:01.491 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:35:01.491 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:35:01.507 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:35:01.508 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:35:01.524 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:35:01.524 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:35:01.540 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:01.539+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:01.541 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:35:01.541 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:35:01.558 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:35:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:35:01.573 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:35:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:35:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:35:01.573 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:01.575 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:35:01.575 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:35:01.582 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:35:01.592 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:35:01.592 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:35:01.627 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T05:35:01.630 INFO:teuthology.orchestra.run.smithi070.stderr:set 3.e pg_upmap_items mapping to [7->1,2->5] 2024-09-11T05:35:01.640 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:01.640+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:01.716 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:35:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:35:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:35:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:35:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:35:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 136.12469237100001, 2024-09-11T05:35:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:35:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:35:01.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:35:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:35:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:35:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:35:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:35:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:35:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:35:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:35:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:35:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:35:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:35:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:35:01.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:35:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:35:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:35:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:35:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:35:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:35:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:35:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:35:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:35:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.547757110999996, 2024-09-11T05:35:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:35:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:35:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:35:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:35:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:35:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:35:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:35:01.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:35:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:35:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:35:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:35:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:35:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:35:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:35:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:35:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.727 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:35:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.547738312000007, 2024-09-11T05:35:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:35:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:35:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:35:01.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:35:01.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:35:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:35:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.547714280999998, 2024-09-11T05:35:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:35:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:35:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:35:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:35:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:35:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:35:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:35:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:35:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:35:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:35:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:35:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:35:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:35:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:35:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.547637492999996, 2024-09-11T05:35:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:35:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:35:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:35:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:35:01.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:35:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:35:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:35:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:35:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:35:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:35:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:35:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:35:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:35:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.547610169999999, 2024-09-11T05:35:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:35:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:35:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.742 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:35:01.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:35:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:35:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:35:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:35:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:35:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:35:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:35:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:35:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.547591621999999, 2024-09-11T05:35:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:35:01.746 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:35:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:35:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:35:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:35:01.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:35:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:35:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:35:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:35:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:35:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:35:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.750 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:35:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.547573550999999, 2024-09-11T05:35:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:35:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.751 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:35:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:35:01.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:35:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:35:01.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:35:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:35:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:35:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:35:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:35:01.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:35:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:35:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:35:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:35:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:35:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:35:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:35:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:35:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:35:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.545975908000003, 2024-09-11T05:35:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:35:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:35:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:35:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:35:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:35:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:35:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:35:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:35:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:35:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:35:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:35:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:35:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:35:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:35:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:35:01.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:35:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:35:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:35:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.762 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:35:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.545955582000005, 2024-09-11T05:35:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:35:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:35:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:35:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:35:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:35:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:35:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:35:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:35:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:35:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:35:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:35:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:35:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:35:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:35:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:35:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:35:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:35:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:35:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:35:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.545916583999997, 2024-09-11T05:35:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:35:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.769 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:35:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:35:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:35:01.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:35:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:35:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:35:01.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:35:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:35:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:35:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:35:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:35:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:35:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:35:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:35:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:35:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:35:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:35:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:35:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.545895942000001, 2024-09-11T05:35:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:35:01.774 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:35:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:35:01.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:35:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:35:01.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:35:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:35:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:35:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:35:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:35:01.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:35:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:35:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:35:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:35:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:35:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:35:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:35:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:35:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:35:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.545773079, 2024-09-11T05:35:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:35:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:35:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:35:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:35:01.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:35:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:35:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:35:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:35:01.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:35:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:35:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:35:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:35:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:35:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:35:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:35:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:35:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:35:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:35:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:35:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.545613521999996, 2024-09-11T05:35:01.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:35:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:35:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:35:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:35:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:35:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:35:01.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:35:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:35:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:35:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:35:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:35:01.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:35:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:35:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:35:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:35:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:35:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.543928855000004, 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:35:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:35:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:35:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:35:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:35:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:35:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:35:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:35:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:35:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:35:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:35:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:35:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:35:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.54390085, 2024-09-11T05:35:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:35:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:35:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:35:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:35:01.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:35:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:35:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:35:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:35:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:35:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:35:01.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:35:01.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:35:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:35:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:35:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:35:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:35:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:35:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:35:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.802 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:35:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.542434387, 2024-09-11T05:35:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:35:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.803 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:35:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:35:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:35:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:35:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:35:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:35:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:35:01.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:35:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:35:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:35:01.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:35:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:35:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:35:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:35:01.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:35:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:35:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:35:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:35:01.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.542249085999998, 2024-09-11T05:35:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:35:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:35:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:35:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:35:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:35:01.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:35:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:35:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:35:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:35:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:35:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:35:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:35:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:35:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:35:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:35:01.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:35:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:35:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:35:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:35:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.542077630999998, 2024-09-11T05:35:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:35:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.814 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:35:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:35:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:35:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:35:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:35:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:35:01.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:35:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:35:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:35:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:35:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:35:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:35:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:194030 3.11 3:8c0c7139:::rbd_object_map.112d3507140b:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:52.789587+0000", 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9253579330000008, 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.002511178, 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:35:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 194030 2024-09-11T05:35:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789587+0000", 2024-09-11T05:35:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789587+0000", 2024-09-11T05:35:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789589+0000", 2024-09-11T05:35:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5120000000000001e-06 2024-09-11T05:35:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:01.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789594+0000", 2024-09-11T05:35:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4920000000000001e-06 2024-09-11T05:35:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789605+0000", 2024-09-11T05:35:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0795000000000001e-05 2024-09-11T05:35:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789612+0000", 2024-09-11T05:35:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8340000000000001e-06 2024-09-11T05:35:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.790925+0000", 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001312847 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.790938+0000", 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3192e-05 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.789344+0000", 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99840615499999996 2024-09-11T05:35:01.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.789491+0000", 2024-09-11T05:35:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014679299999999999 2024-09-11T05:35:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T05:35:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.789679+0000", 2024-09-11T05:35:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018818099999999999 2024-09-11T05:35:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:35:01.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.790923+0000", 2024-09-11T05:35:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012436820000000001 2024-09-11T05:35:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:35:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.791981+0000", 2024-09-11T05:35:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010581570000000001 2024-09-11T05:35:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:35:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.792055+0000", 2024-09-11T05:35:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3749000000000002e-05 2024-09-11T05:35:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:01.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.792099+0000", 2024-09-11T05:35:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3788999999999997e-05 2024-09-11T05:35:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:01.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:01.826 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:01.828 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:35:01.828 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:01.827+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:01.928 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:01.928+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:01.936 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:35:01.936 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:01.944 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:35:02.030 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:02.028+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:02.088 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:35:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:35:02.088 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:02.097 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:35:02.141 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:02.141+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:02.201 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:35:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:35:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:35:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183598 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8097792~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:35:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.457474537000003, 2024-09-11T05:35:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038436577999999999, 2024-09-11T05:35:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183598 2024-09-11T05:35:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:35:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742041+0000", 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742042+0000", 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4499999999999998e-07 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742044+0000", 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.119e-06 2024-09-11T05:35:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742049+0000", 2024-09-11T05:35:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6710000000000004e-06 2024-09-11T05:35:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742054+0000", 2024-09-11T05:35:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7700000000000001e-06 2024-09-11T05:35:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780385+0000", 2024-09-11T05:35:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038330831000000003 2024-09-11T05:35:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780435+0000", 2024-09-11T05:35:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0018999999999997e-05 2024-09-11T05:35:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780478+0000", 2024-09-11T05:35:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2823e-05 2024-09-11T05:35:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183599 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6750208~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:35:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.457455744000001, 2024-09-11T05:35:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038610453000000003, 2024-09-11T05:35:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183599 2024-09-11T05:35:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:35:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:35:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742061+0000", 2024-09-11T05:35:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2200000000000004e-07 2024-09-11T05:35:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742063+0000", 2024-09-11T05:35:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:35:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742068+0000", 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6389999999999997e-06 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742073+0000", 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6990000000000002e-06 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780516+0000", 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038443428000000002 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780601+0000", 2024-09-11T05:35:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4618999999999997e-05 2024-09-11T05:35:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780670+0000", 2024-09-11T05:35:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9593999999999998e-05 2024-09-11T05:35:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183600 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8138752~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:35:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.457436928999996, 2024-09-11T05:35:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038699900000000002, 2024-09-11T05:35:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183600 2024-09-11T05:35:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:35:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:35:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:35:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742081+0000", 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.086e-06 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742087+0000", 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4770000000000002e-06 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742092+0000", 2024-09-11T05:35:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7190000000000001e-06 2024-09-11T05:35:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780697+0000", 2024-09-11T05:35:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038605577000000002 2024-09-11T05:35:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780740+0000", 2024-09-11T05:35:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3139999999999997e-05 2024-09-11T05:35:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780779+0000", 2024-09-11T05:35:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8473000000000002e-05 2024-09-11T05:35:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183601 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6791168~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:35:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.4574189, 2024-09-11T05:35:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038869364000000003, 2024-09-11T05:35:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183601 2024-09-11T05:35:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:35:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9900000000000002e-07 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742099+0000", 2024-09-11T05:35:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742105+0000", 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0759999999999999e-06 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742110+0000", 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6600000000000003e-06 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780809+0000", 2024-09-11T05:35:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038698681999999998 2024-09-11T05:35:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780886+0000", 2024-09-11T05:35:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7888999999999999e-05 2024-09-11T05:35:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780966+0000", 2024-09-11T05:35:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9797999999999997e-05 2024-09-11T05:35:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183602 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8179712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:35:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.457400081000003, 2024-09-11T05:35:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038955028000000003, 2024-09-11T05:35:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183602 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742122+0000", 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9880000000000001e-06 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742128+0000", 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2600000000000002e-06 2024-09-11T05:35:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742133+0000", 2024-09-11T05:35:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9010000000000002e-06 2024-09-11T05:35:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780981+0000", 2024-09-11T05:35:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038848102000000002 2024-09-11T05:35:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781024+0000", 2024-09-11T05:35:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2231000000000003e-05 2024-09-11T05:35:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781071+0000", 2024-09-11T05:35:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7215000000000001e-05 2024-09-11T05:35:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183603 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6832128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.457376455000002, 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039121378999999998, 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183603 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:35:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:35:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742215+0000", 2024-09-11T05:35:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5419000000000004e-05 2024-09-11T05:35:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742218+0000", 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0989999999999999e-06 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742225+0000", 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4019999999999996e-06 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742231+0000", 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6969999999999998e-06 2024-09-11T05:35:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781102+0000", 2024-09-11T05:35:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038871348 2024-09-11T05:35:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781187+0000", 2024-09-11T05:35:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4719e-05 2024-09-11T05:35:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781261+0000", 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3695000000000005e-05 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183604 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8220672~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.457275895000002, 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039154538000000003, 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183604 2024-09-11T05:35:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:35:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:35:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743491+0000", 2024-09-11T05:35:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0012514620000000001 2024-09-11T05:35:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743496+0000", 2024-09-11T05:35:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2910000000000001e-06 2024-09-11T05:35:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743506+0000", 2024-09-11T05:35:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0039e-05 2024-09-11T05:35:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743513+0000", 2024-09-11T05:35:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:35:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781296+0000", 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037783187000000003 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781347+0000", 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1375000000000002e-05 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781394+0000", 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119000000000001e-05 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183609 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6955008~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:35:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.455881040000001, 2024-09-11T05:35:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038553630999999998, 2024-09-11T05:35:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183609 2024-09-11T05:35:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:35:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:35:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:35:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.15e-07 2024-09-11T05:35:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743637+0000", 2024-09-11T05:35:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.86e-06 2024-09-11T05:35:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743641+0000", 2024-09-11T05:35:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7000000000000002e-06 2024-09-11T05:35:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743645+0000", 2024-09-11T05:35:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9600000000000002e-06 2024-09-11T05:35:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782023+0000", 2024-09-11T05:35:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038378520999999999 2024-09-11T05:35:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782119+0000", 2024-09-11T05:35:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5665e-05 2024-09-11T05:35:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782188+0000", 2024-09-11T05:35:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9610000000000006e-05 2024-09-11T05:35:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183610 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8343552~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:35:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.455867462000001, 2024-09-11T05:35:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038675859, 2024-09-11T05:35:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183610 2024-09-11T05:35:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:35:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:35:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743649+0000", 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-07 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743650+0000", 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5799999999999999e-06 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743656+0000", 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743660+0000", 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4259999999999999e-06 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782218+0000", 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038558508999999998 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782270+0000", 2024-09-11T05:35:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.168e-05 2024-09-11T05:35:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782324+0000", 2024-09-11T05:35:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4388999999999997e-05 2024-09-11T05:35:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183611 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6995968~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:35:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.455852569999998, 2024-09-11T05:35:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038861554999999999, 2024-09-11T05:35:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183611 2024-09-11T05:35:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:35:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:35:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:35:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4299999999999999e-07 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743665+0000", 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5060000000000001e-06 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743668+0000", 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1549999999999999e-06 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743671+0000", 2024-09-11T05:35:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7599999999999998e-06 2024-09-11T05:35:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782359+0000", 2024-09-11T05:35:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038687946000000001 2024-09-11T05:35:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782437+0000", 2024-09-11T05:35:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8539000000000001e-05 2024-09-11T05:35:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782525+0000", 2024-09-11T05:35:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7405999999999996e-05 2024-09-11T05:35:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183612 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8384512~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:35:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.455841401000001, 2024-09-11T05:35:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039040111000000002, 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183612 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:35:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743675+0000", 2024-09-11T05:35:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2100000000000001e-07 2024-09-11T05:35:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743676+0000", 2024-09-11T05:35:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.212e-06 2024-09-11T05:35:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743679+0000", 2024-09-11T05:35:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:35:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743681+0000", 2024-09-11T05:35:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.604e-06 2024-09-11T05:35:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782560+0000", 2024-09-11T05:35:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038878687000000002 2024-09-11T05:35:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782644+0000", 2024-09-11T05:35:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3733000000000006e-05 2024-09-11T05:35:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782714+0000", 2024-09-11T05:35:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0655999999999996e-05 2024-09-11T05:35:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183613 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7036928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:35:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.455831367999998, 2024-09-11T05:35:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039233924000000003, 2024-09-11T05:35:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183613 2024-09-11T05:35:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:35:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:35:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745489+0000", 2024-09-11T05:35:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0018047549999999999 2024-09-11T05:35:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745493+0000", 2024-09-11T05:35:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0439999999999997e-06 2024-09-11T05:35:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745501+0000", 2024-09-11T05:35:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:35:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745507+0000", 2024-09-11T05:35:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9490000000000001e-06 2024-09-11T05:35:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782756+0000", 2024-09-11T05:35:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037249522 2024-09-11T05:35:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782839+0000", 2024-09-11T05:35:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3133999999999994e-05 2024-09-11T05:35:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782918+0000", 2024-09-11T05:35:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9167999999999998e-05 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183622 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7323648~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.453872953000001, 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038618008000000002, 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183622 2024-09-11T05:35:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:35:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:35:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:35:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4900000000000001e-07 2024-09-11T05:35:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745645+0000", 2024-09-11T05:35:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9709999999999998e-06 2024-09-11T05:35:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745651+0000", 2024-09-11T05:35:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.251e-06 2024-09-11T05:35:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745657+0000", 2024-09-11T05:35:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:35:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784095+0000", 2024-09-11T05:35:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038437791999999998 2024-09-11T05:35:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784201+0000", 2024-09-11T05:35:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000106801 2024-09-11T05:35:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784261+0000", 2024-09-11T05:35:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9475999999999998e-05 2024-09-11T05:35:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183623 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4296704~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:35:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.453852769000001, 2024-09-11T05:35:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038730705999999997, 2024-09-11T05:35:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183623 2024-09-11T05:35:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:35:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.39e-07 2024-09-11T05:35:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745665+0000", 2024-09-11T05:35:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9860000000000001e-06 2024-09-11T05:35:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745671+0000", 2024-09-11T05:35:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.818e-06 2024-09-11T05:35:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745676+0000", 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.972e-06 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784296+0000", 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038620131000000002 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784353+0000", 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6644999999999997e-05 2024-09-11T05:35:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784394+0000", 2024-09-11T05:35:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0815000000000001e-05 2024-09-11T05:35:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183624 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7364608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:35:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.453833891999999, 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038826315, 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183624 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:35:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:35:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:35:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:35:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745684+0000", 2024-09-11T05:35:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0980000000000001e-06 2024-09-11T05:35:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745690+0000", 2024-09-11T05:35:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.733e-06 2024-09-11T05:35:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745695+0000", 2024-09-11T05:35:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:35:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784418+0000", 2024-09-11T05:35:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038722813000000002 2024-09-11T05:35:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784460+0000", 2024-09-11T05:35:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2222999999999999e-05 2024-09-11T05:35:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784508+0000", 2024-09-11T05:35:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8349000000000001e-05 2024-09-11T05:35:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183625 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4337664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:35:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.453814184000002, 2024-09-11T05:35:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923776, 2024-09-11T05:35:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183625 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:35:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:35:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.41e-07 2024-09-11T05:35:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745713+0000", 2024-09-11T05:35:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0579e-05 2024-09-11T05:35:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745719+0000", 2024-09-11T05:35:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4540000000000004e-06 2024-09-11T05:35:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745724+0000", 2024-09-11T05:35:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1170000000000003e-06 2024-09-11T05:35:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784532+0000", 2024-09-11T05:35:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038807618000000002 2024-09-11T05:35:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784586+0000", 2024-09-11T05:35:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4432999999999999e-05 2024-09-11T05:35:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784625+0000", 2024-09-11T05:35:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9233999999999997e-05 2024-09-11T05:35:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183626 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.453784521999999, 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038934147000000002, 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183626 2024-09-11T05:35:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745732+0000", 2024-09-11T05:35:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:35:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745734+0000", 2024-09-11T05:35:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9649999999999998e-06 2024-09-11T05:35:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745739+0000", 2024-09-11T05:35:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.806e-06 2024-09-11T05:35:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745744+0000", 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5210000000000004e-06 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784660+0000", 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038916077 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784665+0000", 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3929999999999999e-06 2024-09-11T05:35:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183627 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.453766004000002, 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038942282000000002, 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183627 2024-09-11T05:35:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:35:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:35:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:35:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:35:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745752+0000", 2024-09-11T05:35:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9e-06 2024-09-11T05:35:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745758+0000", 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6899999999999997e-06 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745763+0000", 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9169999999999997e-06 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784686+0000", 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923874999999997 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784692+0000", 2024-09-11T05:35:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5600000000000001e-06 2024-09-11T05:35:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183628 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:35:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.453727393000001, 2024-09-11T05:35:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038927438000000002, 2024-09-11T05:35:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183628 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745789+0000", 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3000000000000002e-07 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745791+0000", 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0209999999999998e-06 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745802+0000", 2024-09-11T05:35:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0886e-05 2024-09-11T05:35:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745806+0000", 2024-09-11T05:35:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0289999999999999e-06 2024-09-11T05:35:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784712+0000", 2024-09-11T05:35:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038905922000000003 2024-09-11T05:35:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784716+0000", 2024-09-11T05:35:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.25e-06 2024-09-11T05:35:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183629 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:35:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 50.453705675999998, 2024-09-11T05:35:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038954874, 2024-09-11T05:35:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:35:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183629 2024-09-11T05:35:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:35:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:35:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747489+0000", 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0016785529999999999 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747493+0000", 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0600000000000001e-06 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747501+0000", 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9109999999999993e-06 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747507+0000", 2024-09-11T05:35:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3899999999999998e-06 2024-09-11T05:35:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784760+0000", 2024-09-11T05:35:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037253197000000002 2024-09-11T05:35:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784765+0000", 2024-09-11T05:35:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.763e-06 2024-09-11T05:35:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.295 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:02.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:35:02.297 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:02.296+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:02.397 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:02.397+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:02.442 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:35:02.442 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:02.450 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:35:02.534 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:02.534+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:02.594 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:35:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:35:02.594 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:02.600 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:35:02.599+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:35:02.603 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:35:02.702 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:02.701+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:02.754 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:35:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:35:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:35:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116713 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13060096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:35:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.938149241999994, 2024-09-11T05:35:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599235, 2024-09-11T05:35:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116713 2024-09-11T05:35:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:35:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:35:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813321+0000", 2024-09-11T05:35:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000005e-07 2024-09-11T05:35:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813323+0000", 2024-09-11T05:35:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.667e-06 2024-09-11T05:35:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813331+0000", 2024-09-11T05:35:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6529999999999994e-06 2024-09-11T05:35:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813336+0000", 2024-09-11T05:35:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:35:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813688+0000", 2024-09-11T05:35:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035143199999999999 2024-09-11T05:35:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813692+0000", 2024-09-11T05:35:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5120000000000002e-06 2024-09-11T05:35:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816304+0000", 2024-09-11T05:35:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026115449999999998 2024-09-11T05:35:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816308+0000", 2024-09-11T05:35:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2370000000000003e-06 2024-09-11T05:35:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821720+0000", 2024-09-11T05:35:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0054114869999999 2024-09-11T05:35:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821724+0000", 2024-09-11T05:35:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:35:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873101+0000", 2024-09-11T05:35:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0513774279999999 2024-09-11T05:35:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873159+0000", 2024-09-11T05:35:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819000000000003e-05 2024-09-11T05:35:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873244+0000", 2024-09-11T05:35:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4300000000000003e-05 2024-09-11T05:35:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116714 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:35:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.938106606999995, 2024-09-11T05:35:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600505999999998, 2024-09-11T05:35:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116714 2024-09-11T05:35:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:35:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:35:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:35:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:35:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813366+0000", 2024-09-11T05:35:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6919999999999998e-06 2024-09-11T05:35:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813373+0000", 2024-09-11T05:35:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8689999999999998e-06 2024-09-11T05:35:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813378+0000", 2024-09-11T05:35:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2159999999999997e-06 2024-09-11T05:35:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813733+0000", 2024-09-11T05:35:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035530300000000001 2024-09-11T05:35:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813739+0000", 2024-09-11T05:35:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8819999999999998e-06 2024-09-11T05:35:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816340+0000", 2024-09-11T05:35:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002600598 2024-09-11T05:35:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816349+0000", 2024-09-11T05:35:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9169999999999995e-06 2024-09-11T05:35:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821745+0000", 2024-09-11T05:35:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005396416 2024-09-11T05:35:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821750+0000", 2024-09-11T05:35:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:35:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873269+0000", 2024-09-11T05:35:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0515195159999999 2024-09-11T05:35:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873328+0000", 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9222999999999999e-05 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873413+0000", 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4983999999999998e-05 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116715 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13109248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:35:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.938065125999998, 2024-09-11T05:35:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0602519180000001, 2024-09-11T05:35:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116715 2024-09-11T05:35:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:35:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:35:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813405+0000", 2024-09-11T05:35:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.51e-07 2024-09-11T05:35:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813407+0000", 2024-09-11T05:35:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:35:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813414+0000", 2024-09-11T05:35:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.686e-06 2024-09-11T05:35:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813419+0000", 2024-09-11T05:35:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4249999999999997e-06 2024-09-11T05:35:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813774+0000", 2024-09-11T05:35:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035460800000000002 2024-09-11T05:35:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813778+0000", 2024-09-11T05:35:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:35:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816375+0000", 2024-09-11T05:35:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025967730000000001 2024-09-11T05:35:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816379+0000", 2024-09-11T05:35:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3780000000000003e-06 2024-09-11T05:35:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821770+0000", 2024-09-11T05:35:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053903040000001 2024-09-11T05:35:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821774+0000", 2024-09-11T05:35:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:35:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873437+0000", 2024-09-11T05:35:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051663155 2024-09-11T05:35:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873500+0000", 2024-09-11T05:35:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3027000000000005e-05 2024-09-11T05:35:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873656+0000", 2024-09-11T05:35:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015580800000000001 2024-09-11T05:35:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116716 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13133824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:35:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.938022669000006, 2024-09-11T05:35:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0605170350000002, 2024-09-11T05:35:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116716 2024-09-11T05:35:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:35:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:35:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:35:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5799999999999999e-07 2024-09-11T05:35:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813450+0000", 2024-09-11T05:35:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7659999999999999e-06 2024-09-11T05:35:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813458+0000", 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7430000000000002e-06 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813464+0000", 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813814+0000", 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035073199999999998 2024-09-11T05:35:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813819+0000", 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816410+0000", 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025904349999999999 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816418+0000", 2024-09-11T05:35:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1610000000000003e-06 2024-09-11T05:35:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821794+0000", 2024-09-11T05:35:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005376391 2024-09-11T05:35:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821799+0000", 2024-09-11T05:35:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4870000000000004e-06 2024-09-11T05:35:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873697+0000", 2024-09-11T05:35:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051898843 2024-09-11T05:35:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873810+0000", 2024-09-11T05:35:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112187 2024-09-11T05:35:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873964+0000", 2024-09-11T05:35:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015412800000000001 2024-09-11T05:35:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116717 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13158400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:35:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.937997585000005, 2024-09-11T05:35:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606806560000002, 2024-09-11T05:35:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116717 2024-09-11T05:35:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:35:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:35:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:35:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:35:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813474+0000", 2024-09-11T05:35:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1830000000000001e-06 2024-09-11T05:35:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813481+0000", 2024-09-11T05:35:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5540000000000003e-06 2024-09-11T05:35:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813491+0000", 2024-09-11T05:35:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0472000000000001e-05 2024-09-11T05:35:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813867+0000", 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00037606 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813873+0000", 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.254e-06 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816443+0000", 2024-09-11T05:35:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025701769999999999 2024-09-11T05:35:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816446+0000", 2024-09-11T05:35:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:35:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821818+0000", 2024-09-11T05:35:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053719830000001 2024-09-11T05:35:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821823+0000", 2024-09-11T05:35:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5560000000000001e-06 2024-09-11T05:35:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874006+0000", 2024-09-11T05:35:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05218342 2024-09-11T05:35:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874071+0000", 2024-09-11T05:35:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4369999999999995e-05 2024-09-11T05:35:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874152+0000", 2024-09-11T05:35:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1658999999999999e-05 2024-09-11T05:35:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116718 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13182976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:35:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.937966067000005, 2024-09-11T05:35:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0609185380000001, 2024-09-11T05:35:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116718 2024-09-11T05:35:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:35:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:35:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813504+0000", 2024-09-11T05:35:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7999999999999996e-07 2024-09-11T05:35:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813506+0000", 2024-09-11T05:35:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2989999999999999e-06 2024-09-11T05:35:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813513+0000", 2024-09-11T05:35:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8020000000000003e-06 2024-09-11T05:35:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813517+0000", 2024-09-11T05:35:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5639999999999998e-06 2024-09-11T05:35:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813916+0000", 2024-09-11T05:35:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039859800000000001 2024-09-11T05:35:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813922+0000", 2024-09-11T05:35:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:35:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816476+0000", 2024-09-11T05:35:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025538359999999999 2024-09-11T05:35:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816481+0000", 2024-09-11T05:35:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819999999999999e-06 2024-09-11T05:35:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821843+0000", 2024-09-11T05:35:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053620299999999 2024-09-11T05:35:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821848+0000", 2024-09-11T05:35:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:35:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874191+0000", 2024-09-11T05:35:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052342935 2024-09-11T05:35:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874300+0000", 2024-09-11T05:35:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000108764 2024-09-11T05:35:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874422+0000", 2024-09-11T05:35:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012221399999999999 2024-09-11T05:35:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116719 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13207552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:35:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.937925269000004, 2024-09-11T05:35:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0611734350000002, 2024-09-11T05:35:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116719 2024-09-11T05:35:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:35:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:35:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813545+0000", 2024-09-11T05:35:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2600000000000002e-07 2024-09-11T05:35:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813547+0000", 2024-09-11T05:35:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3329999999999999e-06 2024-09-11T05:35:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813553+0000", 2024-09-11T05:35:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4640000000000003e-06 2024-09-11T05:35:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813558+0000", 2024-09-11T05:35:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:35:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813952+0000", 2024-09-11T05:35:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039390999999999997 2024-09-11T05:35:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813955+0000", 2024-09-11T05:35:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.858e-06 2024-09-11T05:35:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816524+0000", 2024-09-11T05:35:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002568847 2024-09-11T05:35:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816533+0000", 2024-09-11T05:35:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1749999999999994e-06 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821869+0000", 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053358939999999 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821876+0000", 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874454+0000", 2024-09-11T05:35:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052577621 2024-09-11T05:35:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874546+0000", 2024-09-11T05:35:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2151999999999995e-05 2024-09-11T05:35:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874718+0000", 2024-09-11T05:35:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017183399999999999 2024-09-11T05:35:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116720 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13232128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:35:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.937903383000005, 2024-09-11T05:35:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0614845590000002, 2024-09-11T05:35:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116720 2024-09-11T05:35:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:35:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:35:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:35:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5600000000000002e-07 2024-09-11T05:35:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813568+0000", 2024-09-11T05:35:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9089999999999998e-06 2024-09-11T05:35:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813573+0000", 2024-09-11T05:35:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2059999999999998e-06 2024-09-11T05:35:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813577+0000", 2024-09-11T05:35:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1489999999999996e-06 2024-09-11T05:35:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813987+0000", 2024-09-11T05:35:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040977800000000002 2024-09-11T05:35:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813992+0000", 2024-09-11T05:35:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1540000000000001e-06 2024-09-11T05:35:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816560+0000", 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025680389999999998 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816566+0000", 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0679999999999996e-06 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821907+0000", 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005341735 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821916+0000", 2024-09-11T05:35:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3659999999999992e-06 2024-09-11T05:35:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874760+0000", 2024-09-11T05:35:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052844713 2024-09-11T05:35:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874878+0000", 2024-09-11T05:35:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000117321 2024-09-11T05:35:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875051+0000", 2024-09-11T05:35:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017286499999999999 2024-09-11T05:35:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116721 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13256704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:35:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.937886028999998, 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0616932019999998, 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116721 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:35:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:35:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813584+0000", 2024-09-11T05:35:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2e-07 2024-09-11T05:35:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813586+0000", 2024-09-11T05:35:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.277e-06 2024-09-11T05:35:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813592+0000", 2024-09-11T05:35:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5840000000000002e-06 2024-09-11T05:35:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813597+0000", 2024-09-11T05:35:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2839999999999997e-06 2024-09-11T05:35:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814028+0000", 2024-09-11T05:35:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000430689 2024-09-11T05:35:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814032+0000", 2024-09-11T05:35:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3850000000000004e-06 2024-09-11T05:35:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816597+0000", 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00256485 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816606+0000", 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821949+0000", 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005342752 2024-09-11T05:35:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821954+0000", 2024-09-11T05:35:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2270000000000001e-06 2024-09-11T05:35:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875095+0000", 2024-09-11T05:35:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.053140669 2024-09-11T05:35:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875186+0000", 2024-09-11T05:35:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1391999999999995e-05 2024-09-11T05:35:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875277+0000", 2024-09-11T05:35:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0556000000000005e-05 2024-09-11T05:35:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116722 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13281280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:35:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.937849029999995, 2024-09-11T05:35:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.061825491, 2024-09-11T05:35:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116722 2024-09-11T05:35:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:35:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:35:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813621+0000", 2024-09-11T05:35:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:35:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813625+0000", 2024-09-11T05:35:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.228e-06 2024-09-11T05:35:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813635+0000", 2024-09-11T05:35:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5179999999999993e-06 2024-09-11T05:35:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813641+0000", 2024-09-11T05:35:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4710000000000004e-06 2024-09-11T05:35:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814057+0000", 2024-09-11T05:35:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00041530099999999997 2024-09-11T05:35:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814060+0000", 2024-09-11T05:35:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-06 2024-09-11T05:35:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816632+0000", 2024-09-11T05:35:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00257186 2024-09-11T05:35:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816636+0000", 2024-09-11T05:35:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2150000000000003e-06 2024-09-11T05:35:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821977+0000", 2024-09-11T05:35:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053407110000001 2024-09-11T05:35:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821982+0000", 2024-09-11T05:35:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:35:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875307+0000", 2024-09-11T05:35:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0533247000000001 2024-09-11T05:35:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875366+0000", 2024-09-11T05:35:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8628999999999997e-05 2024-09-11T05:35:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875446+0000", 2024-09-11T05:35:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0026999999999998e-05 2024-09-11T05:35:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116723 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13305856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:35:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.937816052000002, 2024-09-11T05:35:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0619630779999998, 2024-09-11T05:35:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116723 2024-09-11T05:35:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:35:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:35:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813654+0000", 2024-09-11T05:35:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:35:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813661+0000", 2024-09-11T05:35:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1890000000000001e-06 2024-09-11T05:35:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813675+0000", 2024-09-11T05:35:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3878e-05 2024-09-11T05:35:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813682+0000", 2024-09-11T05:35:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.063e-06 2024-09-11T05:35:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816666+0000", 2024-09-11T05:35:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029845679999999999 2024-09-11T05:35:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816671+0000", 2024-09-11T05:35:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:35:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822024+0000", 2024-09-11T05:35:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053534660000001 2024-09-11T05:35:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822028+0000", 2024-09-11T05:35:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7799999999999998e-06 2024-09-11T05:35:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875471+0000", 2024-09-11T05:35:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05344306 2024-09-11T05:35:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875531+0000", 2024-09-11T05:35:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0019000000000003e-05 2024-09-11T05:35:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875616+0000", 2024-09-11T05:35:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5304999999999997e-05 2024-09-11T05:35:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116724 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13330432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.937776563, 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0620902609999998, 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116724 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:35:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:35:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:35:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.99e-07 2024-09-11T05:35:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813697+0000", 2024-09-11T05:35:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2430000000000001e-06 2024-09-11T05:35:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813704+0000", 2024-09-11T05:35:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2980000000000003e-06 2024-09-11T05:35:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813709+0000", 2024-09-11T05:35:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8130000000000003e-06 2024-09-11T05:35:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816702+0000", 2024-09-11T05:35:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002992864 2024-09-11T05:35:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816711+0000", 2024-09-11T05:35:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1840000000000005e-06 2024-09-11T05:35:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822050+0000", 2024-09-11T05:35:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.00533864 2024-09-11T05:35:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822055+0000", 2024-09-11T05:35:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:35:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875642+0000", 2024-09-11T05:35:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0535874220000001 2024-09-11T05:35:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875698+0000", 2024-09-11T05:35:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5707e-05 2024-09-11T05:35:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875783+0000", 2024-09-11T05:35:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5362e-05 2024-09-11T05:35:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116725 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13355008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:35:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.937742374999999, 2024-09-11T05:35:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.06220984, 2024-09-11T05:35:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116725 2024-09-11T05:35:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:35:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813728+0000", 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813730+0000", 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6730000000000001e-06 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813743+0000", 2024-09-11T05:35:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2833000000000001e-05 2024-09-11T05:35:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813749+0000", 2024-09-11T05:35:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:35:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816726+0000", 2024-09-11T05:35:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029772090000000002 2024-09-11T05:35:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816730+0000", 2024-09-11T05:35:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.518e-06 2024-09-11T05:35:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822074+0000", 2024-09-11T05:35:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053444030000001 2024-09-11T05:35:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822079+0000", 2024-09-11T05:35:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:35:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875807+0000", 2024-09-11T05:35:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0537284410000001 2024-09-11T05:35:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875858+0000", 2024-09-11T05:35:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0574000000000001e-05 2024-09-11T05:35:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875937+0000", 2024-09-11T05:35:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9268000000000001e-05 2024-09-11T05:35:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116974 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13185024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:35:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.929798539000004, 2024-09-11T05:35:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598649249999998, 2024-09-11T05:35:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116974 2024-09-11T05:35:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:35:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:35:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:35:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:35:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821673+0000", 2024-09-11T05:35:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.722e-06 2024-09-11T05:35:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821686+0000", 2024-09-11T05:35:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2974e-05 2024-09-11T05:35:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821692+0000", 2024-09-11T05:35:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:35:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822089+0000", 2024-09-11T05:35:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039611699999999998 2024-09-11T05:35:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822099+0000", 2024-09-11T05:35:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0029e-05 2024-09-11T05:35:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822803+0000", 2024-09-11T05:35:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000704507 2024-09-11T05:35:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822808+0000", 2024-09-11T05:35:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6460000000000001e-06 2024-09-11T05:35:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881361+0000", 2024-09-11T05:35:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0585529680000001 2024-09-11T05:35:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881432+0000", 2024-09-11T05:35:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:35:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881536+0000", 2024-09-11T05:35:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000103243 2024-09-11T05:35:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116975 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13209600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:35:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.929770204999997, 2024-09-11T05:35:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.060124761, 2024-09-11T05:35:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116975 2024-09-11T05:35:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:35:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:35:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821700+0000", 2024-09-11T05:35:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:35:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821701+0000", 2024-09-11T05:35:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8369999999999999e-06 2024-09-11T05:35:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821708+0000", 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5520000000000001e-06 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821713+0000", 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.091e-06 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822135+0000", 2024-09-11T05:35:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00042166399999999998 2024-09-11T05:35:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822143+0000", 2024-09-11T05:35:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3089999999999996e-06 2024-09-11T05:35:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822820+0000", 2024-09-11T05:35:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000677145 2024-09-11T05:35:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822824+0000", 2024-09-11T05:35:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.641e-06 2024-09-11T05:35:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881569+0000", 2024-09-11T05:35:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.058744785 2024-09-11T05:35:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881674+0000", 2024-09-11T05:35:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000105111 2024-09-11T05:35:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881824+0000", 2024-09-11T05:35:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000150197 2024-09-11T05:35:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116976 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13234176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:35:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.929741226000004, 2024-09-11T05:35:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0603909900000001, 2024-09-11T05:35:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116976 2024-09-11T05:35:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:35:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:35:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821729+0000", 2024-09-11T05:35:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:35:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821731+0000", 2024-09-11T05:35:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0250000000000001e-06 2024-09-11T05:35:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821737+0000", 2024-09-11T05:35:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8839999999999997e-06 2024-09-11T05:35:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821743+0000", 2024-09-11T05:35:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1050000000000003e-06 2024-09-11T05:35:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822194+0000", 2024-09-11T05:35:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000451574 2024-09-11T05:35:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822203+0000", 2024-09-11T05:35:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9449999999999999e-06 2024-09-11T05:35:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822835+0000", 2024-09-11T05:35:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000632019 2024-09-11T05:35:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822839+0000", 2024-09-11T05:35:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8229999999999997e-06 2024-09-11T05:35:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881861+0000", 2024-09-11T05:35:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.059021776 2024-09-11T05:35:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881976+0000", 2024-09-11T05:35:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00011531699999999999 2024-09-11T05:35:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882119+0000", 2024-09-11T05:35:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000143077 2024-09-11T05:35:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116977 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13258752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:35:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.929689991999993, 2024-09-11T05:35:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606236920000001, 2024-09-11T05:35:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116977 2024-09-11T05:35:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821782+0000", 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7719999999999999e-06 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821785+0000", 2024-09-11T05:35:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9409999999999999e-06 2024-09-11T05:35:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821793+0000", 2024-09-11T05:35:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:35:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821799+0000", 2024-09-11T05:35:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4609999999999999e-06 2024-09-11T05:35:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822246+0000", 2024-09-11T05:35:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044669000000000002 2024-09-11T05:35:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822254+0000", 2024-09-11T05:35:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1859999999999992e-06 2024-09-11T05:35:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822850+0000", 2024-09-11T05:35:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005962340000001 2024-09-11T05:35:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822854+0000", 2024-09-11T05:35:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5310000000000002e-06 2024-09-11T05:35:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882149+0000", 2024-09-11T05:35:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0592958729999999 2024-09-11T05:35:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882253+0000", 2024-09-11T05:35:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104058 2024-09-11T05:35:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882403+0000", 2024-09-11T05:35:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014958800000000001 2024-09-11T05:35:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116978 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13283328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:35:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.929659768999997, 2024-09-11T05:35:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0608297769999999, 2024-09-11T05:35:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116978 2024-09-11T05:35:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:35:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:35:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:35:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:35:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821813+0000", 2024-09-11T05:35:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:35:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821820+0000", 2024-09-11T05:35:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3669999999999999e-06 2024-09-11T05:35:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821825+0000", 2024-09-11T05:35:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5119999999999999e-06 2024-09-11T05:35:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822273+0000", 2024-09-11T05:35:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044727900000000003 2024-09-11T05:35:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822278+0000", 2024-09-11T05:35:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7529999999999998e-06 2024-09-11T05:35:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822865+0000", 2024-09-11T05:35:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005861579999999 2024-09-11T05:35:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822868+0000", 2024-09-11T05:35:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4659999999999999e-06 2024-09-11T05:35:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882434+0000", 2024-09-11T05:35:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0595660170000001 2024-09-11T05:35:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882502+0000", 2024-09-11T05:35:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7442999999999998e-05 2024-09-11T05:35:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882639+0000", 2024-09-11T05:35:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013779999999999999 2024-09-11T05:35:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116980 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13332480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:35:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.928120246999995, 2024-09-11T05:35:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598269180000002, 2024-09-11T05:35:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116980 2024-09-11T05:35:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:35:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:35:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823350+0000", 2024-09-11T05:35:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:35:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823352+0000", 2024-09-11T05:35:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5459999999999998e-06 2024-09-11T05:35:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823360+0000", 2024-09-11T05:35:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4359999999999996e-06 2024-09-11T05:35:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823365+0000", 2024-09-11T05:35:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3079999999999998e-06 2024-09-11T05:35:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823418+0000", 2024-09-11T05:35:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2735999999999998e-05 2024-09-11T05:35:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823423+0000", 2024-09-11T05:35:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3410000000000002e-06 2024-09-11T05:35:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822895+0000", 2024-09-11T05:35:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99947249000000005 2024-09-11T05:35:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822899+0000", 2024-09-11T05:35:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6169999999999998e-06 2024-09-11T05:35:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882964+0000", 2024-09-11T05:35:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0600650840000001 2024-09-11T05:35:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883020+0000", 2024-09-11T05:35:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5563000000000003e-05 2024-09-11T05:35:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883176+0000", 2024-09-11T05:35:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015629500000000001 2024-09-11T05:35:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116981 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13357056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:35:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 83.928096267000001, 2024-09-11T05:35:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600075910000002, 2024-09-11T05:35:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116981 2024-09-11T05:35:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:35:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:35:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:35:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.01e-07 2024-09-11T05:35:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823376+0000", 2024-09-11T05:35:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:35:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823381+0000", 2024-09-11T05:35:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000001e-06 2024-09-11T05:35:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823386+0000", 2024-09-11T05:35:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5349999999999998e-06 2024-09-11T05:35:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823447+0000", 2024-09-11T05:35:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1277000000000003e-05 2024-09-11T05:35:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823456+0000", 2024-09-11T05:35:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8859999999999993e-06 2024-09-11T05:35:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822914+0000", 2024-09-11T05:35:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99945797999999997 2024-09-11T05:35:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822918+0000", 2024-09-11T05:35:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5810000000000001e-06 2024-09-11T05:35:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883209+0000", 2024-09-11T05:35:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0602916899999999 2024-09-11T05:35:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883292+0000", 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2849000000000006e-05 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883381+0000", 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8585000000000007e-05 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:02.917 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:02.918 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:35:02.918 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:02.918+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:03.019 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:03.019+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:35:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:03.071 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:35:03.120 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:35:03.119+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:35:03.213 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:03.213 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:03.214 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:35:03.214 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:35:03.214 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:03.221 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:03.220+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:03.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:35:03.323 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:03.322+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:03.326 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:35:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:35:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:35:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 112.676829285, 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:35:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:35:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:35:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:35:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:35:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:35:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:35:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:35:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:35:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:35:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:35:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:35:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:35:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.332 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:35:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:35:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:146253 3.6 3:64dbadcf:::rbd_data.112d55d87bfc.0000000000000332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-11T05:35:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:35:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 77.488014376999999, 2024-09-11T05:35:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4166483809999999, 2024-09-11T05:35:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 146253 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837090+0000", 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.73e-06 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837096+0000", 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3500000000000002e-06 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.336 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837115+0000", 2024-09-11T05:35:03.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8556e-05 2024-09-11T05:35:03.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.336 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837124+0000", 2024-09-11T05:35:03.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6739999999999992e-06 2024-09-11T05:35:03.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.336 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837184+0000", 2024-09-11T05:35:03.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9960000000000002e-05 2024-09-11T05:35:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:35:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837188+0000", 2024-09-11T05:35:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:35:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840481+0000", 2024-09-11T05:35:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032924080000000001 2024-09-11T05:35:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.337 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840497+0000", 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6140000000000001e-05 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850737+0000", 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0102404119999999 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850747+0000", 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7969999999999995e-06 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252495+0000", 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.401748131 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252636+0000", 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014118900000000001 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252737+0000", 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00010058 2024-09-11T05:35:03.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253433+0000", 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00069601999999999999 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253604+0000", 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000170824 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253649+0000", 2024-09-11T05:35:03.340 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5050999999999999e-05 2024-09-11T05:35:03.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.341 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.341 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253736+0000", 2024-09-11T05:35:03.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7509000000000005e-05 2024-09-11T05:35:03.341 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.341 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.341 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.341 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:147298 3.6 3:652e51de:::rbd_data.112d55d87bfc.0000000000000377:head [set-alloc-hint object_size 262144 write_size 262144,write 122880~2839] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-11T05:35:03.341 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:35:03.341 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 74.091473801000006, 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62981612099999995, 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 147298 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:35:03.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233630+0000", 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5489999999999999e-06 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233637+0000", 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.272e-06 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233654+0000", 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6283999999999999e-05 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233662+0000", 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.875e-06 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.344 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233723+0000", 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1501000000000006e-05 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233732+0000", 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0699999999999996e-06 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862055+0000", 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62832274799999999 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.345 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862219+0000", 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016404899999999999 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862313+0000", 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4105999999999997e-05 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862981+0000", 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00066744199999999997 2024-09-11T05:35:03.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863382+0000", 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040111200000000002 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863419+0000", 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6974000000000002e-05 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863445+0000", 2024-09-11T05:35:03.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6139000000000002e-05 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151292 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368822406000007, 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054346481000000002, 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.348 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151292 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956283+0000", 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2450000000000001e-06 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956290+0000", 2024-09-11T05:35:03.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0910000000000004e-06 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956296+0000", 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.947e-06 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010460+0000", 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054164165 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010537+0000", 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6965000000000006e-05 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010626+0000", 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9628000000000003e-05 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151293 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1933312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:35:03.352 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368799562999996, 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054563858999999999, 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151293 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:35:03.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.46e-07 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.354 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956306+0000", 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2259999999999999e-06 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956312+0000", 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956317+0000", 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.355 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.356 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010671+0000", 2024-09-11T05:35:03.356 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054353830999999998 2024-09-11T05:35:03.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.356 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.356 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.356 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010757+0000", 2024-09-11T05:35:03.356 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6120999999999998e-05 2024-09-11T05:35:03.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.356 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.356 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.356 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010867+0000", 2024-09-11T05:35:03.356 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000109687 2024-09-11T05:35:03.356 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151294 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2179072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368777700999999, 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054741825000000001, 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.357 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151294 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.84e-07 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956326+0000", 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.483e-06 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956330+0000", 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8519999999999997e-06 2024-09-11T05:35:03.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956334+0000", 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4139999999999998e-06 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010894+0000", 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054560243000000001 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010970+0000", 2024-09-11T05:35:03.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6138999999999997e-05 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011067+0000", 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6409999999999993e-05 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151295 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2392064~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368765030000006, 2024-09-11T05:35:03.361 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054949748999999999, 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151295 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.363 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:35:03.363 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.363 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956338+0000", 2024-09-11T05:35:03.363 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.23e-07 2024-09-11T05:35:03.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.363 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956339+0000", 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.243e-06 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956342+0000", 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.473e-06 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956345+0000", 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.364 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011109+0000", 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054763698999999999 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011188+0000", 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8887999999999994e-05 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011287+0000", 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9504000000000001e-05 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.365 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151296 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368753920000003, 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055045187000000002, 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.366 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151296 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956349+0000", 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956350+0000", 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956353+0000", 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.016e-06 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956355+0000", 2024-09-11T05:35:03.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5509999999999998e-06 2024-09-11T05:35:03.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011303+0000", 2024-09-11T05:35:03.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054947306000000001 2024-09-11T05:35:03.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011342+0000", 2024-09-11T05:35:03.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9057999999999998e-05 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011394+0000", 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1925999999999997e-05 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151297 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2818048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368743988999995, 2024-09-11T05:35:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055238158000000002, 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151297 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.372 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.372 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:35:03.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.372 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.372 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956359+0000", 2024-09-11T05:35:03.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:35:03.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.372 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.372 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956360+0000", 2024-09-11T05:35:03.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1030000000000001e-06 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956363+0000", 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.021e-06 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956365+0000", 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4770000000000002e-06 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011425+0000", 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055059967000000001 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011506+0000", 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1063000000000006e-05 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011597+0000", 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0299999999999999e-05 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151298 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3031040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368734023000002, 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055425825999999997, 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151298 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.375 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:35:03.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:35:03.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956369+0000", 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4400000000000001e-07 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956370+0000", 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.068e-06 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956373+0000", 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0419999999999998e-06 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.377 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956375+0000", 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011631+0000", 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055255116999999999 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011703+0000", 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2554999999999999e-05 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.378 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011794+0000", 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1119999999999995e-05 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151299 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3276800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368722720999997, 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055567477999999997, 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.379 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.380 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.380 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.380 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.380 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.380 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151299 2024-09-11T05:35:03.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.380 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.380 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.380 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:35:03.380 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.381 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.381 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:35:03.381 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.381 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.381 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:35:03.381 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:35:03.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.381 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.381 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956382+0000", 2024-09-11T05:35:03.382 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.72e-06 2024-09-11T05:35:03.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.382 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.382 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.382 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956386+0000", 2024-09-11T05:35:03.382 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0990000000000001e-06 2024-09-11T05:35:03.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.382 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.382 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.382 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956390+0000", 2024-09-11T05:35:03.383 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.318e-06 2024-09-11T05:35:03.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.383 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.383 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011823+0000", 2024-09-11T05:35:03.383 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055432976000000002 2024-09-11T05:35:03.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.384 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.384 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011882+0000", 2024-09-11T05:35:03.384 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8656999999999998e-05 2024-09-11T05:35:03.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.384 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.384 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.384 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011947+0000", 2024-09-11T05:35:03.385 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5177000000000003e-05 2024-09-11T05:35:03.385 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.385 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.385 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.385 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.385 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151300 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3489792~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.385 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:35:03.386 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368706254000003, 2024-09-11T05:35:03.386 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055745232999999998, 2024-09-11T05:35:03.386 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.386 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.386 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.386 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.386 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.386 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.387 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151300 2024-09-11T05:35:03.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.387 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.387 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.387 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.387 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:35:03.387 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.388 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.388 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.388 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:35:03.388 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.388 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.388 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.389 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956397+0000", 2024-09-11T05:35:03.389 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:35:03.389 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.389 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.389 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.389 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956398+0000", 2024-09-11T05:35:03.390 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.869e-06 2024-09-11T05:35:03.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.390 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.390 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.390 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956404+0000", 2024-09-11T05:35:03.390 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:35:03.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.391 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.391 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.391 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956407+0000", 2024-09-11T05:35:03.391 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.191e-06 2024-09-11T05:35:03.391 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.391 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.391 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.391 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011981+0000", 2024-09-11T05:35:03.392 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055573553999999997 2024-09-11T05:35:03.392 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.392 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.392 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.392 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012051+0000", 2024-09-11T05:35:03.392 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9542999999999995e-05 2024-09-11T05:35:03.392 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.393 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.393 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.393 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012141+0000", 2024-09-11T05:35:03.393 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0845000000000002e-05 2024-09-11T05:35:03.393 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.393 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.393 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.394 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.394 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.394 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151301 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3702784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.394 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:35:03.394 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368691325, 2024-09-11T05:35:03.394 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055834747999999997, 2024-09-11T05:35:03.394 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.395 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.395 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.395 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.395 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.395 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.395 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151301 2024-09-11T05:35:03.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.396 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.396 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.396 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.396 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:35:03.396 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.396 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.397 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.397 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:35:03.397 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.397 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.397 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.397 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.397 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:35:03.398 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:35:03.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.398 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.398 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.398 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956413+0000", 2024-09-11T05:35:03.398 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2810000000000001e-06 2024-09-11T05:35:03.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.398 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.399 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.399 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956416+0000", 2024-09-11T05:35:03.399 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1559999999999999e-06 2024-09-11T05:35:03.399 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.399 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.399 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.399 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956418+0000", 2024-09-11T05:35:03.400 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:35:03.400 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.400 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.400 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.400 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012155+0000", 2024-09-11T05:35:03.400 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055736651999999998 2024-09-11T05:35:03.400 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.400 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.400 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.400 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012193+0000", 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7848000000000001e-05 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012246+0000", 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3041000000000003e-05 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151302 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3915776~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:35:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368681222000006, 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056035532999999998, 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151302 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:35:03.402 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.403 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956426+0000", 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.853e-06 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956430+0000", 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3699999999999999e-06 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956432+0000", 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5979999999999999e-06 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.404 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.405 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012281+0000", 2024-09-11T05:35:03.405 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055848644000000003 2024-09-11T05:35:03.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.405 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.405 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012358+0000", 2024-09-11T05:35:03.405 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6662000000000006e-05 2024-09-11T05:35:03.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.405 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.405 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012457+0000", 2024-09-11T05:35:03.405 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9197999999999995e-05 2024-09-11T05:35:03.405 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.406 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.406 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.406 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151303 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4128768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.406 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:35:03.406 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368666640000001, 2024-09-11T05:35:03.406 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056186709000000001, 2024-09-11T05:35:03.406 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.406 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.406 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.406 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.406 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151303 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956437+0000", 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.201e-06 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956440+0000", 2024-09-11T05:35:03.408 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-06 2024-09-11T05:35:03.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.409 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.409 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.409 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956443+0000", 2024-09-11T05:35:03.409 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5909999999999998e-06 2024-09-11T05:35:03.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.409 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.409 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.409 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012494+0000", 2024-09-11T05:35:03.409 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056051541000000003 2024-09-11T05:35:03.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.409 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.409 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.410 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012558+0000", 2024-09-11T05:35:03.410 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3347000000000002e-05 2024-09-11T05:35:03.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.410 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.410 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.410 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012622+0000", 2024-09-11T05:35:03.410 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4760999999999999e-05 2024-09-11T05:35:03.410 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.410 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.410 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.410 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.411 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151304 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.411 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:35:03.411 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368656583000003, 2024-09-11T05:35:03.411 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056360149999999998, 2024-09-11T05:35:03.411 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.411 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.411 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.411 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.411 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.411 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.412 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151304 2024-09-11T05:35:03.412 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.412 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.412 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.412 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.412 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:35:03.412 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.412 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.412 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.412 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.412 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:35:03.412 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.413 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.413 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.413 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:35:03.413 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:35:03.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.413 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.413 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.413 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956447+0000", 2024-09-11T05:35:03.414 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.153e-06 2024-09-11T05:35:03.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.414 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.414 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.414 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956450+0000", 2024-09-11T05:35:03.414 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9909999999999998e-06 2024-09-11T05:35:03.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956453+0000", 2024-09-11T05:35:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.447e-06 2024-09-11T05:35:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.415 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012660+0000", 2024-09-11T05:35:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056207510000000002 2024-09-11T05:35:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012741+0000", 2024-09-11T05:35:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0734000000000003e-05 2024-09-11T05:35:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.416 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.417 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.417 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012806+0000", 2024-09-11T05:35:03.417 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5087999999999998e-05 2024-09-11T05:35:03.417 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.417 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.417 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.418 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.418 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151305 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4587520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.418 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:35:03.418 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368646822000002, 2024-09-11T05:35:03.418 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056476407999999999, 2024-09-11T05:35:03.418 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.418 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.418 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.419 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.419 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.419 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.419 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151305 2024-09-11T05:35:03.419 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.419 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.419 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.419 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.420 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:35:03.420 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.420 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.420 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.420 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.420 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:35:03.420 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.421 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.421 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.421 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:35:03.421 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:35:03.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.421 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.422 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.422 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956457+0000", 2024-09-11T05:35:03.422 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.353e-06 2024-09-11T05:35:03.422 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.422 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.422 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.422 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956460+0000", 2024-09-11T05:35:03.422 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0060000000000001e-06 2024-09-11T05:35:03.423 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.423 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.423 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.423 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956463+0000", 2024-09-11T05:35:03.423 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.452e-06 2024-09-11T05:35:03.423 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.423 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.424 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.424 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012834+0000", 2024-09-11T05:35:03.424 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056370917999999999 2024-09-11T05:35:03.424 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.424 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.424 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.424 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012877+0000", 2024-09-11T05:35:03.425 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000999999999997e-05 2024-09-11T05:35:03.425 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.425 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.425 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.425 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012932+0000", 2024-09-11T05:35:03.425 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5470000000000003e-05 2024-09-11T05:35:03.425 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.425 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.426 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.426 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.426 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.426 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151306 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4800512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.426 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:35:03.426 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368636842000001, 2024-09-11T05:35:03.426 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056579203000000002, 2024-09-11T05:35:03.427 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.427 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.427 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.427 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.427 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.427 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.427 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151306 2024-09-11T05:35:03.428 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.428 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.428 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.428 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.428 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:35:03.428 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.428 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.429 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.429 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.429 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:35:03.429 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.429 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.430 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.430 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.430 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:35:03.430 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.28e-07 2024-09-11T05:35:03.430 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.430 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.430 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.430 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956467+0000", 2024-09-11T05:35:03.430 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.088e-06 2024-09-11T05:35:03.430 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.430 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.431 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.431 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956470+0000", 2024-09-11T05:35:03.431 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0240000000000002e-06 2024-09-11T05:35:03.431 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.431 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.431 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.431 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956472+0000", 2024-09-11T05:35:03.431 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4609999999999998e-06 2024-09-11T05:35:03.431 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.431 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.431 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.431 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012953+0000", 2024-09-11T05:35:03.431 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056480524999999997 2024-09-11T05:35:03.432 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.432 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.432 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.432 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012994+0000", 2024-09-11T05:35:03.432 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1394999999999999e-05 2024-09-11T05:35:03.432 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.432 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.432 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.432 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013045+0000", 2024-09-11T05:35:03.432 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0482000000000002e-05 2024-09-11T05:35:03.432 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.432 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.432 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.433 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.433 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151307 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5013504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.433 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:35:03.433 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368627172999993, 2024-09-11T05:35:03.433 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056680525000000002, 2024-09-11T05:35:03.433 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.433 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.433 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.433 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.433 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.433 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.433 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151307 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.434 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956476+0000", 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0359999999999999e-06 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956479+0000", 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8899999999999999e-06 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.435 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.436 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.436 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956482+0000", 2024-09-11T05:35:03.436 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5380000000000001e-06 2024-09-11T05:35:03.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.436 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.436 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.436 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013065+0000", 2024-09-11T05:35:03.436 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056582983000000003 2024-09-11T05:35:03.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.436 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.436 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.436 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013104+0000", 2024-09-11T05:35:03.436 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9119999999999998e-05 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013156+0000", 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1743999999999998e-05 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151308 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5226496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 69.368609841999998, 2024-09-11T05:35:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056772738000000003, 2024-09-11T05:35:03.438 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:03.438 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:03.438 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:03.438 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:03.438 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:03.438 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:03.438 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151308 2024-09-11T05:35:03.438 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.438 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:03.438 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.438 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:03.438 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:35:03.438 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.439 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.439 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.439 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:03.439 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:35:03.439 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:03.439 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.439 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.439 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:03.439 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:35:03.439 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2599999999999998e-07 2024-09-11T05:35:03.439 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.439 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.440 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:03.440 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956495+0000", 2024-09-11T05:35:03.440 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9750000000000001e-06 2024-09-11T05:35:03.440 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.440 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.440 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:03.440 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956499+0000", 2024-09-11T05:35:03.440 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5179999999999998e-06 2024-09-11T05:35:03.440 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.440 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.440 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:03.440 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956502+0000", 2024-09-11T05:35:03.441 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7530000000000002e-06 2024-09-11T05:35:03.441 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.441 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.441 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:03.441 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013177+0000", 2024-09-11T05:35:03.441 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056674536999999997 2024-09-11T05:35:03.441 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.441 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.441 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:03.441 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013215+0000", 2024-09-11T05:35:03.441 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8578999999999998e-05 2024-09-11T05:35:03.441 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:03.442 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:03.442 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:03.442 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013265+0000", 2024-09-11T05:35:03.442 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0049999999999997e-05 2024-09-11T05:35:03.442 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.442 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.442 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.442 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:03.442 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:03.442 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:03.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:35:03.445 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:03.443+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:03.545 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:03.544+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:03.590 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:03.590 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:03.590 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:35:03.590 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:03.599 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:35:03.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:35:03.646 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:03.646+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:03.652 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:35:03.703 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:03.703 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:03.703 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:35:03.703 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:35:03.703 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:03.712 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:35:03.741 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:35:03.741 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:35:03.746 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:03.745+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:03.759 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:35:03.760 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:35:03.784 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:35:03.785 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:35:03.805 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:35:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:35:03.822 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:35:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:35:03.841 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:35:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:35:03.847 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:03.846+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:03.856 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:35:03.856 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:35:03.863 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:03.863 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:03.873 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:35:03.873 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:35:03.874 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:35:03.949 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:03.949+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:03.978 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:03.978 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:03.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:35:04.050 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:35:04.049+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:35:04.090 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:04.090 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:04.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:35:04.151 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:04.151+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:04.241 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:04.242 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:04.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:35:04.252 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:04.251+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:04.353 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:04.352+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:04.354 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:04.354 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:04.363 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:35:04.456 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:04.454+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:04.505 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:04.506 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:04.514 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:35:04.555 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:04.555+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:04.617 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:04.618 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:04.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:35:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T05:35:04.656 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:04.656+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:04.750 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:04.750 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:04.757 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:04.757+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:04.760 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:35:04.858 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:35:04.856+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:35:04.865 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:04.865 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:04.874 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:35:04.958 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:04.958+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:05.017 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:05.017 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:05.025 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:35:05.068 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:35:05.067+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:35:05.128 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:05.128 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:05.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:35:05.160 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:05.160+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:05.261 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:05.261+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:05.279 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:05.279 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:05.288 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:35:05.362 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:05.361+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:05.392 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:05.392 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:05.400 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:35:05.463 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:05.463+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:05.516 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:05.516 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:05.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:35:05.564 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:35:05.563+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:35:05.665 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:05.665+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:05.674 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:05.674 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:05.685 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:35:05.770 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:05.770+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:05.829 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:05.829 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:05.838 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:35:05.879 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:05.879+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:05.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:35:05.968 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:05.968+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:05.982 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:05.982 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:05.991 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:35:06.010 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:35:06.010 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:35:06.026 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:35:06.026 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:35:06.042 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:35:06.042 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:35:06.058 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:35:06.058 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:35:06.069 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:06.069+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:06.075 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:35:06.075 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:35:06.091 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:35:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:35:06.095 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:06.095 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:06.103 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:35:06.107 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:35:06.108 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:35:06.124 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:35:06.124 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:35:06.187 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:06.187+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:06.247 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:35:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:35:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:35:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116713 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13060096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:35:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.432303942000004, 2024-09-11T05:35:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599235, 2024-09-11T05:35:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116713 2024-09-11T05:35:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:35:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:35:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813321+0000", 2024-09-11T05:35:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000005e-07 2024-09-11T05:35:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813323+0000", 2024-09-11T05:35:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.667e-06 2024-09-11T05:35:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813331+0000", 2024-09-11T05:35:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6529999999999994e-06 2024-09-11T05:35:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813336+0000", 2024-09-11T05:35:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:35:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813688+0000", 2024-09-11T05:35:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035143199999999999 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813692+0000", 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5120000000000002e-06 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816304+0000", 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026115449999999998 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816308+0000", 2024-09-11T05:35:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2370000000000003e-06 2024-09-11T05:35:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821720+0000", 2024-09-11T05:35:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0054114869999999 2024-09-11T05:35:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821724+0000", 2024-09-11T05:35:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:35:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873101+0000", 2024-09-11T05:35:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0513774279999999 2024-09-11T05:35:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873159+0000", 2024-09-11T05:35:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819000000000003e-05 2024-09-11T05:35:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873244+0000", 2024-09-11T05:35:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4300000000000003e-05 2024-09-11T05:35:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116714 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:35:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.432261307000005, 2024-09-11T05:35:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600505999999998, 2024-09-11T05:35:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116714 2024-09-11T05:35:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813366+0000", 2024-09-11T05:35:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6919999999999998e-06 2024-09-11T05:35:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813373+0000", 2024-09-11T05:35:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8689999999999998e-06 2024-09-11T05:35:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813378+0000", 2024-09-11T05:35:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2159999999999997e-06 2024-09-11T05:35:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813733+0000", 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035530300000000001 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813739+0000", 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8819999999999998e-06 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816340+0000", 2024-09-11T05:35:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002600598 2024-09-11T05:35:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816349+0000", 2024-09-11T05:35:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9169999999999995e-06 2024-09-11T05:35:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821745+0000", 2024-09-11T05:35:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005396416 2024-09-11T05:35:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821750+0000", 2024-09-11T05:35:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:35:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873269+0000", 2024-09-11T05:35:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0515195159999999 2024-09-11T05:35:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873328+0000", 2024-09-11T05:35:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9222999999999999e-05 2024-09-11T05:35:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873413+0000", 2024-09-11T05:35:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4983999999999998e-05 2024-09-11T05:35:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116715 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13109248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:35:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.432219825999994, 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0602519180000001, 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116715 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:35:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:35:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813405+0000", 2024-09-11T05:35:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.51e-07 2024-09-11T05:35:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813407+0000", 2024-09-11T05:35:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:35:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813414+0000", 2024-09-11T05:35:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.686e-06 2024-09-11T05:35:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813419+0000", 2024-09-11T05:35:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4249999999999997e-06 2024-09-11T05:35:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813774+0000", 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035460800000000002 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813778+0000", 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816375+0000", 2024-09-11T05:35:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025967730000000001 2024-09-11T05:35:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816379+0000", 2024-09-11T05:35:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3780000000000003e-06 2024-09-11T05:35:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821770+0000", 2024-09-11T05:35:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053903040000001 2024-09-11T05:35:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821774+0000", 2024-09-11T05:35:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:35:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873437+0000", 2024-09-11T05:35:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051663155 2024-09-11T05:35:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873500+0000", 2024-09-11T05:35:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3027000000000005e-05 2024-09-11T05:35:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873656+0000", 2024-09-11T05:35:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015580800000000001 2024-09-11T05:35:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116716 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13133824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:35:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.432177369000001, 2024-09-11T05:35:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0605170350000002, 2024-09-11T05:35:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116716 2024-09-11T05:35:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:35:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:35:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:35:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5799999999999999e-07 2024-09-11T05:35:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813450+0000", 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7659999999999999e-06 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813458+0000", 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7430000000000002e-06 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813464+0000", 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813814+0000", 2024-09-11T05:35:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035073199999999998 2024-09-11T05:35:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813819+0000", 2024-09-11T05:35:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:35:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816410+0000", 2024-09-11T05:35:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025904349999999999 2024-09-11T05:35:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816418+0000", 2024-09-11T05:35:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1610000000000003e-06 2024-09-11T05:35:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821794+0000", 2024-09-11T05:35:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005376391 2024-09-11T05:35:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821799+0000", 2024-09-11T05:35:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4870000000000004e-06 2024-09-11T05:35:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873697+0000", 2024-09-11T05:35:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051898843 2024-09-11T05:35:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873810+0000", 2024-09-11T05:35:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112187 2024-09-11T05:35:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873964+0000", 2024-09-11T05:35:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015412800000000001 2024-09-11T05:35:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116717 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13158400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:35:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.432152285000001, 2024-09-11T05:35:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606806560000002, 2024-09-11T05:35:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116717 2024-09-11T05:35:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:35:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:35:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:35:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:35:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813474+0000", 2024-09-11T05:35:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1830000000000001e-06 2024-09-11T05:35:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813481+0000", 2024-09-11T05:35:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5540000000000003e-06 2024-09-11T05:35:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813491+0000", 2024-09-11T05:35:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0472000000000001e-05 2024-09-11T05:35:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813867+0000", 2024-09-11T05:35:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00037606 2024-09-11T05:35:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813873+0000", 2024-09-11T05:35:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.254e-06 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816443+0000", 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025701769999999999 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816446+0000", 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821818+0000", 2024-09-11T05:35:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053719830000001 2024-09-11T05:35:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821823+0000", 2024-09-11T05:35:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5560000000000001e-06 2024-09-11T05:35:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874006+0000", 2024-09-11T05:35:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05218342 2024-09-11T05:35:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874071+0000", 2024-09-11T05:35:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4369999999999995e-05 2024-09-11T05:35:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874152+0000", 2024-09-11T05:35:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1658999999999999e-05 2024-09-11T05:35:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116718 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13182976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:35:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.432120767000001, 2024-09-11T05:35:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0609185380000001, 2024-09-11T05:35:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116718 2024-09-11T05:35:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:35:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:35:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813504+0000", 2024-09-11T05:35:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7999999999999996e-07 2024-09-11T05:35:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813506+0000", 2024-09-11T05:35:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2989999999999999e-06 2024-09-11T05:35:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813513+0000", 2024-09-11T05:35:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8020000000000003e-06 2024-09-11T05:35:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813517+0000", 2024-09-11T05:35:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5639999999999998e-06 2024-09-11T05:35:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813916+0000", 2024-09-11T05:35:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039859800000000001 2024-09-11T05:35:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813922+0000", 2024-09-11T05:35:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:35:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816476+0000", 2024-09-11T05:35:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025538359999999999 2024-09-11T05:35:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816481+0000", 2024-09-11T05:35:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819999999999999e-06 2024-09-11T05:35:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821843+0000", 2024-09-11T05:35:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053620299999999 2024-09-11T05:35:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821848+0000", 2024-09-11T05:35:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:35:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874191+0000", 2024-09-11T05:35:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052342935 2024-09-11T05:35:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874300+0000", 2024-09-11T05:35:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000108764 2024-09-11T05:35:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874422+0000", 2024-09-11T05:35:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012221399999999999 2024-09-11T05:35:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116719 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13207552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:35:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.432079969, 2024-09-11T05:35:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0611734350000002, 2024-09-11T05:35:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116719 2024-09-11T05:35:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:35:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:35:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813545+0000", 2024-09-11T05:35:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2600000000000002e-07 2024-09-11T05:35:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813547+0000", 2024-09-11T05:35:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3329999999999999e-06 2024-09-11T05:35:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813553+0000", 2024-09-11T05:35:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4640000000000003e-06 2024-09-11T05:35:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813558+0000", 2024-09-11T05:35:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:35:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813952+0000", 2024-09-11T05:35:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039390999999999997 2024-09-11T05:35:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813955+0000", 2024-09-11T05:35:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.858e-06 2024-09-11T05:35:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816524+0000", 2024-09-11T05:35:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002568847 2024-09-11T05:35:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816533+0000", 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1749999999999994e-06 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821869+0000", 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053358939999999 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821876+0000", 2024-09-11T05:35:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:35:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874454+0000", 2024-09-11T05:35:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052577621 2024-09-11T05:35:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874546+0000", 2024-09-11T05:35:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2151999999999995e-05 2024-09-11T05:35:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874718+0000", 2024-09-11T05:35:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017183399999999999 2024-09-11T05:35:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116720 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13232128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:35:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.432058083000001, 2024-09-11T05:35:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0614845590000002, 2024-09-11T05:35:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116720 2024-09-11T05:35:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:35:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:35:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:35:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5600000000000002e-07 2024-09-11T05:35:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813568+0000", 2024-09-11T05:35:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9089999999999998e-06 2024-09-11T05:35:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813573+0000", 2024-09-11T05:35:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2059999999999998e-06 2024-09-11T05:35:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813577+0000", 2024-09-11T05:35:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1489999999999996e-06 2024-09-11T05:35:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813987+0000", 2024-09-11T05:35:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040977800000000002 2024-09-11T05:35:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813992+0000", 2024-09-11T05:35:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1540000000000001e-06 2024-09-11T05:35:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816560+0000", 2024-09-11T05:35:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025680389999999998 2024-09-11T05:35:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816566+0000", 2024-09-11T05:35:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0679999999999996e-06 2024-09-11T05:35:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821907+0000", 2024-09-11T05:35:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005341735 2024-09-11T05:35:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821916+0000", 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3659999999999992e-06 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874760+0000", 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052844713 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874878+0000", 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000117321 2024-09-11T05:35:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875051+0000", 2024-09-11T05:35:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017286499999999999 2024-09-11T05:35:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116721 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13256704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:35:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.432040728999993, 2024-09-11T05:35:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0616932019999998, 2024-09-11T05:35:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116721 2024-09-11T05:35:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:35:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:35:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813584+0000", 2024-09-11T05:35:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2e-07 2024-09-11T05:35:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813586+0000", 2024-09-11T05:35:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.277e-06 2024-09-11T05:35:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813592+0000", 2024-09-11T05:35:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5840000000000002e-06 2024-09-11T05:35:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813597+0000", 2024-09-11T05:35:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2839999999999997e-06 2024-09-11T05:35:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814028+0000", 2024-09-11T05:35:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000430689 2024-09-11T05:35:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814032+0000", 2024-09-11T05:35:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3850000000000004e-06 2024-09-11T05:35:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816597+0000", 2024-09-11T05:35:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00256485 2024-09-11T05:35:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816606+0000", 2024-09-11T05:35:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:35:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821949+0000", 2024-09-11T05:35:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005342752 2024-09-11T05:35:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821954+0000", 2024-09-11T05:35:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2270000000000001e-06 2024-09-11T05:35:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875095+0000", 2024-09-11T05:35:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.053140669 2024-09-11T05:35:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875186+0000", 2024-09-11T05:35:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1391999999999995e-05 2024-09-11T05:35:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875277+0000", 2024-09-11T05:35:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0556000000000005e-05 2024-09-11T05:35:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116722 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13281280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:35:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.432003730000005, 2024-09-11T05:35:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.061825491, 2024-09-11T05:35:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116722 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813621+0000", 2024-09-11T05:35:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:35:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813625+0000", 2024-09-11T05:35:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.228e-06 2024-09-11T05:35:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813635+0000", 2024-09-11T05:35:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5179999999999993e-06 2024-09-11T05:35:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813641+0000", 2024-09-11T05:35:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4710000000000004e-06 2024-09-11T05:35:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814057+0000", 2024-09-11T05:35:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00041530099999999997 2024-09-11T05:35:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814060+0000", 2024-09-11T05:35:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-06 2024-09-11T05:35:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816632+0000", 2024-09-11T05:35:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00257186 2024-09-11T05:35:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816636+0000", 2024-09-11T05:35:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2150000000000003e-06 2024-09-11T05:35:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821977+0000", 2024-09-11T05:35:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053407110000001 2024-09-11T05:35:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821982+0000", 2024-09-11T05:35:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:35:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875307+0000", 2024-09-11T05:35:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0533247000000001 2024-09-11T05:35:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875366+0000", 2024-09-11T05:35:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8628999999999997e-05 2024-09-11T05:35:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875446+0000", 2024-09-11T05:35:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0026999999999998e-05 2024-09-11T05:35:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116723 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13305856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:35:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.431970751999998, 2024-09-11T05:35:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0619630779999998, 2024-09-11T05:35:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116723 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:35:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813654+0000", 2024-09-11T05:35:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:35:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813661+0000", 2024-09-11T05:35:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1890000000000001e-06 2024-09-11T05:35:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813675+0000", 2024-09-11T05:35:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3878e-05 2024-09-11T05:35:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813682+0000", 2024-09-11T05:35:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.063e-06 2024-09-11T05:35:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816666+0000", 2024-09-11T05:35:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029845679999999999 2024-09-11T05:35:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816671+0000", 2024-09-11T05:35:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:35:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822024+0000", 2024-09-11T05:35:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053534660000001 2024-09-11T05:35:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822028+0000", 2024-09-11T05:35:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7799999999999998e-06 2024-09-11T05:35:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875471+0000", 2024-09-11T05:35:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05344306 2024-09-11T05:35:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875531+0000", 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0019000000000003e-05 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875616+0000", 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5304999999999997e-05 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116724 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13330432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:35:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.431931262999996, 2024-09-11T05:35:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0620902609999998, 2024-09-11T05:35:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116724 2024-09-11T05:35:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:35:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:35:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:35:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.99e-07 2024-09-11T05:35:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813697+0000", 2024-09-11T05:35:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2430000000000001e-06 2024-09-11T05:35:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813704+0000", 2024-09-11T05:35:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2980000000000003e-06 2024-09-11T05:35:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813709+0000", 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8130000000000003e-06 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816702+0000", 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002992864 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816711+0000", 2024-09-11T05:35:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1840000000000005e-06 2024-09-11T05:35:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822050+0000", 2024-09-11T05:35:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.00533864 2024-09-11T05:35:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822055+0000", 2024-09-11T05:35:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:35:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875642+0000", 2024-09-11T05:35:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0535874220000001 2024-09-11T05:35:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875698+0000", 2024-09-11T05:35:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5707e-05 2024-09-11T05:35:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875783+0000", 2024-09-11T05:35:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5362e-05 2024-09-11T05:35:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116725 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13355008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:35:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.431897074999995, 2024-09-11T05:35:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.06220984, 2024-09-11T05:35:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116725 2024-09-11T05:35:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:35:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:35:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813728+0000", 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813730+0000", 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6730000000000001e-06 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813743+0000", 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2833000000000001e-05 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813749+0000", 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816726+0000", 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029772090000000002 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816730+0000", 2024-09-11T05:35:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.518e-06 2024-09-11T05:35:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822074+0000", 2024-09-11T05:35:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053444030000001 2024-09-11T05:35:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822079+0000", 2024-09-11T05:35:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:35:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875807+0000", 2024-09-11T05:35:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0537284410000001 2024-09-11T05:35:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875858+0000", 2024-09-11T05:35:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0574000000000001e-05 2024-09-11T05:35:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875937+0000", 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9268000000000001e-05 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116974 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13185024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.423953238999999, 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598649249999998, 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116974 2024-09-11T05:35:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:35:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821673+0000", 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.722e-06 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821686+0000", 2024-09-11T05:35:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2974e-05 2024-09-11T05:35:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821692+0000", 2024-09-11T05:35:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:35:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822089+0000", 2024-09-11T05:35:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039611699999999998 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822099+0000", 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0029e-05 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822803+0000", 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000704507 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822808+0000", 2024-09-11T05:35:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6460000000000001e-06 2024-09-11T05:35:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881361+0000", 2024-09-11T05:35:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0585529680000001 2024-09-11T05:35:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881432+0000", 2024-09-11T05:35:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:35:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881536+0000", 2024-09-11T05:35:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000103243 2024-09-11T05:35:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116975 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13209600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:35:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.423924905000007, 2024-09-11T05:35:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.060124761, 2024-09-11T05:35:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116975 2024-09-11T05:35:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:35:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:35:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821700+0000", 2024-09-11T05:35:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:35:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821701+0000", 2024-09-11T05:35:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8369999999999999e-06 2024-09-11T05:35:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821708+0000", 2024-09-11T05:35:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5520000000000001e-06 2024-09-11T05:35:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821713+0000", 2024-09-11T05:35:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.091e-06 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822135+0000", 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00042166399999999998 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822143+0000", 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3089999999999996e-06 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822820+0000", 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000677145 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822824+0000", 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.641e-06 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881569+0000", 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.058744785 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881674+0000", 2024-09-11T05:35:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000105111 2024-09-11T05:35:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881824+0000", 2024-09-11T05:35:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000150197 2024-09-11T05:35:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116976 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13234176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:35:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.423895926, 2024-09-11T05:35:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0603909900000001, 2024-09-11T05:35:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116976 2024-09-11T05:35:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:35:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:35:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821729+0000", 2024-09-11T05:35:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:35:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821731+0000", 2024-09-11T05:35:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0250000000000001e-06 2024-09-11T05:35:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821737+0000", 2024-09-11T05:35:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8839999999999997e-06 2024-09-11T05:35:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821743+0000", 2024-09-11T05:35:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1050000000000003e-06 2024-09-11T05:35:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822194+0000", 2024-09-11T05:35:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000451574 2024-09-11T05:35:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822203+0000", 2024-09-11T05:35:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9449999999999999e-06 2024-09-11T05:35:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822835+0000", 2024-09-11T05:35:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000632019 2024-09-11T05:35:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822839+0000", 2024-09-11T05:35:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8229999999999997e-06 2024-09-11T05:35:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881861+0000", 2024-09-11T05:35:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.059021776 2024-09-11T05:35:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881976+0000", 2024-09-11T05:35:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00011531699999999999 2024-09-11T05:35:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882119+0000", 2024-09-11T05:35:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000143077 2024-09-11T05:35:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116977 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13258752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:35:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.423844692000003, 2024-09-11T05:35:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606236920000001, 2024-09-11T05:35:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116977 2024-09-11T05:35:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:35:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:35:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821782+0000", 2024-09-11T05:35:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7719999999999999e-06 2024-09-11T05:35:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821785+0000", 2024-09-11T05:35:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9409999999999999e-06 2024-09-11T05:35:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821793+0000", 2024-09-11T05:35:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:35:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821799+0000", 2024-09-11T05:35:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4609999999999999e-06 2024-09-11T05:35:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822246+0000", 2024-09-11T05:35:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044669000000000002 2024-09-11T05:35:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822254+0000", 2024-09-11T05:35:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1859999999999992e-06 2024-09-11T05:35:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822850+0000", 2024-09-11T05:35:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005962340000001 2024-09-11T05:35:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822854+0000", 2024-09-11T05:35:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5310000000000002e-06 2024-09-11T05:35:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882149+0000", 2024-09-11T05:35:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0592958729999999 2024-09-11T05:35:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882253+0000", 2024-09-11T05:35:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104058 2024-09-11T05:35:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882403+0000", 2024-09-11T05:35:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014958800000000001 2024-09-11T05:35:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116978 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13283328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:35:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.423814469000007, 2024-09-11T05:35:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0608297769999999, 2024-09-11T05:35:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116978 2024-09-11T05:35:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:35:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:35:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:35:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:35:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821813+0000", 2024-09-11T05:35:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:35:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821820+0000", 2024-09-11T05:35:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3669999999999999e-06 2024-09-11T05:35:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821825+0000", 2024-09-11T05:35:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5119999999999999e-06 2024-09-11T05:35:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822273+0000", 2024-09-11T05:35:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044727900000000003 2024-09-11T05:35:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822278+0000", 2024-09-11T05:35:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7529999999999998e-06 2024-09-11T05:35:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822865+0000", 2024-09-11T05:35:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005861579999999 2024-09-11T05:35:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822868+0000", 2024-09-11T05:35:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4659999999999999e-06 2024-09-11T05:35:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882434+0000", 2024-09-11T05:35:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0595660170000001 2024-09-11T05:35:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882502+0000", 2024-09-11T05:35:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7442999999999998e-05 2024-09-11T05:35:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882639+0000", 2024-09-11T05:35:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013779999999999999 2024-09-11T05:35:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116980 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13332480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:35:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.422274947000005, 2024-09-11T05:35:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598269180000002, 2024-09-11T05:35:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116980 2024-09-11T05:35:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:35:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:35:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823350+0000", 2024-09-11T05:35:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:35:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823352+0000", 2024-09-11T05:35:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5459999999999998e-06 2024-09-11T05:35:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823360+0000", 2024-09-11T05:35:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4359999999999996e-06 2024-09-11T05:35:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823365+0000", 2024-09-11T05:35:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3079999999999998e-06 2024-09-11T05:35:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823418+0000", 2024-09-11T05:35:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2735999999999998e-05 2024-09-11T05:35:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823423+0000", 2024-09-11T05:35:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3410000000000002e-06 2024-09-11T05:35:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822895+0000", 2024-09-11T05:35:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99947249000000005 2024-09-11T05:35:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822899+0000", 2024-09-11T05:35:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6169999999999998e-06 2024-09-11T05:35:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882964+0000", 2024-09-11T05:35:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0600650840000001 2024-09-11T05:35:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883020+0000", 2024-09-11T05:35:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5563000000000003e-05 2024-09-11T05:35:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883176+0000", 2024-09-11T05:35:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015629500000000001 2024-09-11T05:35:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116981 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13357056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:35:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 87.422250966999997, 2024-09-11T05:35:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600075910000002, 2024-09-11T05:35:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116981 2024-09-11T05:35:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:35:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:35:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:35:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.01e-07 2024-09-11T05:35:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823376+0000", 2024-09-11T05:35:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:35:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823381+0000", 2024-09-11T05:35:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000001e-06 2024-09-11T05:35:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823386+0000", 2024-09-11T05:35:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5349999999999998e-06 2024-09-11T05:35:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823447+0000", 2024-09-11T05:35:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1277000000000003e-05 2024-09-11T05:35:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823456+0000", 2024-09-11T05:35:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8859999999999993e-06 2024-09-11T05:35:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822914+0000", 2024-09-11T05:35:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99945797999999997 2024-09-11T05:35:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822918+0000", 2024-09-11T05:35:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5810000000000001e-06 2024-09-11T05:35:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883209+0000", 2024-09-11T05:35:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0602916899999999 2024-09-11T05:35:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883292+0000", 2024-09-11T05:35:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2849000000000006e-05 2024-09-11T05:35:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883381+0000", 2024-09-11T05:35:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8585000000000007e-05 2024-09-11T05:35:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.386 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:06.388 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:35:06.388 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:06.387+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:06.488 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:06.488+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:06.531 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:35:06.532 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:06.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:35:06.589 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:06.589+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:06.648 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:35:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:35:06.649 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:06.650 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T05:35:06.652 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 5, 6, 3] out_osds: [4, 7, 1] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-09-11T05:35:06.653 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:35:06.653 INFO:tasks.thrashosds.thrasher:Adding osd 7 2024-09-11T05:35:06.653 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 7 2024-09-11T05:35:06.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:35:06.700 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:06.700+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:06.791 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:06.791+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:06.804 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:35:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:35:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:35:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:35:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:35:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 116.154741237, 2024-09-11T05:35:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:35:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:35:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:35:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:35:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:35:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:35:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:35:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:35:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:35:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:35:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:35:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:35:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:35:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:35:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:35:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:35:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:35:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:35:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:35:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:35:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:35:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:35:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:35:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:35:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:35:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:35:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:35:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:35:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:35:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:35:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:35:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:146253 3.6 3:64dbadcf:::rbd_data.112d55d87bfc.0000000000000332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-11T05:35:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:35:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.965926328999998, 2024-09-11T05:35:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4166483809999999, 2024-09-11T05:35:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:35:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 146253 2024-09-11T05:35:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:35:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:35:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837090+0000", 2024-09-11T05:35:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.73e-06 2024-09-11T05:35:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837096+0000", 2024-09-11T05:35:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3500000000000002e-06 2024-09-11T05:35:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837115+0000", 2024-09-11T05:35:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8556e-05 2024-09-11T05:35:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837124+0000", 2024-09-11T05:35:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6739999999999992e-06 2024-09-11T05:35:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837184+0000", 2024-09-11T05:35:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9960000000000002e-05 2024-09-11T05:35:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:35:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837188+0000", 2024-09-11T05:35:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:35:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840481+0000", 2024-09-11T05:35:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032924080000000001 2024-09-11T05:35:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840497+0000", 2024-09-11T05:35:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6140000000000001e-05 2024-09-11T05:35:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850737+0000", 2024-09-11T05:35:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0102404119999999 2024-09-11T05:35:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850747+0000", 2024-09-11T05:35:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7969999999999995e-06 2024-09-11T05:35:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252495+0000", 2024-09-11T05:35:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.401748131 2024-09-11T05:35:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252636+0000", 2024-09-11T05:35:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014118900000000001 2024-09-11T05:35:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:35:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252737+0000", 2024-09-11T05:35:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00010058 2024-09-11T05:35:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:35:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253433+0000", 2024-09-11T05:35:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00069601999999999999 2024-09-11T05:35:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:35:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253604+0000", 2024-09-11T05:35:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000170824 2024-09-11T05:35:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:35:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253649+0000", 2024-09-11T05:35:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5050999999999999e-05 2024-09-11T05:35:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253736+0000", 2024-09-11T05:35:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7509000000000005e-05 2024-09-11T05:35:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:147298 3.6 3:652e51de:::rbd_data.112d55d87bfc.0000000000000377:head [set-alloc-hint object_size 262144 write_size 262144,write 122880~2839] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-11T05:35:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:35:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 77.569385753000006, 2024-09-11T05:35:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62981612099999995, 2024-09-11T05:35:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:35:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 147298 2024-09-11T05:35:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:35:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:35:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233630+0000", 2024-09-11T05:35:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5489999999999999e-06 2024-09-11T05:35:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233637+0000", 2024-09-11T05:35:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.272e-06 2024-09-11T05:35:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233654+0000", 2024-09-11T05:35:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6283999999999999e-05 2024-09-11T05:35:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233662+0000", 2024-09-11T05:35:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.875e-06 2024-09-11T05:35:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233723+0000", 2024-09-11T05:35:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1501000000000006e-05 2024-09-11T05:35:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233732+0000", 2024-09-11T05:35:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0699999999999996e-06 2024-09-11T05:35:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862055+0000", 2024-09-11T05:35:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62832274799999999 2024-09-11T05:35:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862219+0000", 2024-09-11T05:35:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016404899999999999 2024-09-11T05:35:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:35:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862313+0000", 2024-09-11T05:35:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4105999999999997e-05 2024-09-11T05:35:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:35:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862981+0000", 2024-09-11T05:35:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00066744199999999997 2024-09-11T05:35:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:35:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863382+0000", 2024-09-11T05:35:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040111200000000002 2024-09-11T05:35:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:35:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863419+0000", 2024-09-11T05:35:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6974000000000002e-05 2024-09-11T05:35:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863445+0000", 2024-09-11T05:35:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6139000000000002e-05 2024-09-11T05:35:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151292 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:35:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846734358000006, 2024-09-11T05:35:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054346481000000002, 2024-09-11T05:35:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151292 2024-09-11T05:35:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:35:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:35:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:35:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:35:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956283+0000", 2024-09-11T05:35:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2450000000000001e-06 2024-09-11T05:35:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956290+0000", 2024-09-11T05:35:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0910000000000004e-06 2024-09-11T05:35:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956296+0000", 2024-09-11T05:35:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.947e-06 2024-09-11T05:35:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010460+0000", 2024-09-11T05:35:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054164165 2024-09-11T05:35:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010537+0000", 2024-09-11T05:35:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6965000000000006e-05 2024-09-11T05:35:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010626+0000", 2024-09-11T05:35:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9628000000000003e-05 2024-09-11T05:35:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151293 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1933312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:35:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846711514999996, 2024-09-11T05:35:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054563858999999999, 2024-09-11T05:35:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151293 2024-09-11T05:35:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:35:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:35:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:35:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.46e-07 2024-09-11T05:35:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956306+0000", 2024-09-11T05:35:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2259999999999999e-06 2024-09-11T05:35:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956312+0000", 2024-09-11T05:35:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:35:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956317+0000", 2024-09-11T05:35:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:35:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010671+0000", 2024-09-11T05:35:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054353830999999998 2024-09-11T05:35:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010757+0000", 2024-09-11T05:35:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6120999999999998e-05 2024-09-11T05:35:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010867+0000", 2024-09-11T05:35:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000109687 2024-09-11T05:35:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151294 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2179072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:35:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846689652999999, 2024-09-11T05:35:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054741825000000001, 2024-09-11T05:35:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151294 2024-09-11T05:35:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:35:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:35:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.84e-07 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956326+0000", 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.483e-06 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956330+0000", 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8519999999999997e-06 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956334+0000", 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4139999999999998e-06 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010894+0000", 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054560243000000001 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010970+0000", 2024-09-11T05:35:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6138999999999997e-05 2024-09-11T05:35:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011067+0000", 2024-09-11T05:35:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6409999999999993e-05 2024-09-11T05:35:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151295 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2392064~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:35:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846676982000005, 2024-09-11T05:35:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054949748999999999, 2024-09-11T05:35:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151295 2024-09-11T05:35:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:35:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:35:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956338+0000", 2024-09-11T05:35:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.23e-07 2024-09-11T05:35:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956339+0000", 2024-09-11T05:35:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.243e-06 2024-09-11T05:35:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956342+0000", 2024-09-11T05:35:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.473e-06 2024-09-11T05:35:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956345+0000", 2024-09-11T05:35:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:35:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011109+0000", 2024-09-11T05:35:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054763698999999999 2024-09-11T05:35:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011188+0000", 2024-09-11T05:35:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8887999999999994e-05 2024-09-11T05:35:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011287+0000", 2024-09-11T05:35:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9504000000000001e-05 2024-09-11T05:35:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151296 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846665872000003, 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055045187000000002, 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151296 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:35:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:35:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956349+0000", 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956350+0000", 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956353+0000", 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.016e-06 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956355+0000", 2024-09-11T05:35:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5509999999999998e-06 2024-09-11T05:35:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011303+0000", 2024-09-11T05:35:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054947306000000001 2024-09-11T05:35:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011342+0000", 2024-09-11T05:35:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9057999999999998e-05 2024-09-11T05:35:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011394+0000", 2024-09-11T05:35:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1925999999999997e-05 2024-09-11T05:35:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151297 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2818048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:35:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846655940999995, 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055238158000000002, 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151297 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:35:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:35:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956359+0000", 2024-09-11T05:35:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:35:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956360+0000", 2024-09-11T05:35:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1030000000000001e-06 2024-09-11T05:35:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956363+0000", 2024-09-11T05:35:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.021e-06 2024-09-11T05:35:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956365+0000", 2024-09-11T05:35:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4770000000000002e-06 2024-09-11T05:35:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011425+0000", 2024-09-11T05:35:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055059967000000001 2024-09-11T05:35:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011506+0000", 2024-09-11T05:35:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1063000000000006e-05 2024-09-11T05:35:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011597+0000", 2024-09-11T05:35:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0299999999999999e-05 2024-09-11T05:35:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151298 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3031040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:35:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846645975000001, 2024-09-11T05:35:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055425825999999997, 2024-09-11T05:35:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151298 2024-09-11T05:35:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:35:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:35:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956369+0000", 2024-09-11T05:35:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4400000000000001e-07 2024-09-11T05:35:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956370+0000", 2024-09-11T05:35:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.068e-06 2024-09-11T05:35:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956373+0000", 2024-09-11T05:35:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0419999999999998e-06 2024-09-11T05:35:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956375+0000", 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011631+0000", 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055255116999999999 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011703+0000", 2024-09-11T05:35:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2554999999999999e-05 2024-09-11T05:35:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011794+0000", 2024-09-11T05:35:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1119999999999995e-05 2024-09-11T05:35:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151299 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3276800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:35:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846634672999997, 2024-09-11T05:35:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055567477999999997, 2024-09-11T05:35:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151299 2024-09-11T05:35:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:35:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:35:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956382+0000", 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.72e-06 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956386+0000", 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0990000000000001e-06 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956390+0000", 2024-09-11T05:35:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.318e-06 2024-09-11T05:35:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011823+0000", 2024-09-11T05:35:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055432976000000002 2024-09-11T05:35:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011882+0000", 2024-09-11T05:35:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8656999999999998e-05 2024-09-11T05:35:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011947+0000", 2024-09-11T05:35:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5177000000000003e-05 2024-09-11T05:35:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151300 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3489792~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:35:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846618206000002, 2024-09-11T05:35:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055745232999999998, 2024-09-11T05:35:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151300 2024-09-11T05:35:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:35:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:35:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956397+0000", 2024-09-11T05:35:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:35:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956398+0000", 2024-09-11T05:35:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.869e-06 2024-09-11T05:35:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956404+0000", 2024-09-11T05:35:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:35:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956407+0000", 2024-09-11T05:35:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.191e-06 2024-09-11T05:35:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011981+0000", 2024-09-11T05:35:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055573553999999997 2024-09-11T05:35:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012051+0000", 2024-09-11T05:35:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9542999999999995e-05 2024-09-11T05:35:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012141+0000", 2024-09-11T05:35:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0845000000000002e-05 2024-09-11T05:35:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151301 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3702784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:35:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846603277, 2024-09-11T05:35:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055834747999999997, 2024-09-11T05:35:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151301 2024-09-11T05:35:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:35:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:35:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:35:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:35:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956413+0000", 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2810000000000001e-06 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956416+0000", 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1559999999999999e-06 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956418+0000", 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012155+0000", 2024-09-11T05:35:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055736651999999998 2024-09-11T05:35:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012193+0000", 2024-09-11T05:35:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7848000000000001e-05 2024-09-11T05:35:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012246+0000", 2024-09-11T05:35:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3041000000000003e-05 2024-09-11T05:35:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151302 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3915776~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:35:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846593174000006, 2024-09-11T05:35:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056035532999999998, 2024-09-11T05:35:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151302 2024-09-11T05:35:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:35:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:35:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:35:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:35:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956426+0000", 2024-09-11T05:35:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.853e-06 2024-09-11T05:35:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956430+0000", 2024-09-11T05:35:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3699999999999999e-06 2024-09-11T05:35:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956432+0000", 2024-09-11T05:35:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5979999999999999e-06 2024-09-11T05:35:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012281+0000", 2024-09-11T05:35:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055848644000000003 2024-09-11T05:35:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012358+0000", 2024-09-11T05:35:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6662000000000006e-05 2024-09-11T05:35:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012457+0000", 2024-09-11T05:35:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9197999999999995e-05 2024-09-11T05:35:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151303 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4128768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:35:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846578592, 2024-09-11T05:35:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056186709000000001, 2024-09-11T05:35:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151303 2024-09-11T05:35:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:35:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:35:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:35:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:35:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956437+0000", 2024-09-11T05:35:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.201e-06 2024-09-11T05:35:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956440+0000", 2024-09-11T05:35:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-06 2024-09-11T05:35:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956443+0000", 2024-09-11T05:35:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5909999999999998e-06 2024-09-11T05:35:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012494+0000", 2024-09-11T05:35:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056051541000000003 2024-09-11T05:35:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012558+0000", 2024-09-11T05:35:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3347000000000002e-05 2024-09-11T05:35:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012622+0000", 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4760999999999999e-05 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151304 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846568535000003, 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056360149999999998, 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151304 2024-09-11T05:35:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:35:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:35:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:35:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:35:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956447+0000", 2024-09-11T05:35:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.153e-06 2024-09-11T05:35:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956450+0000", 2024-09-11T05:35:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9909999999999998e-06 2024-09-11T05:35:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956453+0000", 2024-09-11T05:35:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.447e-06 2024-09-11T05:35:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012660+0000", 2024-09-11T05:35:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056207510000000002 2024-09-11T05:35:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012741+0000", 2024-09-11T05:35:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0734000000000003e-05 2024-09-11T05:35:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012806+0000", 2024-09-11T05:35:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5087999999999998e-05 2024-09-11T05:35:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151305 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4587520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:35:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846558774000002, 2024-09-11T05:35:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056476407999999999, 2024-09-11T05:35:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151305 2024-09-11T05:35:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:35:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:35:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:35:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:35:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956457+0000", 2024-09-11T05:35:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.353e-06 2024-09-11T05:35:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956460+0000", 2024-09-11T05:35:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0060000000000001e-06 2024-09-11T05:35:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956463+0000", 2024-09-11T05:35:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.452e-06 2024-09-11T05:35:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012834+0000", 2024-09-11T05:35:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056370917999999999 2024-09-11T05:35:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012877+0000", 2024-09-11T05:35:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000999999999997e-05 2024-09-11T05:35:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012932+0000", 2024-09-11T05:35:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5470000000000003e-05 2024-09-11T05:35:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151306 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4800512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:35:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846548794, 2024-09-11T05:35:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056579203000000002, 2024-09-11T05:35:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151306 2024-09-11T05:35:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:35:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:35:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:35:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.28e-07 2024-09-11T05:35:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956467+0000", 2024-09-11T05:35:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.088e-06 2024-09-11T05:35:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956470+0000", 2024-09-11T05:35:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0240000000000002e-06 2024-09-11T05:35:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956472+0000", 2024-09-11T05:35:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4609999999999998e-06 2024-09-11T05:35:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012953+0000", 2024-09-11T05:35:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056480524999999997 2024-09-11T05:35:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012994+0000", 2024-09-11T05:35:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1394999999999999e-05 2024-09-11T05:35:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013045+0000", 2024-09-11T05:35:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0482000000000002e-05 2024-09-11T05:35:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151307 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5013504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:35:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846539125000007, 2024-09-11T05:35:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056680525000000002, 2024-09-11T05:35:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151307 2024-09-11T05:35:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:35:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:35:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:35:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:35:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956476+0000", 2024-09-11T05:35:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0359999999999999e-06 2024-09-11T05:35:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956479+0000", 2024-09-11T05:35:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8899999999999999e-06 2024-09-11T05:35:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956482+0000", 2024-09-11T05:35:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5380000000000001e-06 2024-09-11T05:35:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013065+0000", 2024-09-11T05:35:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056582983000000003 2024-09-11T05:35:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013104+0000", 2024-09-11T05:35:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9119999999999998e-05 2024-09-11T05:35:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013156+0000", 2024-09-11T05:35:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1743999999999998e-05 2024-09-11T05:35:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151308 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5226496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:35:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 72.846521793999997, 2024-09-11T05:35:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056772738000000003, 2024-09-11T05:35:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151308 2024-09-11T05:35:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:35:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:35:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:35:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2599999999999998e-07 2024-09-11T05:35:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956495+0000", 2024-09-11T05:35:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9750000000000001e-06 2024-09-11T05:35:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956499+0000", 2024-09-11T05:35:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5179999999999998e-06 2024-09-11T05:35:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956502+0000", 2024-09-11T05:35:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7530000000000002e-06 2024-09-11T05:35:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013177+0000", 2024-09-11T05:35:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056674536999999997 2024-09-11T05:35:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013215+0000", 2024-09-11T05:35:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8578999999999998e-05 2024-09-11T05:35:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013265+0000", 2024-09-11T05:35:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0049999999999997e-05 2024-09-11T05:35:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:06.933 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:06.935 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:35:06.935 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:06.934+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:06.989 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-11T05:35:06.989+0000 7fc03b8fe640 -1 mon.a@0(leader).osd e141 definitely_dead 0 2024-09-11T05:35:07.034 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:07.034+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:07.079 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:07.080 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:07.080 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:35:07.080 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:07.089 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:35:07.173 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:07.173+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:07.232 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:07.232 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:07.232 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:35:07.233 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:35:07.233 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:07.236 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:35:07.236+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:35:07.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:35:07.337 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:07.336+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:07.385 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:35:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:35:07.385 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:35:07.385 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:07.393 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:35:07.437 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:07.437+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:07.500 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:07.500 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:35:07.500 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:35:07.500 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:07.508 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:35:07.538 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:07.538+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:07.623 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T05:35:07.624 INFO:teuthology.orchestra.run.smithi070.stderr:marked in osd.7. 2024-09-11T05:35:07.639 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:07.639+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:07.647 INFO:tasks.thrashosds.thrasher:Added osd 7 2024-09-11T05:35:07.660 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:07.660 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:35:07.660 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:35:07.660 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:35:07.661 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:07.670 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:35:07.741 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:07.741+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:07.814 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:07.815 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:35:07.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:35:07.815 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:35:07.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.815 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116524 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.815 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:35:07.815 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001723197000004, 2024-09-11T05:35:07.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344630100000001, 2024-09-11T05:35:07.815 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116524 2024-09-11T05:35:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:35:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:35:07.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811270+0000", 2024-09-11T05:35:07.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:35:07.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811272+0000", 2024-09-11T05:35:07.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:35:07.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811278+0000", 2024-09-11T05:35:07.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1970000000000001e-06 2024-09-11T05:35:07.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811283+0000", 2024-09-11T05:35:07.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-09-11T05:35:07.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813113+0000", 2024-09-11T05:35:07.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001830302 2024-09-11T05:35:07.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:07.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813117+0000", 2024-09-11T05:35:07.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0810000000000004e-06 2024-09-11T05:35:07.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814661+0000", 2024-09-11T05:35:07.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015436969999999999 2024-09-11T05:35:07.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814667+0000", 2024-09-11T05:35:07.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6370000000000002e-06 2024-09-11T05:35:07.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826115+0000", 2024-09-11T05:35:07.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114479059999999 2024-09-11T05:35:07.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826123+0000", 2024-09-11T05:35:07.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000004e-06 2024-09-11T05:35:07.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845722+0000", 2024-09-11T05:35:07.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195993000000001 2024-09-11T05:35:07.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845732+0000", 2024-09-11T05:35:07.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T05:35:07.823 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.823 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.823 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.823 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116525 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.823 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:35:07.823 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001703315, 2024-09-11T05:35:07.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344747700000001, 2024-09-11T05:35:07.824 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.824 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.824 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.824 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116525 2024-09-11T05:35:07.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.824 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:35:07.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:35:07.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811290+0000", 2024-09-11T05:35:07.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:35:07.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811295+0000", 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8969999999999999e-06 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811301+0000", 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4919999999999998e-06 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811306+0000", 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999998e-06 2024-09-11T05:35:07.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813138+0000", 2024-09-11T05:35:07.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001832078 2024-09-11T05:35:07.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:07.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813142+0000", 2024-09-11T05:35:07.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0380000000000001e-06 2024-09-11T05:35:07.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814689+0000", 2024-09-11T05:35:07.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546799 2024-09-11T05:35:07.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814695+0000", 2024-09-11T05:35:07.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8739999999999997e-06 2024-09-11T05:35:07.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826148+0000", 2024-09-11T05:35:07.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114527259999999 2024-09-11T05:35:07.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826166+0000", 2024-09-11T05:35:07.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7484999999999999e-05 2024-09-11T05:35:07.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845756+0000", 2024-09-11T05:35:07.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019590609 2024-09-11T05:35:07.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845764+0000", 2024-09-11T05:35:07.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7020000000000001e-06 2024-09-11T05:35:07.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.830 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.830 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116526 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.831 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:35:07.831 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001680516999997, 2024-09-11T05:35:07.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344863210000002, 2024-09-11T05:35:07.831 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116526 2024-09-11T05:35:07.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.831 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:35:07.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:35:07.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:35:07.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:35:07.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811315+0000", 2024-09-11T05:35:07.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079999999999999e-06 2024-09-11T05:35:07.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811320+0000", 2024-09-11T05:35:07.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8619999999999999e-06 2024-09-11T05:35:07.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811325+0000", 2024-09-11T05:35:07.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T05:35:07.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814736+0000", 2024-09-11T05:35:07.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034115780000000002 2024-09-11T05:35:07.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814744+0000", 2024-09-11T05:35:07.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5340000000000002e-06 2024-09-11T05:35:07.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826212+0000", 2024-09-11T05:35:07.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114682749999999 2024-09-11T05:35:07.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826225+0000", 2024-09-11T05:35:07.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:35:07.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845789+0000", 2024-09-11T05:35:07.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195649200000001 2024-09-11T05:35:07.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845798+0000", 2024-09-11T05:35:07.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9269999999999994e-06 2024-09-11T05:35:07.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.837 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.837 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116527 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.837 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:35:07.838 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001661584999994, 2024-09-11T05:35:07.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345095849999999, 2024-09-11T05:35:07.838 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.838 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.838 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116527 2024-09-11T05:35:07.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.839 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:35:07.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:35:07.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:35:07.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:35:07.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811334+0000", 2024-09-11T05:35:07.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:35:07.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811340+0000", 2024-09-11T05:35:07.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.691e-06 2024-09-11T05:35:07.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811345+0000", 2024-09-11T05:35:07.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5480000000000003e-06 2024-09-11T05:35:07.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814767+0000", 2024-09-11T05:35:07.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034223190000000001 2024-09-11T05:35:07.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814774+0000", 2024-09-11T05:35:07.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:35:07.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826265+0000", 2024-09-11T05:35:07.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114912460000001 2024-09-11T05:35:07.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826274+0000", 2024-09-11T05:35:07.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3909999999999998e-06 2024-09-11T05:35:07.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845831+0000", 2024-09-11T05:35:07.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195574080000001 2024-09-11T05:35:07.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845841+0000", 2024-09-11T05:35:07.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3610000000000007e-06 2024-09-11T05:35:07.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.845 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.846 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116528 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.846 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:35:07.846 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001642145999995, 2024-09-11T05:35:07.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345287679999999, 2024-09-11T05:35:07.847 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.847 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.847 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.847 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.847 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116528 2024-09-11T05:35:07.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.848 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:35:07.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:35:07.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811351+0000", 2024-09-11T05:35:07.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T05:35:07.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811353+0000", 2024-09-11T05:35:07.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:35:07.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811359+0000", 2024-09-11T05:35:07.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T05:35:07.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811364+0000", 2024-09-11T05:35:07.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000001e-06 2024-09-11T05:35:07.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814795+0000", 2024-09-11T05:35:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034316569999999998 2024-09-11T05:35:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814826+0000", 2024-09-11T05:35:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0587999999999999e-05 2024-09-11T05:35:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826309+0000", 2024-09-11T05:35:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011483444 2024-09-11T05:35:07.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826319+0000", 2024-09-11T05:35:07.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6849999999999996e-06 2024-09-11T05:35:07.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845868+0000", 2024-09-11T05:35:07.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195487110000001 2024-09-11T05:35:07.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845879+0000", 2024-09-11T05:35:07.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1428e-05 2024-09-11T05:35:07.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.854 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.854 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116529 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.854 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:35:07.854 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001623511999995, 2024-09-11T05:35:07.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034542531, 2024-09-11T05:35:07.854 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.855 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.855 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.855 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116529 2024-09-11T05:35:07.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.855 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:35:07.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:35:07.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:35:07.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:35:07.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811371+0000", 2024-09-11T05:35:07.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T05:35:07.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811377+0000", 2024-09-11T05:35:07.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1580000000000002e-06 2024-09-11T05:35:07.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811383+0000", 2024-09-11T05:35:07.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.135e-06 2024-09-11T05:35:07.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814851+0000", 2024-09-11T05:35:07.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034684690000000001 2024-09-11T05:35:07.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814858+0000", 2024-09-11T05:35:07.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6969999999999996e-06 2024-09-11T05:35:07.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826354+0000", 2024-09-11T05:35:07.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114962359999999 2024-09-11T05:35:07.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826364+0000", 2024-09-11T05:35:07.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0047999999999999e-05 2024-09-11T05:35:07.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845903+0000", 2024-09-11T05:35:07.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195393610000001 2024-09-11T05:35:07.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845912+0000", 2024-09-11T05:35:07.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2269999999999993e-06 2024-09-11T05:35:07.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.863 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.864 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116530 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.864 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:35:07.864 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001604599999993, 2024-09-11T05:35:07.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345557429999999, 2024-09-11T05:35:07.865 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.865 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.865 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.865 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.865 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.866 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.866 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116530 2024-09-11T05:35:07.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.866 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:35:07.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:35:07.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:35:07.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:35:07.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811390+0000", 2024-09-11T05:35:07.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:35:07.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811396+0000", 2024-09-11T05:35:07.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:35:07.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811402+0000", 2024-09-11T05:35:07.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:35:07.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814879+0000", 2024-09-11T05:35:07.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034769290000000001 2024-09-11T05:35:07.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814885+0000", 2024-09-11T05:35:07.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.156e-06 2024-09-11T05:35:07.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826389+0000", 2024-09-11T05:35:07.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115041140000001 2024-09-11T05:35:07.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826397+0000", 2024-09-11T05:35:07.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:35:07.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845935+0000", 2024-09-11T05:35:07.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195381370000001 2024-09-11T05:35:07.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845944+0000", 2024-09-11T05:35:07.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4540000000000007e-06 2024-09-11T05:35:07.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.872 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.872 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116531 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.872 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:35:07.872 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001584541, 2024-09-11T05:35:07.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345764630000001, 2024-09-11T05:35:07.872 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.872 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.872 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.873 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116531 2024-09-11T05:35:07.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.873 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:35:07.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:35:07.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:35:07.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:35:07.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811411+0000", 2024-09-11T05:35:07.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:35:07.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811417+0000", 2024-09-11T05:35:07.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:35:07.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811422+0000", 2024-09-11T05:35:07.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3229999999999997e-06 2024-09-11T05:35:07.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814906+0000", 2024-09-11T05:35:07.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034835389999999999 2024-09-11T05:35:07.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814913+0000", 2024-09-11T05:35:07.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309999999999996e-06 2024-09-11T05:35:07.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826423+0000", 2024-09-11T05:35:07.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115109019999999 2024-09-11T05:35:07.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826431+0000", 2024-09-11T05:35:07.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9410000000000007e-06 2024-09-11T05:35:07.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845975+0000", 2024-09-11T05:35:07.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019543767 2024-09-11T05:35:07.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845984+0000", 2024-09-11T05:35:07.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3530000000000001e-06 2024-09-11T05:35:07.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.879 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.880 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116532 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.880 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:35:07.880 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001564342999998, 2024-09-11T05:35:07.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034588131, 2024-09-11T05:35:07.880 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.880 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.880 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116532 2024-09-11T05:35:07.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.881 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:35:07.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:35:07.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811429+0000", 2024-09-11T05:35:07.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:35:07.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811431+0000", 2024-09-11T05:35:07.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9910000000000001e-06 2024-09-11T05:35:07.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811437+0000", 2024-09-11T05:35:07.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.049e-06 2024-09-11T05:35:07.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811441+0000", 2024-09-11T05:35:07.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8289999999999998e-06 2024-09-11T05:35:07.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814934+0000", 2024-09-11T05:35:07.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034927220000000002 2024-09-11T05:35:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814941+0000", 2024-09-11T05:35:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.844e-06 2024-09-11T05:35:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826480+0000", 2024-09-11T05:35:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115393260000001 2024-09-11T05:35:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826496+0000", 2024-09-11T05:35:07.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5406000000000001e-05 2024-09-11T05:35:07.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846008+0000", 2024-09-11T05:35:07.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.01951214 2024-09-11T05:35:07.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846016+0000", 2024-09-11T05:35:07.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4440000000000008e-06 2024-09-11T05:35:07.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.887 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.887 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116533 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.887 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:35:07.887 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001544788999993, 2024-09-11T05:35:07.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345994049999998, 2024-09-11T05:35:07.887 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116533 2024-09-11T05:35:07.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.888 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:35:07.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:35:07.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:35:07.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:35:07.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811450+0000", 2024-09-11T05:35:07.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0940000000000002e-06 2024-09-11T05:35:07.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811457+0000", 2024-09-11T05:35:07.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2729999999999999e-06 2024-09-11T05:35:07.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811461+0000", 2024-09-11T05:35:07.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.673e-06 2024-09-11T05:35:07.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814962+0000", 2024-09-11T05:35:07.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035012530000000002 2024-09-11T05:35:07.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814970+0000", 2024-09-11T05:35:07.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0539999999999997e-06 2024-09-11T05:35:07.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826536+0000", 2024-09-11T05:35:07.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011566049 2024-09-11T05:35:07.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826542+0000", 2024-09-11T05:35:07.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1709999999999999e-06 2024-09-11T05:35:07.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846039+0000", 2024-09-11T05:35:07.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019497168 2024-09-11T05:35:07.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846047+0000", 2024-09-11T05:35:07.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-11T05:35:07.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.900 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.900 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116534 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.900 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:35:07.901 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001525881999996, 2024-09-11T05:35:07.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034610979, 2024-09-11T05:35:07.901 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.901 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.901 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.902 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116534 2024-09-11T05:35:07.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.902 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:35:07.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:35:07.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:35:07.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:35:07.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811469+0000", 2024-09-11T05:35:07.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.871e-06 2024-09-11T05:35:07.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811475+0000", 2024-09-11T05:35:07.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1689999999999997e-06 2024-09-11T05:35:07.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811480+0000", 2024-09-11T05:35:07.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5990000000000004e-06 2024-09-11T05:35:07.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814990+0000", 2024-09-11T05:35:07.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003510876 2024-09-11T05:35:07.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814997+0000", 2024-09-11T05:35:07.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T05:35:07.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826571+0000", 2024-09-11T05:35:07.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115740230000001 2024-09-11T05:35:07.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826576+0000", 2024-09-11T05:35:07.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-11T05:35:07.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846070+0000", 2024-09-11T05:35:07.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194937660000001 2024-09-11T05:35:07.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846078+0000", 2024-09-11T05:35:07.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.038e-06 2024-09-11T05:35:07.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.909 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116535 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001506723000006, 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346218060000001, 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116535 2024-09-11T05:35:07.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.911 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:35:07.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:35:07.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:35:07.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:35:07.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811488+0000", 2024-09-11T05:35:07.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:35:07.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811495+0000", 2024-09-11T05:35:07.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3960000000000003e-06 2024-09-11T05:35:07.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811500+0000", 2024-09-11T05:35:07.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9910000000000002e-06 2024-09-11T05:35:07.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815019+0000", 2024-09-11T05:35:07.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035190479999999999 2024-09-11T05:35:07.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815025+0000", 2024-09-11T05:35:07.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2550000000000003e-06 2024-09-11T05:35:07.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826604+0000", 2024-09-11T05:35:07.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115789959999999 2024-09-11T05:35:07.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826611+0000", 2024-09-11T05:35:07.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:35:07.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846100+0000", 2024-09-11T05:35:07.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194890569999999 2024-09-11T05:35:07.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846108+0000", 2024-09-11T05:35:07.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4089999999999997e-06 2024-09-11T05:35:07.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.919 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116536 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.919 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:35:07.919 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001487202000007, 2024-09-11T05:35:07.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034634724, 2024-09-11T05:35:07.919 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.919 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.920 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.920 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.920 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.920 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.920 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116536 2024-09-11T05:35:07.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.920 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:35:07.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:35:07.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811506+0000", 2024-09-11T05:35:07.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:35:07.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811508+0000", 2024-09-11T05:35:07.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T05:35:07.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811514+0000", 2024-09-11T05:35:07.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0610000000000001e-06 2024-09-11T05:35:07.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811519+0000", 2024-09-11T05:35:07.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0340000000000004e-06 2024-09-11T05:35:07.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815049+0000", 2024-09-11T05:35:07.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035296440000000002 2024-09-11T05:35:07.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815055+0000", 2024-09-11T05:35:07.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:35:07.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826642+0000", 2024-09-11T05:35:07.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011586375 2024-09-11T05:35:07.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826649+0000", 2024-09-11T05:35:07.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-09-11T05:35:07.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846131+0000", 2024-09-11T05:35:07.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194814569999999 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846140+0000", 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2240000000000001e-06 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116537 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001467633000004, 2024-09-11T05:35:07.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346492180000002, 2024-09-11T05:35:07.928 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.928 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116537 2024-09-11T05:35:07.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.928 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:35:07.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811532+0000", 2024-09-11T05:35:07.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:35:07.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811538+0000", 2024-09-11T05:35:07.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7259999999999996e-06 2024-09-11T05:35:07.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811543+0000", 2024-09-11T05:35:07.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.164e-06 2024-09-11T05:35:07.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815078+0000", 2024-09-11T05:35:07.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003534428 2024-09-11T05:35:07.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815086+0000", 2024-09-11T05:35:07.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8210000000000002e-06 2024-09-11T05:35:07.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826736+0000", 2024-09-11T05:35:07.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116503429999999 2024-09-11T05:35:07.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826751+0000", 2024-09-11T05:35:07.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4895999999999999e-05 2024-09-11T05:35:07.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846165+0000", 2024-09-11T05:35:07.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019413854 2024-09-11T05:35:07.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846174+0000", 2024-09-11T05:35:07.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3149999999999998e-06 2024-09-11T05:35:07.933 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.933 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.933 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.933 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116538 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.933 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:35:07.933 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001442944000004, 2024-09-11T05:35:07.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346557729999999, 2024-09-11T05:35:07.934 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.934 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.934 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.934 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116538 2024-09-11T05:35:07.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.934 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:35:07.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:35:07.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:35:07.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:35:07.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811552+0000", 2024-09-11T05:35:07.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2869999999999999e-06 2024-09-11T05:35:07.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811559+0000", 2024-09-11T05:35:07.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3820000000000001e-06 2024-09-11T05:35:07.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811564+0000", 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815109+0000", 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035450989999999999 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815115+0000", 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:35:07.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826780+0000", 2024-09-11T05:35:07.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116645799999999 2024-09-11T05:35:07.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826787+0000", 2024-09-11T05:35:07.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3880000000000002e-06 2024-09-11T05:35:07.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846196+0000", 2024-09-11T05:35:07.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194094069999999 2024-09-11T05:35:07.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846205+0000", 2024-09-11T05:35:07.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.884e-06 2024-09-11T05:35:07.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.939 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.940 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116539 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.940 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:35:07.940 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001422898000001, 2024-09-11T05:35:07.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346668399999999, 2024-09-11T05:35:07.940 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.940 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.940 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116539 2024-09-11T05:35:07.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:35:07.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:35:07.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811572+0000", 2024-09-11T05:35:07.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:35:07.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811578+0000", 2024-09-11T05:35:07.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T05:35:07.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811583+0000", 2024-09-11T05:35:07.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:35:07.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815137+0000", 2024-09-11T05:35:07.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035540210000000001 2024-09-11T05:35:07.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815144+0000", 2024-09-11T05:35:07.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5969999999999997e-06 2024-09-11T05:35:07.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826851+0000", 2024-09-11T05:35:07.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117072149999999 2024-09-11T05:35:07.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826860+0000", 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4200000000000007e-06 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846228+0000", 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019368287 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846236+0000", 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.541e-06 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116540 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001403474, 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346767830000001, 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116540 2024-09-11T05:35:07.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.948 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:35:07.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:35:07.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:35:07.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:35:07.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811591+0000", 2024-09-11T05:35:07.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:35:07.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811598+0000", 2024-09-11T05:35:07.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T05:35:07.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811603+0000", 2024-09-11T05:35:07.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9470000000000002e-06 2024-09-11T05:35:07.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815168+0000", 2024-09-11T05:35:07.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035651810000000002 2024-09-11T05:35:07.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815174+0000", 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826883+0000", 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117088830000001 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826891+0000", 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7179999999999996e-06 2024-09-11T05:35:07.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846258+0000", 2024-09-11T05:35:07.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019367328 2024-09-11T05:35:07.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846266+0000", 2024-09-11T05:35:07.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4880000000000001e-06 2024-09-11T05:35:07.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.953 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116541 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.953 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:35:07.953 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001384180000002, 2024-09-11T05:35:07.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346837, 2024-09-11T05:35:07.953 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116541 2024-09-11T05:35:07.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.954 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:35:07.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:35:07.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811609+0000", 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811611+0000", 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8679999999999999e-06 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811617+0000", 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:35:07.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811622+0000", 2024-09-11T05:35:07.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9370000000000003e-06 2024-09-11T05:35:07.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815201+0000", 2024-09-11T05:35:07.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035788679999999998 2024-09-11T05:35:07.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815207+0000", 2024-09-11T05:35:07.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7530000000000004e-06 2024-09-11T05:35:07.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826988+0000", 2024-09-11T05:35:07.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117802300000001 2024-09-11T05:35:07.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826996+0000", 2024-09-11T05:35:07.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.259e-06 2024-09-11T05:35:07.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846285+0000", 2024-09-11T05:35:07.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192892090000001 2024-09-11T05:35:07.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846292+0000", 2024-09-11T05:35:07.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9399999999999996e-06 2024-09-11T05:35:07.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.958 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116542 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001365269999994, 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034697618, 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116542 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:35:07.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:35:07.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811628+0000", 2024-09-11T05:35:07.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:35:07.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811629+0000", 2024-09-11T05:35:07.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8059999999999999e-06 2024-09-11T05:35:07.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811636+0000", 2024-09-11T05:35:07.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0990000000000004e-06 2024-09-11T05:35:07.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811640+0000", 2024-09-11T05:35:07.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6630000000000001e-06 2024-09-11T05:35:07.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815230+0000", 2024-09-11T05:35:07.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035897009999999998 2024-09-11T05:35:07.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815237+0000", 2024-09-11T05:35:07.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6590000000000001e-06 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827019+0000", 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011782261 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827026+0000", 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.605e-06 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846317+0000", 2024-09-11T05:35:07.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192904270000001 2024-09-11T05:35:07.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846325+0000", 2024-09-11T05:35:07.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0530000000000007e-06 2024-09-11T05:35:07.964 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.964 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.964 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.964 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116543 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:07.964 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:35:07.965 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.001346596000005, 2024-09-11T05:35:07.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0347097559999998, 2024-09-11T05:35:07.965 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:07.965 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:07.965 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:07.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:07.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:07.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:07.965 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116543 2024-09-11T05:35:07.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.965 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:07.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:07.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:35:07.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:07.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:35:07.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:07.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:07.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:35:07.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:35:07.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:07.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811648+0000", 2024-09-11T05:35:07.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:35:07.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:07.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811654+0000", 2024-09-11T05:35:07.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T05:35:07.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811659+0000", 2024-09-11T05:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9409999999999998e-06 2024-09-11T05:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815259+0000", 2024-09-11T05:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035993980000000002 2024-09-11T05:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815265+0000", 2024-09-11T05:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-11T05:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827049+0000", 2024-09-11T05:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117836019999999 2024-09-11T05:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827056+0000", 2024-09-11T05:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3919999999999997e-06 2024-09-11T05:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:07.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846348+0000", 2024-09-11T05:35:07.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192919039999999 2024-09-11T05:35:07.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:07.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:07.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:07.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846356+0000", 2024-09-11T05:35:07.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7449999999999995e-06 2024-09-11T05:35:07.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.970 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:07.971 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:07.971 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:07.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:35:07.973 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:07.972+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:08.073 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:08.073+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:08.075 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:35:08.075 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:35:08.075 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:08.084 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:35:08.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T05:35:08.174 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:08.174+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:08.189 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:35:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:35:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:35:08.189 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:08.198 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:35:08.261 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:35:08.262 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:35:08.275 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:08.275+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:08.279 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:35:08.279 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:35:08.295 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:35:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:35:08.306 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:08.306 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:08.311 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:35:08.311 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:35:08.315 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:35:08.329 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:35:08.329 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:35:08.346 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:35:08.347 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:35:08.364 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:35:08.364 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:35:08.376 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:08.376+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:08.381 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:35:08.381 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:35:08.420 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:08.420 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:08.429 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:35:08.513 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:08.513+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:08.573 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:08.573 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:08.578 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:08.578+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:08.581 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:35:08.680 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:08.679+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:08.729 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:08.729 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:08.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:35:08.780 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:08.780+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:08.881 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:08.881+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:08.883 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:08.883 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:08.892 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:35:08.982 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:08.982+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:08.995 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:08.995 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:09.004 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:35:09.082 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:09.082+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:09.107 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:09.108 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:09.117 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:35:09.184 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:09.183+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:09.232 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:09.232 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:09.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:35:09.284 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:35:09.283+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:35:09.385 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:09.385+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:09.386 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:09.386 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:09.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:35:09.486 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:09.486+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:09.538 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:09.538 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:09.547 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:35:09.587 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:35:09.587+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:35:09.648 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T05:35:09.653 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:09.653 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:09.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:35:09.706 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:09.706+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:09.786 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:09.786 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:09.788 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:09.788+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:09.796 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:35:09.889 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:09.889+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:09.946 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:09.946 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:09.956 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:35:09.990 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:09.990+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:10.073 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:10.073 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:10.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:35:10.091 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:35:10.091+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:35:10.192 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:10.192+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:10.194 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:10.194 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:10.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:35:10.293 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:10.292+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:10.313 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:10.314 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:10.323 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:35:10.393 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T05:35:10.394 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:10.393+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:10.482 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:10.482 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:10.492 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:35:10.495 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:10.494+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:10.595 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:10.595+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:10.600 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:10.600 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:10.609 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:35:10.622 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T05:35:10.695 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:10.695+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:10.711 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T05:35:10.712 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T05:35:10.728 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T05:35:10.728 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T05:35:10.744 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T05:35:10.744 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T05:35:10.760 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T05:35:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T05:35:10.761 INFO:teuthology.orchestra.run.smithi084.stdout:ERROR: (22) Invalid argument 2024-09-11T05:35:10.761 INFO:teuthology.orchestra.run.smithi084.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T05:35:10.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T05:35:10.777 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T05:35:10.778 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T05:35:10.796 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T05:35:10.796 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T05:35:10.796 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:35:10.796+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:35:10.812 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T05:35:10.812 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T05:35:10.830 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T05:35:10.831 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T05:35:10.887 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:35:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGRecoveryDeleteReply(3.19 e145,143 3:9e5b29d5:::rbd_data.112d745a9e91.0000000000000006:head,135'1088)", 2024-09-11T05:35:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:35:10.886780+0000", 2024-09-11T05:35:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00013051499999999999, 2024-09-11T05:35:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000146568, 2024-09-11T05:35:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:35:10.886780+0000", 2024-09-11T05:35:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:35:10.886780+0000", 2024-09-11T05:35:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:35:10.886780+0000", 2024-09-11T05:35:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9599999999999999e-07 2024-09-11T05:35:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:35:10.886784+0000", 2024-09-11T05:35:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8460000000000001e-06 2024-09-11T05:35:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:35:10.886794+0000", 2024-09-11T05:35:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0339e-05 2024-09-11T05:35:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:35:10.886805+0000", 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0969e-05 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:35:10.886838+0000", 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2991000000000003e-05 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 1 2024-09-11T05:35:10.890 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:10.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T05:35:10.897 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:35:10.897+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:35:10.998 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:10.998+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:10.999 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:10.999 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:35:10.999 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:35:10.999 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:35:10.999 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:11.008 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T05:35:11.099 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:11.099+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:11.113 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:35:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:35:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:35:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116524 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:35:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.300248136999997, 2024-09-11T05:35:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344630100000001, 2024-09-11T05:35:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116524 2024-09-11T05:35:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:35:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811269+0000", 2024-09-11T05:35:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811270+0000", 2024-09-11T05:35:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T05:35:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811272+0000", 2024-09-11T05:35:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2479999999999999e-06 2024-09-11T05:35:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811278+0000", 2024-09-11T05:35:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1970000000000001e-06 2024-09-11T05:35:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811283+0000", 2024-09-11T05:35:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.425e-06 2024-09-11T05:35:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813113+0000", 2024-09-11T05:35:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001830302 2024-09-11T05:35:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813117+0000", 2024-09-11T05:35:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0810000000000004e-06 2024-09-11T05:35:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814661+0000", 2024-09-11T05:35:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015436969999999999 2024-09-11T05:35:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814667+0000", 2024-09-11T05:35:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6370000000000002e-06 2024-09-11T05:35:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826115+0000", 2024-09-11T05:35:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114479059999999 2024-09-11T05:35:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826123+0000", 2024-09-11T05:35:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000004e-06 2024-09-11T05:35:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845722+0000", 2024-09-11T05:35:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195993000000001 2024-09-11T05:35:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845732+0000", 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116525 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.300228254999993, 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344747700000001, 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116525 2024-09-11T05:35:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:35:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811289+0000", 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811290+0000", 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811295+0000", 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8969999999999999e-06 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811301+0000", 2024-09-11T05:35:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4919999999999998e-06 2024-09-11T05:35:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811306+0000", 2024-09-11T05:35:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6589999999999998e-06 2024-09-11T05:35:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813138+0000", 2024-09-11T05:35:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001832078 2024-09-11T05:35:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.813142+0000", 2024-09-11T05:35:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0380000000000001e-06 2024-09-11T05:35:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814689+0000", 2024-09-11T05:35:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546799 2024-09-11T05:35:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814695+0000", 2024-09-11T05:35:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8739999999999997e-06 2024-09-11T05:35:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826148+0000", 2024-09-11T05:35:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114527259999999 2024-09-11T05:35:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826166+0000", 2024-09-11T05:35:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7484999999999999e-05 2024-09-11T05:35:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845756+0000", 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019590609 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845764+0000", 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7020000000000001e-06 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116526 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:35:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.300205457000004, 2024-09-11T05:35:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0344863210000002, 2024-09-11T05:35:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116526 2024-09-11T05:35:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:35:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:35:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811312+0000", 2024-09-11T05:35:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T05:35:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811315+0000", 2024-09-11T05:35:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079999999999999e-06 2024-09-11T05:35:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811320+0000", 2024-09-11T05:35:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8619999999999999e-06 2024-09-11T05:35:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811325+0000", 2024-09-11T05:35:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T05:35:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814736+0000", 2024-09-11T05:35:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034115780000000002 2024-09-11T05:35:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814744+0000", 2024-09-11T05:35:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5340000000000002e-06 2024-09-11T05:35:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826212+0000", 2024-09-11T05:35:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114682749999999 2024-09-11T05:35:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826225+0000", 2024-09-11T05:35:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2232000000000001e-05 2024-09-11T05:35:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845789+0000", 2024-09-11T05:35:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195649200000001 2024-09-11T05:35:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845798+0000", 2024-09-11T05:35:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9269999999999994e-06 2024-09-11T05:35:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116527 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:35:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.300186525000001, 2024-09-11T05:35:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345095849999999, 2024-09-11T05:35:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116527 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811331+0000", 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811334+0000", 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3099999999999999e-06 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811340+0000", 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.691e-06 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811345+0000", 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5480000000000003e-06 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814767+0000", 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034223190000000001 2024-09-11T05:35:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814774+0000", 2024-09-11T05:35:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9330000000000004e-06 2024-09-11T05:35:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826265+0000", 2024-09-11T05:35:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114912460000001 2024-09-11T05:35:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826274+0000", 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3909999999999998e-06 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845831+0000", 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195574080000001 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845841+0000", 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3610000000000007e-06 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116528 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:35:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.300167086000002, 2024-09-11T05:35:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345287679999999, 2024-09-11T05:35:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116528 2024-09-11T05:35:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:35:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811350+0000", 2024-09-11T05:35:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811351+0000", 2024-09-11T05:35:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T05:35:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811353+0000", 2024-09-11T05:35:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8470000000000001e-06 2024-09-11T05:35:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811359+0000", 2024-09-11T05:35:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811364+0000", 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000001e-06 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814795+0000", 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034316569999999998 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814826+0000", 2024-09-11T05:35:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0587999999999999e-05 2024-09-11T05:35:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826309+0000", 2024-09-11T05:35:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011483444 2024-09-11T05:35:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826319+0000", 2024-09-11T05:35:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6849999999999996e-06 2024-09-11T05:35:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845868+0000", 2024-09-11T05:35:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195487110000001 2024-09-11T05:35:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845879+0000", 2024-09-11T05:35:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1428e-05 2024-09-11T05:35:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116529 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:35:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.300148452000002, 2024-09-11T05:35:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034542531, 2024-09-11T05:35:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116529 2024-09-11T05:35:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:35:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:35:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811369+0000", 2024-09-11T05:35:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T05:35:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811371+0000", 2024-09-11T05:35:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T05:35:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811377+0000", 2024-09-11T05:35:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1580000000000002e-06 2024-09-11T05:35:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811383+0000", 2024-09-11T05:35:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.135e-06 2024-09-11T05:35:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814851+0000", 2024-09-11T05:35:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034684690000000001 2024-09-11T05:35:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814858+0000", 2024-09-11T05:35:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6969999999999996e-06 2024-09-11T05:35:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826354+0000", 2024-09-11T05:35:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0114962359999999 2024-09-11T05:35:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826364+0000", 2024-09-11T05:35:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0047999999999999e-05 2024-09-11T05:35:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845903+0000", 2024-09-11T05:35:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195393610000001 2024-09-11T05:35:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845912+0000", 2024-09-11T05:35:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2269999999999993e-06 2024-09-11T05:35:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116530 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.30012954, 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345557429999999, 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116530 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:35:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:35:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811388+0000", 2024-09-11T05:35:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T05:35:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811390+0000", 2024-09-11T05:35:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:35:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811396+0000", 2024-09-11T05:35:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7910000000000001e-06 2024-09-11T05:35:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811402+0000", 2024-09-11T05:35:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6679999999999998e-06 2024-09-11T05:35:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814879+0000", 2024-09-11T05:35:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034769290000000001 2024-09-11T05:35:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814885+0000", 2024-09-11T05:35:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.156e-06 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826389+0000", 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115041140000001 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826397+0000", 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1349999999999992e-06 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845935+0000", 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0195381370000001 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845944+0000", 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4540000000000007e-06 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116531 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:35:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.300109481000007, 2024-09-11T05:35:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345764630000001, 2024-09-11T05:35:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116531 2024-09-11T05:35:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:35:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:35:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811408+0000", 2024-09-11T05:35:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8799999999999998e-07 2024-09-11T05:35:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811411+0000", 2024-09-11T05:35:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:35:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811417+0000", 2024-09-11T05:35:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3539999999999996e-06 2024-09-11T05:35:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811422+0000", 2024-09-11T05:35:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3229999999999997e-06 2024-09-11T05:35:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814906+0000", 2024-09-11T05:35:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034835389999999999 2024-09-11T05:35:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814913+0000", 2024-09-11T05:35:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309999999999996e-06 2024-09-11T05:35:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826423+0000", 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115109019999999 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826431+0000", 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9410000000000007e-06 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845975+0000", 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019543767 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.845984+0000", 2024-09-11T05:35:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3530000000000001e-06 2024-09-11T05:35:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116532 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:35:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.300089283000005, 2024-09-11T05:35:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034588131, 2024-09-11T05:35:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116532 2024-09-11T05:35:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:35:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811428+0000", 2024-09-11T05:35:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811429+0000", 2024-09-11T05:35:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T05:35:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811431+0000", 2024-09-11T05:35:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9910000000000001e-06 2024-09-11T05:35:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811437+0000", 2024-09-11T05:35:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.049e-06 2024-09-11T05:35:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811441+0000", 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8289999999999998e-06 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814934+0000", 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034927220000000002 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814941+0000", 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.844e-06 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826480+0000", 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115393260000001 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826496+0000", 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5406000000000001e-05 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846008+0000", 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.01951214 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846016+0000", 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4440000000000008e-06 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116533 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.300069729000001, 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0345994049999998, 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116533 2024-09-11T05:35:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:35:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:35:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811448+0000", 2024-09-11T05:35:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:35:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811450+0000", 2024-09-11T05:35:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0940000000000002e-06 2024-09-11T05:35:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811457+0000", 2024-09-11T05:35:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2729999999999999e-06 2024-09-11T05:35:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811461+0000", 2024-09-11T05:35:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.673e-06 2024-09-11T05:35:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814962+0000", 2024-09-11T05:35:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035012530000000002 2024-09-11T05:35:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814970+0000", 2024-09-11T05:35:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0539999999999997e-06 2024-09-11T05:35:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826536+0000", 2024-09-11T05:35:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011566049 2024-09-11T05:35:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826542+0000", 2024-09-11T05:35:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1709999999999999e-06 2024-09-11T05:35:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846039+0000", 2024-09-11T05:35:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019497168 2024-09-11T05:35:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846047+0000", 2024-09-11T05:35:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-11T05:35:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116534 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:35:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.300050822000003, 2024-09-11T05:35:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034610979, 2024-09-11T05:35:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116534 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:35:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811467+0000", 2024-09-11T05:35:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T05:35:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811469+0000", 2024-09-11T05:35:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.871e-06 2024-09-11T05:35:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811475+0000", 2024-09-11T05:35:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1689999999999997e-06 2024-09-11T05:35:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811480+0000", 2024-09-11T05:35:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5990000000000004e-06 2024-09-11T05:35:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814990+0000", 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003510876 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.814997+0000", 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826571+0000", 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115740230000001 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826576+0000", 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846070+0000", 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194937660000001 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846078+0000", 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.038e-06 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116535 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:35:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.300031662999999, 2024-09-11T05:35:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346218060000001, 2024-09-11T05:35:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116535 2024-09-11T05:35:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:35:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:35:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811486+0000", 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4700000000000002e-07 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811488+0000", 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811495+0000", 2024-09-11T05:35:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3960000000000003e-06 2024-09-11T05:35:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811500+0000", 2024-09-11T05:35:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9910000000000002e-06 2024-09-11T05:35:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815019+0000", 2024-09-11T05:35:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035190479999999999 2024-09-11T05:35:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815025+0000", 2024-09-11T05:35:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2550000000000003e-06 2024-09-11T05:35:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826604+0000", 2024-09-11T05:35:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115789959999999 2024-09-11T05:35:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826611+0000", 2024-09-11T05:35:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:35:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846100+0000", 2024-09-11T05:35:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194890569999999 2024-09-11T05:35:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846108+0000", 2024-09-11T05:35:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4089999999999997e-06 2024-09-11T05:35:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116536 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:35:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.300012142, 2024-09-11T05:35:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034634724, 2024-09-11T05:35:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116536 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811505+0000", 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811506+0000", 2024-09-11T05:35:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:35:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811508+0000", 2024-09-11T05:35:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T05:35:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811514+0000", 2024-09-11T05:35:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0610000000000001e-06 2024-09-11T05:35:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811519+0000", 2024-09-11T05:35:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0340000000000004e-06 2024-09-11T05:35:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815049+0000", 2024-09-11T05:35:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035296440000000002 2024-09-11T05:35:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815055+0000", 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826642+0000", 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011586375 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826649+0000", 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.79e-06 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846131+0000", 2024-09-11T05:35:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194814569999999 2024-09-11T05:35:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846140+0000", 2024-09-11T05:35:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2240000000000001e-06 2024-09-11T05:35:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116537 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.299992572999997, 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346492180000002, 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116537 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:35:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:35:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811525+0000", 2024-09-11T05:35:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:35:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811532+0000", 2024-09-11T05:35:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2840000000000003e-06 2024-09-11T05:35:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811538+0000", 2024-09-11T05:35:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7259999999999996e-06 2024-09-11T05:35:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811543+0000", 2024-09-11T05:35:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.164e-06 2024-09-11T05:35:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815078+0000", 2024-09-11T05:35:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003534428 2024-09-11T05:35:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815086+0000", 2024-09-11T05:35:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8210000000000002e-06 2024-09-11T05:35:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826736+0000", 2024-09-11T05:35:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116503429999999 2024-09-11T05:35:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826751+0000", 2024-09-11T05:35:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4895999999999999e-05 2024-09-11T05:35:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846165+0000", 2024-09-11T05:35:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019413854 2024-09-11T05:35:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846174+0000", 2024-09-11T05:35:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3149999999999998e-06 2024-09-11T05:35:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116538 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.299967883999997, 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346557729999999, 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116538 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:35:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:35:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811550+0000", 2024-09-11T05:35:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T05:35:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811552+0000", 2024-09-11T05:35:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2869999999999999e-06 2024-09-11T05:35:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811559+0000", 2024-09-11T05:35:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3820000000000001e-06 2024-09-11T05:35:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811564+0000", 2024-09-11T05:35:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0459999999999996e-06 2024-09-11T05:35:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815109+0000", 2024-09-11T05:35:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035450989999999999 2024-09-11T05:35:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815115+0000", 2024-09-11T05:35:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:35:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826780+0000", 2024-09-11T05:35:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0116645799999999 2024-09-11T05:35:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826787+0000", 2024-09-11T05:35:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3880000000000002e-06 2024-09-11T05:35:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846196+0000", 2024-09-11T05:35:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0194094069999999 2024-09-11T05:35:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846205+0000", 2024-09-11T05:35:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.884e-06 2024-09-11T05:35:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116539 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:35:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.299947837999994, 2024-09-11T05:35:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346668399999999, 2024-09-11T05:35:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116539 2024-09-11T05:35:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811570+0000", 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811572+0000", 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811578+0000", 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811583+0000", 2024-09-11T05:35:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0649999999999998e-06 2024-09-11T05:35:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815137+0000", 2024-09-11T05:35:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035540210000000001 2024-09-11T05:35:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815144+0000", 2024-09-11T05:35:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5969999999999997e-06 2024-09-11T05:35:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826851+0000", 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117072149999999 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826860+0000", 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4200000000000007e-06 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846228+0000", 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019368287 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846236+0000", 2024-09-11T05:35:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.541e-06 2024-09-11T05:35:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116540 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:35:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.299928413999993, 2024-09-11T05:35:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346767830000001, 2024-09-11T05:35:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116540 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:35:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811589+0000", 2024-09-11T05:35:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T05:35:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811591+0000", 2024-09-11T05:35:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.951e-06 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811598+0000", 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811603+0000", 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9470000000000002e-06 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815168+0000", 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035651810000000002 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815174+0000", 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826883+0000", 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117088830000001 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826891+0000", 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7179999999999996e-06 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846258+0000", 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.019367328 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846266+0000", 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4880000000000001e-06 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116541 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.299909119999995, 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0346837, 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116541 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811608+0000", 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811609+0000", 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T05:35:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811611+0000", 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8679999999999999e-06 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811617+0000", 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2589999999999997e-06 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811622+0000", 2024-09-11T05:35:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9370000000000003e-06 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815201+0000", 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035788679999999998 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815207+0000", 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7530000000000004e-06 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826988+0000", 2024-09-11T05:35:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117802300000001 2024-09-11T05:35:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.826996+0000", 2024-09-11T05:35:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.259e-06 2024-09-11T05:35:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846285+0000", 2024-09-11T05:35:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192892090000001 2024-09-11T05:35:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846292+0000", 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9399999999999996e-06 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116542 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.299890210000001, 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.034697618, 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116542 2024-09-11T05:35:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:35:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811627+0000", 2024-09-11T05:35:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811628+0000", 2024-09-11T05:35:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-07 2024-09-11T05:35:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811629+0000", 2024-09-11T05:35:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8059999999999999e-06 2024-09-11T05:35:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811636+0000", 2024-09-11T05:35:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0990000000000004e-06 2024-09-11T05:35:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811640+0000", 2024-09-11T05:35:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6630000000000001e-06 2024-09-11T05:35:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815230+0000", 2024-09-11T05:35:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035897009999999998 2024-09-11T05:35:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815237+0000", 2024-09-11T05:35:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6590000000000001e-06 2024-09-11T05:35:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827019+0000", 2024-09-11T05:35:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.011782261 2024-09-11T05:35:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827026+0000", 2024-09-11T05:35:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.605e-06 2024-09-11T05:35:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846317+0000", 2024-09-11T05:35:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192904270000001 2024-09-11T05:35:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846325+0000", 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0530000000000007e-06 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116543 3.1d 3.20a9c01d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.299871535999998, 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0347097559999998, 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116543 2024-09-11T05:35:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:35:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:35:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811646+0000", 2024-09-11T05:35:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5699999999999998e-07 2024-09-11T05:35:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811648+0000", 2024-09-11T05:35:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8899999999999999e-06 2024-09-11T05:35:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811654+0000", 2024-09-11T05:35:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T05:35:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.811659+0000", 2024-09-11T05:35:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9409999999999998e-06 2024-09-11T05:35:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815259+0000", 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035993980000000002 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.815265+0000", 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827049+0000", 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0117836019999999 2024-09-11T05:35:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.827056+0000", 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3919999999999997e-06 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846348+0000", 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0192919039999999 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.846356+0000", 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7449999999999995e-06 2024-09-11T05:35:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.232 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.232 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.232 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:11.233 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T05:35:11.234 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:11.233+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:11.334 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:35:11.334+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:35:11.379 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:11.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:35:11.379 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:35:11.379 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:11.387 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T05:35:11.435 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-09-11T05:35:11.435+0000 7f2d1fe39640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33357) UID: 0 2024-09-11T05:35:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:11.529 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:35:11.529 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:35:11.529 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:35:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:11.536 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T05:35:11.535+0000 7f9e88fe4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33455) UID: 0 2024-09-11T05:35:11.537 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T05:35:11.638 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:11.637+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:11.688 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:35:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:35:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:35:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:184170 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 8208384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:35:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.767198530000002, 2024-09-11T05:35:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047293133000000001, 2024-09-11T05:35:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 184170 2024-09-11T05:35:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:35:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.920003+0000", 2024-09-11T05:35:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921808+0000", 2024-09-11T05:35:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001805868 2024-09-11T05:35:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921819+0000", 2024-09-11T05:35:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0458e-05 2024-09-11T05:35:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921830+0000", 2024-09-11T05:35:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1482e-05 2024-09-11T05:35:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.921837+0000", 2024-09-11T05:35:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3709999999999996e-06 2024-09-11T05:35:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967150+0000", 2024-09-11T05:35:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045313402000000003 2024-09-11T05:35:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967216+0000", 2024-09-11T05:35:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6322999999999995e-05 2024-09-11T05:35:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:11.967296+0000", 2024-09-11T05:35:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9228999999999996e-05 2024-09-11T05:35:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185733 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3309568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:35:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.413165518, 2024-09-11T05:35:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047365106999999997, 2024-09-11T05:35:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185733 2024-09-11T05:35:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:35:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.274036+0000", 2024-09-11T05:35:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275806+0000", 2024-09-11T05:35:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001769966 2024-09-11T05:35:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275810+0000", 2024-09-11T05:35:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5539999999999999e-06 2024-09-11T05:35:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275821+0000", 2024-09-11T05:35:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1253999999999999e-05 2024-09-11T05:35:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.275828+0000", 2024-09-11T05:35:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:35:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321211+0000", 2024-09-11T05:35:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045383053999999999 2024-09-11T05:35:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321306+0000", 2024-09-11T05:35:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4712999999999999e-05 2024-09-11T05:35:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.321401+0000", 2024-09-11T05:35:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4825000000000001e-05 2024-09-11T05:35:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185743 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3719168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:35:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.411153681999998, 2024-09-11T05:35:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047361001999999999, 2024-09-11T05:35:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185743 2024-09-11T05:35:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:35:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276047+0000", 2024-09-11T05:35:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276048+0000", 2024-09-11T05:35:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T05:35:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276050+0000", 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5189999999999999e-06 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276056+0000", 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0870000000000003e-06 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276061+0000", 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323215+0000", 2024-09-11T05:35:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047153977999999999 2024-09-11T05:35:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323278+0000", 2024-09-11T05:35:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3053999999999996e-05 2024-09-11T05:35:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323408+0000", 2024-09-11T05:35:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013012899999999999 2024-09-11T05:35:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185744 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3760128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:35:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.411133002, 2024-09-11T05:35:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047563095, 2024-09-11T05:35:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185744 2024-09-11T05:35:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:35:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.276068+0000", 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277808+0000", 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001739652 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277816+0000", 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.208e-06 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277829+0000", 2024-09-11T05:35:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2848e-05 2024-09-11T05:35:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.277837+0000", 2024-09-11T05:35:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6379999999999993e-06 2024-09-11T05:35:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323448+0000", 2024-09-11T05:35:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045610604999999999 2024-09-11T05:35:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323562+0000", 2024-09-11T05:35:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113706 2024-09-11T05:35:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.323631+0000", 2024-09-11T05:35:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9437999999999995e-05 2024-09-11T05:35:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185753 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:35:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.409169956, 2024-09-11T05:35:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047283944000000001, 2024-09-11T05:35:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185753 2024-09-11T05:35:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:35:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:35:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278031+0000", 2024-09-11T05:35:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:35:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278033+0000", 2024-09-11T05:35:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.237e-06 2024-09-11T05:35:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278036+0000", 2024-09-11T05:35:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9689999999999999e-06 2024-09-11T05:35:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278038+0000", 2024-09-11T05:35:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5490000000000001e-06 2024-09-11T05:35:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325140+0000", 2024-09-11T05:35:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047101845000000003 2024-09-11T05:35:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325219+0000", 2024-09-11T05:35:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9444999999999996e-05 2024-09-11T05:35:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325315+0000", 2024-09-11T05:35:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.569e-05 2024-09-11T05:35:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185754 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 4169728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:35:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.409160057999998, 2024-09-11T05:35:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047450697, 2024-09-11T05:35:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185754 2024-09-11T05:35:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:35:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:35:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278041+0000", 2024-09-11T05:35:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:35:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278043+0000", 2024-09-11T05:35:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1739999999999999e-06 2024-09-11T05:35:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278045+0000", 2024-09-11T05:35:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:35:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278048+0000", 2024-09-11T05:35:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5679999999999998e-06 2024-09-11T05:35:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325359+0000", 2024-09-11T05:35:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047311262 2024-09-11T05:35:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325421+0000", 2024-09-11T05:35:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1717999999999994e-05 2024-09-11T05:35:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325492+0000", 2024-09-11T05:35:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0716000000000005e-05 2024-09-11T05:35:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185755 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2125824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:35:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.409149991, 2024-09-11T05:35:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047669481999999999, 2024-09-11T05:35:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185755 2024-09-11T05:35:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:35:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:35:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278051+0000", 2024-09-11T05:35:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T05:35:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278052+0000", 2024-09-11T05:35:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-11T05:35:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278055+0000", 2024-09-11T05:35:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8059999999999999e-06 2024-09-11T05:35:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278058+0000", 2024-09-11T05:35:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.503e-06 2024-09-11T05:35:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325563+0000", 2024-09-11T05:35:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047505316999999998 2024-09-11T05:35:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325645+0000", 2024-09-11T05:35:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2439000000000001e-05 2024-09-11T05:35:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325721+0000", 2024-09-11T05:35:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5092999999999994e-05 2024-09-11T05:35:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185756 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2166784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:35:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.409137661000003, 2024-09-11T05:35:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047861556, 2024-09-11T05:35:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185756 2024-09-11T05:35:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:35:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.278063+0000", 2024-09-11T05:35:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279805+0000", 2024-09-11T05:35:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001741586 2024-09-11T05:35:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279809+0000", 2024-09-11T05:35:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0890000000000002e-06 2024-09-11T05:35:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279816+0000", 2024-09-11T05:35:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2060000000000001e-06 2024-09-11T05:35:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.279821+0000", 2024-09-11T05:35:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6709999999999998e-06 2024-09-11T05:35:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325764+0000", 2024-09-11T05:35:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045942749999999997 2024-09-11T05:35:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325846+0000", 2024-09-11T05:35:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2470000000000002e-05 2024-09-11T05:35:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.325925+0000", 2024-09-11T05:35:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8783999999999997e-05 2024-09-11T05:35:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185764 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2494464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:35:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.407173604999997, 2024-09-11T05:35:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308594000000002, 2024-09-11T05:35:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185764 2024-09-11T05:35:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:35:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280027+0000", 2024-09-11T05:35:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280028+0000", 2024-09-11T05:35:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.27e-07 2024-09-11T05:35:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280030+0000", 2024-09-11T05:35:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3319999999999999e-06 2024-09-11T05:35:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280036+0000", 2024-09-11T05:35:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T05:35:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280041+0000", 2024-09-11T05:35:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7530000000000001e-06 2024-09-11T05:35:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327196+0000", 2024-09-11T05:35:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047154967999999998 2024-09-11T05:35:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327266+0000", 2024-09-11T05:35:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0427999999999997e-05 2024-09-11T05:35:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327336+0000", 2024-09-11T05:35:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9659000000000005e-05 2024-09-11T05:35:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185765 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2535424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:35:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.407153686000001, 2024-09-11T05:35:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047410790000000001, 2024-09-11T05:35:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185765 2024-09-11T05:35:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:35:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280047+0000", 2024-09-11T05:35:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280048+0000", 2024-09-11T05:35:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T05:35:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280050+0000", 2024-09-11T05:35:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-11T05:35:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280056+0000", 2024-09-11T05:35:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2099999999999998e-06 2024-09-11T05:35:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280061+0000", 2024-09-11T05:35:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T05:35:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327369+0000", 2024-09-11T05:35:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047308416999999998 2024-09-11T05:35:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327413+0000", 2024-09-11T05:35:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070999999999999e-05 2024-09-11T05:35:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327458+0000", 2024-09-11T05:35:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4836000000000002e-05 2024-09-11T05:35:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185766 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2576384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:35:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.407133696000002, 2024-09-11T05:35:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047571239000000001, 2024-09-11T05:35:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185766 2024-09-11T05:35:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:35:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280067+0000", 2024-09-11T05:35:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280068+0000", 2024-09-11T05:35:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T05:35:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280070+0000", 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280081+0000", 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0951999999999999e-05 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280086+0000", 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5029999999999997e-06 2024-09-11T05:35:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327495+0000", 2024-09-11T05:35:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047408497000000001 2024-09-11T05:35:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327568+0000", 2024-09-11T05:35:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3450999999999999e-05 2024-09-11T05:35:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327639+0000", 2024-09-11T05:35:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0309999999999996e-05 2024-09-11T05:35:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185767 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2617344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:35:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.407086559, 2024-09-11T05:35:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047672355, 2024-09-11T05:35:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185767 2024-09-11T05:35:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:35:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:35:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280115+0000", 2024-09-11T05:35:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8999999999999996e-07 2024-09-11T05:35:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280121+0000", 2024-09-11T05:35:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0599999999999996e-06 2024-09-11T05:35:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280128+0000", 2024-09-11T05:35:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1029999999999996e-06 2024-09-11T05:35:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280133+0000", 2024-09-11T05:35:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T05:35:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327702+0000", 2024-09-11T05:35:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047568307999999997 2024-09-11T05:35:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327745+0000", 2024-09-11T05:35:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3407e-05 2024-09-11T05:35:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327787+0000", 2024-09-11T05:35:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1749000000000003e-05 2024-09-11T05:35:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185768 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2658304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:35:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.407059208, 2024-09-11T05:35:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047830091999999998, 2024-09-11T05:35:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185768 2024-09-11T05:35:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:35:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.280142+0000", 2024-09-11T05:35:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281805+0000", 2024-09-11T05:35:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016635809999999999 2024-09-11T05:35:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281810+0000", 2024-09-11T05:35:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3540000000000002e-06 2024-09-11T05:35:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281820+0000", 2024-09-11T05:35:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T05:35:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281828+0000", 2024-09-11T05:35:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:35:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327826+0000", 2024-09-11T05:35:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045998206999999999 2024-09-11T05:35:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327902+0000", 2024-09-11T05:35:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5761999999999997e-05 2024-09-11T05:35:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.327972+0000", 2024-09-11T05:35:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0414999999999996e-05 2024-09-11T05:35:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185775 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2945024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:35:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.405265149000002, 2024-09-11T05:35:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047301277000000003, 2024-09-11T05:35:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185775 2024-09-11T05:35:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:35:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:35:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281936+0000", 2024-09-11T05:35:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1899999999999999e-07 2024-09-11T05:35:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281938+0000", 2024-09-11T05:35:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5099999999999999e-06 2024-09-11T05:35:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281941+0000", 2024-09-11T05:35:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-06 2024-09-11T05:35:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281943+0000", 2024-09-11T05:35:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.751e-06 2024-09-11T05:35:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329092+0000", 2024-09-11T05:35:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047148177999999999 2024-09-11T05:35:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329166+0000", 2024-09-11T05:35:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4795000000000005e-05 2024-09-11T05:35:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329237+0000", 2024-09-11T05:35:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0864000000000005e-05 2024-09-11T05:35:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185777 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2985984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:35:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.405254720000002, 2024-09-11T05:35:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047500597999999998, 2024-09-11T05:35:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185777 2024-09-11T05:35:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:35:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281946+0000", 2024-09-11T05:35:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281947+0000", 2024-09-11T05:35:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:35:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281948+0000", 2024-09-11T05:35:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1429999999999999e-06 2024-09-11T05:35:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281951+0000", 2024-09-11T05:35:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-11T05:35:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281953+0000", 2024-09-11T05:35:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6709999999999999e-06 2024-09-11T05:35:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329280+0000", 2024-09-11T05:35:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047326857999999999 2024-09-11T05:35:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329364+0000", 2024-09-11T05:35:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3586999999999998e-05 2024-09-11T05:35:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329447+0000", 2024-09-11T05:35:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3314999999999998e-05 2024-09-11T05:35:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185778 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3026944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:35:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.405244906999997, 2024-09-11T05:35:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047668384000000001, 2024-09-11T05:35:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185778 2024-09-11T05:35:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:35:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.281956+0000", 2024-09-11T05:35:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283808+0000", 2024-09-11T05:35:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018518919999999999 2024-09-11T05:35:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283812+0000", 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283820+0000", 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3319999999999992e-06 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283825+0000", 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8729999999999998e-06 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329484+0000", 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045658404999999999 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329554+0000", 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0099999999999996e-05 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.329625+0000", 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0732e-05 2024-09-11T05:35:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185790 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2170880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:35:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.403259953999999, 2024-09-11T05:35:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047276674999999997, 2024-09-11T05:35:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185790 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283941+0000", 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283942+0000", 2024-09-11T05:35:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:35:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283944+0000", 2024-09-11T05:35:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9800000000000001e-06 2024-09-11T05:35:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283948+0000", 2024-09-11T05:35:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9729999999999999e-06 2024-09-11T05:35:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283950+0000", 2024-09-11T05:35:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7020000000000001e-06 2024-09-11T05:35:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331076+0000", 2024-09-11T05:35:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047126016 2024-09-11T05:35:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331147+0000", 2024-09-11T05:35:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0848999999999999e-05 2024-09-11T05:35:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331218+0000", 2024-09-11T05:35:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0621e-05 2024-09-11T05:35:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185791 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3395584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:35:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.403233903999997, 2024-09-11T05:35:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047372307000000002, 2024-09-11T05:35:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185791 2024-09-11T05:35:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:35:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283967+0000", 2024-09-11T05:35:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283968+0000", 2024-09-11T05:35:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T05:35:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283970+0000", 2024-09-11T05:35:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.199e-06 2024-09-11T05:35:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283976+0000", 2024-09-11T05:35:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T05:35:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283981+0000", 2024-09-11T05:35:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8439999999999997e-06 2024-09-11T05:35:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331252+0000", 2024-09-11T05:35:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047270999000000001 2024-09-11T05:35:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331299+0000", 2024-09-11T05:35:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7376999999999997e-05 2024-09-11T05:35:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331339+0000", 2024-09-11T05:35:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0428e-05 2024-09-11T05:35:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185792 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 2211840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:35:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.403214007000003, 2024-09-11T05:35:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047522035999999997, 2024-09-11T05:35:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185792 2024-09-11T05:35:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:35:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:35:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283987+0000", 2024-09-11T05:35:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T05:35:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283990+0000", 2024-09-11T05:35:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T05:35:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.283995+0000", 2024-09-11T05:35:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3329999999999996e-06 2024-09-11T05:35:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284002+0000", 2024-09-11T05:35:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6120000000000001e-06 2024-09-11T05:35:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331373+0000", 2024-09-11T05:35:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047370269999999999 2024-09-11T05:35:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331442+0000", 2024-09-11T05:35:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8794999999999994e-05 2024-09-11T05:35:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331509+0000", 2024-09-11T05:35:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7570000000000005e-05 2024-09-11T05:35:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:185793 3.1c 3:3ec12b05:::rbd_data.112d95d25762.0000000000000001:29 [read 3436544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:35:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.403191907999997, 2024-09-11T05:35:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.047706692000000002, 2024-09-11T05:35:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 185793 2024-09-11T05:35:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:35:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.284009+0000", 2024-09-11T05:35:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285808+0000", 2024-09-11T05:35:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001798352 2024-09-11T05:35:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285812+0000", 2024-09-11T05:35:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6399999999999996e-06 2024-09-11T05:35:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:11.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285823+0000", 2024-09-11T05:35:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0783e-05 2024-09-11T05:35:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:11.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.285831+0000", 2024-09-11T05:35:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9500000000000001e-06 2024-09-11T05:35:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331550+0000", 2024-09-11T05:35:11.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045719518000000001 2024-09-11T05:35:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331633+0000", 2024-09-11T05:35:11.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2992999999999996e-05 2024-09-11T05:35:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:12.331716+0000", 2024-09-11T05:35:11.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2455999999999998e-05 2024-09-11T05:35:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:11.805 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:11.805 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:11.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T05:35:11.808 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:11.807+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:11.908 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-09-11T05:35:11.908+0000 7fd5a1616640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33360) UID: 0 2024-09-11T05:35:11.912 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:11.912 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:35:11.912 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:35:11.912 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:11.921 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T05:35:12.009 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-09-11T05:35:12.008+0000 7f86debfd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33353) UID: 0 2024-09-11T05:35:12.024 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:35:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:35:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:35:12.025 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:12.033 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T05:35:12.109 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:12.108+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:12.139 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:35:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:35:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:35:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116623 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13477888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:35:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247528630000005, 2024-09-11T05:35:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9661491070000001, 2024-09-11T05:35:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116623 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889572+0000", 2024-09-11T05:35:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889573+0000", 2024-09-11T05:35:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:35:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889574+0000", 2024-09-11T05:35:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4810000000000001e-06 2024-09-11T05:35:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889578+0000", 2024-09-11T05:35:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T05:35:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889581+0000", 2024-09-11T05:35:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2380000000000002e-06 2024-09-11T05:35:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890367+0000", 2024-09-11T05:35:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078646599999999999 2024-09-11T05:35:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890377+0000", 2024-09-11T05:35:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5789999999999993e-06 2024-09-11T05:35:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829092+0000", 2024-09-11T05:35:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871527899999996 2024-09-11T05:35:12.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829101+0000", 2024-09-11T05:35:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6680000000000007e-06 2024-09-11T05:35:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854695+0000", 2024-09-11T05:35:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0255937369999999 2024-09-11T05:35:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.854786+0000", 2024-09-11T05:35:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1831999999999998e-05 2024-09-11T05:35:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855721+0000", 2024-09-11T05:35:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093499800000000004 2024-09-11T05:35:12.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116624 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13502464~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:35:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247514783, 2024-09-11T05:35:12.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9664307189999999, 2024-09-11T05:35:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116624 2024-09-11T05:35:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.147 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:35:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889586+0000", 2024-09-11T05:35:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889587+0000", 2024-09-11T05:35:12.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T05:35:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889588+0000", 2024-09-11T05:35:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T05:35:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889592+0000", 2024-09-11T05:35:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.472e-06 2024-09-11T05:35:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889594+0000", 2024-09-11T05:35:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T05:35:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890405+0000", 2024-09-11T05:35:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00081088199999999997 2024-09-11T05:35:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890410+0000", 2024-09-11T05:35:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999996e-06 2024-09-11T05:35:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829131+0000", 2024-09-11T05:35:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93872118999999998 2024-09-11T05:35:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829138+0000", 2024-09-11T05:35:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1760000000000004e-06 2024-09-11T05:35:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855755+0000", 2024-09-11T05:35:12.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026616722 2024-09-11T05:35:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.855872+0000", 2024-09-11T05:35:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116927 2024-09-11T05:35:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856017+0000", 2024-09-11T05:35:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145313 2024-09-11T05:35:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116625 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13527040~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.156 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:35:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247503563999999, 2024-09-11T05:35:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9666986180000001, 2024-09-11T05:35:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116625 2024-09-11T05:35:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:35:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889597+0000", 2024-09-11T05:35:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889598+0000", 2024-09-11T05:35:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2600000000000001e-07 2024-09-11T05:35:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889599+0000", 2024-09-11T05:35:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.144e-06 2024-09-11T05:35:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889602+0000", 2024-09-11T05:35:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9510000000000002e-06 2024-09-11T05:35:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889604+0000", 2024-09-11T05:35:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7640000000000001e-06 2024-09-11T05:35:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890442+0000", 2024-09-11T05:35:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083777099999999996 2024-09-11T05:35:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890452+0000", 2024-09-11T05:35:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5559999999999996e-06 2024-09-11T05:35:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829170+0000", 2024-09-11T05:35:12.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871818900000004 2024-09-11T05:35:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829177+0000", 2024-09-11T05:35:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7220000000000002e-06 2024-09-11T05:35:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856046+0000", 2024-09-11T05:35:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.026868943 2024-09-11T05:35:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856144+0000", 2024-09-11T05:35:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8684999999999995e-05 2024-09-11T05:35:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856296+0000", 2024-09-11T05:35:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151667 2024-09-11T05:35:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116626 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13551616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:35:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247492793999996, 2024-09-11T05:35:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.96707056, 2024-09-11T05:35:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116626 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889608+0000", 2024-09-11T05:35:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:35:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889610+0000", 2024-09-11T05:35:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.186e-06 2024-09-11T05:35:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889613+0000", 2024-09-11T05:35:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T05:35:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889615+0000", 2024-09-11T05:35:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6060000000000001e-06 2024-09-11T05:35:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890487+0000", 2024-09-11T05:35:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087202600000000003 2024-09-11T05:35:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890492+0000", 2024-09-11T05:35:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3719999999999998e-06 2024-09-11T05:35:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829202+0000", 2024-09-11T05:35:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93871036299999999 2024-09-11T05:35:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829209+0000", 2024-09-11T05:35:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7669999999999998e-06 2024-09-11T05:35:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856327+0000", 2024-09-11T05:35:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027118465 2024-09-11T05:35:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856525+0000", 2024-09-11T05:35:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019825499999999999 2024-09-11T05:35:12.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856679+0000", 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015328 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116627 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13576192~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247482908999999, 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9673406419999999, 2024-09-11T05:35:12.171 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116627 2024-09-11T05:35:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:35:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:35:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889618+0000", 2024-09-11T05:35:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T05:35:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889619+0000", 2024-09-11T05:35:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.093e-06 2024-09-11T05:35:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889622+0000", 2024-09-11T05:35:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T05:35:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889625+0000", 2024-09-11T05:35:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6749999999999998e-06 2024-09-11T05:35:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890528+0000", 2024-09-11T05:35:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000902804 2024-09-11T05:35:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890537+0000", 2024-09-11T05:35:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2029999999999998e-06 2024-09-11T05:35:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829232+0000", 2024-09-11T05:35:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93869459799999999 2024-09-11T05:35:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829238+0000", 2024-09-11T05:35:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6699999999999997e-06 2024-09-11T05:35:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856709+0000", 2024-09-11T05:35:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027470925 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856815+0000", 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010566899999999999 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.856959+0000", 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000143752 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116628 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13600768~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:35:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247458914000006, 2024-09-11T05:35:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9676105420000001, 2024-09-11T05:35:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116628 2024-09-11T05:35:12.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.179 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:35:12.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:35:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889642+0000", 2024-09-11T05:35:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6399999999999998e-07 2024-09-11T05:35:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889644+0000", 2024-09-11T05:35:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5549999999999999e-06 2024-09-11T05:35:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889647+0000", 2024-09-11T05:35:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3950000000000001e-06 2024-09-11T05:35:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889650+0000", 2024-09-11T05:35:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5579999999999999e-06 2024-09-11T05:35:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890570+0000", 2024-09-11T05:35:12.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092007999999999999 2024-09-11T05:35:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890577+0000", 2024-09-11T05:35:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.764e-06 2024-09-11T05:35:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829261+0000", 2024-09-11T05:35:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93868468500000002 2024-09-11T05:35:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829268+0000", 2024-09-11T05:35:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T05:35:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857004+0000", 2024-09-11T05:35:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027736043 2024-09-11T05:35:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857102+0000", 2024-09-11T05:35:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8066999999999995e-05 2024-09-11T05:35:12.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857253+0000", 2024-09-11T05:35:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015050400000000001 2024-09-11T05:35:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116629 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 13625344~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:35:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247442402999994, 2024-09-11T05:35:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967906154, 2024-09-11T05:35:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116629 2024-09-11T05:35:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:35:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:35:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889659+0000", 2024-09-11T05:35:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-07 2024-09-11T05:35:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889660+0000", 2024-09-11T05:35:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5650000000000001e-06 2024-09-11T05:35:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889664+0000", 2024-09-11T05:35:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4000000000000001e-06 2024-09-11T05:35:12.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889666+0000", 2024-09-11T05:35:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:35:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890614+0000", 2024-09-11T05:35:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00094762999999999998 2024-09-11T05:35:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890621+0000", 2024-09-11T05:35:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.379e-06 2024-09-11T05:35:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829291+0000", 2024-09-11T05:35:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866938499999997 2024-09-11T05:35:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829298+0000", 2024-09-11T05:35:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6610000000000003e-06 2024-09-11T05:35:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857284+0000", 2024-09-11T05:35:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.027986522 2024-09-11T05:35:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857393+0000", 2024-09-11T05:35:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109054 2024-09-11T05:35:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857565+0000", 2024-09-11T05:35:12.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017160999999999999 2024-09-11T05:35:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116843 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12595200~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:35:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247431180999996, 2024-09-11T05:35:12.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9682605290000001, 2024-09-11T05:35:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116843 2024-09-11T05:35:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:35:12.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:35:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889670+0000", 2024-09-11T05:35:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:35:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889671+0000", 2024-09-11T05:35:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-11T05:35:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889674+0000", 2024-09-11T05:35:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.005e-06 2024-09-11T05:35:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889677+0000", 2024-09-11T05:35:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T05:35:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890648+0000", 2024-09-11T05:35:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097103399999999996 2024-09-11T05:35:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890652+0000", 2024-09-11T05:35:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0790000000000002e-06 2024-09-11T05:35:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829320+0000", 2024-09-11T05:35:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93866793199999998 2024-09-11T05:35:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829327+0000", 2024-09-11T05:35:12.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5529999999999998e-06 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857596+0000", 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028269125 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857834+0000", 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023784300000000001 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857930+0000", 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6704000000000001e-05 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116844 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12619776~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247420989999995, 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9685250679999999, 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116844 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889680+0000", 2024-09-11T05:35:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T05:35:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889681+0000", 2024-09-11T05:35:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.229e-06 2024-09-11T05:35:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889684+0000", 2024-09-11T05:35:12.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0130000000000002e-06 2024-09-11T05:35:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889687+0000", 2024-09-11T05:35:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7259999999999998e-06 2024-09-11T05:35:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890685+0000", 2024-09-11T05:35:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099783399999999996 2024-09-11T05:35:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890695+0000", 2024-09-11T05:35:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6590000000000002e-06 2024-09-11T05:35:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829349+0000", 2024-09-11T05:35:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865456300000005 2024-09-11T05:35:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829356+0000", 2024-09-11T05:35:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5130000000000002e-06 2024-09-11T05:35:12.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.857959+0000", 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0286034959999999 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858057+0000", 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8097999999999995e-05 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858205+0000", 2024-09-11T05:35:12.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147732 2024-09-11T05:35:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116845 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12644352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:35:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247410756999997, 2024-09-11T05:35:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968783033, 2024-09-11T05:35:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116845 2024-09-11T05:35:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:35:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:35:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889690+0000", 2024-09-11T05:35:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:35:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889692+0000", 2024-09-11T05:35:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2330000000000001e-06 2024-09-11T05:35:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889695+0000", 2024-09-11T05:35:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9249999999999999e-06 2024-09-11T05:35:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889697+0000", 2024-09-11T05:35:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T05:35:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890719+0000", 2024-09-11T05:35:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010218429999999999 2024-09-11T05:35:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890723+0000", 2024-09-11T05:35:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T05:35:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829378+0000", 2024-09-11T05:35:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93865562000000002 2024-09-11T05:35:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829385+0000", 2024-09-11T05:35:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4579999999999998e-06 2024-09-11T05:35:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858234+0000", 2024-09-11T05:35:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.028849288 2024-09-11T05:35:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858337+0000", 2024-09-11T05:35:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102371 2024-09-11T05:35:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858473+0000", 2024-09-11T05:35:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013669299999999999 2024-09-11T05:35:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116846 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12668928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:35:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247387832000001, 2024-09-11T05:35:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.969056522, 2024-09-11T05:35:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116846 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:35:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889713+0000", 2024-09-11T05:35:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-07 2024-09-11T05:35:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889715+0000", 2024-09-11T05:35:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.482e-06 2024-09-11T05:35:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889718+0000", 2024-09-11T05:35:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:35:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889721+0000", 2024-09-11T05:35:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-11T05:35:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890762+0000", 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010413659999999999 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890772+0000", 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5750000000000007e-06 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829407+0000", 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93863550699999998 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829414+0000", 2024-09-11T05:35:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5640000000000002e-06 2024-09-11T05:35:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858502+0000", 2024-09-11T05:35:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0290880099999999 2024-09-11T05:35:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858634+0000", 2024-09-11T05:35:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013173199999999999 2024-09-11T05:35:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858770+0000", 2024-09-11T05:35:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135943 2024-09-11T05:35:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116847 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12693504~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:35:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247358144000003, 2024-09-11T05:35:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9692923329999998, 2024-09-11T05:35:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116847 2024-09-11T05:35:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889743+0000", 2024-09-11T05:35:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T05:35:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889747+0000", 2024-09-11T05:35:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.501e-06 2024-09-11T05:35:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889753+0000", 2024-09-11T05:35:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1360000000000002e-06 2024-09-11T05:35:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889756+0000", 2024-09-11T05:35:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3110000000000001e-06 2024-09-11T05:35:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890808+0000", 2024-09-11T05:35:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010523240000000001 2024-09-11T05:35:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890813+0000", 2024-09-11T05:35:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5650000000000003e-06 2024-09-11T05:35:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829436+0000", 2024-09-11T05:35:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93862351799999999 2024-09-11T05:35:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829443+0000", 2024-09-11T05:35:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5220000000000004e-06 2024-09-11T05:35:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858798+0000", 2024-09-11T05:35:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.029354903 2024-09-11T05:35:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.858899+0000", 2024-09-11T05:35:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101414 2024-09-11T05:35:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859035+0000", 2024-09-11T05:35:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013589 2024-09-11T05:35:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116848 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12718080~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:35:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247341458999998, 2024-09-11T05:35:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9695514759999999, 2024-09-11T05:35:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116848 2024-09-11T05:35:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:35:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889759+0000", 2024-09-11T05:35:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889760+0000", 2024-09-11T05:35:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T05:35:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889761+0000", 2024-09-11T05:35:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.189e-06 2024-09-11T05:35:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889764+0000", 2024-09-11T05:35:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9399999999999998e-06 2024-09-11T05:35:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889766+0000", 2024-09-11T05:35:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4789999999999999e-06 2024-09-11T05:35:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890850+0000", 2024-09-11T05:35:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010835479999999999 2024-09-11T05:35:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890857+0000", 2024-09-11T05:35:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6299999999999998e-06 2024-09-11T05:35:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829465+0000", 2024-09-11T05:35:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860787000000001 2024-09-11T05:35:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829472+0000", 2024-09-11T05:35:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4420000000000003e-06 2024-09-11T05:35:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859062+0000", 2024-09-11T05:35:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0295903360000001 2024-09-11T05:35:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859169+0000", 2024-09-11T05:35:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010674400000000001 2024-09-11T05:35:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859311+0000", 2024-09-11T05:35:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014209499999999999 2024-09-11T05:35:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116849 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12742656~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:35:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247331673000005, 2024-09-11T05:35:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9698160310000001, 2024-09-11T05:35:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116849 2024-09-11T05:35:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:35:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:35:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889769+0000", 2024-09-11T05:35:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:35:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889771+0000", 2024-09-11T05:35:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1650000000000001e-06 2024-09-11T05:35:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889774+0000", 2024-09-11T05:35:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T05:35:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889776+0000", 2024-09-11T05:35:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.638e-06 2024-09-11T05:35:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890886+0000", 2024-09-11T05:35:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011102519999999999 2024-09-11T05:35:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890891+0000", 2024-09-11T05:35:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2200000000000003e-06 2024-09-11T05:35:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829494+0000", 2024-09-11T05:35:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93860342500000005 2024-09-11T05:35:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829501+0000", 2024-09-11T05:35:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4829999999999996e-06 2024-09-11T05:35:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859339+0000", 2024-09-11T05:35:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0298381320000001 2024-09-11T05:35:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859440+0000", 2024-09-11T05:35:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010145 2024-09-11T05:35:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859585+0000", 2024-09-11T05:35:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014513300000000001 2024-09-11T05:35:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116850 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12767232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:35:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247310647000006, 2024-09-11T05:35:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970125645, 2024-09-11T05:35:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116850 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889790+0000", 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889791+0000", 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889792+0000", 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4899999999999999e-06 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889795+0000", 2024-09-11T05:35:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809999999999999e-06 2024-09-11T05:35:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889798+0000", 2024-09-11T05:35:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7089999999999998e-06 2024-09-11T05:35:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890924+0000", 2024-09-11T05:35:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001125685 2024-09-11T05:35:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890933+0000", 2024-09-11T05:35:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3340000000000008e-06 2024-09-11T05:35:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829523+0000", 2024-09-11T05:35:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858966099999996 2024-09-11T05:35:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829529+0000", 2024-09-11T05:35:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5740000000000001e-06 2024-09-11T05:35:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859614+0000", 2024-09-11T05:35:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0300843289999999 2024-09-11T05:35:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859743+0000", 2024-09-11T05:35:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129407 2024-09-11T05:35:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859916+0000", 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017282500000000001 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116851 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12791808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247270776999997, 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970347268, 2024-09-11T05:35:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116851 2024-09-11T05:35:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:35:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:35:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889830+0000", 2024-09-11T05:35:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0100000000000001e-07 2024-09-11T05:35:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889832+0000", 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6819999999999999e-06 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889838+0000", 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889841+0000", 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8219999999999998e-06 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890957+0000", 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001115956 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890961+0000", 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7050000000000001e-06 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829552+0000", 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93859101499999997 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829558+0000", 2024-09-11T05:35:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5429999999999999e-06 2024-09-11T05:35:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.859947+0000", 2024-09-11T05:35:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030388248 2024-09-11T05:35:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860043+0000", 2024-09-11T05:35:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5847999999999994e-05 2024-09-11T05:35:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860177+0000", 2024-09-11T05:35:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013484400000000001 2024-09-11T05:35:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116852 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12816384~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:35:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247256166, 2024-09-11T05:35:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.970594859, 2024-09-11T05:35:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116852 2024-09-11T05:35:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:35:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:35:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889845+0000", 2024-09-11T05:35:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T05:35:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889846+0000", 2024-09-11T05:35:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.204e-06 2024-09-11T05:35:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889849+0000", 2024-09-11T05:35:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.931e-06 2024-09-11T05:35:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889852+0000", 2024-09-11T05:35:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T05:35:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.890993+0000", 2024-09-11T05:35:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001141176 2024-09-11T05:35:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891001+0000", 2024-09-11T05:35:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5259999999999996e-06 2024-09-11T05:35:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829582+0000", 2024-09-11T05:35:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93858050800000004 2024-09-11T05:35:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829588+0000", 2024-09-11T05:35:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4980000000000003e-06 2024-09-11T05:35:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860207+0000", 2024-09-11T05:35:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.030618713 2024-09-11T05:35:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860305+0000", 2024-09-11T05:35:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8209999999999997e-05 2024-09-11T05:35:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860440+0000", 2024-09-11T05:35:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134692 2024-09-11T05:35:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116853 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12840960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:35:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247245448000001, 2024-09-11T05:35:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.97084075, 2024-09-11T05:35:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116853 2024-09-11T05:35:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:35:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889855+0000", 2024-09-11T05:35:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889856+0000", 2024-09-11T05:35:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T05:35:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889857+0000", 2024-09-11T05:35:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.435e-06 2024-09-11T05:35:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889860+0000", 2024-09-11T05:35:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9620000000000002e-06 2024-09-11T05:35:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889863+0000", 2024-09-11T05:35:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T05:35:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891036+0000", 2024-09-11T05:35:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011734580000000001 2024-09-11T05:35:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891042+0000", 2024-09-11T05:35:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3290000000000001e-06 2024-09-11T05:35:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829611+0000", 2024-09-11T05:35:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856954299999995 2024-09-11T05:35:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829618+0000", 2024-09-11T05:35:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T05:35:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860465+0000", 2024-09-11T05:35:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0308472500000001 2024-09-11T05:35:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860558+0000", 2024-09-11T05:35:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3253999999999999e-05 2024-09-11T05:35:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860696+0000", 2024-09-11T05:35:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138169 2024-09-11T05:35:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116854 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12865536~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:35:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247235257, 2024-09-11T05:35:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9710979320000002, 2024-09-11T05:35:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116854 2024-09-11T05:35:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:35:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:35:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889866+0000", 2024-09-11T05:35:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:35:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889867+0000", 2024-09-11T05:35:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.155e-06 2024-09-11T05:35:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889871+0000", 2024-09-11T05:35:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9260000000000002e-06 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889875+0000", 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.262e-06 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891070+0000", 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011945160000000001 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.891079+0000", 2024-09-11T05:35:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3759999999999997e-06 2024-09-11T05:35:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829642+0000", 2024-09-11T05:35:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.93856325900000004 2024-09-11T05:35:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829649+0000", 2024-09-11T05:35:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5599999999999999e-06 2024-09-11T05:35:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860726+0000", 2024-09-11T05:35:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.031076791 2024-09-11T05:35:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860831+0000", 2024-09-11T05:35:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105003 2024-09-11T05:35:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.860964+0000", 2024-09-11T05:35:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013285700000000001 2024-09-11T05:35:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:116855 3.14 3:2f825f5f:::rbd_data.112df73e5671.0000000000000002:1a [read 12890112~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:35:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.247220476999999, 2024-09-11T05:35:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.971277814, 2024-09-11T05:35:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116855 2024-09-11T05:35:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:35:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:38.889880+0000", 2024-09-11T05:35:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817809+0000", 2024-09-11T05:35:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.92792850999999998 2024-09-11T05:35:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817815+0000", 2024-09-11T05:35:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4110000000000001e-06 2024-09-11T05:35:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817827+0000", 2024-09-11T05:35:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2031000000000001e-05 2024-09-11T05:35:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.817837+0000", 2024-09-11T05:35:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2159999999999995e-06 2024-09-11T05:35:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829673+0000", 2024-09-11T05:35:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011836197 2024-09-11T05:35:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:39.829679+0000", 2024-09-11T05:35:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5390000000000004e-06 2024-09-11T05:35:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861000+0000", 2024-09-11T05:35:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0313209539999999 2024-09-11T05:35:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861080+0000", 2024-09-11T05:35:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9606999999999999e-05 2024-09-11T05:35:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:40.861158+0000", 2024-09-11T05:35:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8349000000000005e-05 2024-09-11T05:35:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.292 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:12.294 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T05:35:12.294 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:35:12.293+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:35:12.394 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-09-11T05:35:12.394+0000 7f78013af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 44702) UID: 0 2024-09-11T05:35:12.438 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:12.438 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:35:12.438 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T05:35:12.438 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:12.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T05:35:12.495 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T05:35:12.494+0000 7f97df18f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33449) UID: 0 2024-09-11T05:35:12.549 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:12.549 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T05:35:12.549 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T05:35:12.549 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T05:35:12.549 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:12.557 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T05:35:12.599 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T05:35:12.598+0000 7f82b518f640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33436) UID: 0 2024-09-11T05:35:12.642 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:35:12.648 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 5, 6, 3, 7] out_osds: [4, 1] dead_osds: [] live_osds: [0, 1, 2, 3, 5, 6, 7, 4] 2024-09-11T05:35:12.648 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T05:35:12.648 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:35:12.694 INFO:teuthology.orchestra.run.smithi070.stdout:All operations completed A-OK! 2024-09-11T05:35:12.697 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T05:35:12.696+0000 7f0ff6c9b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33448) UID: 0 2024-09-11T05:35:12.707 DEBUG:teuthology.parallel:result is None 2024-09-11T05:35:12.707 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-11T05:35:12.724 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-11T05:35:12.747 INFO:tasks.thrashosds:joining thrashosds 2024-09-11T05:35:12.749 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:12.749 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T05:35:12.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T05:35:12.749 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T05:35:12.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.749 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4235.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-11T05:35:12.749 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:35:12.749 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 147.12291998500001, 2024-09-11T05:35:12.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.11304679500000001, 2024-09-11T05:35:12.750 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.750 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.750 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T05:35:12.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4235", 2024-09-11T05:35:12.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1912917395", 2024-09-11T05:35:12.750 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T05:35:12.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.750 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590253+0000", 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590254+0000", 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2699999999999998e-07 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590262+0000", 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2169999999999994e-06 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590273+0000", 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1272e-05 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590281+0000", 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0069999999999997e-06 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590346+0000", 2024-09-11T05:35:12.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4354000000000001e-05 2024-09-11T05:35:12.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.590353+0000", 2024-09-11T05:35:12.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5870000000000004e-06 2024-09-11T05:35:12.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703151+0000", 2024-09-11T05:35:12.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.112798126 2024-09-11T05:35:12.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:32:45.703300+0000", 2024-09-11T05:35:12.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148405 2024-09-11T05:35:12.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.754 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.754 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44355 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6496256~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:35:12.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.545984725, 2024-09-11T05:35:12.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044580043999999999, 2024-09-11T05:35:12.755 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.755 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44355 2024-09-11T05:35:12.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:35:12.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167188+0000", 2024-09-11T05:35:12.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167189+0000", 2024-09-11T05:35:12.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T05:35:12.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167190+0000", 2024-09-11T05:35:12.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8390000000000001e-06 2024-09-11T05:35:12.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167197+0000", 2024-09-11T05:35:12.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T05:35:12.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167202+0000", 2024-09-11T05:35:12.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5469999999999998e-06 2024-09-11T05:35:12.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211628+0000", 2024-09-11T05:35:12.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044426083999999998 2024-09-11T05:35:12.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211696+0000", 2024-09-11T05:35:12.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-11T05:35:12.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211768+0000", 2024-09-11T05:35:12.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2132000000000007e-05 2024-09-11T05:35:12.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.759 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.759 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44356 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6545408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.759 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:35:12.759 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.54596592599999, 2024-09-11T05:35:12.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044707998999999998, 2024-09-11T05:35:12.759 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.760 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44356 2024-09-11T05:35:12.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.760 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:35:12.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:35:12.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167207+0000", 2024-09-11T05:35:12.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T05:35:12.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167215+0000", 2024-09-11T05:35:12.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.503e-06 2024-09-11T05:35:12.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167221+0000", 2024-09-11T05:35:12.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T05:35:12.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167225+0000", 2024-09-11T05:35:12.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5809999999999998e-06 2024-09-11T05:35:12.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211814+0000", 2024-09-11T05:35:12.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044588910000000002 2024-09-11T05:35:12.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211859+0000", 2024-09-11T05:35:12.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5266000000000003e-05 2024-09-11T05:35:12.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211915+0000", 2024-09-11T05:35:12.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5651e-05 2024-09-11T05:35:12.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.764 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.764 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44357 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6594560~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.764 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:35:12.764 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.545941895, 2024-09-11T05:35:12.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044806922999999999, 2024-09-11T05:35:12.764 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44357 2024-09-11T05:35:12.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.765 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:35:12.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167231+0000", 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167233+0000", 2024-09-11T05:35:12.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.968e-06 2024-09-11T05:35:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167239+0000", 2024-09-11T05:35:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T05:35:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167244+0000", 2024-09-11T05:35:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T05:35:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211944+0000", 2024-09-11T05:35:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044700035999999999 2024-09-11T05:35:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.211986+0000", 2024-09-11T05:35:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2648000000000002e-05 2024-09-11T05:35:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212038+0000", 2024-09-11T05:35:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1601000000000003e-05 2024-09-11T05:35:12.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.769 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.769 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44358 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6643712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.769 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:35:12.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.545865107, 2024-09-11T05:35:12.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044846743000000001, 2024-09-11T05:35:12.770 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44358 2024-09-11T05:35:12.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.770 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:35:12.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:35:12.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167308+0000", 2024-09-11T05:35:12.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T05:35:12.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167315+0000", 2024-09-11T05:35:12.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9349999999999997e-06 2024-09-11T05:35:12.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167323+0000", 2024-09-11T05:35:12.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2490000000000004e-06 2024-09-11T05:35:12.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167328+0000", 2024-09-11T05:35:12.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1930000000000001e-06 2024-09-11T05:35:12.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212062+0000", 2024-09-11T05:35:12.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044734695999999997 2024-09-11T05:35:12.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212103+0000", 2024-09-11T05:35:12.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1016000000000002e-05 2024-09-11T05:35:12.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212155+0000", 2024-09-11T05:35:12.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1119999999999998e-05 2024-09-11T05:35:12.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.774 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.774 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44359 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6692864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.774 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:35:12.774 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.545837784, 2024-09-11T05:35:12.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044937756000000002, 2024-09-11T05:35:12.775 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44359 2024-09-11T05:35:12.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.775 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:35:12.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:35:12.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167335+0000", 2024-09-11T05:35:12.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.84e-07 2024-09-11T05:35:12.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167338+0000", 2024-09-11T05:35:12.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T05:35:12.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167343+0000", 2024-09-11T05:35:12.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7010000000000001e-06 2024-09-11T05:35:12.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167348+0000", 2024-09-11T05:35:12.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T05:35:12.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212179+0000", 2024-09-11T05:35:12.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044830527000000002 2024-09-11T05:35:12.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212220+0000", 2024-09-11T05:35:12.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1789000000000003e-05 2024-09-11T05:35:12.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212273+0000", 2024-09-11T05:35:12.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2451000000000003e-05 2024-09-11T05:35:12.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.779 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.779 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44360 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6742016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.779 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:35:12.779 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.545819236, 2024-09-11T05:35:12.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045043062000000002, 2024-09-11T05:35:12.780 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44360 2024-09-11T05:35:12.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.780 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:35:12.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:35:12.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167354+0000", 2024-09-11T05:35:12.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T05:35:12.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167356+0000", 2024-09-11T05:35:12.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.826e-06 2024-09-11T05:35:12.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167361+0000", 2024-09-11T05:35:12.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4929999999999998e-06 2024-09-11T05:35:12.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167366+0000", 2024-09-11T05:35:12.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7469999999999996e-06 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212298+0000", 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044932016999999998 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212340+0000", 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1389e-05 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212397+0000", 2024-09-11T05:35:12.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7200000000000001e-05 2024-09-11T05:35:12.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.784 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.784 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44361 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 6791168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.784 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:35:12.784 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.545801165, 2024-09-11T05:35:12.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045157500000000003, 2024-09-11T05:35:12.784 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44361 2024-09-11T05:35:12.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.785 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:35:12.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.167372+0000", 2024-09-11T05:35:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168814+0000", 2024-09-11T05:35:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014426230000000001 2024-09-11T05:35:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168826+0000", 2024-09-11T05:35:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1815e-05 2024-09-11T05:35:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168835+0000", 2024-09-11T05:35:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0569999999999999e-06 2024-09-11T05:35:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168842+0000", 2024-09-11T05:35:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9600000000000003e-06 2024-09-11T05:35:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212428+0000", 2024-09-11T05:35:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043585351000000001 2024-09-11T05:35:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212473+0000", 2024-09-11T05:35:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5537999999999997e-05 2024-09-11T05:35:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.212529+0000", 2024-09-11T05:35:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6156000000000002e-05 2024-09-11T05:35:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44367 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7086080~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:35:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.544203522, 2024-09-11T05:35:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044582304000000003, 2024-09-11T05:35:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44367 2024-09-11T05:35:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:35:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168969+0000", 2024-09-11T05:35:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168970+0000", 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8100000000000003e-07 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168972+0000", 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168978+0000", 2024-09-11T05:35:12.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T05:35:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168983+0000", 2024-09-11T05:35:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.741e-06 2024-09-11T05:35:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213432+0000", 2024-09-11T05:35:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044448559999999998 2024-09-11T05:35:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213488+0000", 2024-09-11T05:35:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6570000000000002e-05 2024-09-11T05:35:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213552+0000", 2024-09-11T05:35:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3516999999999995e-05 2024-09-11T05:35:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44368 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7135232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:35:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.54418319600001, 2024-09-11T05:35:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044702003999999997, 2024-09-11T05:35:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44368 2024-09-11T05:35:12.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:35:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:35:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.168990+0000", 2024-09-11T05:35:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:35:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169009+0000", 2024-09-11T05:35:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8904000000000001e-05 2024-09-11T05:35:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169016+0000", 2024-09-11T05:35:12.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T05:35:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169021+0000", 2024-09-11T05:35:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4790000000000004e-06 2024-09-11T05:35:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213575+0000", 2024-09-11T05:35:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044554125 2024-09-11T05:35:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213628+0000", 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2686999999999999e-05 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213692+0000", 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3727999999999997e-05 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44369 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7184384~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:35:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.544144198, 2024-09-11T05:35:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044817223000000003, 2024-09-11T05:35:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44369 2024-09-11T05:35:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:35:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:35:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169029+0000", 2024-09-11T05:35:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169031+0000", 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169038+0000", 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1130000000000003e-06 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169043+0000", 2024-09-11T05:35:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T05:35:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213727+0000", 2024-09-11T05:35:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044683414999999997 2024-09-11T05:35:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213781+0000", 2024-09-11T05:35:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4593999999999999e-05 2024-09-11T05:35:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213846+0000", 2024-09-11T05:35:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4759999999999997e-05 2024-09-11T05:35:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44370 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7233536~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:35:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.544123556, 2024-09-11T05:35:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044990967, 2024-09-11T05:35:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44370 2024-09-11T05:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169049+0000", 2024-09-11T05:35:12.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169147+0000", 2024-09-11T05:35:12.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7268000000000005e-05 2024-09-11T05:35:12.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169150+0000", 2024-09-11T05:35:12.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5109999999999999e-06 2024-09-11T05:35:12.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169157+0000", 2024-09-11T05:35:12.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7120000000000003e-06 2024-09-11T05:35:12.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169163+0000", 2024-09-11T05:35:12.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:35:12.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213894+0000", 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044730881 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.213978+0000", 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3855000000000003e-05 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214040+0000", 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2761000000000004e-05 2024-09-11T05:35:12.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.808 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.808 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44371 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7282688~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.808 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:35:12.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.544000693, 2024-09-11T05:35:12.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045034943000000001, 2024-09-11T05:35:12.808 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44371 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169172+0000", 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169307+0000", 2024-09-11T05:35:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013435899999999999 2024-09-11T05:35:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169310+0000", 2024-09-11T05:35:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T05:35:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169316+0000", 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169322+0000", 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8950000000000003e-06 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214071+0000", 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044748538999999997 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214117+0000", 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6173e-05 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214207+0000", 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0303999999999995e-05 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.812 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44372 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7331840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:35:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.543841136, 2024-09-11T05:35:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.045013022, 2024-09-11T05:35:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44372 2024-09-11T05:35:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:35:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.169332+0000", 2024-09-11T05:35:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170806+0000", 2024-09-11T05:35:12.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014741680000000001 2024-09-11T05:35:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170817+0000", 2024-09-11T05:35:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1353e-05 2024-09-11T05:35:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170827+0000", 2024-09-11T05:35:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7799999999999995e-06 2024-09-11T05:35:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.170834+0000", 2024-09-11T05:35:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2790000000000001e-06 2024-09-11T05:35:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214241+0000", 2024-09-11T05:35:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043406330999999999 2024-09-11T05:35:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214287+0000", 2024-09-11T05:35:12.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6516e-05 2024-09-11T05:35:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.214345+0000", 2024-09-11T05:35:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7595e-05 2024-09-11T05:35:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44380 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7725056~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:35:12.817 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.54215646900001, 2024-09-11T05:35:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044625315999999998, 2024-09-11T05:35:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44380 2024-09-11T05:35:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171016+0000", 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171017+0000", 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171027+0000", 2024-09-11T05:35:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8600000000000005e-06 2024-09-11T05:35:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171033+0000", 2024-09-11T05:35:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-06 2024-09-11T05:35:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171038+0000", 2024-09-11T05:35:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T05:35:12.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215540+0000", 2024-09-11T05:35:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044501740999999997 2024-09-11T05:35:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215586+0000", 2024-09-11T05:35:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000001e-05 2024-09-11T05:35:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215642+0000", 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6158e-05 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44381 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 7774208~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.542128464, 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044809716999999999, 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44381 2024-09-11T05:35:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:35:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.171044+0000", 2024-09-11T05:35:12.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172290+0000", 2024-09-11T05:35:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001245967 2024-09-11T05:35:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172295+0000", 2024-09-11T05:35:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.481e-06 2024-09-11T05:35:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172303+0000", 2024-09-11T05:35:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5949999999999999e-06 2024-09-11T05:35:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172310+0000", 2024-09-11T05:35:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.319e-06 2024-09-11T05:35:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215677+0000", 2024-09-11T05:35:12.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043367007999999999 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215758+0000", 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1508000000000006e-05 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.215854+0000", 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5839000000000002e-05 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44389 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8167424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:35:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.540662001, 2024-09-11T05:35:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044670870000000001, 2024-09-11T05:35:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44389 2024-09-11T05:35:12.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:35:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172511+0000", 2024-09-11T05:35:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172670+0000", 2024-09-11T05:35:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159464 2024-09-11T05:35:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172674+0000", 2024-09-11T05:35:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5750000000000001e-06 2024-09-11T05:35:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172681+0000", 2024-09-11T05:35:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6019999999999996e-06 2024-09-11T05:35:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172686+0000", 2024-09-11T05:35:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8379999999999998e-06 2024-09-11T05:35:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217017+0000", 2024-09-11T05:35:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044330611999999998 2024-09-11T05:35:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217096+0000", 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8584000000000005e-05 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217182+0000", 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6194999999999997e-05 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.831 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44390 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8216576~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:35:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.5404767, 2024-09-11T05:35:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044616659000000003, 2024-09-11T05:35:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44390 2024-09-11T05:35:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.832 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172696+0000", 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172842+0000", 2024-09-11T05:35:12.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014551000000000001 2024-09-11T05:35:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172846+0000", 2024-09-11T05:35:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7960000000000002e-06 2024-09-11T05:35:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172852+0000", 2024-09-11T05:35:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.832e-06 2024-09-11T05:35:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172858+0000", 2024-09-11T05:35:12.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6350000000000003e-06 2024-09-11T05:35:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217210+0000", 2024-09-11T05:35:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044351929999999998 2024-09-11T05:35:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217255+0000", 2024-09-11T05:35:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5337000000000003e-05 2024-09-11T05:35:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217313+0000", 2024-09-11T05:35:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7618999999999998e-05 2024-09-11T05:35:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:44391 3.13 3:cf8acfbc:::rbd_data.112dcdbd4c7c.0000000000000005:14 [read 8265728~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-11T05:35:12.837 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:35:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.540305245, 2024-09-11T05:35:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044646241000000003, 2024-09-11T05:35:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T05:35:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 44391 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.172868+0000", 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174807+0000", 2024-09-11T05:35:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019394939999999999 2024-09-11T05:35:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174811+0000", 2024-09-11T05:35:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1030000000000004e-06 2024-09-11T05:35:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174820+0000", 2024-09-11T05:35:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5769999999999994e-06 2024-09-11T05:35:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.174826+0000", 2024-09-11T05:35:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6340000000000003e-06 2024-09-11T05:35:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217348+0000", 2024-09-11T05:35:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042521171000000003 2024-09-11T05:35:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217425+0000", 2024-09-11T05:35:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7256999999999996e-05 2024-09-11T05:35:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:33:25.217514+0000", 2024-09-11T05:35:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9005000000000006e-05 2024-09-11T05:35:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4397.0:194030 3.11 3:8c0c7139:::rbd_object_map.112d3507140b:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T05:34:52.789587+0000", 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.923585546999998, 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.002511178, 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4397", 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 194030 2024-09-11T05:35:12.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T05:35:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T05:35:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789587+0000", 2024-09-11T05:35:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T05:35:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789587+0000", 2024-09-11T05:35:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T05:35:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T05:35:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789589+0000", 2024-09-11T05:35:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5120000000000001e-06 2024-09-11T05:35:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T05:35:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789594+0000", 2024-09-11T05:35:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4920000000000001e-06 2024-09-11T05:35:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T05:35:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789605+0000", 2024-09-11T05:35:12.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0795000000000001e-05 2024-09-11T05:35:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T05:35:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.789612+0000", 2024-09-11T05:35:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8340000000000001e-06 2024-09-11T05:35:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.790925+0000", 2024-09-11T05:35:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001312847 2024-09-11T05:35:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T05:35:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:52.790938+0000", 2024-09-11T05:35:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3192e-05 2024-09-11T05:35:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T05:35:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.789344+0000", 2024-09-11T05:35:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99840615499999996 2024-09-11T05:35:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T05:35:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.789491+0000", 2024-09-11T05:35:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014679299999999999 2024-09-11T05:35:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T05:35:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.789679+0000", 2024-09-11T05:35:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018818099999999999 2024-09-11T05:35:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T05:35:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.790923+0000", 2024-09-11T05:35:12.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012436820000000001 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.791981+0000", 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010581570000000001 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.792055+0000", 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3749000000000002e-05 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T05:35:12.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T05:34:53.792099+0000", 2024-09-11T05:35:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3788999999999997e-05 2024-09-11T05:35:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T05:35:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T05:35:12.850 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:12.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T05:35:12.961 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:12.961 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:12.962 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:35:12.962 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:12.970 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T05:35:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:35:12.978 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:35:12.990 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-09-11T05:35:12.624829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":15810032,"num_objects":126,"num_object_clones":3,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":107,"num_read":175690,"num_read_kb":500484,"num_write":18041,"num_write_kb":269901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3499,"num_bytes_recovered":148340116,"num_keys_recovered":137,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16401,"ondisk_log_size":16401,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":322084,"kb_used_data":11388,"kb_used_omap":9,"kb_used_meta":310518,"kb_avail":565908956,"statfs":{"total":579820584960,"available":579490770944,"internally_reserved":0,"allocated":11661312,"data_stored":6310686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":317971110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.999020"},"pg_stats":[{"pgid":"3.1f","version":"141'600","reported_seq":7376,"reported_epoch":141,"state":"peering","last_fresh":"2024-09-11T05:35:06.631839+0000","last_change":"2024-09-11T05:35:07.630038+0000","last_active":"2024-09-11T05:35:07.630038+0000","last_peered":"2024-09-11T05:35:06.631839+0000","last_clean":"2024-09-11T05:35:06.631839+0000","last_became_active":"2024-09-11T05:34:48.625234+0000","last_became_peered":"2024-09-11T05:34:48.625234+0000","last_unstale":"2024-09-11T05:35:06.631839+0000","last_undegraded":"2024-09-11T05:35:06.631839+0000","last_fullsized":"2024-09-11T05:35:06.631839+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0035870469999999999,"stat_sum":{"num_bytes":51,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":6,"num_read":7725,"num_read_kb":22569,"num_write":751,"num_write_kb":11145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":4324235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,7],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"5"}]},{"pgid":"3.1e","version":"139'296","reported_seq":3714,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.630391+0000","last_change":"2024-09-11T05:35:07.630838+0000","last_active":"2024-09-11T05:35:07.630391+0000","last_peered":"2024-09-11T05:35:07.630391+0000","last_clean":"2024-09-11T05:35:07.630391+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:35:07.630391+0000","last_undegraded":"2024-09-11T05:35:07.630391+0000","last_fullsized":"2024-09-11T05:35:07.630391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:08:09.638108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001142152,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":3027,"num_read_kb":23842,"num_write":231,"num_write_kb":6198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.1d","version":"139'909","reported_seq":21638,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.633885+0000","last_change":"2024-09-11T05:35:07.634386+0000","last_active":"2024-09-11T05:35:07.633885+0000","last_peered":"2024-09-11T05:35:07.633885+0000","last_clean":"2024-09-11T05:35:07.633885+0000","last_became_active":"2024-09-11T05:34:54.792973+0000","last_became_peered":"2024-09-11T05:34:54.792973+0000","last_unstale":"2024-09-11T05:35:07.633885+0000","last_undegraded":"2024-09-11T05:35:07.633885+0000","last_fullsized":"2024-09-11T05:35:07.633885+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:31.043712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003253822,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":3,"num_read":16637,"num_read_kb":25385,"num_write":1111,"num_write_kb":7409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":6593091,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.1c","version":"141'599","reported_seq":7705,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.632680+0000","last_change":"2024-09-11T05:35:07.633782+0000","last_active":"2024-09-11T05:35:07.632680+0000","last_peered":"2024-09-11T05:35:07.632680+0000","last_clean":"2024-09-11T05:35:07.632680+0000","last_became_active":"2024-09-11T05:34:47.624936+0000","last_became_peered":"2024-09-11T05:34:47.624936+0000","last_unstale":"2024-09-11T05:35:07.632680+0000","last_undegraded":"2024-09-11T05:35:07.632680+0000","last_fullsized":"2024-09-11T05:35:07.632680+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:38.404407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035841110000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9002,"num_read_kb":27636,"num_write":671,"num_write_kb":16439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":13219858,"num_keys_recovered":56,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.1b","version":"140'579","reported_seq":7801,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.629909+0000","last_change":"2024-09-11T05:35:07.632588+0000","last_active":"2024-09-11T05:35:07.629909+0000","last_peered":"2024-09-11T05:35:07.629909+0000","last_clean":"2024-09-11T05:35:07.629909+0000","last_became_active":"2024-09-11T05:34:54.791166+0000","last_became_peered":"2024-09-11T05:34:54.791166+0000","last_unstale":"2024-09-11T05:35:07.629909+0000","last_undegraded":"2024-09-11T05:35:07.629909+0000","last_fullsized":"2024-09-11T05:35:07.629909+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:42.671686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033265629999999998,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":7366,"num_read_kb":17763,"num_write":665,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":7543883,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.1a","version":"136'445","reported_seq":4977,"reported_epoch":141,"state":"peering","last_fresh":"2024-09-11T05:35:06.732563+0000","last_change":"2024-09-11T05:35:07.630682+0000","last_active":"2024-09-11T05:35:07.630682+0000","last_peered":"2024-09-11T05:35:06.732563+0000","last_clean":"2024-09-11T05:35:06.732563+0000","last_became_active":"2024-09-11T05:34:47.624650+0000","last_became_peered":"2024-09-11T05:34:47.624650+0000","last_unstale":"2024-09-11T05:35:06.732563+0000","last_undegraded":"2024-09-11T05:35:06.732563+0000","last_fullsized":"2024-09-11T05:35:06.732563+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003372594,"stat_sum":{"num_bytes":19,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":6,"num_read":5400,"num_read_kb":14242,"num_write":483,"num_write_kb":12836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":4852988,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6,7],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"5"}]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"unknown","last_fresh":"2024-09-11T05:35:07.630102+0000","last_change":"2024-09-11T05:35:07.978178+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T05:35:07.630102+0000","last_undegraded":"2024-09-11T05:35:07.630102+0000","last_fullsized":"2024-09-11T05:35:07.630102+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.18","version":"140'517","reported_seq":3107,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.630821+0000","last_change":"2024-09-11T05:35:07.631584+0000","last_active":"2024-09-11T05:35:07.630821+0000","last_peered":"2024-09-11T05:35:07.630821+0000","last_clean":"2024-09-11T05:35:07.630821+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:35:07.630821+0000","last_undegraded":"2024-09-11T05:35:07.630821+0000","last_fullsized":"2024-09-11T05:35:07.630821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:03.274784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017746019999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":3338,"num_read_kb":10070,"num_write":595,"num_write_kb":6210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.17","version":"139'1157","reported_seq":3285,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.631058+0000","last_change":"2024-09-11T05:35:07.631435+0000","last_active":"2024-09-11T05:35:07.631058+0000","last_peered":"2024-09-11T05:35:07.631058+0000","last_clean":"2024-09-11T05:35:07.631058+0000","last_became_active":"2024-09-11T05:34:54.790407+0000","last_became_peered":"2024-09-11T05:34:54.790407+0000","last_unstale":"2024-09-11T05:35:07.631058+0000","last_undegraded":"2024-09-11T05:35:07.631058+0000","last_fullsized":"2024-09-11T05:35:07.631058+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1157,"log_dups_size":0,"ondisk_log_size":1157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:57.870761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013919830000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5158,"num_read_kb":28626,"num_write":1706,"num_write_kb":20682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":292,"num_bytes_recovered":48701806,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.16","version":"142'286","reported_seq":3624,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.631129+0000","last_change":"2024-09-11T05:35:07.631542+0000","last_active":"2024-09-11T05:35:07.631129+0000","last_peered":"2024-09-11T05:35:07.631129+0000","last_clean":"2024-09-11T05:35:07.631129+0000","last_became_active":"2024-09-11T05:34:53.790235+0000","last_became_peered":"2024-09-11T05:34:53.790235+0000","last_unstale":"2024-09-11T05:35:07.631129+0000","last_undegraded":"2024-09-11T05:35:07.631129+0000","last_fullsized":"2024-09-11T05:35:07.631129+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:29:50.153431+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0054691490000000004,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2863,"num_read_kb":14884,"num_write":221,"num_write_kb":7375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":1456269,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.15","version":"141'725","reported_seq":3786,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.634480+0000","last_change":"2024-09-11T05:35:07.635549+0000","last_active":"2024-09-11T05:35:07.634480+0000","last_peered":"2024-09-11T05:35:07.634480+0000","last_clean":"2024-09-11T05:35:07.634480+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:35:07.634480+0000","last_undegraded":"2024-09-11T05:35:07.634480+0000","last_fullsized":"2024-09-11T05:35:07.634480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:46:07.205517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042167799999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5390,"num_read_kb":12737,"num_write":875,"num_write_kb":9766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.14","version":"142'369","reported_seq":11948,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.631706+0000","last_change":"2024-09-11T05:35:07.632110+0000","last_active":"2024-09-11T05:35:07.631706+0000","last_peered":"2024-09-11T05:35:07.631706+0000","last_clean":"2024-09-11T05:35:07.631706+0000","last_became_active":"2024-09-11T05:34:53.790227+0000","last_became_peered":"2024-09-11T05:34:53.790227+0000","last_unstale":"2024-09-11T05:35:07.631706+0000","last_undegraded":"2024-09-11T05:35:07.631706+0000","last_fullsized":"2024-09-11T05:35:07.631706+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:18.918687+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0055791590000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5068,"num_read_kb":14759,"num_write":300,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":7503668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.627551+0000","last_change":"2024-09-11T05:34:50.627854+0000","last_active":"2024-09-11T05:35:07.627551+0000","last_peered":"2024-09-11T05:35:07.627551+0000","last_clean":"2024-09-11T05:35:07.627551+0000","last_became_active":"2024-09-11T05:34:50.627529+0000","last_became_peered":"2024-09-11T05:34:50.627529+0000","last_unstale":"2024-09-11T05:35:07.627551+0000","last_undegraded":"2024-09-11T05:35:07.627551+0000","last_fullsized":"2024-09-11T05:35:07.627551+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:35.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"unknown","last_fresh":"2024-09-11T05:35:07.630985+0000","last_change":"2024-09-11T05:35:07.978225+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T05:35:07.630985+0000","last_undegraded":"2024-09-11T05:35:07.630985+0000","last_fullsized":"2024-09-11T05:35:07.630985+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":250,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.630878+0000","last_change":"2024-09-11T05:32:55.614406+0000","last_active":"2024-09-11T05:35:07.630878+0000","last_peered":"2024-09-11T05:35:07.630878+0000","last_clean":"2024-09-11T05:35:07.630878+0000","last_became_active":"2024-09-11T05:32:55.614125+0000","last_became_peered":"2024-09-11T05:32:55.614125+0000","last_unstale":"2024-09-11T05:35:07.630878+0000","last_undegraded":"2024-09-11T05:35:07.630878+0000","last_fullsized":"2024-09-11T05:35:07.630878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:06:59.971006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"140'467","reported_seq":6071,"reported_epoch":142,"state":"unknown","last_fresh":"2024-09-11T05:35:07.632785+0000","last_change":"2024-09-11T05:35:07.978191+0000","last_active":"2024-09-11T05:35:07.632785+0000","last_peered":"2024-09-11T05:35:06.630627+0000","last_clean":"2024-09-11T05:35:06.630627+0000","last_became_active":"2024-09-11T05:34:47.624881+0000","last_became_peered":"2024-09-11T05:34:47.624881+0000","last_unstale":"2024-09-11T05:35:07.632785+0000","last_undegraded":"2024-09-11T05:35:07.632785+0000","last_fullsized":"2024-09-11T05:35:07.632785+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034374060000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6977,"num_read_kb":16019,"num_write":349,"num_write_kb":6385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":1715668,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"5","length":"5"}]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.625774+0000","last_change":"2024-09-11T05:34:50.625911+0000","last_active":"2024-09-11T05:35:07.625774+0000","last_peered":"2024-09-11T05:35:07.625774+0000","last_clean":"2024-09-11T05:35:07.625774+0000","last_became_active":"2024-09-11T05:34:50.625595+0000","last_became_peered":"2024-09-11T05:34:50.625595+0000","last_unstale":"2024-09-11T05:35:07.625774+0000","last_undegraded":"2024-09-11T05:35:07.625774+0000","last_fullsized":"2024-09-11T05:35:07.625774+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:53:14.794842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"141'1609","reported_seq":8061,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.632804+0000","last_change":"2024-09-11T05:35:07.634176+0000","last_active":"2024-09-11T05:35:07.632804+0000","last_peered":"2024-09-11T05:35:07.632804+0000","last_clean":"2024-09-11T05:35:07.632804+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:35:07.632804+0000","last_undegraded":"2024-09-11T05:35:07.632804+0000","last_fullsized":"2024-09-11T05:35:07.632804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1609,"log_dups_size":0,"ondisk_log_size":1609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:04:16.284690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013911240000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":6,"num_read":15095,"num_read_kb":37800,"num_write":2274,"num_write_kb":19407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"2.4","version":"0'0","reported_seq":272,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.629431+0000","last_change":"2024-09-11T05:34:44.768103+0000","last_active":"2024-09-11T05:35:07.629431+0000","last_peered":"2024-09-11T05:35:07.629431+0000","last_clean":"2024-09-11T05:35:07.629431+0000","last_became_active":"2024-09-11T05:34:44.767862+0000","last_became_peered":"2024-09-11T05:34:44.767862+0000","last_unstale":"2024-09-11T05:35:07.629431+0000","last_undegraded":"2024-09-11T05:35:07.629431+0000","last_fullsized":"2024-09-11T05:35:07.629431+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:15:05.574617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"142'844","reported_seq":12636,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.635788+0000","last_change":"2024-09-11T05:35:07.636190+0000","last_active":"2024-09-11T05:35:07.635788+0000","last_peered":"2024-09-11T05:35:07.635788+0000","last_clean":"2024-09-11T05:35:07.635788+0000","last_became_active":"2024-09-11T05:34:38.741666+0000","last_became_peered":"2024-09-11T05:34:38.741666+0000","last_unstale":"2024-09-11T05:35:07.635788+0000","last_undegraded":"2024-09-11T05:35:07.635788+0000","last_fullsized":"2024-09-11T05:35:07.635788+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:12.839480+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0034996329999999998,"stat_sum":{"num_bytes":38593,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":15193,"num_read_kb":18227,"num_write":822,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.3","version":"141'668","reported_seq":4299,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.631500+0000","last_change":"2024-09-11T05:35:07.635329+0000","last_active":"2024-09-11T05:35:07.631500+0000","last_peered":"2024-09-11T05:35:07.631500+0000","last_clean":"2024-09-11T05:35:07.631500+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:35:07.631500+0000","last_undegraded":"2024-09-11T05:35:07.631500+0000","last_fullsized":"2024-09-11T05:35:07.631500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:48.589207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057509390000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4299,"num_read_kb":22860,"num_write":711,"num_write_kb":8267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"2.2","version":"21'2","reported_seq":231,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.633434+0000","last_change":"2024-09-11T05:34:50.629913+0000","last_active":"2024-09-11T05:35:07.633434+0000","last_peered":"2024-09-11T05:35:07.633434+0000","last_clean":"2024-09-11T05:35:07.633434+0000","last_became_active":"2024-09-11T05:34:50.626576+0000","last_became_peered":"2024-09-11T05:34:50.626576+0000","last_unstale":"2024-09-11T05:35:07.633434+0000","last_undegraded":"2024-09-11T05:35:07.633434+0000","last_fullsized":"2024-09-11T05:35:07.633434+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:31.184793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"141'343","reported_seq":2589,"reported_epoch":141,"state":"peering","last_fresh":"2024-09-11T05:35:06.675388+0000","last_change":"2024-09-11T05:35:07.630023+0000","last_active":"2024-09-11T05:35:07.630023+0000","last_peered":"2024-09-11T05:35:06.675388+0000","last_clean":"2024-09-11T05:35:06.675388+0000","last_became_active":"2024-09-11T05:34:13.624034+0000","last_became_peered":"2024-09-11T05:34:13.624034+0000","last_unstale":"2024-09-11T05:35:06.675388+0000","last_undegraded":"2024-09-11T05:35:06.675388+0000","last_fullsized":"2024-09-11T05:35:06.675388+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093218200000000004,"stat_sum":{"num_bytes":6268000,"num_objects":7,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":6,"num_read":2061,"num_read_kb":16420,"num_write":311,"num_write_kb":9397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3410911,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,7],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"5"}]},{"pgid":"2.1","version":"0'0","reported_seq":2,"reported_epoch":142,"state":"peering","last_fresh":"2024-09-11T05:34:10.616334+0000","last_change":"2024-09-11T05:34:09.941148+0000","last_active":"2024-09-11T05:32:44.569039+0000","last_peered":"2024-09-11T05:32:44.569039+0000","last_clean":"2024-09-11T05:32:44.569039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T05:34:10.616334+0000","last_undegraded":"2024-09-11T05:34:10.616334+0000","last_fullsized":"2024-09-11T05:34:10.616334+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"139'743","reported_seq":8611,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.632589+0000","last_change":"2024-09-11T05:35:07.633388+0000","last_active":"2024-09-11T05:35:07.632589+0000","last_peered":"2024-09-11T05:35:07.632589+0000","last_clean":"2024-09-11T05:35:07.632589+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:35:07.632589+0000","last_undegraded":"2024-09-11T05:35:07.632589+0000","last_fullsized":"2024-09-11T05:35:07.632589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:59:55.107802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096271699999999998,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":11851,"num_read_kb":20739,"num_write":676,"num_write_kb":6668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.625582+0000","last_change":"2024-09-11T05:34:50.626273+0000","last_active":"2024-09-11T05:35:07.625582+0000","last_peered":"2024-09-11T05:35:07.625582+0000","last_clean":"2024-09-11T05:35:07.625582+0000","last_became_active":"2024-09-11T05:34:50.625970+0000","last_became_peered":"2024-09-11T05:34:50.625970+0000","last_unstale":"2024-09-11T05:35:07.625582+0000","last_undegraded":"2024-09-11T05:35:07.625582+0000","last_fullsized":"2024-09-11T05:35:07.625582+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:45.970895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"141'587","reported_seq":3834,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.628683+0000","last_change":"2024-09-11T05:35:07.629839+0000","last_active":"2024-09-11T05:35:07.628683+0000","last_peered":"2024-09-11T05:35:07.628683+0000","last_clean":"2024-09-11T05:35:07.628683+0000","last_became_active":"2024-09-11T05:34:38.742487+0000","last_became_peered":"2024-09-11T05:34:38.742487+0000","last_unstale":"2024-09-11T05:35:07.628683+0000","last_undegraded":"2024-09-11T05:35:07.628683+0000","last_fullsized":"2024-09-11T05:35:07.628683+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:54:51.879533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131898,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":5913,"num_read_kb":15123,"num_write":617,"num_write_kb":14349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"2.3","version":"19'1","reported_seq":48,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.627392+0000","last_change":"2024-09-11T05:34:50.628817+0000","last_active":"2024-09-11T05:35:07.627392+0000","last_peered":"2024-09-11T05:35:07.627392+0000","last_clean":"2024-09-11T05:35:07.627392+0000","last_became_active":"2024-09-11T05:34:50.625495+0000","last_became_peered":"2024-09-11T05:34:50.625495+0000","last_unstale":"2024-09-11T05:35:07.627392+0000","last_undegraded":"2024-09-11T05:35:07.627392+0000","last_fullsized":"2024-09-11T05:35:07.627392+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:38.332373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":221,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.630296+0000","last_change":"2024-09-11T05:34:47.626929+0000","last_active":"2024-09-11T05:35:07.630296+0000","last_peered":"2024-09-11T05:35:07.630296+0000","last_clean":"2024-09-11T05:35:07.630296+0000","last_became_active":"2024-09-11T05:34:47.626561+0000","last_became_peered":"2024-09-11T05:34:47.626561+0000","last_unstale":"2024-09-11T05:35:07.630296+0000","last_undegraded":"2024-09-11T05:35:07.630296+0000","last_fullsized":"2024-09-11T05:35:07.630296+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:09.689444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"unknown","last_fresh":"2024-09-11T05:35:07.627494+0000","last_change":"2024-09-11T05:35:07.978134+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T05:35:07.627494+0000","last_undegraded":"2024-09-11T05:35:07.627494+0000","last_fullsized":"2024-09-11T05:35:07.627494+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"142'411","reported_seq":10387,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.635603+0000","last_change":"2024-09-11T05:35:07.636454+0000","last_active":"2024-09-11T05:35:07.635603+0000","last_peered":"2024-09-11T05:35:07.635603+0000","last_clean":"2024-09-11T05:35:07.635603+0000","last_became_active":"2024-09-11T05:34:54.788935+0000","last_became_peered":"2024-09-11T05:34:54.788935+0000","last_unstale":"2024-09-11T05:35:07.635603+0000","last_undegraded":"2024-09-11T05:35:07.635603+0000","last_fullsized":"2024-09-11T05:35:07.635603+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:03.764530+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0084495779999999993,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9328,"num_read_kb":19500,"num_write":336,"num_write_kb":14817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":8961432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"unknown","last_fresh":"2024-09-11T05:35:07.627562+0000","last_change":"2024-09-11T05:35:07.978195+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T05:35:07.627562+0000","last_undegraded":"2024-09-11T05:35:07.627562+0000","last_fullsized":"2024-09-11T05:35:07.627562+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"unknown","last_fresh":"2024-09-11T05:35:07.630649+0000","last_change":"2024-09-11T05:35:07.978210+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T05:35:07.630649+0000","last_undegraded":"2024-09-11T05:35:07.630649+0000","last_fullsized":"2024-09-11T05:35:07.630649+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"141'404","reported_seq":2862,"reported_epoch":141,"state":"peering","last_fresh":"2024-09-11T05:35:06.742349+0000","last_change":"2024-09-11T05:35:07.627216+0000","last_active":"2024-09-11T05:35:07.627216+0000","last_peered":"2024-09-11T05:35:06.742349+0000","last_clean":"2024-09-11T05:35:06.742349+0000","last_became_active":"2024-09-11T05:34:53.791937+0000","last_became_peered":"2024-09-11T05:34:53.791937+0000","last_unstale":"2024-09-11T05:35:06.742349+0000","last_undegraded":"2024-09-11T05:35:06.742349+0000","last_fullsized":"2024-09-11T05:35:06.742349+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0087239190000000001,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":4,"num_read":1985,"num_read_kb":12033,"num_write":382,"num_write_kb":5272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":6119775,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,7],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5","length":"5"}]},{"pgid":"3.d","version":"141'478","reported_seq":5921,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.635645+0000","last_change":"2024-09-11T05:35:07.636214+0000","last_active":"2024-09-11T05:35:07.635645+0000","last_peered":"2024-09-11T05:35:07.635645+0000","last_clean":"2024-09-11T05:35:07.635645+0000","last_became_active":"2024-09-11T05:34:54.793037+0000","last_became_peered":"2024-09-11T05:34:54.793037+0000","last_unstale":"2024-09-11T05:35:07.635645+0000","last_undegraded":"2024-09-11T05:35:07.635645+0000","last_fullsized":"2024-09-11T05:35:07.635645+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:27.201216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046614300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5865,"num_read_kb":13697,"num_write":403,"num_write_kb":10315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":13015515,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.e","version":"140'401","reported_seq":2893,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.630381+0000","last_change":"2024-09-11T05:35:07.630381+0000","last_active":"2024-09-11T05:35:07.630381+0000","last_peered":"2024-09-11T05:35:07.630381+0000","last_clean":"2024-09-11T05:35:07.630381+0000","last_became_active":"2024-09-11T05:35:05.630573+0000","last_became_peered":"2024-09-11T05:35:05.630573+0000","last_unstale":"2024-09-11T05:35:07.630381+0000","last_undegraded":"2024-09-11T05:35:07.630381+0000","last_fullsized":"2024-09-11T05:35:07.630381+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:52.226741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079023199999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2127,"num_read_kb":12622,"num_write":331,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":262196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.f","version":"141'638","reported_seq":4920,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.635312+0000","last_change":"2024-09-11T05:35:07.636636+0000","last_active":"2024-09-11T05:35:07.635312+0000","last_peered":"2024-09-11T05:35:07.635312+0000","last_clean":"2024-09-11T05:35:07.635312+0000","last_became_active":"2024-09-11T05:34:48.626675+0000","last_became_peered":"2024-09-11T05:34:48.626675+0000","last_unstale":"2024-09-11T05:35:07.635312+0000","last_undegraded":"2024-09-11T05:35:07.635312+0000","last_fullsized":"2024-09-11T05:35:07.635312+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:06.742782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051924110000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":6001,"num_read_kb":12376,"num_write":612,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":2111260,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.10","version":"135'377","reported_seq":5513,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.629538+0000","last_change":"2024-09-11T05:35:07.631526+0000","last_active":"2024-09-11T05:35:07.629538+0000","last_peered":"2024-09-11T05:35:07.629538+0000","last_clean":"2024-09-11T05:35:07.629538+0000","last_became_active":"2024-09-11T05:34:53.791234+0000","last_became_peered":"2024-09-11T05:34:53.791234+0000","last_unstale":"2024-09-11T05:35:07.629538+0000","last_undegraded":"2024-09-11T05:35:07.629538+0000","last_fullsized":"2024-09-11T05:35:07.629538+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:44.029142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016355860000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4943,"num_read_kb":12354,"num_write":293,"num_write_kb":4874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":3066244,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.11","version":"141'664","reported_seq":2243,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.632688+0000","last_change":"2024-09-11T05:35:07.633618+0000","last_active":"2024-09-11T05:35:07.632688+0000","last_peered":"2024-09-11T05:35:07.632688+0000","last_clean":"2024-09-11T05:35:07.632688+0000","last_became_active":"2024-09-11T05:34:53.787385+0000","last_became_peered":"2024-09-11T05:34:53.787385+0000","last_unstale":"2024-09-11T05:35:07.632688+0000","last_undegraded":"2024-09-11T05:35:07.632688+0000","last_fullsized":"2024-09-11T05:35:07.632688+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:56:26.981189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006514667,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2920,"num_read_kb":11034,"num_write":809,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":3434090,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.12","version":"142'612","reported_seq":11131,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.636769+0000","last_change":"2024-09-11T05:35:07.637037+0000","last_active":"2024-09-11T05:35:07.636769+0000","last_peered":"2024-09-11T05:35:07.636769+0000","last_clean":"2024-09-11T05:35:07.636769+0000","last_became_active":"2024-09-11T05:34:53.789002+0000","last_became_peered":"2024-09-11T05:34:53.789002+0000","last_unstale":"2024-09-11T05:35:07.636769+0000","last_undegraded":"2024-09-11T05:35:07.636769+0000","last_fullsized":"2024-09-11T05:35:07.636769+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:53:11.349714+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0037042379999999999,"stat_sum":{"num_bytes":524288,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":3,"num_read":3076,"num_read_kb":7989,"num_write":737,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":6984484,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4","length":"6"}]},{"pgid":"3.13","version":"141'553","reported_seq":6545,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T05:35:07.629603+0000","last_change":"2024-09-11T05:35:07.630761+0000","last_active":"2024-09-11T05:35:07.629603+0000","last_peered":"2024-09-11T05:35:07.629603+0000","last_clean":"2024-09-11T05:35:07.629603+0000","last_became_active":"2024-09-11T05:34:54.791212+0000","last_became_peered":"2024-09-11T05:34:54.791212+0000","last_unstale":"2024-09-11T05:35:07.629603+0000","last_undegraded":"2024-09-11T05:35:07.629603+0000","last_fullsized":"2024-09-11T05:35:07.629603+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:31:25.463179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017107820000000001,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":6966,"num_read_kb":39078,"num_write":608,"num_write_kb":9923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":4472318,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"6"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":15219645,"num_objects":122,"num_object_clones":3,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":107,"num_read":175574,"num_read_kb":500384,"num_write":17880,"num_write_kb":267483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3492,"num_bytes_recovered":147749691,"num_keys_recovered":137,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19783680,"data_stored":29801228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16281,"ondisk_log_size":16281,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41172,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330668,"statfs":{"total":96636764160,"available":96594604032,"internally_reserved":0,"allocated":1699840,"data_stored":819689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59212,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312628,"statfs":{"total":96636764160,"available":96576131072,"internally_reserved":0,"allocated":1695744,"data_stored":813182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542176,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59848,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311992,"statfs":{"total":96636764160,"available":96575479808,"internally_reserved":0,"allocated":2338816,"data_stored":1444192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":0,"seq":442381631498,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542177,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59240,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312600,"statfs":{"total":96636764160,"available":96576102400,"internally_reserved":0,"allocated":1712128,"data_stored":819778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542176,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51680,"kb_used_data":2436,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320160,"statfs":{"total":96636764160,"available":96583843840,"internally_reserved":0,"allocated":2494464,"data_stored":1594019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":60129542176,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542177,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50932,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320908,"statfs":{"total":96636764160,"available":96584609792,"internally_reserved":0,"allocated":1720320,"data_stored":819826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19644416,"data_stored":29719696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":40626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":40680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:35:13.074 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:13.074 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:13.074 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:35:13.074 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:35:13.074 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:13.082 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T05:35:13.187 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:13.187 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:35:13.187 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:35:13.187 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:35:13.187 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.187 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183599 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6750208~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.187 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:35:13.187 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.443394804999997, 2024-09-11T05:35:13.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038610453000000003, 2024-09-11T05:35:13.188 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.188 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.188 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.188 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.188 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.188 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.188 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183599 2024-09-11T05:35:13.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.188 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.188 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.188 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:35:13.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742060+0000", 2024-09-11T05:35:13.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742061+0000", 2024-09-11T05:35:13.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2200000000000004e-07 2024-09-11T05:35:13.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742063+0000", 2024-09-11T05:35:13.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9520000000000001e-06 2024-09-11T05:35:13.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742068+0000", 2024-09-11T05:35:13.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6389999999999997e-06 2024-09-11T05:35:13.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742073+0000", 2024-09-11T05:35:13.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6990000000000002e-06 2024-09-11T05:35:13.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780516+0000", 2024-09-11T05:35:13.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038443428000000002 2024-09-11T05:35:13.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780601+0000", 2024-09-11T05:35:13.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4618999999999997e-05 2024-09-11T05:35:13.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780670+0000", 2024-09-11T05:35:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9593999999999998e-05 2024-09-11T05:35:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183600 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8138752~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:35:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.44337599, 2024-09-11T05:35:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038699900000000002, 2024-09-11T05:35:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.193 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.193 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.193 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.193 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.193 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.193 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183600 2024-09-11T05:35:13.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.193 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:35:13.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742079+0000", 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2800000000000002e-07 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742081+0000", 2024-09-11T05:35:13.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.086e-06 2024-09-11T05:35:13.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742087+0000", 2024-09-11T05:35:13.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4770000000000002e-06 2024-09-11T05:35:13.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742092+0000", 2024-09-11T05:35:13.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7190000000000001e-06 2024-09-11T05:35:13.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780697+0000", 2024-09-11T05:35:13.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038605577000000002 2024-09-11T05:35:13.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780740+0000", 2024-09-11T05:35:13.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3139999999999997e-05 2024-09-11T05:35:13.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780779+0000", 2024-09-11T05:35:13.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8473000000000002e-05 2024-09-11T05:35:13.197 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.197 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.197 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.197 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.197 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183601 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6791168~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.197 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:35:13.197 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.443357960999997, 2024-09-11T05:35:13.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038869364000000003, 2024-09-11T05:35:13.197 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.197 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.197 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.198 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.198 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.198 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.198 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183601 2024-09-11T05:35:13.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.198 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:35:13.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742097+0000", 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9900000000000002e-07 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742099+0000", 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9599999999999999e-06 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742105+0000", 2024-09-11T05:35:13.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0759999999999999e-06 2024-09-11T05:35:13.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742110+0000", 2024-09-11T05:35:13.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6600000000000003e-06 2024-09-11T05:35:13.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780809+0000", 2024-09-11T05:35:13.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038698681999999998 2024-09-11T05:35:13.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780886+0000", 2024-09-11T05:35:13.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7888999999999999e-05 2024-09-11T05:35:13.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780966+0000", 2024-09-11T05:35:13.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9797999999999997e-05 2024-09-11T05:35:13.201 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.201 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.201 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.202 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183602 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8179712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.202 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:35:13.202 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.443339141999999, 2024-09-11T05:35:13.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038955028000000003, 2024-09-11T05:35:13.202 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.202 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.202 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183602 2024-09-11T05:35:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:35:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:35:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742116+0000", 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3099999999999999e-07 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742122+0000", 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9880000000000001e-06 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742128+0000", 2024-09-11T05:35:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.2600000000000002e-06 2024-09-11T05:35:13.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742133+0000", 2024-09-11T05:35:13.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9010000000000002e-06 2024-09-11T05:35:13.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.780981+0000", 2024-09-11T05:35:13.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038848102000000002 2024-09-11T05:35:13.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781024+0000", 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2231000000000003e-05 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781071+0000", 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7215000000000001e-05 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183603 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6832128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.206 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.443315515999998, 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039121378999999998, 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183603 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.207 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742139+0000", 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742215+0000", 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.5419000000000004e-05 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742218+0000", 2024-09-11T05:35:13.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0989999999999999e-06 2024-09-11T05:35:13.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742225+0000", 2024-09-11T05:35:13.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4019999999999996e-06 2024-09-11T05:35:13.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742231+0000", 2024-09-11T05:35:13.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6969999999999998e-06 2024-09-11T05:35:13.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781102+0000", 2024-09-11T05:35:13.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038871348 2024-09-11T05:35:13.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781187+0000", 2024-09-11T05:35:13.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4719e-05 2024-09-11T05:35:13.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781261+0000", 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3695000000000005e-05 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183604 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8220672~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.443214955999998, 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039154538000000003, 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.212 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.212 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.212 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.212 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183604 2024-09-11T05:35:13.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.212 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:35:13.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.742240+0000", 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743491+0000", 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0012514620000000001 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743496+0000", 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2910000000000001e-06 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743506+0000", 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0039e-05 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743513+0000", 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0650000000000001e-06 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781296+0000", 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037783187000000003 2024-09-11T05:35:13.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781347+0000", 2024-09-11T05:35:13.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1375000000000002e-05 2024-09-11T05:35:13.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.781394+0000", 2024-09-11T05:35:13.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7119000000000001e-05 2024-09-11T05:35:13.215 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.215 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.215 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183609 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6955008~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:35:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.441820100999998, 2024-09-11T05:35:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038553630999999998, 2024-09-11T05:35:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.216 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183609 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743635+0000", 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.15e-07 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743637+0000", 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.86e-06 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743641+0000", 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7000000000000002e-06 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743645+0000", 2024-09-11T05:35:13.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9600000000000002e-06 2024-09-11T05:35:13.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782023+0000", 2024-09-11T05:35:13.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038378520999999999 2024-09-11T05:35:13.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782119+0000", 2024-09-11T05:35:13.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5665e-05 2024-09-11T05:35:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782188+0000", 2024-09-11T05:35:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9610000000000006e-05 2024-09-11T05:35:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183610 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8343552~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:35:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.441806522999997, 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038675859, 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183610 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:35:13.221 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743648+0000", 2024-09-11T05:35:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743649+0000", 2024-09-11T05:35:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-07 2024-09-11T05:35:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.223 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743650+0000", 2024-09-11T05:35:13.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5799999999999999e-06 2024-09-11T05:35:13.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.223 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.223 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.223 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743656+0000", 2024-09-11T05:35:13.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9789999999999998e-06 2024-09-11T05:35:13.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.223 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.223 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.223 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743660+0000", 2024-09-11T05:35:13.223 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4259999999999999e-06 2024-09-11T05:35:13.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782218+0000", 2024-09-11T05:35:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038558508999999998 2024-09-11T05:35:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782270+0000", 2024-09-11T05:35:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.168e-05 2024-09-11T05:35:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782324+0000", 2024-09-11T05:35:13.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4388999999999997e-05 2024-09-11T05:35:13.225 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.225 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.225 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.225 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.225 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183611 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 6995968~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.225 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:35:13.225 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.441791631000001, 2024-09-11T05:35:13.225 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038861554999999999, 2024-09-11T05:35:13.225 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.225 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.225 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.226 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.226 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.226 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.226 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183611 2024-09-11T05:35:13.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.226 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.226 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.226 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:35:13.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.227 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:35:13.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.227 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.227 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.227 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743663+0000", 2024-09-11T05:35:13.227 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4299999999999999e-07 2024-09-11T05:35:13.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.228 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.228 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743665+0000", 2024-09-11T05:35:13.228 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5060000000000001e-06 2024-09-11T05:35:13.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.228 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.228 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743668+0000", 2024-09-11T05:35:13.228 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1549999999999999e-06 2024-09-11T05:35:13.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.228 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.228 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743671+0000", 2024-09-11T05:35:13.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7599999999999998e-06 2024-09-11T05:35:13.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782359+0000", 2024-09-11T05:35:13.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038687946000000001 2024-09-11T05:35:13.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.229 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.229 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782437+0000", 2024-09-11T05:35:13.229 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8539000000000001e-05 2024-09-11T05:35:13.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.229 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.230 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.230 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782525+0000", 2024-09-11T05:35:13.230 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7405999999999996e-05 2024-09-11T05:35:13.230 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.230 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.230 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.230 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.230 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183612 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 8384512~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.441780461999997, 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039040111000000002, 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183612 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.231 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.232 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:35:13.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.232 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.232 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.232 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743674+0000", 2024-09-11T05:35:13.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.232 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.232 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.232 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743675+0000", 2024-09-11T05:35:13.232 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2100000000000001e-07 2024-09-11T05:35:13.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.233 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.233 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743676+0000", 2024-09-11T05:35:13.233 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.212e-06 2024-09-11T05:35:13.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.233 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.233 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743679+0000", 2024-09-11T05:35:13.233 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9979999999999999e-06 2024-09-11T05:35:13.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.233 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.233 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743681+0000", 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.604e-06 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782560+0000", 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038878687000000002 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782644+0000", 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3733000000000006e-05 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.235 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.235 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782714+0000", 2024-09-11T05:35:13.235 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0655999999999996e-05 2024-09-11T05:35:13.235 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.235 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.235 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.235 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.235 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183613 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7036928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.235 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:35:13.235 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.441770429000002, 2024-09-11T05:35:13.235 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.039233924000000003, 2024-09-11T05:35:13.235 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.236 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.236 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.236 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.236 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.236 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.236 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183613 2024-09-11T05:35:13.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.236 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.236 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.236 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:35:13.236 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.237 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.237 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.743684+0000", 2024-09-11T05:35:13.237 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.237 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.237 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745489+0000", 2024-09-11T05:35:13.237 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0018047549999999999 2024-09-11T05:35:13.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.238 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.238 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745493+0000", 2024-09-11T05:35:13.238 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0439999999999997e-06 2024-09-11T05:35:13.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.238 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.238 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.238 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745501+0000", 2024-09-11T05:35:13.238 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3520000000000001e-06 2024-09-11T05:35:13.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.238 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.238 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.238 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745507+0000", 2024-09-11T05:35:13.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9490000000000001e-06 2024-09-11T05:35:13.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.239 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.239 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782756+0000", 2024-09-11T05:35:13.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037249522 2024-09-11T05:35:13.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.239 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.239 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782839+0000", 2024-09-11T05:35:13.239 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3133999999999994e-05 2024-09-11T05:35:13.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.239 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.240 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.240 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.782918+0000", 2024-09-11T05:35:13.240 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9167999999999998e-05 2024-09-11T05:35:13.240 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.240 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.240 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.240 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.240 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183622 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7323648~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.240 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:35:13.240 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.439812013999997, 2024-09-11T05:35:13.240 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038618008000000002, 2024-09-11T05:35:13.240 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.241 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.241 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.241 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.241 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.241 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.241 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183622 2024-09-11T05:35:13.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.241 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.241 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.241 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.241 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:35:13.241 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745643+0000", 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4900000000000001e-07 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.242 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745645+0000", 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9709999999999998e-06 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745651+0000", 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.251e-06 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745657+0000", 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.243 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784095+0000", 2024-09-11T05:35:13.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038437791999999998 2024-09-11T05:35:13.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.244 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784201+0000", 2024-09-11T05:35:13.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000106801 2024-09-11T05:35:13.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.244 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.244 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784261+0000", 2024-09-11T05:35:13.244 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9475999999999998e-05 2024-09-11T05:35:13.244 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.245 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.245 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.245 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.245 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183623 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4296704~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.245 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:35:13.245 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.439791829999997, 2024-09-11T05:35:13.245 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038730705999999997, 2024-09-11T05:35:13.245 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.245 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.245 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.245 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.246 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.246 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.246 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183623 2024-09-11T05:35:13.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.246 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.246 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.246 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.246 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:35:13.246 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.246 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.246 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.247 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:35:13.247 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.247 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.247 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.247 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745663+0000", 2024-09-11T05:35:13.247 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.39e-07 2024-09-11T05:35:13.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.247 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.247 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.247 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745665+0000", 2024-09-11T05:35:13.247 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9860000000000001e-06 2024-09-11T05:35:13.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.248 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.248 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745671+0000", 2024-09-11T05:35:13.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.818e-06 2024-09-11T05:35:13.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.248 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.248 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745676+0000", 2024-09-11T05:35:13.248 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.972e-06 2024-09-11T05:35:13.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.248 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.248 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.249 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784296+0000", 2024-09-11T05:35:13.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038620131000000002 2024-09-11T05:35:13.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.249 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.249 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784353+0000", 2024-09-11T05:35:13.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6644999999999997e-05 2024-09-11T05:35:13.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.249 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.249 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784394+0000", 2024-09-11T05:35:13.249 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0815000000000001e-05 2024-09-11T05:35:13.249 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.250 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.250 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.250 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.250 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183624 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 7364608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.250 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:35:13.250 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.439772953000002, 2024-09-11T05:35:13.250 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038826315, 2024-09-11T05:35:13.250 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.250 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.250 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.250 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.250 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.251 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.251 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183624 2024-09-11T05:35:13.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.251 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:35:13.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.251 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.251 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.251 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:35:13.251 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745682+0000", 2024-09-11T05:35:13.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4799999999999999e-07 2024-09-11T05:35:13.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.252 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745684+0000", 2024-09-11T05:35:13.252 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0980000000000001e-06 2024-09-11T05:35:13.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.252 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.252 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745690+0000", 2024-09-11T05:35:13.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.733e-06 2024-09-11T05:35:13.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745695+0000", 2024-09-11T05:35:13.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7509999999999999e-06 2024-09-11T05:35:13.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.253 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.253 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784418+0000", 2024-09-11T05:35:13.253 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038722813000000002 2024-09-11T05:35:13.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.254 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.254 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.254 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784460+0000", 2024-09-11T05:35:13.254 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2222999999999999e-05 2024-09-11T05:35:13.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.254 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.254 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.254 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784508+0000", 2024-09-11T05:35:13.254 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8349000000000001e-05 2024-09-11T05:35:13.254 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.254 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.254 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.255 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.255 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183625 3.1f 3:f914546f:::rbd_data.112d95d25762.0000000000000006:29 [read 4337664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.255 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:35:13.255 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.439753244999999, 2024-09-11T05:35:13.255 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923776, 2024-09-11T05:35:13.255 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.255 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.255 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.255 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.255 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.255 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.255 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183625 2024-09-11T05:35:13.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.256 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.256 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.256 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.256 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:35:13.256 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.256 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.256 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.256 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:35:13.256 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.256 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.256 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.257 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745702+0000", 2024-09-11T05:35:13.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.41e-07 2024-09-11T05:35:13.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.257 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745713+0000", 2024-09-11T05:35:13.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0579e-05 2024-09-11T05:35:13.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.257 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.257 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745719+0000", 2024-09-11T05:35:13.257 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4540000000000004e-06 2024-09-11T05:35:13.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745724+0000", 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1170000000000003e-06 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784532+0000", 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038807618000000002 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784586+0000", 2024-09-11T05:35:13.258 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4432999999999999e-05 2024-09-11T05:35:13.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.259 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.259 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784625+0000", 2024-09-11T05:35:13.259 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9233999999999997e-05 2024-09-11T05:35:13.259 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.259 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.259 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.259 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183626 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.259 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:35:13.260 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.439723583000003, 2024-09-11T05:35:13.260 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038934147000000002, 2024-09-11T05:35:13.260 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.260 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.260 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:35:13.260 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.260 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.260 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.260 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183626 2024-09-11T05:35:13.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.260 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.260 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.260 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:35:13.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.261 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745731+0000", 2024-09-11T05:35:13.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.261 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.261 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.261 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745732+0000", 2024-09-11T05:35:13.261 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8500000000000002e-07 2024-09-11T05:35:13.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745734+0000", 2024-09-11T05:35:13.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9649999999999998e-06 2024-09-11T05:35:13.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.262 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745739+0000", 2024-09-11T05:35:13.262 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.806e-06 2024-09-11T05:35:13.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.262 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745744+0000", 2024-09-11T05:35:13.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5210000000000004e-06 2024-09-11T05:35:13.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784660+0000", 2024-09-11T05:35:13.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038916077 2024-09-11T05:35:13.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.263 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.263 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784665+0000", 2024-09-11T05:35:13.263 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3929999999999999e-06 2024-09-11T05:35:13.263 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.264 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.264 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.264 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.264 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183627 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.264 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:35:13.264 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.439705064999998, 2024-09-11T05:35:13.264 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038942282000000002, 2024-09-11T05:35:13.264 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.264 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.264 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:35:13.264 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.264 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.265 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.265 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183627 2024-09-11T05:35:13.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.265 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.265 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.265 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:35:13.265 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.265 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.265 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:35:13.265 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745750+0000", 2024-09-11T05:35:13.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3999999999999997e-07 2024-09-11T05:35:13.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.266 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745752+0000", 2024-09-11T05:35:13.266 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9e-06 2024-09-11T05:35:13.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.266 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.266 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745758+0000", 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.6899999999999997e-06 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745763+0000", 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.9169999999999997e-06 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784686+0000", 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038923874999999997 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.268 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.268 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784692+0000", 2024-09-11T05:35:13.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5600000000000001e-06 2024-09-11T05:35:13.268 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.268 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.268 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.268 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183628 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.268 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:35:13.268 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.439666453999997, 2024-09-11T05:35:13.268 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038927438000000002, 2024-09-11T05:35:13.268 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:35:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183628 2024-09-11T05:35:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:35:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745788+0000", 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745789+0000", 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3000000000000002e-07 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745791+0000", 2024-09-11T05:35:13.270 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0209999999999998e-06 2024-09-11T05:35:13.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745802+0000", 2024-09-11T05:35:13.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0886e-05 2024-09-11T05:35:13.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.271 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745806+0000", 2024-09-11T05:35:13.271 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0289999999999999e-06 2024-09-11T05:35:13.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.271 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784712+0000", 2024-09-11T05:35:13.272 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038905922000000003 2024-09-11T05:35:13.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.272 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.272 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784716+0000", 2024-09-11T05:35:13.272 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.25e-06 2024-09-11T05:35:13.272 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.272 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.272 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.272 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.272 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:183629 3.1f 3.f62a289f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 61.439644737000002, 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.038954874, 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "reached pg", 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 183629 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.273 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:35:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.745810+0000", 2024-09-11T05:35:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747489+0000", 2024-09-11T05:35:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0016785529999999999 2024-09-11T05:35:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747493+0000", 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0600000000000001e-06 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747501+0000", 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9109999999999993e-06 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.747507+0000", 2024-09-11T05:35:13.275 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3899999999999998e-06 2024-09-11T05:35:13.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.276 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.276 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.276 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784760+0000", 2024-09-11T05:35:13.276 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.037253197000000002 2024-09-11T05:35:13.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.276 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.276 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.276 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:34:11.784765+0000", 2024-09-11T05:35:13.276 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.763e-06 2024-09-11T05:35:13.276 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.276 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.276 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:196271 3.1f 3:fb1c8fd3:::rbd_object_map.112d307a6c14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2024-09-11T05:35:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:35:11.646785+0000", 2024-09-11T05:35:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 1.5386703370000001, 2024-09-11T05:35:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.98599682799999999, 2024-09-11T05:35:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:35:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 196271 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:11.646785+0000", 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:11.646785+0000", 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.278 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:11.646786+0000", 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.672e-06 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:11.646793+0000", 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3990000000000001e-06 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:11.646805+0000", 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2685e-05 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.280 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.280 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:11.646811+0000", 2024-09-11T05:35:13.280 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1630000000000001e-06 2024-09-11T05:35:13.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.280 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.280 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:11.646871+0000", 2024-09-11T05:35:13.280 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9898999999999997e-05 2024-09-11T05:35:13.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.280 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.280 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:11.646880+0000", 2024-09-11T05:35:13.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1379999999999996e-06 2024-09-11T05:35:13.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:12.631007+0000", 2024-09-11T05:35:13.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.98412615999999997 2024-09-11T05:35:13.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.281 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.281 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:12.631200+0000", 2024-09-11T05:35:13.281 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00019304700000000001 2024-09-11T05:35:13.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.281 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.282 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 7", 2024-09-11T05:35:13.282 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:12.631425+0000", 2024-09-11T05:35:13.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00022537800000000001 2024-09-11T05:35:13.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.282 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:35:13.282 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:12.632522+0000", 2024-09-11T05:35:13.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0010967430000000001 2024-09-11T05:35:13.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.282 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.282 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:35:13.282 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:12.632650+0000", 2024-09-11T05:35:13.282 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012777900000000001 2024-09-11T05:35:13.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:35:13.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:12.632722+0000", 2024-09-11T05:35:13.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2455999999999999e-05 2024-09-11T05:35:13.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.283 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.283 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:35:12.632781+0000", 2024-09-11T05:35:13.283 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9308999999999997e-05 2024-09-11T05:35:13.283 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.283 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.283 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.284 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.284 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.284 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:13.285 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T05:35:13.388 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:13.388 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:13.388 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:35:13.388 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:13.396 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T05:35:13.499 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:13.500 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:13.500 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:35:13.500 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:35:13.500 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:13.508 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T05:35:13.614 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:13.614 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:35:13.614 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:35:13.615 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:35:13.615 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.615 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116713 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13060096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.615 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:35:13.615 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.798232565999996, 2024-09-11T05:35:13.615 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0599235, 2024-09-11T05:35:13.616 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.616 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.616 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.616 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.616 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.617 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.617 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116713 2024-09-11T05:35:13.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.617 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.617 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.618 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:35:13.618 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.618 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.618 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.618 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813320+0000", 2024-09-11T05:35:13.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.619 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.619 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813321+0000", 2024-09-11T05:35:13.619 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3900000000000005e-07 2024-09-11T05:35:13.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.620 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.620 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.620 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813323+0000", 2024-09-11T05:35:13.620 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.667e-06 2024-09-11T05:35:13.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.621 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.621 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813331+0000", 2024-09-11T05:35:13.621 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6529999999999994e-06 2024-09-11T05:35:13.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.622 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.622 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813336+0000", 2024-09-11T05:35:13.622 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3680000000000001e-06 2024-09-11T05:35:13.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.622 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813688+0000", 2024-09-11T05:35:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035143199999999999 2024-09-11T05:35:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:13.624 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813692+0000", 2024-09-11T05:35:13.624 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5120000000000002e-06 2024-09-11T05:35:13.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.625 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.625 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.625 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816304+0000", 2024-09-11T05:35:13.625 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0026115449999999998 2024-09-11T05:35:13.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.625 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816308+0000", 2024-09-11T05:35:13.626 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2370000000000003e-06 2024-09-11T05:35:13.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.626 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.626 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.626 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821720+0000", 2024-09-11T05:35:13.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0054114869999999 2024-09-11T05:35:13.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.627 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.627 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.627 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821724+0000", 2024-09-11T05:35:13.627 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5129999999999998e-06 2024-09-11T05:35:13.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.628 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.628 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873101+0000", 2024-09-11T05:35:13.628 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0513774279999999 2024-09-11T05:35:13.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.628 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873159+0000", 2024-09-11T05:35:13.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819000000000003e-05 2024-09-11T05:35:13.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.629 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.629 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873244+0000", 2024-09-11T05:35:13.629 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4300000000000003e-05 2024-09-11T05:35:13.630 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.630 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.630 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.630 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116714 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.630 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:35:13.630 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.798189930999996, 2024-09-11T05:35:13.630 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600505999999998, 2024-09-11T05:35:13.630 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.630 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.631 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.631 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.631 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.631 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.631 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116714 2024-09-11T05:35:13.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.631 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.631 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:35:13.632 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:35:13.632 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.632 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.632 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.632 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813363+0000", 2024-09-11T05:35:13.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:35:13.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.633 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813366+0000", 2024-09-11T05:35:13.633 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6919999999999998e-06 2024-09-11T05:35:13.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.633 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.633 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813373+0000", 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8689999999999998e-06 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813378+0000", 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2159999999999997e-06 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813733+0000", 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035530300000000001 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.634 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813739+0000", 2024-09-11T05:35:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8819999999999998e-06 2024-09-11T05:35:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816340+0000", 2024-09-11T05:35:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002600598 2024-09-11T05:35:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816349+0000", 2024-09-11T05:35:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9169999999999995e-06 2024-09-11T05:35:13.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.636 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821745+0000", 2024-09-11T05:35:13.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005396416 2024-09-11T05:35:13.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.636 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821750+0000", 2024-09-11T05:35:13.636 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4530000000000004e-06 2024-09-11T05:35:13.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.636 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873269+0000", 2024-09-11T05:35:13.637 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0515195159999999 2024-09-11T05:35:13.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.637 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.637 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.637 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873328+0000", 2024-09-11T05:35:13.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9222999999999999e-05 2024-09-11T05:35:13.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.638 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.638 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873413+0000", 2024-09-11T05:35:13.638 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.4983999999999998e-05 2024-09-11T05:35:13.638 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.638 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.638 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.639 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116715 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13109248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.639 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:35:13.639 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.798148449999999, 2024-09-11T05:35:13.639 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0602519180000001, 2024-09-11T05:35:13.639 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.639 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.640 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.640 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.640 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.640 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.640 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116715 2024-09-11T05:35:13.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.640 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.640 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.640 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:35:13.640 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.641 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813404+0000", 2024-09-11T05:35:13.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.641 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.641 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.641 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813405+0000", 2024-09-11T05:35:13.641 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.51e-07 2024-09-11T05:35:13.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813407+0000", 2024-09-11T05:35:13.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4090000000000001e-06 2024-09-11T05:35:13.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.642 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813414+0000", 2024-09-11T05:35:13.642 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.686e-06 2024-09-11T05:35:13.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.642 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813419+0000", 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4249999999999997e-06 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813774+0000", 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035460800000000002 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813778+0000", 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2749999999999997e-06 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.643 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.644 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816375+0000", 2024-09-11T05:35:13.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025967730000000001 2024-09-11T05:35:13.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.644 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.644 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816379+0000", 2024-09-11T05:35:13.644 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3780000000000003e-06 2024-09-11T05:35:13.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.644 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821770+0000", 2024-09-11T05:35:13.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053903040000001 2024-09-11T05:35:13.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821774+0000", 2024-09-11T05:35:13.645 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5190000000000003e-06 2024-09-11T05:35:13.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.645 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.645 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.645 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873437+0000", 2024-09-11T05:35:13.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051663155 2024-09-11T05:35:13.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873500+0000", 2024-09-11T05:35:13.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3027000000000005e-05 2024-09-11T05:35:13.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.646 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.646 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.646 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873656+0000", 2024-09-11T05:35:13.646 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015580800000000001 2024-09-11T05:35:13.646 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.647 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.647 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.647 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.647 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116716 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13133824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.647 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:35:13.647 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.798105992999993, 2024-09-11T05:35:13.647 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0605170350000002, 2024-09-11T05:35:13.647 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.647 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.647 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.647 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.648 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.648 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.648 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116716 2024-09-11T05:35:13.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.648 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.648 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.648 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:35:13.648 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:35:13.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813447+0000", 2024-09-11T05:35:13.649 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5799999999999999e-07 2024-09-11T05:35:13.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.649 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.649 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.649 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813450+0000", 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7659999999999999e-06 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813458+0000", 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.7430000000000002e-06 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813464+0000", 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8839999999999999e-06 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.650 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813814+0000", 2024-09-11T05:35:13.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00035073199999999998 2024-09-11T05:35:13.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:13.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813819+0000", 2024-09-11T05:35:13.651 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999997e-06 2024-09-11T05:35:13.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.651 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.651 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816410+0000", 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025904349999999999 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816418+0000", 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1610000000000003e-06 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821794+0000", 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005376391 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.652 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821799+0000", 2024-09-11T05:35:13.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4870000000000004e-06 2024-09-11T05:35:13.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873697+0000", 2024-09-11T05:35:13.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.051898843 2024-09-11T05:35:13.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.653 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.653 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.653 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873810+0000", 2024-09-11T05:35:13.653 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112187 2024-09-11T05:35:13.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.654 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.654 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.873964+0000", 2024-09-11T05:35:13.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015412800000000001 2024-09-11T05:35:13.654 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.654 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.654 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.654 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116717 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13158400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.654 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:35:13.654 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.798080909000006, 2024-09-11T05:35:13.654 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606806560000002, 2024-09-11T05:35:13.655 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.655 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.655 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.655 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.655 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.655 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.655 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116717 2024-09-11T05:35:13.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.655 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.655 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.655 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.655 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:35:13.655 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:35:13.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.656 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.656 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813472+0000", 2024-09-11T05:35:13.656 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000000000000001e-07 2024-09-11T05:35:13.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813474+0000", 2024-09-11T05:35:13.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1830000000000001e-06 2024-09-11T05:35:13.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813481+0000", 2024-09-11T05:35:13.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5540000000000003e-06 2024-09-11T05:35:13.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.657 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.657 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813491+0000", 2024-09-11T05:35:13.657 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0472000000000001e-05 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813867+0000", 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00037606 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813873+0000", 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.254e-06 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.658 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816443+0000", 2024-09-11T05:35:13.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025701769999999999 2024-09-11T05:35:13.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.659 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.659 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816446+0000", 2024-09-11T05:35:13.659 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5379999999999998e-06 2024-09-11T05:35:13.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.660 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821818+0000", 2024-09-11T05:35:13.660 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053719830000001 2024-09-11T05:35:13.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.660 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.660 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.661 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821823+0000", 2024-09-11T05:35:13.661 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5560000000000001e-06 2024-09-11T05:35:13.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.661 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.661 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874006+0000", 2024-09-11T05:35:13.662 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05218342 2024-09-11T05:35:13.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.662 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.662 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.662 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874071+0000", 2024-09-11T05:35:13.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4369999999999995e-05 2024-09-11T05:35:13.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.663 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.663 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.663 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874152+0000", 2024-09-11T05:35:13.663 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1658999999999999e-05 2024-09-11T05:35:13.663 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.664 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.664 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.664 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116718 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13182976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.665 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:35:13.665 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.798049391000006, 2024-09-11T05:35:13.665 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0609185380000001, 2024-09-11T05:35:13.665 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.665 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.666 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.666 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.666 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.666 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.666 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116718 2024-09-11T05:35:13.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.667 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.667 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.667 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.667 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:35:13.667 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.668 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.668 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.668 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813503+0000", 2024-09-11T05:35:13.668 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.669 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.669 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.669 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813504+0000", 2024-09-11T05:35:13.669 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7999999999999996e-07 2024-09-11T05:35:13.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.670 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.670 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.670 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813506+0000", 2024-09-11T05:35:13.670 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2989999999999999e-06 2024-09-11T05:35:13.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.671 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.671 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813513+0000", 2024-09-11T05:35:13.671 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8020000000000003e-06 2024-09-11T05:35:13.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.672 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.672 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813517+0000", 2024-09-11T05:35:13.672 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5639999999999998e-06 2024-09-11T05:35:13.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.673 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.673 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813916+0000", 2024-09-11T05:35:13.673 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039859800000000001 2024-09-11T05:35:13.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.673 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.674 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:13.674 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813922+0000", 2024-09-11T05:35:13.676 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7869999999999998e-06 2024-09-11T05:35:13.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.677 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.677 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.677 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816476+0000", 2024-09-11T05:35:13.677 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025538359999999999 2024-09-11T05:35:13.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.678 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.678 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816481+0000", 2024-09-11T05:35:13.678 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7819999999999999e-06 2024-09-11T05:35:13.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.678 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.679 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.679 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821843+0000", 2024-09-11T05:35:13.679 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053620299999999 2024-09-11T05:35:13.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.679 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.680 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821848+0000", 2024-09-11T05:35:13.680 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4469999999999999e-06 2024-09-11T05:35:13.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.680 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.681 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874191+0000", 2024-09-11T05:35:13.681 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052342935 2024-09-11T05:35:13.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.681 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.682 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874300+0000", 2024-09-11T05:35:13.682 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000108764 2024-09-11T05:35:13.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.682 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.683 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874422+0000", 2024-09-11T05:35:13.683 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00012221399999999999 2024-09-11T05:35:13.683 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.683 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.683 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.684 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116719 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13207552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.684 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:35:13.684 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.798008593000006, 2024-09-11T05:35:13.684 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0611734350000002, 2024-09-11T05:35:13.684 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.685 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.685 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.685 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.685 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.685 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.686 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116719 2024-09-11T05:35:13.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.686 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.686 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.686 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:35:13.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.687 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.687 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813544+0000", 2024-09-11T05:35:13.687 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.688 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.688 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.688 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813545+0000", 2024-09-11T05:35:13.688 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2600000000000002e-07 2024-09-11T05:35:13.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.689 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.689 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.689 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813547+0000", 2024-09-11T05:35:13.689 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.3329999999999999e-06 2024-09-11T05:35:13.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.690 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.690 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813553+0000", 2024-09-11T05:35:13.690 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4640000000000003e-06 2024-09-11T05:35:13.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.690 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.691 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813558+0000", 2024-09-11T05:35:13.691 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0479999999999998e-06 2024-09-11T05:35:13.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.691 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.691 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.691 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813952+0000", 2024-09-11T05:35:13.691 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039390999999999997 2024-09-11T05:35:13.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.692 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.692 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:13.692 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813955+0000", 2024-09-11T05:35:13.692 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.858e-06 2024-09-11T05:35:13.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.692 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.692 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.692 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816524+0000", 2024-09-11T05:35:13.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002568847 2024-09-11T05:35:13.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816533+0000", 2024-09-11T05:35:13.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1749999999999994e-06 2024-09-11T05:35:13.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.693 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.693 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821869+0000", 2024-09-11T05:35:13.693 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053358939999999 2024-09-11T05:35:13.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821876+0000", 2024-09-11T05:35:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7730000000000002e-06 2024-09-11T05:35:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874454+0000", 2024-09-11T05:35:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052577621 2024-09-11T05:35:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874546+0000", 2024-09-11T05:35:13.694 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.2151999999999995e-05 2024-09-11T05:35:13.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.695 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.695 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.695 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874718+0000", 2024-09-11T05:35:13.695 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017183399999999999 2024-09-11T05:35:13.695 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.695 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.695 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.695 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.695 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116720 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13232128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.695 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:35:13.695 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.797986707000007, 2024-09-11T05:35:13.696 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0614845590000002, 2024-09-11T05:35:13.696 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.696 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.696 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.696 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.696 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.696 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.696 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116720 2024-09-11T05:35:13.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.696 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.696 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.697 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:35:13.697 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.697 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.697 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:35:13.697 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.697 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.697 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813566+0000", 2024-09-11T05:35:13.697 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5600000000000002e-07 2024-09-11T05:35:13.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813568+0000", 2024-09-11T05:35:13.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9089999999999998e-06 2024-09-11T05:35:13.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.698 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813573+0000", 2024-09-11T05:35:13.698 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2059999999999998e-06 2024-09-11T05:35:13.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.698 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.698 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813577+0000", 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1489999999999996e-06 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813987+0000", 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040977800000000002 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813992+0000", 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1540000000000001e-06 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.699 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.700 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.700 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816560+0000", 2024-09-11T05:35:13.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0025680389999999998 2024-09-11T05:35:13.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.700 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.700 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.700 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816566+0000", 2024-09-11T05:35:13.700 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0679999999999996e-06 2024-09-11T05:35:13.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.700 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.701 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.701 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821907+0000", 2024-09-11T05:35:13.701 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005341735 2024-09-11T05:35:13.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.701 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.701 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.701 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821916+0000", 2024-09-11T05:35:13.701 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3659999999999992e-06 2024-09-11T05:35:13.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.701 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874760+0000", 2024-09-11T05:35:13.702 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.052844713 2024-09-11T05:35:13.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.702 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.874878+0000", 2024-09-11T05:35:13.702 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000117321 2024-09-11T05:35:13.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.702 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875051+0000", 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00017286499999999999 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116721 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13256704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.797969352999999, 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0616932019999998, 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.703 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.704 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.704 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.704 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.704 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116721 2024-09-11T05:35:13.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.704 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.704 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.704 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:35:13.704 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.705 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813583+0000", 2024-09-11T05:35:13.705 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.705 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813584+0000", 2024-09-11T05:35:13.705 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2e-07 2024-09-11T05:35:13.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.705 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.705 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813586+0000", 2024-09-11T05:35:13.705 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.277e-06 2024-09-11T05:35:13.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.706 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.706 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813592+0000", 2024-09-11T05:35:13.706 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5840000000000002e-06 2024-09-11T05:35:13.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.706 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.706 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813597+0000", 2024-09-11T05:35:13.706 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2839999999999997e-06 2024-09-11T05:35:13.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.706 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.707 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814028+0000", 2024-09-11T05:35:13.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000430689 2024-09-11T05:35:13.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.707 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.707 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:13.707 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814032+0000", 2024-09-11T05:35:13.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3850000000000004e-06 2024-09-11T05:35:13.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.707 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.707 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.707 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816597+0000", 2024-09-11T05:35:13.707 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00256485 2024-09-11T05:35:13.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.708 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.708 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816606+0000", 2024-09-11T05:35:13.708 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1169999999999993e-06 2024-09-11T05:35:13.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.709 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821949+0000", 2024-09-11T05:35:13.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.005342752 2024-09-11T05:35:13.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.709 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.709 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821954+0000", 2024-09-11T05:35:13.709 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2270000000000001e-06 2024-09-11T05:35:13.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.710 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.710 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875095+0000", 2024-09-11T05:35:13.710 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.053140669 2024-09-11T05:35:13.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.710 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.710 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875186+0000", 2024-09-11T05:35:13.710 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1391999999999995e-05 2024-09-11T05:35:13.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.710 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.711 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875277+0000", 2024-09-11T05:35:13.711 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0556000000000005e-05 2024-09-11T05:35:13.711 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.711 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.711 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.711 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.711 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116722 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13281280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.711 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:35:13.711 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.797932353999997, 2024-09-11T05:35:13.711 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.061825491, 2024-09-11T05:35:13.711 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.711 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.712 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.712 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.712 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.712 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.712 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116722 2024-09-11T05:35:13.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.712 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.712 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:35:13.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813620+0000", 2024-09-11T05:35:13.713 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.713 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.713 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813621+0000", 2024-09-11T05:35:13.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0200000000000001e-07 2024-09-11T05:35:13.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.714 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813625+0000", 2024-09-11T05:35:13.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.228e-06 2024-09-11T05:35:13.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.714 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.714 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813635+0000", 2024-09-11T05:35:13.714 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.5179999999999993e-06 2024-09-11T05:35:13.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813641+0000", 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4710000000000004e-06 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814057+0000", 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00041530099999999997 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting_for_map not empty", 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.814060+0000", 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7500000000000001e-06 2024-09-11T05:35:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.716 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816632+0000", 2024-09-11T05:35:13.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00257186 2024-09-11T05:35:13.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.716 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816636+0000", 2024-09-11T05:35:13.716 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2150000000000003e-06 2024-09-11T05:35:13.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.716 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.716 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821977+0000", 2024-09-11T05:35:13.717 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053407110000001 2024-09-11T05:35:13.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.717 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.717 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.821982+0000", 2024-09-11T05:35:13.717 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2789999999999998e-06 2024-09-11T05:35:13.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.717 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.717 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875307+0000", 2024-09-11T05:35:13.717 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0533247000000001 2024-09-11T05:35:13.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875366+0000", 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8628999999999997e-05 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875446+0000", 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0026999999999998e-05 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.718 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116723 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13305856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.797899376000004, 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0619630779999998, 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116723 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.719 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.720 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:35:13.720 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.720 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.720 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813653+0000", 2024-09-11T05:35:13.720 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.720 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.720 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813654+0000", 2024-09-11T05:35:13.720 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.7199999999999999e-07 2024-09-11T05:35:13.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.721 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.721 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813661+0000", 2024-09-11T05:35:13.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1890000000000001e-06 2024-09-11T05:35:13.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.721 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.721 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813675+0000", 2024-09-11T05:35:13.721 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3878e-05 2024-09-11T05:35:13.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.721 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.721 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.721 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813682+0000", 2024-09-11T05:35:13.722 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.063e-06 2024-09-11T05:35:13.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.722 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.722 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.722 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816666+0000", 2024-09-11T05:35:13.722 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029845679999999999 2024-09-11T05:35:13.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.722 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.722 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.722 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816671+0000", 2024-09-11T05:35:13.722 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2780000000000004e-06 2024-09-11T05:35:13.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822024+0000", 2024-09-11T05:35:13.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053534660000001 2024-09-11T05:35:13.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.723 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.723 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822028+0000", 2024-09-11T05:35:13.723 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7799999999999998e-06 2024-09-11T05:35:13.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.724 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.724 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875471+0000", 2024-09-11T05:35:13.724 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.05344306 2024-09-11T05:35:13.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.724 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.724 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875531+0000", 2024-09-11T05:35:13.725 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.0019000000000003e-05 2024-09-11T05:35:13.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.725 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.725 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.725 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875616+0000", 2024-09-11T05:35:13.725 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5304999999999997e-05 2024-09-11T05:35:13.725 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.725 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.725 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.725 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.725 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116724 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13330432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.726 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:35:13.726 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.797859887000001, 2024-09-11T05:35:13.726 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0620902609999998, 2024-09-11T05:35:13.726 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.726 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.726 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.726 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.726 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.726 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.726 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116724 2024-09-11T05:35:13.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.726 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.726 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813693+0000", 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.99e-07 2024-09-11T05:35:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.728 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813697+0000", 2024-09-11T05:35:13.728 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2430000000000001e-06 2024-09-11T05:35:13.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.728 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813704+0000", 2024-09-11T05:35:13.728 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2980000000000003e-06 2024-09-11T05:35:13.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.728 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.728 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.728 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813709+0000", 2024-09-11T05:35:13.729 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.8130000000000003e-06 2024-09-11T05:35:13.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.729 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.729 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.729 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816702+0000", 2024-09-11T05:35:13.729 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.002992864 2024-09-11T05:35:13.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.729 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.729 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.729 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816711+0000", 2024-09-11T05:35:13.729 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1840000000000005e-06 2024-09-11T05:35:13.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.729 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822050+0000", 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.00533864 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822055+0000", 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0289999999999996e-06 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875642+0000", 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0535874220000001 2024-09-11T05:35:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875698+0000", 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5707e-05 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875783+0000", 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.5362e-05 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.732 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116725 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13355008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.732 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:35:13.732 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.797825699000001, 2024-09-11T05:35:13.732 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.06220984, 2024-09-11T05:35:13.732 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.732 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.732 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.732 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.732 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.732 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.732 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116725 2024-09-11T05:35:13.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.732 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.733 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.733 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.733 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:35:13.733 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.733 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.733 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.733 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.733 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813727+0000", 2024-09-11T05:35:13.734 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.734 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.734 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.734 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813728+0000", 2024-09-11T05:35:13.734 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8599999999999998e-07 2024-09-11T05:35:13.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.734 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.734 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.734 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813730+0000", 2024-09-11T05:35:13.734 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6730000000000001e-06 2024-09-11T05:35:13.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.734 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.735 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813743+0000", 2024-09-11T05:35:13.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2833000000000001e-05 2024-09-11T05:35:13.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.735 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.735 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.813749+0000", 2024-09-11T05:35:13.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7509999999999997e-06 2024-09-11T05:35:13.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.735 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.735 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.735 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816726+0000", 2024-09-11T05:35:13.735 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0029772090000000002 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.816730+0000", 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.518e-06 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822074+0000", 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0053444030000001 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.736 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822079+0000", 2024-09-11T05:35:13.737 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5839999999999996e-06 2024-09-11T05:35:13.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.737 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.737 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.737 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875807+0000", 2024-09-11T05:35:13.737 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0537284410000001 2024-09-11T05:35:13.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.737 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.737 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.737 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875858+0000", 2024-09-11T05:35:13.737 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0574000000000001e-05 2024-09-11T05:35:13.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.875937+0000", 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9268000000000001e-05 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116974 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13185024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.789881863000005, 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598649249999998, 2024-09-11T05:35:13.738 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.739 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.739 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.739 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.739 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.739 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.739 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116974 2024-09-11T05:35:13.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.739 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.739 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.739 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.739 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:35:13.739 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.740 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.740 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.740 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:35:13.740 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.740 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.740 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.740 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821671+0000", 2024-09-11T05:35:13.741 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3799999999999998e-07 2024-09-11T05:35:13.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.741 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.741 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.741 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821673+0000", 2024-09-11T05:35:13.741 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.722e-06 2024-09-11T05:35:13.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.741 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.742 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.742 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821686+0000", 2024-09-11T05:35:13.742 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2974e-05 2024-09-11T05:35:13.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.742 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.742 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.743 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821692+0000", 2024-09-11T05:35:13.743 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5309999999999998e-06 2024-09-11T05:35:13.743 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.743 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.743 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.743 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822089+0000", 2024-09-11T05:35:13.743 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00039611699999999998 2024-09-11T05:35:13.743 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.743 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.744 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.744 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822099+0000", 2024-09-11T05:35:13.744 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0029e-05 2024-09-11T05:35:13.744 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.744 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.744 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.744 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822803+0000", 2024-09-11T05:35:13.744 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000704507 2024-09-11T05:35:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822808+0000", 2024-09-11T05:35:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.6460000000000001e-06 2024-09-11T05:35:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881361+0000", 2024-09-11T05:35:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0585529680000001 2024-09-11T05:35:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881432+0000", 2024-09-11T05:35:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.1749999999999996e-05 2024-09-11T05:35:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881536+0000", 2024-09-11T05:35:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000103243 2024-09-11T05:35:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116975 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13209600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.789853528999998, 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.060124761, 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116975 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.747 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.748 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:35:13.748 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.748 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.748 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.748 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821699+0000", 2024-09-11T05:35:13.748 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.748 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.749 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.749 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821700+0000", 2024-09-11T05:35:13.749 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.2899999999999999e-07 2024-09-11T05:35:13.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.749 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.749 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.749 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821701+0000", 2024-09-11T05:35:13.750 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8369999999999999e-06 2024-09-11T05:35:13.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.750 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.750 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.750 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821708+0000", 2024-09-11T05:35:13.750 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5520000000000001e-06 2024-09-11T05:35:13.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.751 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.751 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821713+0000", 2024-09-11T05:35:13.751 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.091e-06 2024-09-11T05:35:13.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.752 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.752 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822135+0000", 2024-09-11T05:35:13.752 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00042166399999999998 2024-09-11T05:35:13.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.752 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.752 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.752 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822143+0000", 2024-09-11T05:35:13.752 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3089999999999996e-06 2024-09-11T05:35:13.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822820+0000", 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000677145 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822824+0000", 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.641e-06 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881569+0000", 2024-09-11T05:35:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.058744785 2024-09-11T05:35:13.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.754 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.754 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881674+0000", 2024-09-11T05:35:13.754 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000105111 2024-09-11T05:35:13.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.754 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.754 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881824+0000", 2024-09-11T05:35:13.754 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000150197 2024-09-11T05:35:13.754 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.755 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.755 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.755 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.755 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116976 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13234176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.755 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:35:13.755 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.789824550000006, 2024-09-11T05:35:13.755 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0603909900000001, 2024-09-11T05:35:13.755 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.755 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.755 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.756 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.756 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.756 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.756 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116976 2024-09-11T05:35:13.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.756 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.756 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.756 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:35:13.756 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821728+0000", 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821729+0000", 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4499999999999997e-07 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821731+0000", 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0250000000000001e-06 2024-09-11T05:35:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.758 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.758 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821737+0000", 2024-09-11T05:35:13.758 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.8839999999999997e-06 2024-09-11T05:35:13.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.758 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.758 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821743+0000", 2024-09-11T05:35:13.758 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1050000000000003e-06 2024-09-11T05:35:13.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.758 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.758 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822194+0000", 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000451574 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822203+0000", 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9449999999999999e-06 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822835+0000", 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.000632019 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.759 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.760 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822839+0000", 2024-09-11T05:35:13.760 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8229999999999997e-06 2024-09-11T05:35:13.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.760 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.760 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881861+0000", 2024-09-11T05:35:13.760 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.059021776 2024-09-11T05:35:13.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.760 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.760 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.881976+0000", 2024-09-11T05:35:13.760 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00011531699999999999 2024-09-11T05:35:13.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882119+0000", 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000143077 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116977 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13258752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.789773315999994, 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0606236920000001, 2024-09-11T05:35:13.761 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116977 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.763 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.763 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821779+0000", 2024-09-11T05:35:13.763 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.763 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.763 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.763 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821782+0000", 2024-09-11T05:35:13.763 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7719999999999999e-06 2024-09-11T05:35:13.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.763 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.763 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.763 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821785+0000", 2024-09-11T05:35:13.763 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9409999999999999e-06 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821793+0000", 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.3580000000000003e-06 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821799+0000", 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.4609999999999999e-06 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.764 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822246+0000", 2024-09-11T05:35:13.765 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044669000000000002 2024-09-11T05:35:13.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.765 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.765 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822254+0000", 2024-09-11T05:35:13.765 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1859999999999992e-06 2024-09-11T05:35:13.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822850+0000", 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005962340000001 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822854+0000", 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5310000000000002e-06 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882149+0000", 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0592958729999999 2024-09-11T05:35:13.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.767 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.767 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.767 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882253+0000", 2024-09-11T05:35:13.767 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000104058 2024-09-11T05:35:13.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.767 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.767 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.767 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882403+0000", 2024-09-11T05:35:13.767 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014958800000000001 2024-09-11T05:35:13.767 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.767 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.767 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116978 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13283328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.789743092999998, 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0608297769999999, 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116978 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.768 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.769 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.769 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:35:13.769 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.769 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.769 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:35:13.769 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.769 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.769 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821810+0000", 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3200000000000005e-07 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821813+0000", 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4499999999999998e-06 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821820+0000", 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.3669999999999999e-06 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.770 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.771 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.821825+0000", 2024-09-11T05:35:13.771 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5119999999999999e-06 2024-09-11T05:35:13.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.771 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.771 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.771 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822273+0000", 2024-09-11T05:35:13.771 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00044727900000000003 2024-09-11T05:35:13.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.771 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.771 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.771 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.822278+0000", 2024-09-11T05:35:13.771 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7529999999999998e-06 2024-09-11T05:35:13.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.772 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.772 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.772 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822865+0000", 2024-09-11T05:35:13.772 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0005861579999999 2024-09-11T05:35:13.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.772 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.772 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.772 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822868+0000", 2024-09-11T05:35:13.772 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4659999999999999e-06 2024-09-11T05:35:13.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.772 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.772 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.772 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882434+0000", 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0595660170000001 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882502+0000", 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.7442999999999998e-05 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882639+0000", 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00013779999999999999 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.773 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.774 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.774 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116980 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13332480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.774 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:35:13.774 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.788203570999997, 2024-09-11T05:35:13.774 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0598269180000002, 2024-09-11T05:35:13.774 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.774 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.774 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.774 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.774 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.774 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.774 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116980 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823349+0000", 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.775 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.776 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823350+0000", 2024-09-11T05:35:13.776 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0200000000000002e-07 2024-09-11T05:35:13.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.776 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.776 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.776 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823352+0000", 2024-09-11T05:35:13.776 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5459999999999998e-06 2024-09-11T05:35:13.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.777 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.777 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.777 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823360+0000", 2024-09-11T05:35:13.777 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.4359999999999996e-06 2024-09-11T05:35:13.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.777 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.777 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.777 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823365+0000", 2024-09-11T05:35:13.777 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3079999999999998e-06 2024-09-11T05:35:13.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.777 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.778 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.778 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823418+0000", 2024-09-11T05:35:13.778 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2735999999999998e-05 2024-09-11T05:35:13.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.778 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.778 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.778 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823423+0000", 2024-09-11T05:35:13.778 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3410000000000002e-06 2024-09-11T05:35:13.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.778 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.778 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.778 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822895+0000", 2024-09-11T05:35:13.778 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99947249000000005 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822899+0000", 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6169999999999998e-06 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.882964+0000", 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0600650840000001 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.779 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883020+0000", 2024-09-11T05:35:13.780 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5563000000000003e-05 2024-09-11T05:35:13.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.780 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.780 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.780 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883176+0000", 2024-09-11T05:35:13.780 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00015629500000000001 2024-09-11T05:35:13.780 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.780 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.780 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.780 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.780 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:116981 3.12 3:49d56f21:::rbd_data.112df73e5671.0000000000000005:1a [read 13357056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-11T05:35:13.780 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 94.788179591000002, 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0600075910000002, 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 116981 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:13.781 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823373+0000", 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.01e-07 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.782 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:13.783 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823376+0000", 2024-09-11T05:35:13.783 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0669999999999999e-06 2024-09-11T05:35:13.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.783 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.783 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:13.783 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823381+0000", 2024-09-11T05:35:13.783 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.7400000000000001e-06 2024-09-11T05:35:13.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.783 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.783 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:13.783 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823386+0000", 2024-09-11T05:35:13.783 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5349999999999998e-06 2024-09-11T05:35:13.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.784 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.784 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.784 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823447+0000", 2024-09-11T05:35:13.784 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1277000000000003e-05 2024-09-11T05:35:13.784 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.784 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.784 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.784 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:38.823456+0000", 2024-09-11T05:35:13.784 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8859999999999993e-06 2024-09-11T05:35:13.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.785 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.785 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.785 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822914+0000", 2024-09-11T05:35:13.785 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.99945797999999997 2024-09-11T05:35:13.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.785 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.785 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:13.786 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:39.822918+0000", 2024-09-11T05:35:13.786 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.5810000000000001e-06 2024-09-11T05:35:13.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.786 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.786 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:13.786 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883209+0000", 2024-09-11T05:35:13.786 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0602916899999999 2024-09-11T05:35:13.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.787 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.787 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:13.787 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883292+0000", 2024-09-11T05:35:13.787 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.2849000000000006e-05 2024-09-11T05:35:13.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:13.787 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:13.787 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:13.787 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:40.883381+0000", 2024-09-11T05:35:13.787 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.8585000000000007e-05 2024-09-11T05:35:13.788 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.788 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.788 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.788 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:13.788 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:13.788 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:13.790 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T05:35:13.829 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T05:35:13.893 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:13.894 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:13.894 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:35:13.894 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:13.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T05:35:14.004 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:14.005 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:14.005 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:35:14.005 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:35:14.005 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:14.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T05:35:14.117 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:14.117 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:35:14.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:35:14.117 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [ 2024-09-11T05:35:14.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.117 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:17179 3.6 3:61799472:::rbd_data.112d40cf1ce.0000000000000060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T05:35:14.117 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:35:14.117 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 123.46713595600001, 2024-09-11T05:35:14.117 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96607420300000002, 2024-09-11T05:35:14.117 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.117 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.118 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:35:14.118 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.118 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.118 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.118 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 17179 2024-09-11T05:35:14.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.118 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.118 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.118 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:35:14.118 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648273+0000", 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648274+0000", 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.3489999999999999e-06 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648279+0000", 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5669999999999996e-06 2024-09-11T05:35:14.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648291+0000", 2024-09-11T05:35:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1827999999999999e-05 2024-09-11T05:35:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648296+0000", 2024-09-11T05:35:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.575e-06 2024-09-11T05:35:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648358+0000", 2024-09-11T05:35:14.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1211999999999996e-05 2024-09-11T05:35:14.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648437+0000", 2024-09-11T05:35:14.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.9281000000000002e-05 2024-09-11T05:35:14.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.121 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 1", 2024-09-11T05:35:14.121 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.648549+0000", 2024-09-11T05:35:14.121 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000112038 2024-09-11T05:35:14.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.121 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:10.649256+0000", 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00070721300000000005 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614284+0000", 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.96502748599999999 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614318+0000", 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3874000000000001e-05 2024-09-11T05:35:14.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.123 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.123 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:11.614347+0000", 2024-09-11T05:35:14.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9779999999999999e-05 2024-09-11T05:35:14.123 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.123 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.123 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.123 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.123 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:146253 3.6 3:64dbadcf:::rbd_data.112d55d87bfc.0000000000000332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-11T05:35:14.123 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:35:14.123 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 88.278321047999995, 2024-09-11T05:35:14.123 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4166483809999999, 2024-09-11T05:35:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:35:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 146253 2024-09-11T05:35:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:35:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837088+0000", 2024-09-11T05:35:14.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.125 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837090+0000", 2024-09-11T05:35:14.125 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.73e-06 2024-09-11T05:35:14.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.125 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.125 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837096+0000", 2024-09-11T05:35:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3500000000000002e-06 2024-09-11T05:35:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837115+0000", 2024-09-11T05:35:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.8556e-05 2024-09-11T05:35:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837124+0000", 2024-09-11T05:35:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6739999999999992e-06 2024-09-11T05:35:14.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837184+0000", 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.9960000000000002e-05 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op must wait for map", 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.837188+0000", 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0500000000000002e-06 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840481+0000", 2024-09-11T05:35:14.127 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.0032924080000000001 2024-09-11T05:35:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:45.840497+0000", 2024-09-11T05:35:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6140000000000001e-05 2024-09-11T05:35:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850737+0000", 2024-09-11T05:35:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0102404119999999 2024-09-11T05:35:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.128 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:14.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:46.850747+0000", 2024-09-11T05:35:14.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.7969999999999995e-06 2024-09-11T05:35:14.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252495+0000", 2024-09-11T05:35:14.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.401748131 2024-09-11T05:35:14.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.129 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.129 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.129 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252636+0000", 2024-09-11T05:35:14.129 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00014118900000000001 2024-09-11T05:35:14.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:35:14.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.252737+0000", 2024-09-11T05:35:14.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00010058 2024-09-11T05:35:14.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.130 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.130 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:35:14.130 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253433+0000", 2024-09-11T05:35:14.130 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00069601999999999999 2024-09-11T05:35:14.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:35:14.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253604+0000", 2024-09-11T05:35:14.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000170824 2024-09-11T05:35:14.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:35:14.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253649+0000", 2024-09-11T05:35:14.131 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5050999999999999e-05 2024-09-11T05:35:14.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.131 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.131 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:48.253736+0000", 2024-09-11T05:35:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.7509000000000005e-05 2024-09-11T05:35:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:147298 3.6 3:652e51de:::rbd_data.112d55d87bfc.0000000000000377:head [set-alloc-hint object_size 262144 write_size 262144,write 122880~2839] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-11T05:35:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:35:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 84.881780472000003, 2024-09-11T05:35:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62981612099999995, 2024-09-11T05:35:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.132 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T05:35:14.133 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.133 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.133 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.133 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 147298 2024-09-11T05:35:14.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.133 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.133 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:35:14.133 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.133 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.133 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233629+0000", 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233630+0000", 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.5489999999999999e-06 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233637+0000", 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.272e-06 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233654+0000", 2024-09-11T05:35:14.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.6283999999999999e-05 2024-09-11T05:35:14.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233662+0000", 2024-09-11T05:35:14.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.875e-06 2024-09-11T05:35:14.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.135 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.135 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.135 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233723+0000", 2024-09-11T05:35:14.135 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.1501000000000006e-05 2024-09-11T05:35:14.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for peered", 2024-09-11T05:35:14.136 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.233732+0000", 2024-09-11T05:35:14.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0699999999999996e-06 2024-09-11T05:35:14.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.136 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862055+0000", 2024-09-11T05:35:14.136 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.62832274799999999 2024-09-11T05:35:14.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.136 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.136 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862219+0000", 2024-09-11T05:35:14.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00016404899999999999 2024-09-11T05:35:14.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "waiting for subops from 2", 2024-09-11T05:35:14.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862313+0000", 2024-09-11T05:35:14.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.4105999999999997e-05 2024-09-11T05:35:14.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.137 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.137 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "op_commit", 2024-09-11T05:35:14.137 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.862981+0000", 2024-09-11T05:35:14.137 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00066744199999999997 2024-09-11T05:35:14.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "sub_op_commit_rec", 2024-09-11T05:35:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863382+0000", 2024-09-11T05:35:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.00040111200000000002 2024-09-11T05:35:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "commit_sent", 2024-09-11T05:35:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863419+0000", 2024-09-11T05:35:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.6974000000000002e-05 2024-09-11T05:35:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:49.863445+0000", 2024-09-11T05:35:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6139000000000002e-05 2024-09-11T05:35:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151292 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:35:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.159129077000003, 2024-09-11T05:35:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054346481000000002, 2024-09-11T05:35:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151292 2024-09-11T05:35:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:35:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:35:14.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956280+0000", 2024-09-11T05:35:14.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.4000000000000002e-07 2024-09-11T05:35:14.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.141 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.141 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.141 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956283+0000", 2024-09-11T05:35:14.141 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2450000000000001e-06 2024-09-11T05:35:14.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956290+0000", 2024-09-11T05:35:14.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.0910000000000004e-06 2024-09-11T05:35:14.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.142 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.142 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956296+0000", 2024-09-11T05:35:14.142 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.947e-06 2024-09-11T05:35:14.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010460+0000", 2024-09-11T05:35:14.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054164165 2024-09-11T05:35:14.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.143 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.143 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010537+0000", 2024-09-11T05:35:14.143 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6965000000000006e-05 2024-09-11T05:35:14.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.143 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.144 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.144 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010626+0000", 2024-09-11T05:35:14.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.9628000000000003e-05 2024-09-11T05:35:14.144 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.144 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.144 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.144 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.144 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151293 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 1933312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.144 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:35:14.144 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.159106234000006, 2024-09-11T05:35:14.144 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054563858999999999, 2024-09-11T05:35:14.144 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151293 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:35:14.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956303+0000", 2024-09-11T05:35:14.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.46e-07 2024-09-11T05:35:14.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.146 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.146 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956306+0000", 2024-09-11T05:35:14.146 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2259999999999999e-06 2024-09-11T05:35:14.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956312+0000", 2024-09-11T05:35:14.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3369999999999996e-06 2024-09-11T05:35:14.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.147 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956317+0000", 2024-09-11T05:35:14.147 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.2109999999999997e-06 2024-09-11T05:35:14.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.147 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.147 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010671+0000", 2024-09-11T05:35:14.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054353830999999998 2024-09-11T05:35:14.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010757+0000", 2024-09-11T05:35:14.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.6120999999999998e-05 2024-09-11T05:35:14.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.148 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.148 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.148 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010867+0000", 2024-09-11T05:35:14.148 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.000109687 2024-09-11T05:35:14.148 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.149 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.149 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.149 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151294 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2179072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.149 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:35:14.149 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.159084371999995, 2024-09-11T05:35:14.149 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054741825000000001, 2024-09-11T05:35:14.149 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.149 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.149 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.149 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.149 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151294 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.151 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956325+0000", 2024-09-11T05:35:14.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.84e-07 2024-09-11T05:35:14.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.151 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956326+0000", 2024-09-11T05:35:14.151 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.483e-06 2024-09-11T05:35:14.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.151 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.151 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956330+0000", 2024-09-11T05:35:14.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8519999999999997e-06 2024-09-11T05:35:14.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.152 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.152 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956334+0000", 2024-09-11T05:35:14.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.4139999999999998e-06 2024-09-11T05:35:14.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.152 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.152 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010894+0000", 2024-09-11T05:35:14.152 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054560243000000001 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.010970+0000", 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6138999999999997e-05 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011067+0000", 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.6409999999999993e-05 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151295 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2392064~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:35:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.159071701000002, 2024-09-11T05:35:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054949748999999999, 2024-09-11T05:35:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151295 2024-09-11T05:35:14.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.155 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:35:14.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.155 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956337+0000", 2024-09-11T05:35:14.155 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.155 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956338+0000", 2024-09-11T05:35:14.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.23e-07 2024-09-11T05:35:14.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956339+0000", 2024-09-11T05:35:14.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.243e-06 2024-09-11T05:35:14.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.156 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.156 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956342+0000", 2024-09-11T05:35:14.156 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.473e-06 2024-09-11T05:35:14.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.157 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.157 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.157 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956345+0000", 2024-09-11T05:35:14.157 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7190000000000001e-06 2024-09-11T05:35:14.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.157 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.157 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.157 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011109+0000", 2024-09-11T05:35:14.157 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054763698999999999 2024-09-11T05:35:14.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.157 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.157 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.157 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011188+0000", 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.8887999999999994e-05 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011287+0000", 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9504000000000001e-05 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151296 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:35:14.158 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.159060590999999, 2024-09-11T05:35:14.159 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055045187000000002, 2024-09-11T05:35:14.159 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.159 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.159 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.159 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.159 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.159 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.159 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151296 2024-09-11T05:35:14.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.159 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.159 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:35:14.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.160 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956348+0000", 2024-09-11T05:35:14.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.160 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.160 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956349+0000", 2024-09-11T05:35:14.160 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0900000000000001e-07 2024-09-11T05:35:14.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.161 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956350+0000", 2024-09-11T05:35:14.161 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1209999999999999e-06 2024-09-11T05:35:14.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.161 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956353+0000", 2024-09-11T05:35:14.161 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.016e-06 2024-09-11T05:35:14.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.161 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.162 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956355+0000", 2024-09-11T05:35:14.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5509999999999998e-06 2024-09-11T05:35:14.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.162 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.162 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.162 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011303+0000", 2024-09-11T05:35:14.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.054947306000000001 2024-09-11T05:35:14.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.162 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.162 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.162 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011342+0000", 2024-09-11T05:35:14.162 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9057999999999998e-05 2024-09-11T05:35:14.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.163 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.163 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011394+0000", 2024-09-11T05:35:14.163 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1925999999999997e-05 2024-09-11T05:35:14.163 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.163 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.163 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.163 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151297 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 2818048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.164 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:35:14.164 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.159050660000005, 2024-09-11T05:35:14.164 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055238158000000002, 2024-09-11T05:35:14.164 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.164 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.164 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.164 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.164 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.164 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.164 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151297 2024-09-11T05:35:14.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.164 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:35:14.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956358+0000", 2024-09-11T05:35:14.165 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.165 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.165 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956359+0000", 2024-09-11T05:35:14.166 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:35:14.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.166 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.166 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.166 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956360+0000", 2024-09-11T05:35:14.166 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.1030000000000001e-06 2024-09-11T05:35:14.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.166 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.166 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.166 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956363+0000", 2024-09-11T05:35:14.166 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.021e-06 2024-09-11T05:35:14.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.166 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.167 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956365+0000", 2024-09-11T05:35:14.167 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4770000000000002e-06 2024-09-11T05:35:14.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.167 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011425+0000", 2024-09-11T05:35:14.167 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055059967000000001 2024-09-11T05:35:14.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.167 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.167 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011506+0000", 2024-09-11T05:35:14.167 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.1063000000000006e-05 2024-09-11T05:35:14.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.168 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.168 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011597+0000", 2024-09-11T05:35:14.168 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0299999999999999e-05 2024-09-11T05:35:14.168 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.168 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.168 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.168 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151298 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3031040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.168 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:35:14.169 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.159040693999998, 2024-09-11T05:35:14.169 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055425825999999997, 2024-09-11T05:35:14.169 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.169 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.169 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.169 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.169 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.169 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.169 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151298 2024-09-11T05:35:14.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.169 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.169 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956368+0000", 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956369+0000", 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4400000000000001e-07 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.170 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.171 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.171 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956370+0000", 2024-09-11T05:35:14.171 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.068e-06 2024-09-11T05:35:14.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.171 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.171 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.171 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956373+0000", 2024-09-11T05:35:14.171 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0419999999999998e-06 2024-09-11T05:35:14.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.171 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.171 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.171 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956375+0000", 2024-09-11T05:35:14.171 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.6800000000000002e-06 2024-09-11T05:35:14.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.172 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.172 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.172 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011631+0000", 2024-09-11T05:35:14.172 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055255116999999999 2024-09-11T05:35:14.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.172 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.172 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.172 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011703+0000", 2024-09-11T05:35:14.172 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.2554999999999999e-05 2024-09-11T05:35:14.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.172 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.172 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.173 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011794+0000", 2024-09-11T05:35:14.173 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.1119999999999995e-05 2024-09-11T05:35:14.173 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.173 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.173 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.173 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.173 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151299 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3276800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.173 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:35:14.173 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.159029391999994, 2024-09-11T05:35:14.173 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055567477999999997, 2024-09-11T05:35:14.173 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.173 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151299 2024-09-11T05:35:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:35:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:35:14.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956380+0000", 2024-09-11T05:35:14.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3099999999999998e-07 2024-09-11T05:35:14.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.175 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.175 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956382+0000", 2024-09-11T05:35:14.175 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.72e-06 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956386+0000", 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.0990000000000001e-06 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956390+0000", 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.318e-06 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.176 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011823+0000", 2024-09-11T05:35:14.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055432976000000002 2024-09-11T05:35:14.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011882+0000", 2024-09-11T05:35:14.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8656999999999998e-05 2024-09-11T05:35:14.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.177 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.177 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.177 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011947+0000", 2024-09-11T05:35:14.177 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5177000000000003e-05 2024-09-11T05:35:14.177 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.177 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.178 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.178 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.178 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151300 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3489792~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.178 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:35:14.178 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.159012924999999, 2024-09-11T05:35:14.178 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055745232999999998, 2024-09-11T05:35:14.178 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.178 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.178 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.178 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.178 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.178 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151300 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956396+0000", 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.180 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.180 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956397+0000", 2024-09-11T05:35:14.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9400000000000001e-07 2024-09-11T05:35:14.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.180 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.180 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956398+0000", 2024-09-11T05:35:14.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.869e-06 2024-09-11T05:35:14.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.180 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.180 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.180 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956404+0000", 2024-09-11T05:35:14.180 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.8370000000000002e-06 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956407+0000", 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.191e-06 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.011981+0000", 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055573553999999997 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012051+0000", 2024-09-11T05:35:14.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.9542999999999995e-05 2024-09-11T05:35:14.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.182 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.182 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012141+0000", 2024-09-11T05:35:14.182 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.0845000000000002e-05 2024-09-11T05:35:14.182 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.182 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.182 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.182 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.182 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151301 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3702784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.182 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.158997995999997, 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055834747999999997, 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151301 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.183 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956411+0000", 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2999999999999999e-07 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.184 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956413+0000", 2024-09-11T05:35:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.2810000000000001e-06 2024-09-11T05:35:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956416+0000", 2024-09-11T05:35:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.1559999999999999e-06 2024-09-11T05:35:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956418+0000", 2024-09-11T05:35:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5399999999999998e-06 2024-09-11T05:35:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012155+0000", 2024-09-11T05:35:14.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055736651999999998 2024-09-11T05:35:14.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012193+0000", 2024-09-11T05:35:14.186 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.7848000000000001e-05 2024-09-11T05:35:14.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.186 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.186 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.186 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012246+0000", 2024-09-11T05:35:14.187 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.3041000000000003e-05 2024-09-11T05:35:14.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.187 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.187 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.187 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.187 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151302 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 3915776~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.187 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:35:14.187 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.158987893000003, 2024-09-11T05:35:14.187 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056035532999999998, 2024-09-11T05:35:14.187 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.187 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.188 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.188 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.188 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.188 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.188 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151302 2024-09-11T05:35:14.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.188 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.188 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.188 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:35:14.188 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956421+0000", 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956426+0000", 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.853e-06 2024-09-11T05:35:14.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956430+0000", 2024-09-11T05:35:14.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.3699999999999999e-06 2024-09-11T05:35:14.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.190 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956432+0000", 2024-09-11T05:35:14.190 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5979999999999999e-06 2024-09-11T05:35:14.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.190 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.190 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012281+0000", 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.055848644000000003 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012358+0000", 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 7.6662000000000006e-05 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012457+0000", 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 9.9197999999999995e-05 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.191 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.192 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.192 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.192 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151303 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4128768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.192 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:35:14.192 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.158973310999997, 2024-09-11T05:35:14.192 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056186709000000001, 2024-09-11T05:35:14.192 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.192 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.192 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.192 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.192 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.193 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.193 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151303 2024-09-11T05:35:14.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.193 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:35:14.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.193 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.193 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:35:14.193 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956436+0000", 2024-09-11T05:35:14.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0800000000000001e-07 2024-09-11T05:35:14.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.194 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956437+0000", 2024-09-11T05:35:14.194 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.201e-06 2024-09-11T05:35:14.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.194 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956440+0000", 2024-09-11T05:35:14.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.96e-06 2024-09-11T05:35:14.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956443+0000", 2024-09-11T05:35:14.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5909999999999998e-06 2024-09-11T05:35:14.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.195 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.195 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.195 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012494+0000", 2024-09-11T05:35:14.195 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056051541000000003 2024-09-11T05:35:14.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012558+0000", 2024-09-11T05:35:14.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.3347000000000002e-05 2024-09-11T05:35:14.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.196 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.196 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.196 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012622+0000", 2024-09-11T05:35:14.196 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.4760999999999999e-05 2024-09-11T05:35:14.196 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.196 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.196 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.197 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.197 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151304 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.197 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:35:14.197 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.158963254, 2024-09-11T05:35:14.197 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056360149999999998, 2024-09-11T05:35:14.197 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.197 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.197 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.197 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.197 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.197 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151304 2024-09-11T05:35:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:35:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:35:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956446+0000", 2024-09-11T05:35:14.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.2700000000000001e-07 2024-09-11T05:35:14.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956447+0000", 2024-09-11T05:35:14.199 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.153e-06 2024-09-11T05:35:14.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.199 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.199 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.199 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956450+0000", 2024-09-11T05:35:14.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.9909999999999998e-06 2024-09-11T05:35:14.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956453+0000", 2024-09-11T05:35:14.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.447e-06 2024-09-11T05:35:14.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.200 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.200 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012660+0000", 2024-09-11T05:35:14.200 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056207510000000002 2024-09-11T05:35:14.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012741+0000", 2024-09-11T05:35:14.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 8.0734000000000003e-05 2024-09-11T05:35:14.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.201 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.201 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012806+0000", 2024-09-11T05:35:14.201 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 6.5087999999999998e-05 2024-09-11T05:35:14.201 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.201 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.201 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.201 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.202 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151305 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4587520~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.202 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:35:14.202 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.158953492999999, 2024-09-11T05:35:14.202 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056476407999999999, 2024-09-11T05:35:14.202 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.202 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.202 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.202 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.202 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151305 2024-09-11T05:35:14.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.203 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:35:14.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.203 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:35:14.203 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.203 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.203 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956456+0000", 2024-09-11T05:35:14.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.0800000000000001e-07 2024-09-11T05:35:14.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956457+0000", 2024-09-11T05:35:14.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.353e-06 2024-09-11T05:35:14.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.204 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.204 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956460+0000", 2024-09-11T05:35:14.204 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0060000000000001e-06 2024-09-11T05:35:14.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956463+0000", 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.452e-06 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012834+0000", 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056370917999999999 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012877+0000", 2024-09-11T05:35:14.205 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.3000999999999997e-05 2024-09-11T05:35:14.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.206 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.206 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012932+0000", 2024-09-11T05:35:14.206 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.5470000000000003e-05 2024-09-11T05:35:14.206 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.206 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.206 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.206 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151306 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 4800512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.206 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:35:14.207 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.158943512999997, 2024-09-11T05:35:14.207 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056579203000000002, 2024-09-11T05:35:14.207 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.207 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.207 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.207 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.207 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.207 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.207 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151306 2024-09-11T05:35:14.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.207 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.207 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:35:14.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:35:14.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.208 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.208 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.208 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956466+0000", 2024-09-11T05:35:14.208 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.28e-07 2024-09-11T05:35:14.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956467+0000", 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.088e-06 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956470+0000", 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.0240000000000002e-06 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956472+0000", 2024-09-11T05:35:14.209 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.4609999999999998e-06 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012953+0000", 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056480524999999997 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.012994+0000", 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.1394999999999999e-05 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.210 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013045+0000", 2024-09-11T05:35:14.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0482000000000002e-05 2024-09-11T05:35:14.211 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.211 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.211 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.211 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151307 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5013504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.211 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:35:14.211 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.158933844000003, 2024-09-11T05:35:14.211 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056680525000000002, 2024-09-11T05:35:14.211 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.211 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.211 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.212 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.212 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.212 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.212 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151307 2024-09-11T05:35:14.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.212 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.212 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:35:14.212 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.212 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.212 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:35:14.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956475+0000", 2024-09-11T05:35:14.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.1400000000000001e-07 2024-09-11T05:35:14.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.213 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.213 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.213 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956476+0000", 2024-09-11T05:35:14.213 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.0359999999999999e-06 2024-09-11T05:35:14.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956479+0000", 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.8899999999999999e-06 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956482+0000", 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.5380000000000001e-06 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013065+0000", 2024-09-11T05:35:14.214 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056582983000000003 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013104+0000", 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.9119999999999998e-05 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013156+0000", 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.1743999999999998e-05 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.216 INFO:teuthology.orchestra.run.smithi084.stdout: "description": "osd_op(client.4397.0:151308 3.8 3:168cdc89:::rbd_data.112dde02699e.0000000000000000:1d [read 5226496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T05:35:14.216 INFO:teuthology.orchestra.run.smithi084.stdout: "initiated_at": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:35:14.216 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 80.158916512999994, 2024-09-11T05:35:14.216 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056772738000000003, 2024-09-11T05:35:14.216 INFO:teuthology.orchestra.run.smithi084.stdout: "continuous": false, 2024-09-11T05:35:14.216 INFO:teuthology.orchestra.run.smithi084.stdout: "type_data": { 2024-09-11T05:35:14.216 INFO:teuthology.orchestra.run.smithi084.stdout: "flag_point": "started", 2024-09-11T05:35:14.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client_info": { 2024-09-11T05:35:14.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client": "client.4397", 2024-09-11T05:35:14.216 INFO:teuthology.orchestra.run.smithi084.stdout: "client_addr": "172.21.15.70:0/1182198885", 2024-09-11T05:35:14.216 INFO:teuthology.orchestra.run.smithi084.stdout: "tid": 151308 2024-09-11T05:35:14.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.216 INFO:teuthology.orchestra.run.smithi084.stdout: "events": [ 2024-09-11T05:35:14.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "initiated", 2024-09-11T05:35:14.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:35:14.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "header_read", 2024-09-11T05:35:14.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:35:14.217 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0 2024-09-11T05:35:14.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.217 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.217 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "throttled", 2024-09-11T05:35:14.217 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956493+0000", 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.2599999999999998e-07 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "all_read", 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956495+0000", 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 1.9750000000000001e-06 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "dispatched", 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956499+0000", 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 4.5179999999999998e-06 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.218 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "queued_for_pg", 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:53.956502+0000", 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 2.7530000000000002e-06 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "reached_pg", 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013177+0000", 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 0.056674536999999997 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "started", 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013215+0000", 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 3.8578999999999998e-05 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-11T05:35:14.219 INFO:teuthology.orchestra.run.smithi084.stdout: "event": "done", 2024-09-11T05:35:14.220 INFO:teuthology.orchestra.run.smithi084.stdout: "time": "2024-09-11T05:33:54.013265+0000", 2024-09-11T05:35:14.220 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 5.0049999999999997e-05 2024-09-11T05:35:14.220 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.220 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.220 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.220 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-11T05:35:14.220 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-11T05:35:14.220 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:14.221 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T05:35:14.325 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:14.325 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:14.325 INFO:teuthology.orchestra.run.smithi084.stdout: "num_ops": 0 2024-09-11T05:35:14.326 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:14.334 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T05:35:14.436 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:14.437 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [], 2024-09-11T05:35:14.437 INFO:teuthology.orchestra.run.smithi084.stdout: "complaint_time": 30, 2024-09-11T05:35:14.437 INFO:teuthology.orchestra.run.smithi084.stdout: "num_blocked_ops": 0 2024-09-11T05:35:14.437 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:14.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T05:35:14.547 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-11T05:35:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: "size": 20, 2024-09-11T05:35:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: "duration": 600, 2024-09-11T05:35:14.547 INFO:teuthology.orchestra.run.smithi084.stdout: "ops": [] 2024-09-11T05:35:14.547 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-11T05:35:15.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T05:35:16.637 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T05:35:16.653 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T05:35:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T05:35:17.993 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-11T05:35:17.993 INFO:tasks.thrashosds.thrasher:Adding osd 1 2024-09-11T05:35:17.993 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 1 2024-09-11T05:35:18.285 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-11T05:35:18.284+0000 7fc03b8fe640 -1 mon.a@0(leader).osd e151 definitely_dead 0 2024-09-11T05:35:18.644 INFO:teuthology.orchestra.run.smithi070.stderr:marked in osd.1. 2024-09-11T05:35:18.662 INFO:tasks.thrashosds.thrasher:Added osd 1 2024-09-11T05:35:18.662 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-11T05:35:18.662 INFO:tasks.thrashosds.thrasher:Adding osd 4 2024-09-11T05:35:18.662 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 4 2024-09-11T05:35:18.952 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-11T05:35:18.952+0000 7fc03b8fe640 -1 mon.a@0(leader).osd e152 definitely_dead 0 2024-09-11T05:35:19.648 INFO:teuthology.orchestra.run.smithi070.stderr:marked in osd.4. 2024-09-11T05:35:19.667 INFO:tasks.thrashosds.thrasher:Added osd 4 2024-09-11T05:35:19.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-11T05:35:19.780 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a: {} 2024-09-11T05:35:19.780 INFO:teuthology.orchestra.run.smithi070.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T05:35:19.790 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b: {} 2024-09-11T05:35:19.790 INFO:teuthology.orchestra.run.smithi070.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T05:35:19.798 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c: {} 2024-09-11T05:35:19.798 INFO:teuthology.orchestra.run.smithi070.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T05:35:19.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T05:35:20.624 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T05:35:20.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-11T05:35:21.635 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-11T05:35:21.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T05:35:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T05:35:22.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-11T05:35:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-11T05:35:23.648 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T05:35:24.675 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T05:35:24.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-11T05:35:25.679 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-11T05:35:25.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T05:35:26.682 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T05:35:26.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-11T05:35:27.689 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-11T05:35:27.712 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-11T05:35:28.691 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.5 to 1 (10000) 2024-09-11T05:35:28.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-11T05:35:29.708 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-11T05:35:29.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-11T05:35:30.714 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.6 to 1 (10000) 2024-09-11T05:35:30.729 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-11T05:35:31.720 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-11T05:35:31.736 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-11T05:35:32.722 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.7 to 1 (10000) 2024-09-11T05:35:32.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-11T05:35:33.727 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-11T05:35:33.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-11T05:35:34.734 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.4 to 1 (10000) 2024-09-11T05:35:34.749 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-11T05:35:35.744 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-11T05:35:35.758 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-11T05:35:35.759 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-11T05:35:35.759 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-11T05:35:35.759 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-11T05:35:35.759 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T05:35:35.759 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T05:35:36.039 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:35:36.040 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":169,"fsid":"eb5ff116-0384-4170-94d3-d3ddcb9c254f","created":"2024-09-11T05:32:25.817911+0000","modified":"2024-09-11T05:35:35.740715+0000","last_up_change":"2024-09-11T05:34:28.684725+0000","last_in_change":"2024-09-11T05:35:19.644002+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T05:32:37.977484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T05:32:43.780723+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-11T05:32:53.728195+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":44,"snap_epoch":145,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef7487b-9326-4062-8fe4-ef39030252bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6819","nonce":4108497907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6821","nonce":4108497907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6825","nonce":4108497907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6823","nonce":4108497907}]},"public_addr":"172.21.15.70:6819/4108497907","cluster_addr":"172.21.15.70:6821/4108497907","heartbeat_back_addr":"172.21.15.70:6825/4108497907","heartbeat_front_addr":"172.21.15.70:6823/4108497907","state":["exists","up"]},{"osd":1,"uuid":"3e0d8348-6e1b-4d63-b0f1-c20d90d73760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6801","nonce":3979396531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6803","nonce":3979396531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6807","nonce":3979396531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6805","nonce":3979396531}]},"public_addr":"172.21.15.70:6801/3979396531","cluster_addr":"172.21.15.70:6803/3979396531","heartbeat_back_addr":"172.21.15.70:6807/3979396531","heartbeat_front_addr":"172.21.15.70:6805/3979396531","state":["exists","up"]},{"osd":2,"uuid":"38bbb42f-85e2-4064-8f55-e0385aff07d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6811","nonce":4053894977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6813","nonce":4053894977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6817","nonce":4053894977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6815","nonce":4053894977}]},"public_addr":"172.21.15.70:6811/4053894977","cluster_addr":"172.21.15.70:6813/4053894977","heartbeat_back_addr":"172.21.15.70:6817/4053894977","heartbeat_front_addr":"172.21.15.70:6815/4053894977","state":["exists","up"]},{"osd":3,"uuid":"e96ca529-f3b3-4f7e-bd59-1e9872a5efab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6827","nonce":2067624829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6829","nonce":2067624829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6833","nonce":2067624829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6831","nonce":2067624829}]},"public_addr":"172.21.15.70:6827/2067624829","cluster_addr":"172.21.15.70:6829/2067624829","heartbeat_back_addr":"172.21.15.70:6833/2067624829","heartbeat_front_addr":"172.21.15.70:6831/2067624829","state":["exists","up"]},{"osd":4,"uuid":"dbbde660-d90e-4e02-9a01-16b0f76aa2b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":74,"up_from":103,"up_thru":156,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":4108789898},{"type":"v1","addr":"172.21.15.84:6817","nonce":4108789898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4108789898},{"type":"v1","addr":"172.21.15.84:6819","nonce":4108789898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4108789898},{"type":"v1","addr":"172.21.15.84:6823","nonce":4108789898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4108789898},{"type":"v1","addr":"172.21.15.84:6821","nonce":4108789898}]},"public_addr":"172.21.15.84:6817/4108789898","cluster_addr":"172.21.15.84:6819/4108789898","heartbeat_back_addr":"172.21.15.84:6823/4108789898","heartbeat_front_addr":"172.21.15.84:6821/4108789898","state":["exists","up"]},{"osd":5,"uuid":"2dc1a002-3ec0-4b4d-b84d-e684fa8a9131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6825","nonce":2732588656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6827","nonce":2732588656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6831","nonce":2732588656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6829","nonce":2732588656}]},"public_addr":"172.21.15.84:6825/2732588656","cluster_addr":"172.21.15.84:6827/2732588656","heartbeat_back_addr":"172.21.15.84:6831/2732588656","heartbeat_front_addr":"172.21.15.84:6829/2732588656","state":["exists","up"]},{"osd":6,"uuid":"4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6801","nonce":372011645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6803","nonce":372011645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6807","nonce":372011645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6805","nonce":372011645}]},"public_addr":"172.21.15.84:6801/372011645","cluster_addr":"172.21.15.84:6803/372011645","heartbeat_back_addr":"172.21.15.84:6807/372011645","heartbeat_front_addr":"172.21.15.84:6805/372011645","state":["exists","up"]},{"osd":7,"uuid":"5fef4450-317c-4e1f-b05b-80740b9538f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6809","nonce":583221652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6811","nonce":583221652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6815","nonce":583221652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6813","nonce":583221652}]},"public_addr":"172.21.15.84:6809/583221652","cluster_addr":"172.21.15.84:6811/583221652","heartbeat_back_addr":"172.21.15.84:6815/583221652","heartbeat_front_addr":"172.21.15.84:6813/583221652","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.130019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.339373+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.204705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.075490+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.279790+0000","dead_epoch":76},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.287168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:34.320448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:34.838001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:35:36.053 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T05:35:36.053 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T05:35:36.330 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:35:36.330 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":169,"fsid":"eb5ff116-0384-4170-94d3-d3ddcb9c254f","created":"2024-09-11T05:32:25.817911+0000","modified":"2024-09-11T05:35:35.740715+0000","last_up_change":"2024-09-11T05:34:28.684725+0000","last_in_change":"2024-09-11T05:35:19.644002+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T05:32:37.977484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T05:32:43.780723+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-11T05:32:53.728195+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":44,"snap_epoch":145,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef7487b-9326-4062-8fe4-ef39030252bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6819","nonce":4108497907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6821","nonce":4108497907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6825","nonce":4108497907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6823","nonce":4108497907}]},"public_addr":"172.21.15.70:6819/4108497907","cluster_addr":"172.21.15.70:6821/4108497907","heartbeat_back_addr":"172.21.15.70:6825/4108497907","heartbeat_front_addr":"172.21.15.70:6823/4108497907","state":["exists","up"]},{"osd":1,"uuid":"3e0d8348-6e1b-4d63-b0f1-c20d90d73760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6801","nonce":3979396531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6803","nonce":3979396531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6807","nonce":3979396531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6805","nonce":3979396531}]},"public_addr":"172.21.15.70:6801/3979396531","cluster_addr":"172.21.15.70:6803/3979396531","heartbeat_back_addr":"172.21.15.70:6807/3979396531","heartbeat_front_addr":"172.21.15.70:6805/3979396531","state":["exists","up"]},{"osd":2,"uuid":"38bbb42f-85e2-4064-8f55-e0385aff07d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6811","nonce":4053894977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6813","nonce":4053894977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6817","nonce":4053894977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6815","nonce":4053894977}]},"public_addr":"172.21.15.70:6811/4053894977","cluster_addr":"172.21.15.70:6813/4053894977","heartbeat_back_addr":"172.21.15.70:6817/4053894977","heartbeat_front_addr":"172.21.15.70:6815/4053894977","state":["exists","up"]},{"osd":3,"uuid":"e96ca529-f3b3-4f7e-bd59-1e9872a5efab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6827","nonce":2067624829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6829","nonce":2067624829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6833","nonce":2067624829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6831","nonce":2067624829}]},"public_addr":"172.21.15.70:6827/2067624829","cluster_addr":"172.21.15.70:6829/2067624829","heartbeat_back_addr":"172.21.15.70:6833/2067624829","heartbeat_front_addr":"172.21.15.70:6831/2067624829","state":["exists","up"]},{"osd":4,"uuid":"dbbde660-d90e-4e02-9a01-16b0f76aa2b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":74,"up_from":103,"up_thru":156,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":4108789898},{"type":"v1","addr":"172.21.15.84:6817","nonce":4108789898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4108789898},{"type":"v1","addr":"172.21.15.84:6819","nonce":4108789898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4108789898},{"type":"v1","addr":"172.21.15.84:6823","nonce":4108789898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4108789898},{"type":"v1","addr":"172.21.15.84:6821","nonce":4108789898}]},"public_addr":"172.21.15.84:6817/4108789898","cluster_addr":"172.21.15.84:6819/4108789898","heartbeat_back_addr":"172.21.15.84:6823/4108789898","heartbeat_front_addr":"172.21.15.84:6821/4108789898","state":["exists","up"]},{"osd":5,"uuid":"2dc1a002-3ec0-4b4d-b84d-e684fa8a9131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6825","nonce":2732588656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6827","nonce":2732588656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6831","nonce":2732588656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6829","nonce":2732588656}]},"public_addr":"172.21.15.84:6825/2732588656","cluster_addr":"172.21.15.84:6827/2732588656","heartbeat_back_addr":"172.21.15.84:6831/2732588656","heartbeat_front_addr":"172.21.15.84:6829/2732588656","state":["exists","up"]},{"osd":6,"uuid":"4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6801","nonce":372011645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6803","nonce":372011645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6807","nonce":372011645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6805","nonce":372011645}]},"public_addr":"172.21.15.84:6801/372011645","cluster_addr":"172.21.15.84:6803/372011645","heartbeat_back_addr":"172.21.15.84:6807/372011645","heartbeat_front_addr":"172.21.15.84:6805/372011645","state":["exists","up"]},{"osd":7,"uuid":"5fef4450-317c-4e1f-b05b-80740b9538f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6809","nonce":583221652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6811","nonce":583221652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6815","nonce":583221652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6813","nonce":583221652}]},"public_addr":"172.21.15.84:6809/583221652","cluster_addr":"172.21.15.84:6811/583221652","heartbeat_back_addr":"172.21.15.84:6815/583221652","heartbeat_front_addr":"172.21.15.84:6813/583221652","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.130019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.339373+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.204705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.075490+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.279790+0000","dead_epoch":76},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.287168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:34.320448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:34.838001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:35:36.343 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T05:35:36.343 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T05:35:36.344 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T05:35:36.344 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T05:35:36.345 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T05:35:36.345 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T05:35:36.345 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T05:35:36.346 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T05:35:36.588 INFO:teuthology.orchestra.run.smithi070.stdout:60129542183 2024-09-11T05:35:36.588 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T05:35:36.589 INFO:teuthology.orchestra.run.smithi070.stdout:60129542182 2024-09-11T05:35:36.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T05:35:36.590 INFO:teuthology.orchestra.run.smithi070.stdout:60129542182 2024-09-11T05:35:36.590 INFO:teuthology.orchestra.run.smithi070.stdout:60129542184 2024-09-11T05:35:36.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T05:35:36.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T05:35:36.592 INFO:teuthology.orchestra.run.smithi070.stdout:60129542183 2024-09-11T05:35:36.593 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T05:35:36.594 INFO:teuthology.orchestra.run.smithi070.stdout:60129542184 2024-09-11T05:35:36.594 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T05:35:36.595 INFO:teuthology.orchestra.run.smithi070.stdout:60129542182 2024-09-11T05:35:36.595 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T05:35:36.596 INFO:teuthology.orchestra.run.smithi070.stdout:442381631504 2024-09-11T05:35:36.596 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T05:35:37.212 INFO:teuthology.orchestra.run.smithi070.stdout:60129542182 2024-09-11T05:35:37.219 INFO:teuthology.orchestra.run.smithi070.stdout:60129542181 2024-09-11T05:35:37.224 INFO:teuthology.orchestra.run.smithi070.stdout:60129542183 2024-09-11T05:35:37.225 INFO:teuthology.orchestra.run.smithi070.stdout:60129542182 2024-09-11T05:35:37.232 INFO:teuthology.orchestra.run.smithi070.stdout:60129542181 2024-09-11T05:35:37.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542182 for osd.0 2024-09-11T05:35:37.235 INFO:teuthology.orchestra.run.smithi070.stdout:442381631503 2024-09-11T05:35:37.235 INFO:teuthology.orchestra.run.smithi070.stdout:60129542181 2024-09-11T05:35:37.243 INFO:teuthology.orchestra.run.smithi070.stdout:60129542183 2024-09-11T05:35:37.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542182 got 60129542181 for osd.1 2024-09-11T05:35:37.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542182 for osd.3 2024-09-11T05:35:37.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542183 for osd.6 2024-09-11T05:35:37.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542182 got 60129542181 for osd.2 2024-09-11T05:35:37.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 442381631504 got 442381631503 for osd.4 2024-09-11T05:35:37.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542182 got 60129542181 for osd.5 2024-09-11T05:35:37.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542183 for osd.7 2024-09-11T05:35:38.236 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T05:35:38.246 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T05:35:38.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T05:35:38.252 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T05:35:38.254 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T05:35:38.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T05:35:38.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T05:35:38.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T05:35:38.801 INFO:teuthology.orchestra.run.smithi070.stdout:60129542183 2024-09-11T05:35:38.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542183 for osd.0 2024-09-11T05:35:38.821 DEBUG:teuthology.parallel:result is None 2024-09-11T05:35:38.840 INFO:teuthology.orchestra.run.smithi070.stdout:60129542184 2024-09-11T05:35:38.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542184 for osd.6 2024-09-11T05:35:38.854 DEBUG:teuthology.parallel:result is None 2024-09-11T05:35:38.867 INFO:teuthology.orchestra.run.smithi070.stdout:60129542182 2024-09-11T05:35:38.880 INFO:teuthology.orchestra.run.smithi070.stdout:60129542183 2024-09-11T05:35:38.880 INFO:teuthology.orchestra.run.smithi070.stdout:442381631504 2024-09-11T05:35:38.881 INFO:teuthology.orchestra.run.smithi070.stdout:60129542182 2024-09-11T05:35:38.881 INFO:teuthology.orchestra.run.smithi070.stdout:60129542182 2024-09-11T05:35:38.884 INFO:teuthology.orchestra.run.smithi070.stdout:60129542184 2024-09-11T05:35:38.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542182 got 60129542182 for osd.1 2024-09-11T05:35:38.886 DEBUG:teuthology.parallel:result is None 2024-09-11T05:35:38.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542183 for osd.3 2024-09-11T05:35:38.898 DEBUG:teuthology.parallel:result is None 2024-09-11T05:35:38.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542182 got 60129542182 for osd.2 2024-09-11T05:35:38.900 DEBUG:teuthology.parallel:result is None 2024-09-11T05:35:38.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542184 for osd.7 2024-09-11T05:35:38.901 DEBUG:teuthology.parallel:result is None 2024-09-11T05:35:38.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 442381631504 got 442381631504 for osd.4 2024-09-11T05:35:38.903 DEBUG:teuthology.parallel:result is None 2024-09-11T05:35:38.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542182 got 60129542182 for osd.5 2024-09-11T05:35:38.905 DEBUG:teuthology.parallel:result is None 2024-09-11T05:35:38.905 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T05:35:38.905 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:35:39.221 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:35:39.222 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:35:39.233 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-09-11T05:35:37.974498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":121,"num_read":220833,"num_read_kb":578688,"num_write":22011,"num_write_kb":318169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6665,"num_bytes_recovered":182406169,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19699,"ondisk_log_size":19699,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436496,"kb_used_data":17000,"kb_used_omap":15,"kb_used_meta":419312,"kb_avail":754538224,"statfs":{"total":773094113280,"available":772647141376,"internally_reserved":0,"allocated":17408000,"data_stored":9008524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15611,"internal_metadata":429376261},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-129,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.252097"},"pg_stats":[{"pgid":"3.1f","version":"147'611","reported_seq":7854,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361610+0000","last_change":"2024-09-11T05:35:22.638115+0000","last_active":"2024-09-11T05:35:36.361610+0000","last_peered":"2024-09-11T05:35:36.361610+0000","last_clean":"2024-09-11T05:35:36.361610+0000","last_became_active":"2024-09-11T05:35:22.637032+0000","last_became_peered":"2024-09-11T05:35:22.637032+0000","last_unstale":"2024-09-11T05:35:36.361610+0000","last_undegraded":"2024-09-11T05:35:36.361610+0000","last_fullsized":"2024-09-11T05:35:36.361610+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:31.476738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00245933,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7747,"num_read_kb":22584,"num_write":761,"num_write_kb":11145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":285,"num_bytes_recovered":4324286,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"139'296","reported_seq":3772,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361548+0000","last_change":"2024-09-11T05:35:10.630226+0000","last_active":"2024-09-11T05:35:36.361548+0000","last_peered":"2024-09-11T05:35:36.361548+0000","last_clean":"2024-09-11T05:35:36.361548+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:35:36.361548+0000","last_undegraded":"2024-09-11T05:35:36.361548+0000","last_fullsized":"2024-09-11T05:35:36.361548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:57:10.083669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014246319999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":3027,"num_read_kb":23842,"num_write":231,"num_write_kb":6198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"144'910","reported_seq":21667,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819869+0000","last_change":"2024-09-11T05:35:28.699205+0000","last_active":"2024-09-11T05:35:35.819869+0000","last_peered":"2024-09-11T05:35:35.819869+0000","last_clean":"2024-09-11T05:35:35.819869+0000","last_became_active":"2024-09-11T05:35:28.696723+0000","last_became_peered":"2024-09-11T05:35:28.696723+0000","last_unstale":"2024-09-11T05:35:35.819869+0000","last_undegraded":"2024-09-11T05:35:35.819869+0000","last_fullsized":"2024-09-11T05:35:35.819869+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:40.890246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003253822,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":16637,"num_read_kb":25385,"num_write":1112,"num_write_kb":7409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":6593091,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"147'601","reported_seq":7773,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743694+0000","last_change":"2024-09-11T05:35:22.638770+0000","last_active":"2024-09-11T05:35:35.743694+0000","last_peered":"2024-09-11T05:35:35.743694+0000","last_clean":"2024-09-11T05:35:35.743694+0000","last_became_active":"2024-09-11T05:35:22.636725+0000","last_became_peered":"2024-09-11T05:35:22.636725+0000","last_unstale":"2024-09-11T05:35:35.743694+0000","last_undegraded":"2024-09-11T05:35:35.743694+0000","last_fullsized":"2024-09-11T05:35:35.743694+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:53:13.907056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028264560000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9012,"num_read_kb":27646,"num_write":675,"num_write_kb":16439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":13219858,"num_keys_recovered":56,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"140'579","reported_seq":7861,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944261+0000","last_change":"2024-09-11T05:35:23.636456+0000","last_active":"2024-09-11T05:35:35.944261+0000","last_peered":"2024-09-11T05:35:35.944261+0000","last_clean":"2024-09-11T05:35:35.944261+0000","last_became_active":"2024-09-11T05:35:23.634303+0000","last_became_peered":"2024-09-11T05:35:23.634303+0000","last_unstale":"2024-09-11T05:35:35.944261+0000","last_undegraded":"2024-09-11T05:35:35.944261+0000","last_fullsized":"2024-09-11T05:35:35.944261+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:01.958896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049355689999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":7366,"num_read_kb":17763,"num_write":665,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":421,"num_bytes_recovered":7543883,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"136'445","reported_seq":5277,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743659+0000","last_change":"2024-09-11T05:35:22.638768+0000","last_active":"2024-09-11T05:35:35.743659+0000","last_peered":"2024-09-11T05:35:35.743659+0000","last_clean":"2024-09-11T05:35:35.743659+0000","last_became_active":"2024-09-11T05:35:22.636807+0000","last_became_peered":"2024-09-11T05:35:22.636807+0000","last_unstale":"2024-09-11T05:35:35.743659+0000","last_undegraded":"2024-09-11T05:35:35.743659+0000","last_fullsized":"2024-09-11T05:35:35.743659+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:29.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017105359999999999,"stat_sum":{"num_bytes":19,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":6,"num_read":5410,"num_read_kb":14252,"num_write":483,"num_write_kb":12836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":327,"num_bytes_recovered":4853026,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"139'1101","reported_seq":11036,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944244+0000","last_change":"2024-09-11T05:35:22.634971+0000","last_active":"2024-09-11T05:35:35.944244+0000","last_peered":"2024-09-11T05:35:35.944244+0000","last_clean":"2024-09-11T05:35:35.944244+0000","last_became_active":"2024-09-11T05:35:22.632741+0000","last_became_peered":"2024-09-11T05:35:22.632741+0000","last_unstale":"2024-09-11T05:35:35.944244+0000","last_undegraded":"2024-09-11T05:35:35.944244+0000","last_fullsized":"2024-09-11T05:35:35.944244+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:27.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030616850000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":13726,"num_read_kb":13435,"num_write":1662,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":1269861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"140'517","reported_seq":3166,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361418+0000","last_change":"2024-09-11T05:35:10.632188+0000","last_active":"2024-09-11T05:35:36.361418+0000","last_peered":"2024-09-11T05:35:36.361418+0000","last_clean":"2024-09-11T05:35:36.361418+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:35:36.361418+0000","last_undegraded":"2024-09-11T05:35:36.361418+0000","last_fullsized":"2024-09-11T05:35:36.361418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:44.971488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027595950000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":3338,"num_read_kb":10070,"num_write":595,"num_write_kb":6210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"139'1157","reported_seq":3344,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361628+0000","last_change":"2024-09-11T05:35:10.631584+0000","last_active":"2024-09-11T05:35:36.361628+0000","last_peered":"2024-09-11T05:35:36.361628+0000","last_clean":"2024-09-11T05:35:36.361628+0000","last_became_active":"2024-09-11T05:34:54.790407+0000","last_became_peered":"2024-09-11T05:34:54.790407+0000","last_unstale":"2024-09-11T05:35:36.361628+0000","last_undegraded":"2024-09-11T05:35:36.361628+0000","last_fullsized":"2024-09-11T05:35:36.361628+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1157,"log_dups_size":0,"ondisk_log_size":1157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:22.948505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022982459999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5158,"num_read_kb":28626,"num_write":1706,"num_write_kb":20682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":292,"num_bytes_recovered":48701806,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"142'286","reported_seq":3645,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.363325+0000","last_change":"2024-09-11T05:35:27.700408+0000","last_active":"2024-09-11T05:35:36.363325+0000","last_peered":"2024-09-11T05:35:36.363325+0000","last_clean":"2024-09-11T05:35:36.363325+0000","last_became_active":"2024-09-11T05:35:27.699049+0000","last_became_peered":"2024-09-11T05:35:27.699049+0000","last_unstale":"2024-09-11T05:35:36.363325+0000","last_undegraded":"2024-09-11T05:35:36.363325+0000","last_fullsized":"2024-09-11T05:35:36.363325+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:56.992530+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00066517799999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2863,"num_read_kb":14884,"num_write":221,"num_write_kb":7375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":1456269,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"141'725","reported_seq":3846,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743446+0000","last_change":"2024-09-11T05:35:10.633716+0000","last_active":"2024-09-11T05:35:35.743446+0000","last_peered":"2024-09-11T05:35:35.743446+0000","last_clean":"2024-09-11T05:35:35.743446+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:35:35.743446+0000","last_undegraded":"2024-09-11T05:35:35.743446+0000","last_fullsized":"2024-09-11T05:35:35.743446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:59.138792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079156780000000006,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5390,"num_read_kb":12737,"num_write":875,"num_write_kb":9766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"142'369","reported_seq":12008,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819737+0000","last_change":"2024-09-11T05:35:28.700196+0000","last_active":"2024-09-11T05:35:35.819737+0000","last_peered":"2024-09-11T05:35:35.819737+0000","last_clean":"2024-09-11T05:35:35.819737+0000","last_became_active":"2024-09-11T05:35:28.697994+0000","last_became_peered":"2024-09-11T05:35:28.697994+0000","last_unstale":"2024-09-11T05:35:35.819737+0000","last_undegraded":"2024-09-11T05:35:35.819737+0000","last_fullsized":"2024-09-11T05:35:35.819737+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:53.037666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015799760000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5068,"num_read_kb":14759,"num_write":300,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":7503668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819881+0000","last_change":"2024-09-11T05:34:50.627854+0000","last_active":"2024-09-11T05:35:35.819881+0000","last_peered":"2024-09-11T05:35:35.819881+0000","last_clean":"2024-09-11T05:35:35.819881+0000","last_became_active":"2024-09-11T05:34:50.627529+0000","last_became_peered":"2024-09-11T05:34:50.627529+0000","last_unstale":"2024-09-11T05:35:35.819881+0000","last_undegraded":"2024-09-11T05:35:35.819881+0000","last_fullsized":"2024-09-11T05:35:35.819881+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:35.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"147'703","reported_seq":4450,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944385+0000","last_change":"2024-09-11T05:35:22.635026+0000","last_active":"2024-09-11T05:35:35.944385+0000","last_peered":"2024-09-11T05:35:35.944385+0000","last_clean":"2024-09-11T05:35:35.944385+0000","last_became_active":"2024-09-11T05:35:22.632683+0000","last_became_peered":"2024-09-11T05:35:22.632683+0000","last_unstale":"2024-09-11T05:35:35.944385+0000","last_undegraded":"2024-09-11T05:35:35.944385+0000","last_fullsized":"2024-09-11T05:35:35.944385+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:50:23.986237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057885200000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5183,"num_read_kb":4253,"num_write":904,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":463,"num_bytes_recovered":1655489,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944376+0000","last_change":"2024-09-11T05:35:20.631589+0000","last_active":"2024-09-11T05:35:35.944376+0000","last_peered":"2024-09-11T05:35:35.944376+0000","last_clean":"2024-09-11T05:35:35.944376+0000","last_became_active":"2024-09-11T05:35:20.631241+0000","last_became_peered":"2024-09-11T05:35:20.631241+0000","last_unstale":"2024-09-11T05:35:35.944376+0000","last_undegraded":"2024-09-11T05:35:35.944376+0000","last_fullsized":"2024-09-11T05:35:35.944376+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:15.796354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"140'467","reported_seq":6364,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944331+0000","last_change":"2024-09-11T05:35:22.635052+0000","last_active":"2024-09-11T05:35:35.944331+0000","last_peered":"2024-09-11T05:35:35.944331+0000","last_clean":"2024-09-11T05:35:35.944331+0000","last_became_active":"2024-09-11T05:35:22.632436+0000","last_became_peered":"2024-09-11T05:35:22.632436+0000","last_unstale":"2024-09-11T05:35:35.944331+0000","last_undegraded":"2024-09-11T05:35:35.944331+0000","last_fullsized":"2024-09-11T05:35:35.944331+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:45.444932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027050960000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6977,"num_read_kb":16019,"num_write":349,"num_write_kb":6385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":1715668,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":102,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819877+0000","last_change":"2024-09-11T05:35:20.638832+0000","last_active":"2024-09-11T05:35:35.819877+0000","last_peered":"2024-09-11T05:35:35.819877+0000","last_clean":"2024-09-11T05:35:35.819877+0000","last_became_active":"2024-09-11T05:35:20.638478+0000","last_became_peered":"2024-09-11T05:35:20.638478+0000","last_unstale":"2024-09-11T05:35:35.819877+0000","last_undegraded":"2024-09-11T05:35:35.819877+0000","last_fullsized":"2024-09-11T05:35:35.819877+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:12.803640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"147'1631","reported_seq":8207,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361298+0000","last_change":"2024-09-11T05:35:10.631545+0000","last_active":"2024-09-11T05:35:36.361298+0000","last_peered":"2024-09-11T05:35:36.361298+0000","last_clean":"2024-09-11T05:35:36.361298+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:35:36.361298+0000","last_undegraded":"2024-09-11T05:35:36.361298+0000","last_fullsized":"2024-09-11T05:35:36.361298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1631,"log_dups_size":0,"ondisk_log_size":1631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:07.737928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026555530000000002,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":15252,"num_read_kb":37939,"num_write":2291,"num_write_kb":19413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":325,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361624+0000","last_change":"2024-09-11T05:34:44.768103+0000","last_active":"2024-09-11T05:35:36.361624+0000","last_peered":"2024-09-11T05:35:36.361624+0000","last_clean":"2024-09-11T05:35:36.361624+0000","last_became_active":"2024-09-11T05:34:44.767862+0000","last_became_peered":"2024-09-11T05:34:44.767862+0000","last_unstale":"2024-09-11T05:35:36.361624+0000","last_undegraded":"2024-09-11T05:35:36.361624+0000","last_fullsized":"2024-09-11T05:35:36.361624+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:15:05.574617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"144'845","reported_seq":12664,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.363156+0000","last_change":"2024-09-11T05:35:27.700438+0000","last_active":"2024-09-11T05:35:36.363156+0000","last_peered":"2024-09-11T05:35:36.363156+0000","last_clean":"2024-09-11T05:35:36.363156+0000","last_became_active":"2024-09-11T05:35:27.699111+0000","last_became_peered":"2024-09-11T05:35:27.699111+0000","last_unstale":"2024-09-11T05:35:36.363156+0000","last_undegraded":"2024-09-11T05:35:36.363156+0000","last_fullsized":"2024-09-11T05:35:36.363156+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:45.051639+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0034996329999999998,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":15193,"num_read_kb":18227,"num_write":823,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"147'676","reported_seq":4374,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743567+0000","last_change":"2024-09-11T05:35:10.632354+0000","last_active":"2024-09-11T05:35:35.743567+0000","last_peered":"2024-09-11T05:35:35.743567+0000","last_clean":"2024-09-11T05:35:35.743567+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:35:35.743567+0000","last_undegraded":"2024-09-11T05:35:35.743567+0000","last_fullsized":"2024-09-11T05:35:35.743567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:36.049428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0073602759999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4311,"num_read_kb":22872,"num_write":719,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":210,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819683+0000","last_change":"2024-09-11T05:35:28.700422+0000","last_active":"2024-09-11T05:35:35.819683+0000","last_peered":"2024-09-11T05:35:35.819683+0000","last_clean":"2024-09-11T05:35:35.819683+0000","last_became_active":"2024-09-11T05:35:28.700119+0000","last_became_peered":"2024-09-11T05:35:28.700119+0000","last_unstale":"2024-09-11T05:35:35.819683+0000","last_undegraded":"2024-09-11T05:35:35.819683+0000","last_fullsized":"2024-09-11T05:35:35.819683+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:03.431125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"146'345","reported_seq":2882,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361248+0000","last_change":"2024-09-11T05:35:11.642354+0000","last_active":"2024-09-11T05:35:36.361248+0000","last_peered":"2024-09-11T05:35:36.361248+0000","last_clean":"2024-09-11T05:35:36.361248+0000","last_became_active":"2024-09-11T05:35:11.635099+0000","last_became_peered":"2024-09-11T05:35:11.635099+0000","last_unstale":"2024-09-11T05:35:36.361248+0000","last_undegraded":"2024-09-11T05:35:36.361248+0000","last_fullsized":"2024-09-11T05:35:36.361248+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:37:53.460954+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0054654079999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2061,"num_read_kb":16420,"num_write":311,"num_write_kb":9397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3451521,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.744863+0000","last_change":"2024-09-11T05:35:08.633295+0000","last_active":"2024-09-11T05:35:35.744863+0000","last_peered":"2024-09-11T05:35:35.744863+0000","last_clean":"2024-09-11T05:35:35.744863+0000","last_became_active":"2024-09-11T05:35:08.632954+0000","last_became_peered":"2024-09-11T05:35:08.632954+0000","last_unstale":"2024-09-11T05:35:35.744863+0000","last_undegraded":"2024-09-11T05:35:35.744863+0000","last_fullsized":"2024-09-11T05:35:35.744863+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:38:42.279949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"139'743","reported_seq":8668,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361154+0000","last_change":"2024-09-11T05:35:10.629926+0000","last_active":"2024-09-11T05:35:36.361154+0000","last_peered":"2024-09-11T05:35:36.361154+0000","last_clean":"2024-09-11T05:35:36.361154+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:35:36.361154+0000","last_undegraded":"2024-09-11T05:35:36.361154+0000","last_fullsized":"2024-09-11T05:35:36.361154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:51.136449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013315200000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":11851,"num_read_kb":20739,"num_write":676,"num_write_kb":6668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819620+0000","last_change":"2024-09-11T05:34:50.626273+0000","last_active":"2024-09-11T05:35:35.819620+0000","last_peered":"2024-09-11T05:35:35.819620+0000","last_clean":"2024-09-11T05:35:35.819620+0000","last_became_active":"2024-09-11T05:34:50.625970+0000","last_became_peered":"2024-09-11T05:34:50.625970+0000","last_unstale":"2024-09-11T05:35:35.819620+0000","last_undegraded":"2024-09-11T05:35:35.819620+0000","last_fullsized":"2024-09-11T05:35:35.819620+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:45.970895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"144'588","reported_seq":3895,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944239+0000","last_change":"2024-09-11T05:35:23.637690+0000","last_active":"2024-09-11T05:35:35.944239+0000","last_peered":"2024-09-11T05:35:35.944239+0000","last_clean":"2024-09-11T05:35:35.944239+0000","last_became_active":"2024-09-11T05:35:23.635903+0000","last_became_peered":"2024-09-11T05:35:23.635903+0000","last_unstale":"2024-09-11T05:35:35.944239+0000","last_undegraded":"2024-09-11T05:35:35.944239+0000","last_fullsized":"2024-09-11T05:35:35.944239+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:18:14.825205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002640187,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5913,"num_read_kb":15123,"num_write":618,"num_write_kb":14349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":103,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819741+0000","last_change":"2024-09-11T05:35:28.699062+0000","last_active":"2024-09-11T05:35:35.819741+0000","last_peered":"2024-09-11T05:35:35.819741+0000","last_clean":"2024-09-11T05:35:35.819741+0000","last_became_active":"2024-09-11T05:35:28.698723+0000","last_became_peered":"2024-09-11T05:35:28.698723+0000","last_unstale":"2024-09-11T05:35:35.819741+0000","last_undegraded":"2024-09-11T05:35:35.819741+0000","last_fullsized":"2024-09-11T05:35:35.819741+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743659+0000","last_change":"2024-09-11T05:35:22.637165+0000","last_active":"2024-09-11T05:35:35.743659+0000","last_peered":"2024-09-11T05:35:35.743659+0000","last_clean":"2024-09-11T05:35:35.743659+0000","last_became_active":"2024-09-11T05:35:22.636808+0000","last_became_peered":"2024-09-11T05:35:22.636808+0000","last_unstale":"2024-09-11T05:35:35.743659+0000","last_undegraded":"2024-09-11T05:35:35.743659+0000","last_fullsized":"2024-09-11T05:35:35.743659+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:42.605285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"147'674","reported_seq":21155,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944229+0000","last_change":"2024-09-11T05:35:23.638318+0000","last_active":"2024-09-11T05:35:35.944229+0000","last_peered":"2024-09-11T05:35:35.944229+0000","last_clean":"2024-09-11T05:35:35.944229+0000","last_became_active":"2024-09-11T05:35:23.635346+0000","last_became_peered":"2024-09-11T05:35:23.635346+0000","last_unstale":"2024-09-11T05:35:35.944229+0000","last_undegraded":"2024-09-11T05:35:35.944229+0000","last_fullsized":"2024-09-11T05:35:35.944229+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:03:59.781583+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0012007719999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":21937,"num_read_kb":27288,"num_write":631,"num_write_kb":9659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":357,"num_bytes_recovered":6098347,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"142'411","reported_seq":10435,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819648+0000","last_change":"2024-09-11T05:35:28.701354+0000","last_active":"2024-09-11T05:35:35.819648+0000","last_peered":"2024-09-11T05:35:35.819648+0000","last_clean":"2024-09-11T05:35:35.819648+0000","last_became_active":"2024-09-11T05:35:28.699365+0000","last_became_peered":"2024-09-11T05:35:28.699365+0000","last_unstale":"2024-09-11T05:35:35.819648+0000","last_undegraded":"2024-09-11T05:35:35.819648+0000","last_fullsized":"2024-09-11T05:35:35.819648+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:37.199627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003370732,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9328,"num_read_kb":19500,"num_write":336,"num_write_kb":14817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":8961432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"144'432","reported_seq":3813,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819680+0000","last_change":"2024-09-11T05:35:28.701794+0000","last_active":"2024-09-11T05:35:35.819680+0000","last_peered":"2024-09-11T05:35:35.819680+0000","last_clean":"2024-09-11T05:35:35.819680+0000","last_became_active":"2024-09-11T05:35:28.700107+0000","last_became_peered":"2024-09-11T05:35:28.700107+0000","last_unstale":"2024-09-11T05:35:35.819680+0000","last_undegraded":"2024-09-11T05:35:35.819680+0000","last_fullsized":"2024-09-11T05:35:35.819680+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:45.230792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003122947,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1794,"num_read_kb":9402,"num_write":412,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":10914094,"num_keys_recovered":66,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"139'324","reported_seq":2603,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.744872+0000","last_change":"2024-09-11T05:35:11.637663+0000","last_active":"2024-09-11T05:35:35.744872+0000","last_peered":"2024-09-11T05:35:35.744872+0000","last_clean":"2024-09-11T05:35:35.744872+0000","last_became_active":"2024-09-11T05:35:11.631665+0000","last_became_peered":"2024-09-11T05:35:11.631665+0000","last_unstale":"2024-09-11T05:35:35.744872+0000","last_undegraded":"2024-09-11T05:35:35.744872+0000","last_fullsized":"2024-09-11T05:35:35.744872+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:56:28.397445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040247640000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2267,"num_read_kb":23620,"num_write":305,"num_write_kb":16916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":14087582,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"146'409","reported_seq":3153,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743504+0000","last_change":"2024-09-11T05:35:11.640341+0000","last_active":"2024-09-11T05:35:35.743504+0000","last_peered":"2024-09-11T05:35:35.743504+0000","last_clean":"2024-09-11T05:35:35.743504+0000","last_became_active":"2024-09-11T05:35:11.630867+0000","last_became_peered":"2024-09-11T05:35:11.630867+0000","last_unstale":"2024-09-11T05:35:35.743504+0000","last_undegraded":"2024-09-11T05:35:35.743504+0000","last_fullsized":"2024-09-11T05:35:35.743504+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:13.877495+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0078972569999999995,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1985,"num_read_kb":12033,"num_write":383,"num_write_kb":5272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":320,"num_bytes_recovered":6119775,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"141'478","reported_seq":5937,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819734+0000","last_change":"2024-09-11T05:35:28.702740+0000","last_active":"2024-09-11T05:35:35.819734+0000","last_peered":"2024-09-11T05:35:35.819734+0000","last_clean":"2024-09-11T05:35:35.819734+0000","last_became_active":"2024-09-11T05:35:28.699897+0000","last_became_peered":"2024-09-11T05:35:28.699897+0000","last_unstale":"2024-09-11T05:35:35.819734+0000","last_undegraded":"2024-09-11T05:35:35.819734+0000","last_fullsized":"2024-09-11T05:35:35.819734+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:38.206892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039836639999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5865,"num_read_kb":13697,"num_write":403,"num_write_kb":10315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":13015515,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"140'401","reported_seq":2951,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361507+0000","last_change":"2024-09-11T05:35:10.629686+0000","last_active":"2024-09-11T05:35:36.361507+0000","last_peered":"2024-09-11T05:35:36.361507+0000","last_clean":"2024-09-11T05:35:36.361507+0000","last_became_active":"2024-09-11T05:35:05.630573+0000","last_became_peered":"2024-09-11T05:35:05.630573+0000","last_unstale":"2024-09-11T05:35:36.361507+0000","last_undegraded":"2024-09-11T05:35:36.361507+0000","last_fullsized":"2024-09-11T05:35:36.361507+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:55.457196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001163856,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2127,"num_read_kb":12622,"num_write":331,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":262196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"141'638","reported_seq":5213,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743414+0000","last_change":"2024-09-11T05:35:22.636513+0000","last_active":"2024-09-11T05:35:35.743414+0000","last_peered":"2024-09-11T05:35:35.743414+0000","last_clean":"2024-09-11T05:35:35.743414+0000","last_became_active":"2024-09-11T05:35:22.634192+0000","last_became_peered":"2024-09-11T05:35:22.634192+0000","last_unstale":"2024-09-11T05:35:35.743414+0000","last_undegraded":"2024-09-11T05:35:35.743414+0000","last_fullsized":"2024-09-11T05:35:35.743414+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:07.719785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005994961,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":6001,"num_read_kb":12376,"num_write":612,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":2111260,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"135'377","reported_seq":5505,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743356+0000","last_change":"2024-09-11T05:35:22.638949+0000","last_active":"2024-09-11T05:35:35.743356+0000","last_peered":"2024-09-11T05:35:35.743356+0000","last_clean":"2024-09-11T05:35:35.743356+0000","last_became_active":"2024-09-11T05:35:22.635431+0000","last_became_peered":"2024-09-11T05:35:22.635431+0000","last_unstale":"2024-09-11T05:35:35.743356+0000","last_undegraded":"2024-09-11T05:35:35.743356+0000","last_fullsized":"2024-09-11T05:35:35.743356+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:18.444306+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0045659699999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4943,"num_read_kb":12354,"num_write":293,"num_write_kb":4874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":3066244,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"141'664","reported_seq":2303,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819620+0000","last_change":"2024-09-11T05:35:28.703601+0000","last_active":"2024-09-11T05:35:35.819620+0000","last_peered":"2024-09-11T05:35:35.819620+0000","last_clean":"2024-09-11T05:35:35.819620+0000","last_became_active":"2024-09-11T05:35:28.701845+0000","last_became_peered":"2024-09-11T05:35:28.701845+0000","last_unstale":"2024-09-11T05:35:35.819620+0000","last_undegraded":"2024-09-11T05:35:35.819620+0000","last_fullsized":"2024-09-11T05:35:35.819620+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:54.507773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001942809,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2920,"num_read_kb":11034,"num_write":809,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":3434090,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"144'613","reported_seq":11190,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361155+0000","last_change":"2024-09-11T05:35:10.631369+0000","last_active":"2024-09-11T05:35:36.361155+0000","last_peered":"2024-09-11T05:35:36.361155+0000","last_clean":"2024-09-11T05:35:36.361155+0000","last_became_active":"2024-09-11T05:34:53.789002+0000","last_became_peered":"2024-09-11T05:34:53.789002+0000","last_unstale":"2024-09-11T05:35:36.361155+0000","last_undegraded":"2024-09-11T05:35:36.361155+0000","last_fullsized":"2024-09-11T05:35:36.361155+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:29.114608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002392473,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3076,"num_read_kb":7989,"num_write":738,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":6984484,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"144'563","reported_seq":6585,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819733+0000","last_change":"2024-09-11T05:35:28.698744+0000","last_active":"2024-09-11T05:35:35.819733+0000","last_peered":"2024-09-11T05:35:35.819733+0000","last_clean":"2024-09-11T05:35:35.819733+0000","last_became_active":"2024-09-11T05:35:28.696781+0000","last_became_peered":"2024-09-11T05:35:28.696781+0000","last_unstale":"2024-09-11T05:35:35.819733+0000","last_undegraded":"2024-09-11T05:35:35.819733+0000","last_fullsized":"2024-09-11T05:35:35.819733+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:24.791414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017107820000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6991,"num_read_kb":39098,"num_write":620,"num_write_kb":9927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":4472318,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":121,"num_read":220717,"num_read_kb":578588,"num_write":21850,"num_write_kb":315751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6659,"num_bytes_recovered":181815763,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19579,"ondisk_log_size":19579,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542184,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":975543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78160,"kb_used_data":2556,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293680,"statfs":{"total":96636764160,"available":96556728320,"internally_reserved":0,"allocated":2617344,"data_stored":1565930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":103,"seq":442381631504,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":1972,"kb_used_omap":4,"kb_used_meta":31803,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":2019328,"data_stored":975543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4454,"internal_metadata":32566938},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51212,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320628,"statfs":{"total":96636764160,"available":96584323072,"internally_reserved":0,"allocated":2019328,"data_stored":975543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69856,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301984,"statfs":{"total":96636764160,"available":96565231616,"internally_reserved":0,"allocated":2629632,"data_stored":1571772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51220,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320620,"statfs":{"total":96636764160,"available":96584314880,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:35:39.235 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:35:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:35:39.511 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:35:39.522 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-09-11T05:35:37.974498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":121,"num_read":220833,"num_read_kb":578688,"num_write":22011,"num_write_kb":318169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6665,"num_bytes_recovered":182406169,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19699,"ondisk_log_size":19699,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436496,"kb_used_data":17000,"kb_used_omap":15,"kb_used_meta":419312,"kb_avail":754538224,"statfs":{"total":773094113280,"available":772647141376,"internally_reserved":0,"allocated":17408000,"data_stored":9008524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15611,"internal_metadata":429376261},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-129,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.252097"},"pg_stats":[{"pgid":"3.1f","version":"147'611","reported_seq":7854,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361610+0000","last_change":"2024-09-11T05:35:22.638115+0000","last_active":"2024-09-11T05:35:36.361610+0000","last_peered":"2024-09-11T05:35:36.361610+0000","last_clean":"2024-09-11T05:35:36.361610+0000","last_became_active":"2024-09-11T05:35:22.637032+0000","last_became_peered":"2024-09-11T05:35:22.637032+0000","last_unstale":"2024-09-11T05:35:36.361610+0000","last_undegraded":"2024-09-11T05:35:36.361610+0000","last_fullsized":"2024-09-11T05:35:36.361610+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:31.476738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00245933,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7747,"num_read_kb":22584,"num_write":761,"num_write_kb":11145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":285,"num_bytes_recovered":4324286,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"139'296","reported_seq":3772,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361548+0000","last_change":"2024-09-11T05:35:10.630226+0000","last_active":"2024-09-11T05:35:36.361548+0000","last_peered":"2024-09-11T05:35:36.361548+0000","last_clean":"2024-09-11T05:35:36.361548+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:35:36.361548+0000","last_undegraded":"2024-09-11T05:35:36.361548+0000","last_fullsized":"2024-09-11T05:35:36.361548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:57:10.083669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014246319999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":3027,"num_read_kb":23842,"num_write":231,"num_write_kb":6198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"144'910","reported_seq":21667,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819869+0000","last_change":"2024-09-11T05:35:28.699205+0000","last_active":"2024-09-11T05:35:35.819869+0000","last_peered":"2024-09-11T05:35:35.819869+0000","last_clean":"2024-09-11T05:35:35.819869+0000","last_became_active":"2024-09-11T05:35:28.696723+0000","last_became_peered":"2024-09-11T05:35:28.696723+0000","last_unstale":"2024-09-11T05:35:35.819869+0000","last_undegraded":"2024-09-11T05:35:35.819869+0000","last_fullsized":"2024-09-11T05:35:35.819869+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:40.890246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003253822,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":16637,"num_read_kb":25385,"num_write":1112,"num_write_kb":7409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":6593091,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"147'601","reported_seq":7773,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743694+0000","last_change":"2024-09-11T05:35:22.638770+0000","last_active":"2024-09-11T05:35:35.743694+0000","last_peered":"2024-09-11T05:35:35.743694+0000","last_clean":"2024-09-11T05:35:35.743694+0000","last_became_active":"2024-09-11T05:35:22.636725+0000","last_became_peered":"2024-09-11T05:35:22.636725+0000","last_unstale":"2024-09-11T05:35:35.743694+0000","last_undegraded":"2024-09-11T05:35:35.743694+0000","last_fullsized":"2024-09-11T05:35:35.743694+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:53:13.907056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028264560000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9012,"num_read_kb":27646,"num_write":675,"num_write_kb":16439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":13219858,"num_keys_recovered":56,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"140'579","reported_seq":7861,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944261+0000","last_change":"2024-09-11T05:35:23.636456+0000","last_active":"2024-09-11T05:35:35.944261+0000","last_peered":"2024-09-11T05:35:35.944261+0000","last_clean":"2024-09-11T05:35:35.944261+0000","last_became_active":"2024-09-11T05:35:23.634303+0000","last_became_peered":"2024-09-11T05:35:23.634303+0000","last_unstale":"2024-09-11T05:35:35.944261+0000","last_undegraded":"2024-09-11T05:35:35.944261+0000","last_fullsized":"2024-09-11T05:35:35.944261+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:01.958896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049355689999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":7366,"num_read_kb":17763,"num_write":665,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":421,"num_bytes_recovered":7543883,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"136'445","reported_seq":5277,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743659+0000","last_change":"2024-09-11T05:35:22.638768+0000","last_active":"2024-09-11T05:35:35.743659+0000","last_peered":"2024-09-11T05:35:35.743659+0000","last_clean":"2024-09-11T05:35:35.743659+0000","last_became_active":"2024-09-11T05:35:22.636807+0000","last_became_peered":"2024-09-11T05:35:22.636807+0000","last_unstale":"2024-09-11T05:35:35.743659+0000","last_undegraded":"2024-09-11T05:35:35.743659+0000","last_fullsized":"2024-09-11T05:35:35.743659+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:29.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017105359999999999,"stat_sum":{"num_bytes":19,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":6,"num_read":5410,"num_read_kb":14252,"num_write":483,"num_write_kb":12836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":327,"num_bytes_recovered":4853026,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"139'1101","reported_seq":11036,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944244+0000","last_change":"2024-09-11T05:35:22.634971+0000","last_active":"2024-09-11T05:35:35.944244+0000","last_peered":"2024-09-11T05:35:35.944244+0000","last_clean":"2024-09-11T05:35:35.944244+0000","last_became_active":"2024-09-11T05:35:22.632741+0000","last_became_peered":"2024-09-11T05:35:22.632741+0000","last_unstale":"2024-09-11T05:35:35.944244+0000","last_undegraded":"2024-09-11T05:35:35.944244+0000","last_fullsized":"2024-09-11T05:35:35.944244+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:27.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030616850000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":13726,"num_read_kb":13435,"num_write":1662,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":1269861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"140'517","reported_seq":3166,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361418+0000","last_change":"2024-09-11T05:35:10.632188+0000","last_active":"2024-09-11T05:35:36.361418+0000","last_peered":"2024-09-11T05:35:36.361418+0000","last_clean":"2024-09-11T05:35:36.361418+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:35:36.361418+0000","last_undegraded":"2024-09-11T05:35:36.361418+0000","last_fullsized":"2024-09-11T05:35:36.361418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:44.971488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027595950000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":3338,"num_read_kb":10070,"num_write":595,"num_write_kb":6210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"139'1157","reported_seq":3344,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361628+0000","last_change":"2024-09-11T05:35:10.631584+0000","last_active":"2024-09-11T05:35:36.361628+0000","last_peered":"2024-09-11T05:35:36.361628+0000","last_clean":"2024-09-11T05:35:36.361628+0000","last_became_active":"2024-09-11T05:34:54.790407+0000","last_became_peered":"2024-09-11T05:34:54.790407+0000","last_unstale":"2024-09-11T05:35:36.361628+0000","last_undegraded":"2024-09-11T05:35:36.361628+0000","last_fullsized":"2024-09-11T05:35:36.361628+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1157,"log_dups_size":0,"ondisk_log_size":1157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:22.948505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022982459999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5158,"num_read_kb":28626,"num_write":1706,"num_write_kb":20682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":292,"num_bytes_recovered":48701806,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"142'286","reported_seq":3645,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.363325+0000","last_change":"2024-09-11T05:35:27.700408+0000","last_active":"2024-09-11T05:35:36.363325+0000","last_peered":"2024-09-11T05:35:36.363325+0000","last_clean":"2024-09-11T05:35:36.363325+0000","last_became_active":"2024-09-11T05:35:27.699049+0000","last_became_peered":"2024-09-11T05:35:27.699049+0000","last_unstale":"2024-09-11T05:35:36.363325+0000","last_undegraded":"2024-09-11T05:35:36.363325+0000","last_fullsized":"2024-09-11T05:35:36.363325+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:56.992530+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00066517799999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2863,"num_read_kb":14884,"num_write":221,"num_write_kb":7375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":1456269,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"141'725","reported_seq":3846,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743446+0000","last_change":"2024-09-11T05:35:10.633716+0000","last_active":"2024-09-11T05:35:35.743446+0000","last_peered":"2024-09-11T05:35:35.743446+0000","last_clean":"2024-09-11T05:35:35.743446+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:35:35.743446+0000","last_undegraded":"2024-09-11T05:35:35.743446+0000","last_fullsized":"2024-09-11T05:35:35.743446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:59.138792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079156780000000006,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5390,"num_read_kb":12737,"num_write":875,"num_write_kb":9766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"142'369","reported_seq":12008,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819737+0000","last_change":"2024-09-11T05:35:28.700196+0000","last_active":"2024-09-11T05:35:35.819737+0000","last_peered":"2024-09-11T05:35:35.819737+0000","last_clean":"2024-09-11T05:35:35.819737+0000","last_became_active":"2024-09-11T05:35:28.697994+0000","last_became_peered":"2024-09-11T05:35:28.697994+0000","last_unstale":"2024-09-11T05:35:35.819737+0000","last_undegraded":"2024-09-11T05:35:35.819737+0000","last_fullsized":"2024-09-11T05:35:35.819737+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:53.037666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015799760000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5068,"num_read_kb":14759,"num_write":300,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":7503668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819881+0000","last_change":"2024-09-11T05:34:50.627854+0000","last_active":"2024-09-11T05:35:35.819881+0000","last_peered":"2024-09-11T05:35:35.819881+0000","last_clean":"2024-09-11T05:35:35.819881+0000","last_became_active":"2024-09-11T05:34:50.627529+0000","last_became_peered":"2024-09-11T05:34:50.627529+0000","last_unstale":"2024-09-11T05:35:35.819881+0000","last_undegraded":"2024-09-11T05:35:35.819881+0000","last_fullsized":"2024-09-11T05:35:35.819881+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:35.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"147'703","reported_seq":4450,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944385+0000","last_change":"2024-09-11T05:35:22.635026+0000","last_active":"2024-09-11T05:35:35.944385+0000","last_peered":"2024-09-11T05:35:35.944385+0000","last_clean":"2024-09-11T05:35:35.944385+0000","last_became_active":"2024-09-11T05:35:22.632683+0000","last_became_peered":"2024-09-11T05:35:22.632683+0000","last_unstale":"2024-09-11T05:35:35.944385+0000","last_undegraded":"2024-09-11T05:35:35.944385+0000","last_fullsized":"2024-09-11T05:35:35.944385+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:50:23.986237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057885200000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5183,"num_read_kb":4253,"num_write":904,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":463,"num_bytes_recovered":1655489,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944376+0000","last_change":"2024-09-11T05:35:20.631589+0000","last_active":"2024-09-11T05:35:35.944376+0000","last_peered":"2024-09-11T05:35:35.944376+0000","last_clean":"2024-09-11T05:35:35.944376+0000","last_became_active":"2024-09-11T05:35:20.631241+0000","last_became_peered":"2024-09-11T05:35:20.631241+0000","last_unstale":"2024-09-11T05:35:35.944376+0000","last_undegraded":"2024-09-11T05:35:35.944376+0000","last_fullsized":"2024-09-11T05:35:35.944376+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:15.796354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"140'467","reported_seq":6364,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944331+0000","last_change":"2024-09-11T05:35:22.635052+0000","last_active":"2024-09-11T05:35:35.944331+0000","last_peered":"2024-09-11T05:35:35.944331+0000","last_clean":"2024-09-11T05:35:35.944331+0000","last_became_active":"2024-09-11T05:35:22.632436+0000","last_became_peered":"2024-09-11T05:35:22.632436+0000","last_unstale":"2024-09-11T05:35:35.944331+0000","last_undegraded":"2024-09-11T05:35:35.944331+0000","last_fullsized":"2024-09-11T05:35:35.944331+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:45.444932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027050960000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6977,"num_read_kb":16019,"num_write":349,"num_write_kb":6385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":1715668,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":102,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819877+0000","last_change":"2024-09-11T05:35:20.638832+0000","last_active":"2024-09-11T05:35:35.819877+0000","last_peered":"2024-09-11T05:35:35.819877+0000","last_clean":"2024-09-11T05:35:35.819877+0000","last_became_active":"2024-09-11T05:35:20.638478+0000","last_became_peered":"2024-09-11T05:35:20.638478+0000","last_unstale":"2024-09-11T05:35:35.819877+0000","last_undegraded":"2024-09-11T05:35:35.819877+0000","last_fullsized":"2024-09-11T05:35:35.819877+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:12.803640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"147'1631","reported_seq":8207,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361298+0000","last_change":"2024-09-11T05:35:10.631545+0000","last_active":"2024-09-11T05:35:36.361298+0000","last_peered":"2024-09-11T05:35:36.361298+0000","last_clean":"2024-09-11T05:35:36.361298+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:35:36.361298+0000","last_undegraded":"2024-09-11T05:35:36.361298+0000","last_fullsized":"2024-09-11T05:35:36.361298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1631,"log_dups_size":0,"ondisk_log_size":1631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:07.737928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026555530000000002,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":15252,"num_read_kb":37939,"num_write":2291,"num_write_kb":19413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":325,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361624+0000","last_change":"2024-09-11T05:34:44.768103+0000","last_active":"2024-09-11T05:35:36.361624+0000","last_peered":"2024-09-11T05:35:36.361624+0000","last_clean":"2024-09-11T05:35:36.361624+0000","last_became_active":"2024-09-11T05:34:44.767862+0000","last_became_peered":"2024-09-11T05:34:44.767862+0000","last_unstale":"2024-09-11T05:35:36.361624+0000","last_undegraded":"2024-09-11T05:35:36.361624+0000","last_fullsized":"2024-09-11T05:35:36.361624+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:15:05.574617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"144'845","reported_seq":12664,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.363156+0000","last_change":"2024-09-11T05:35:27.700438+0000","last_active":"2024-09-11T05:35:36.363156+0000","last_peered":"2024-09-11T05:35:36.363156+0000","last_clean":"2024-09-11T05:35:36.363156+0000","last_became_active":"2024-09-11T05:35:27.699111+0000","last_became_peered":"2024-09-11T05:35:27.699111+0000","last_unstale":"2024-09-11T05:35:36.363156+0000","last_undegraded":"2024-09-11T05:35:36.363156+0000","last_fullsized":"2024-09-11T05:35:36.363156+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:45.051639+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0034996329999999998,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":15193,"num_read_kb":18227,"num_write":823,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"147'676","reported_seq":4374,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743567+0000","last_change":"2024-09-11T05:35:10.632354+0000","last_active":"2024-09-11T05:35:35.743567+0000","last_peered":"2024-09-11T05:35:35.743567+0000","last_clean":"2024-09-11T05:35:35.743567+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:35:35.743567+0000","last_undegraded":"2024-09-11T05:35:35.743567+0000","last_fullsized":"2024-09-11T05:35:35.743567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:36.049428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0073602759999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4311,"num_read_kb":22872,"num_write":719,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":210,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819683+0000","last_change":"2024-09-11T05:35:28.700422+0000","last_active":"2024-09-11T05:35:35.819683+0000","last_peered":"2024-09-11T05:35:35.819683+0000","last_clean":"2024-09-11T05:35:35.819683+0000","last_became_active":"2024-09-11T05:35:28.700119+0000","last_became_peered":"2024-09-11T05:35:28.700119+0000","last_unstale":"2024-09-11T05:35:35.819683+0000","last_undegraded":"2024-09-11T05:35:35.819683+0000","last_fullsized":"2024-09-11T05:35:35.819683+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:03.431125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"146'345","reported_seq":2882,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361248+0000","last_change":"2024-09-11T05:35:11.642354+0000","last_active":"2024-09-11T05:35:36.361248+0000","last_peered":"2024-09-11T05:35:36.361248+0000","last_clean":"2024-09-11T05:35:36.361248+0000","last_became_active":"2024-09-11T05:35:11.635099+0000","last_became_peered":"2024-09-11T05:35:11.635099+0000","last_unstale":"2024-09-11T05:35:36.361248+0000","last_undegraded":"2024-09-11T05:35:36.361248+0000","last_fullsized":"2024-09-11T05:35:36.361248+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:37:53.460954+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0054654079999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2061,"num_read_kb":16420,"num_write":311,"num_write_kb":9397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3451521,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.744863+0000","last_change":"2024-09-11T05:35:08.633295+0000","last_active":"2024-09-11T05:35:35.744863+0000","last_peered":"2024-09-11T05:35:35.744863+0000","last_clean":"2024-09-11T05:35:35.744863+0000","last_became_active":"2024-09-11T05:35:08.632954+0000","last_became_peered":"2024-09-11T05:35:08.632954+0000","last_unstale":"2024-09-11T05:35:35.744863+0000","last_undegraded":"2024-09-11T05:35:35.744863+0000","last_fullsized":"2024-09-11T05:35:35.744863+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:38:42.279949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"139'743","reported_seq":8668,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361154+0000","last_change":"2024-09-11T05:35:10.629926+0000","last_active":"2024-09-11T05:35:36.361154+0000","last_peered":"2024-09-11T05:35:36.361154+0000","last_clean":"2024-09-11T05:35:36.361154+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:35:36.361154+0000","last_undegraded":"2024-09-11T05:35:36.361154+0000","last_fullsized":"2024-09-11T05:35:36.361154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:51.136449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013315200000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":11851,"num_read_kb":20739,"num_write":676,"num_write_kb":6668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819620+0000","last_change":"2024-09-11T05:34:50.626273+0000","last_active":"2024-09-11T05:35:35.819620+0000","last_peered":"2024-09-11T05:35:35.819620+0000","last_clean":"2024-09-11T05:35:35.819620+0000","last_became_active":"2024-09-11T05:34:50.625970+0000","last_became_peered":"2024-09-11T05:34:50.625970+0000","last_unstale":"2024-09-11T05:35:35.819620+0000","last_undegraded":"2024-09-11T05:35:35.819620+0000","last_fullsized":"2024-09-11T05:35:35.819620+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:45.970895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"144'588","reported_seq":3895,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944239+0000","last_change":"2024-09-11T05:35:23.637690+0000","last_active":"2024-09-11T05:35:35.944239+0000","last_peered":"2024-09-11T05:35:35.944239+0000","last_clean":"2024-09-11T05:35:35.944239+0000","last_became_active":"2024-09-11T05:35:23.635903+0000","last_became_peered":"2024-09-11T05:35:23.635903+0000","last_unstale":"2024-09-11T05:35:35.944239+0000","last_undegraded":"2024-09-11T05:35:35.944239+0000","last_fullsized":"2024-09-11T05:35:35.944239+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:18:14.825205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002640187,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5913,"num_read_kb":15123,"num_write":618,"num_write_kb":14349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":103,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819741+0000","last_change":"2024-09-11T05:35:28.699062+0000","last_active":"2024-09-11T05:35:35.819741+0000","last_peered":"2024-09-11T05:35:35.819741+0000","last_clean":"2024-09-11T05:35:35.819741+0000","last_became_active":"2024-09-11T05:35:28.698723+0000","last_became_peered":"2024-09-11T05:35:28.698723+0000","last_unstale":"2024-09-11T05:35:35.819741+0000","last_undegraded":"2024-09-11T05:35:35.819741+0000","last_fullsized":"2024-09-11T05:35:35.819741+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743659+0000","last_change":"2024-09-11T05:35:22.637165+0000","last_active":"2024-09-11T05:35:35.743659+0000","last_peered":"2024-09-11T05:35:35.743659+0000","last_clean":"2024-09-11T05:35:35.743659+0000","last_became_active":"2024-09-11T05:35:22.636808+0000","last_became_peered":"2024-09-11T05:35:22.636808+0000","last_unstale":"2024-09-11T05:35:35.743659+0000","last_undegraded":"2024-09-11T05:35:35.743659+0000","last_fullsized":"2024-09-11T05:35:35.743659+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:42.605285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"147'674","reported_seq":21155,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944229+0000","last_change":"2024-09-11T05:35:23.638318+0000","last_active":"2024-09-11T05:35:35.944229+0000","last_peered":"2024-09-11T05:35:35.944229+0000","last_clean":"2024-09-11T05:35:35.944229+0000","last_became_active":"2024-09-11T05:35:23.635346+0000","last_became_peered":"2024-09-11T05:35:23.635346+0000","last_unstale":"2024-09-11T05:35:35.944229+0000","last_undegraded":"2024-09-11T05:35:35.944229+0000","last_fullsized":"2024-09-11T05:35:35.944229+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:03:59.781583+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0012007719999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":21937,"num_read_kb":27288,"num_write":631,"num_write_kb":9659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":357,"num_bytes_recovered":6098347,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"142'411","reported_seq":10435,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819648+0000","last_change":"2024-09-11T05:35:28.701354+0000","last_active":"2024-09-11T05:35:35.819648+0000","last_peered":"2024-09-11T05:35:35.819648+0000","last_clean":"2024-09-11T05:35:35.819648+0000","last_became_active":"2024-09-11T05:35:28.699365+0000","last_became_peered":"2024-09-11T05:35:28.699365+0000","last_unstale":"2024-09-11T05:35:35.819648+0000","last_undegraded":"2024-09-11T05:35:35.819648+0000","last_fullsized":"2024-09-11T05:35:35.819648+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:37.199627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003370732,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9328,"num_read_kb":19500,"num_write":336,"num_write_kb":14817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":8961432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"144'432","reported_seq":3813,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819680+0000","last_change":"2024-09-11T05:35:28.701794+0000","last_active":"2024-09-11T05:35:35.819680+0000","last_peered":"2024-09-11T05:35:35.819680+0000","last_clean":"2024-09-11T05:35:35.819680+0000","last_became_active":"2024-09-11T05:35:28.700107+0000","last_became_peered":"2024-09-11T05:35:28.700107+0000","last_unstale":"2024-09-11T05:35:35.819680+0000","last_undegraded":"2024-09-11T05:35:35.819680+0000","last_fullsized":"2024-09-11T05:35:35.819680+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:45.230792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003122947,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1794,"num_read_kb":9402,"num_write":412,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":10914094,"num_keys_recovered":66,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"139'324","reported_seq":2603,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.744872+0000","last_change":"2024-09-11T05:35:11.637663+0000","last_active":"2024-09-11T05:35:35.744872+0000","last_peered":"2024-09-11T05:35:35.744872+0000","last_clean":"2024-09-11T05:35:35.744872+0000","last_became_active":"2024-09-11T05:35:11.631665+0000","last_became_peered":"2024-09-11T05:35:11.631665+0000","last_unstale":"2024-09-11T05:35:35.744872+0000","last_undegraded":"2024-09-11T05:35:35.744872+0000","last_fullsized":"2024-09-11T05:35:35.744872+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:56:28.397445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040247640000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2267,"num_read_kb":23620,"num_write":305,"num_write_kb":16916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":14087582,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"146'409","reported_seq":3153,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743504+0000","last_change":"2024-09-11T05:35:11.640341+0000","last_active":"2024-09-11T05:35:35.743504+0000","last_peered":"2024-09-11T05:35:35.743504+0000","last_clean":"2024-09-11T05:35:35.743504+0000","last_became_active":"2024-09-11T05:35:11.630867+0000","last_became_peered":"2024-09-11T05:35:11.630867+0000","last_unstale":"2024-09-11T05:35:35.743504+0000","last_undegraded":"2024-09-11T05:35:35.743504+0000","last_fullsized":"2024-09-11T05:35:35.743504+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:13.877495+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0078972569999999995,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1985,"num_read_kb":12033,"num_write":383,"num_write_kb":5272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":320,"num_bytes_recovered":6119775,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"141'478","reported_seq":5937,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819734+0000","last_change":"2024-09-11T05:35:28.702740+0000","last_active":"2024-09-11T05:35:35.819734+0000","last_peered":"2024-09-11T05:35:35.819734+0000","last_clean":"2024-09-11T05:35:35.819734+0000","last_became_active":"2024-09-11T05:35:28.699897+0000","last_became_peered":"2024-09-11T05:35:28.699897+0000","last_unstale":"2024-09-11T05:35:35.819734+0000","last_undegraded":"2024-09-11T05:35:35.819734+0000","last_fullsized":"2024-09-11T05:35:35.819734+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:38.206892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039836639999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5865,"num_read_kb":13697,"num_write":403,"num_write_kb":10315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":13015515,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"140'401","reported_seq":2951,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361507+0000","last_change":"2024-09-11T05:35:10.629686+0000","last_active":"2024-09-11T05:35:36.361507+0000","last_peered":"2024-09-11T05:35:36.361507+0000","last_clean":"2024-09-11T05:35:36.361507+0000","last_became_active":"2024-09-11T05:35:05.630573+0000","last_became_peered":"2024-09-11T05:35:05.630573+0000","last_unstale":"2024-09-11T05:35:36.361507+0000","last_undegraded":"2024-09-11T05:35:36.361507+0000","last_fullsized":"2024-09-11T05:35:36.361507+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:55.457196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001163856,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2127,"num_read_kb":12622,"num_write":331,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":262196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"141'638","reported_seq":5213,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743414+0000","last_change":"2024-09-11T05:35:22.636513+0000","last_active":"2024-09-11T05:35:35.743414+0000","last_peered":"2024-09-11T05:35:35.743414+0000","last_clean":"2024-09-11T05:35:35.743414+0000","last_became_active":"2024-09-11T05:35:22.634192+0000","last_became_peered":"2024-09-11T05:35:22.634192+0000","last_unstale":"2024-09-11T05:35:35.743414+0000","last_undegraded":"2024-09-11T05:35:35.743414+0000","last_fullsized":"2024-09-11T05:35:35.743414+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:07.719785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005994961,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":6001,"num_read_kb":12376,"num_write":612,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":2111260,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"135'377","reported_seq":5505,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743356+0000","last_change":"2024-09-11T05:35:22.638949+0000","last_active":"2024-09-11T05:35:35.743356+0000","last_peered":"2024-09-11T05:35:35.743356+0000","last_clean":"2024-09-11T05:35:35.743356+0000","last_became_active":"2024-09-11T05:35:22.635431+0000","last_became_peered":"2024-09-11T05:35:22.635431+0000","last_unstale":"2024-09-11T05:35:35.743356+0000","last_undegraded":"2024-09-11T05:35:35.743356+0000","last_fullsized":"2024-09-11T05:35:35.743356+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:18.444306+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0045659699999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4943,"num_read_kb":12354,"num_write":293,"num_write_kb":4874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":3066244,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"141'664","reported_seq":2303,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819620+0000","last_change":"2024-09-11T05:35:28.703601+0000","last_active":"2024-09-11T05:35:35.819620+0000","last_peered":"2024-09-11T05:35:35.819620+0000","last_clean":"2024-09-11T05:35:35.819620+0000","last_became_active":"2024-09-11T05:35:28.701845+0000","last_became_peered":"2024-09-11T05:35:28.701845+0000","last_unstale":"2024-09-11T05:35:35.819620+0000","last_undegraded":"2024-09-11T05:35:35.819620+0000","last_fullsized":"2024-09-11T05:35:35.819620+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:54.507773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001942809,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2920,"num_read_kb":11034,"num_write":809,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":3434090,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"144'613","reported_seq":11190,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361155+0000","last_change":"2024-09-11T05:35:10.631369+0000","last_active":"2024-09-11T05:35:36.361155+0000","last_peered":"2024-09-11T05:35:36.361155+0000","last_clean":"2024-09-11T05:35:36.361155+0000","last_became_active":"2024-09-11T05:34:53.789002+0000","last_became_peered":"2024-09-11T05:34:53.789002+0000","last_unstale":"2024-09-11T05:35:36.361155+0000","last_undegraded":"2024-09-11T05:35:36.361155+0000","last_fullsized":"2024-09-11T05:35:36.361155+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:29.114608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002392473,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3076,"num_read_kb":7989,"num_write":738,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":6984484,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"144'563","reported_seq":6585,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819733+0000","last_change":"2024-09-11T05:35:28.698744+0000","last_active":"2024-09-11T05:35:35.819733+0000","last_peered":"2024-09-11T05:35:35.819733+0000","last_clean":"2024-09-11T05:35:35.819733+0000","last_became_active":"2024-09-11T05:35:28.696781+0000","last_became_peered":"2024-09-11T05:35:28.696781+0000","last_unstale":"2024-09-11T05:35:35.819733+0000","last_undegraded":"2024-09-11T05:35:35.819733+0000","last_fullsized":"2024-09-11T05:35:35.819733+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:24.791414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017107820000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6991,"num_read_kb":39098,"num_write":620,"num_write_kb":9927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":4472318,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":121,"num_read":220717,"num_read_kb":578588,"num_write":21850,"num_write_kb":315751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6659,"num_bytes_recovered":181815763,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19579,"ondisk_log_size":19579,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542184,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":975543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78160,"kb_used_data":2556,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293680,"statfs":{"total":96636764160,"available":96556728320,"internally_reserved":0,"allocated":2617344,"data_stored":1565930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":103,"seq":442381631504,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":1972,"kb_used_omap":4,"kb_used_meta":31803,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":2019328,"data_stored":975543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4454,"internal_metadata":32566938},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51212,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320628,"statfs":{"total":96636764160,"available":96584323072,"internally_reserved":0,"allocated":2019328,"data_stored":975543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69856,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301984,"statfs":{"total":96636764160,"available":96565231616,"internally_reserved":0,"allocated":2629632,"data_stored":1571772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51220,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320620,"statfs":{"total":96636764160,"available":96584314880,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:35:39.524 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T05:35:39.524 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-11T05:35:39.817 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T05:35:39.827 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T05:35:39.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:35:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:35:40.103 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:35:40.114 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-09-11T05:35:39.975025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":121,"num_read":220833,"num_read_kb":578688,"num_write":22011,"num_write_kb":318169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6665,"num_bytes_recovered":182406169,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19699,"ondisk_log_size":19699,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436552,"kb_used_data":17048,"kb_used_omap":15,"kb_used_meta":419312,"kb_avail":754538168,"statfs":{"total":773094113280,"available":772647084032,"internally_reserved":0,"allocated":17457152,"data_stored":9031892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15611,"internal_metadata":429376261},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.247381"},"pg_stats":[{"pgid":"3.1f","version":"147'611","reported_seq":7854,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361610+0000","last_change":"2024-09-11T05:35:22.638115+0000","last_active":"2024-09-11T05:35:36.361610+0000","last_peered":"2024-09-11T05:35:36.361610+0000","last_clean":"2024-09-11T05:35:36.361610+0000","last_became_active":"2024-09-11T05:35:22.637032+0000","last_became_peered":"2024-09-11T05:35:22.637032+0000","last_unstale":"2024-09-11T05:35:36.361610+0000","last_undegraded":"2024-09-11T05:35:36.361610+0000","last_fullsized":"2024-09-11T05:35:36.361610+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:31.476738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00245933,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7747,"num_read_kb":22584,"num_write":761,"num_write_kb":11145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":285,"num_bytes_recovered":4324286,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"139'296","reported_seq":3772,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361548+0000","last_change":"2024-09-11T05:35:10.630226+0000","last_active":"2024-09-11T05:35:36.361548+0000","last_peered":"2024-09-11T05:35:36.361548+0000","last_clean":"2024-09-11T05:35:36.361548+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:35:36.361548+0000","last_undegraded":"2024-09-11T05:35:36.361548+0000","last_fullsized":"2024-09-11T05:35:36.361548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:57:10.083669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014246319999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":3027,"num_read_kb":23842,"num_write":231,"num_write_kb":6198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"144'910","reported_seq":21667,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819869+0000","last_change":"2024-09-11T05:35:28.699205+0000","last_active":"2024-09-11T05:35:35.819869+0000","last_peered":"2024-09-11T05:35:35.819869+0000","last_clean":"2024-09-11T05:35:35.819869+0000","last_became_active":"2024-09-11T05:35:28.696723+0000","last_became_peered":"2024-09-11T05:35:28.696723+0000","last_unstale":"2024-09-11T05:35:35.819869+0000","last_undegraded":"2024-09-11T05:35:35.819869+0000","last_fullsized":"2024-09-11T05:35:35.819869+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:40.890246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003253822,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":16637,"num_read_kb":25385,"num_write":1112,"num_write_kb":7409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":6593091,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"147'601","reported_seq":7773,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743694+0000","last_change":"2024-09-11T05:35:22.638770+0000","last_active":"2024-09-11T05:35:35.743694+0000","last_peered":"2024-09-11T05:35:35.743694+0000","last_clean":"2024-09-11T05:35:35.743694+0000","last_became_active":"2024-09-11T05:35:22.636725+0000","last_became_peered":"2024-09-11T05:35:22.636725+0000","last_unstale":"2024-09-11T05:35:35.743694+0000","last_undegraded":"2024-09-11T05:35:35.743694+0000","last_fullsized":"2024-09-11T05:35:35.743694+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:53:13.907056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028264560000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9012,"num_read_kb":27646,"num_write":675,"num_write_kb":16439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":13219858,"num_keys_recovered":56,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"140'579","reported_seq":7861,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944261+0000","last_change":"2024-09-11T05:35:23.636456+0000","last_active":"2024-09-11T05:35:35.944261+0000","last_peered":"2024-09-11T05:35:35.944261+0000","last_clean":"2024-09-11T05:35:35.944261+0000","last_became_active":"2024-09-11T05:35:23.634303+0000","last_became_peered":"2024-09-11T05:35:23.634303+0000","last_unstale":"2024-09-11T05:35:35.944261+0000","last_undegraded":"2024-09-11T05:35:35.944261+0000","last_fullsized":"2024-09-11T05:35:35.944261+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:01.958896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049355689999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":7366,"num_read_kb":17763,"num_write":665,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":421,"num_bytes_recovered":7543883,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"136'445","reported_seq":5277,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743659+0000","last_change":"2024-09-11T05:35:22.638768+0000","last_active":"2024-09-11T05:35:35.743659+0000","last_peered":"2024-09-11T05:35:35.743659+0000","last_clean":"2024-09-11T05:35:35.743659+0000","last_became_active":"2024-09-11T05:35:22.636807+0000","last_became_peered":"2024-09-11T05:35:22.636807+0000","last_unstale":"2024-09-11T05:35:35.743659+0000","last_undegraded":"2024-09-11T05:35:35.743659+0000","last_fullsized":"2024-09-11T05:35:35.743659+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:29.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017105359999999999,"stat_sum":{"num_bytes":19,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":6,"num_read":5410,"num_read_kb":14252,"num_write":483,"num_write_kb":12836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":327,"num_bytes_recovered":4853026,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"139'1101","reported_seq":11036,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944244+0000","last_change":"2024-09-11T05:35:22.634971+0000","last_active":"2024-09-11T05:35:35.944244+0000","last_peered":"2024-09-11T05:35:35.944244+0000","last_clean":"2024-09-11T05:35:35.944244+0000","last_became_active":"2024-09-11T05:35:22.632741+0000","last_became_peered":"2024-09-11T05:35:22.632741+0000","last_unstale":"2024-09-11T05:35:35.944244+0000","last_undegraded":"2024-09-11T05:35:35.944244+0000","last_fullsized":"2024-09-11T05:35:35.944244+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:27.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030616850000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":13726,"num_read_kb":13435,"num_write":1662,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":1269861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"140'517","reported_seq":3166,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361418+0000","last_change":"2024-09-11T05:35:10.632188+0000","last_active":"2024-09-11T05:35:36.361418+0000","last_peered":"2024-09-11T05:35:36.361418+0000","last_clean":"2024-09-11T05:35:36.361418+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:35:36.361418+0000","last_undegraded":"2024-09-11T05:35:36.361418+0000","last_fullsized":"2024-09-11T05:35:36.361418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:44.971488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027595950000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":3338,"num_read_kb":10070,"num_write":595,"num_write_kb":6210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"139'1157","reported_seq":3344,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361628+0000","last_change":"2024-09-11T05:35:10.631584+0000","last_active":"2024-09-11T05:35:36.361628+0000","last_peered":"2024-09-11T05:35:36.361628+0000","last_clean":"2024-09-11T05:35:36.361628+0000","last_became_active":"2024-09-11T05:34:54.790407+0000","last_became_peered":"2024-09-11T05:34:54.790407+0000","last_unstale":"2024-09-11T05:35:36.361628+0000","last_undegraded":"2024-09-11T05:35:36.361628+0000","last_fullsized":"2024-09-11T05:35:36.361628+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1157,"log_dups_size":0,"ondisk_log_size":1157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:22.948505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022982459999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5158,"num_read_kb":28626,"num_write":1706,"num_write_kb":20682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":292,"num_bytes_recovered":48701806,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"142'286","reported_seq":3645,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.363325+0000","last_change":"2024-09-11T05:35:27.700408+0000","last_active":"2024-09-11T05:35:36.363325+0000","last_peered":"2024-09-11T05:35:36.363325+0000","last_clean":"2024-09-11T05:35:36.363325+0000","last_became_active":"2024-09-11T05:35:27.699049+0000","last_became_peered":"2024-09-11T05:35:27.699049+0000","last_unstale":"2024-09-11T05:35:36.363325+0000","last_undegraded":"2024-09-11T05:35:36.363325+0000","last_fullsized":"2024-09-11T05:35:36.363325+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:56.992530+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00066517799999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2863,"num_read_kb":14884,"num_write":221,"num_write_kb":7375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":1456269,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"141'725","reported_seq":3846,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743446+0000","last_change":"2024-09-11T05:35:10.633716+0000","last_active":"2024-09-11T05:35:35.743446+0000","last_peered":"2024-09-11T05:35:35.743446+0000","last_clean":"2024-09-11T05:35:35.743446+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:35:35.743446+0000","last_undegraded":"2024-09-11T05:35:35.743446+0000","last_fullsized":"2024-09-11T05:35:35.743446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:59.138792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079156780000000006,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5390,"num_read_kb":12737,"num_write":875,"num_write_kb":9766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"142'369","reported_seq":12008,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819737+0000","last_change":"2024-09-11T05:35:28.700196+0000","last_active":"2024-09-11T05:35:35.819737+0000","last_peered":"2024-09-11T05:35:35.819737+0000","last_clean":"2024-09-11T05:35:35.819737+0000","last_became_active":"2024-09-11T05:35:28.697994+0000","last_became_peered":"2024-09-11T05:35:28.697994+0000","last_unstale":"2024-09-11T05:35:35.819737+0000","last_undegraded":"2024-09-11T05:35:35.819737+0000","last_fullsized":"2024-09-11T05:35:35.819737+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:53.037666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015799760000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5068,"num_read_kb":14759,"num_write":300,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":7503668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819881+0000","last_change":"2024-09-11T05:34:50.627854+0000","last_active":"2024-09-11T05:35:35.819881+0000","last_peered":"2024-09-11T05:35:35.819881+0000","last_clean":"2024-09-11T05:35:35.819881+0000","last_became_active":"2024-09-11T05:34:50.627529+0000","last_became_peered":"2024-09-11T05:34:50.627529+0000","last_unstale":"2024-09-11T05:35:35.819881+0000","last_undegraded":"2024-09-11T05:35:35.819881+0000","last_fullsized":"2024-09-11T05:35:35.819881+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:35.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"147'703","reported_seq":4450,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944385+0000","last_change":"2024-09-11T05:35:22.635026+0000","last_active":"2024-09-11T05:35:35.944385+0000","last_peered":"2024-09-11T05:35:35.944385+0000","last_clean":"2024-09-11T05:35:35.944385+0000","last_became_active":"2024-09-11T05:35:22.632683+0000","last_became_peered":"2024-09-11T05:35:22.632683+0000","last_unstale":"2024-09-11T05:35:35.944385+0000","last_undegraded":"2024-09-11T05:35:35.944385+0000","last_fullsized":"2024-09-11T05:35:35.944385+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:50:23.986237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057885200000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5183,"num_read_kb":4253,"num_write":904,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":463,"num_bytes_recovered":1655489,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944376+0000","last_change":"2024-09-11T05:35:20.631589+0000","last_active":"2024-09-11T05:35:35.944376+0000","last_peered":"2024-09-11T05:35:35.944376+0000","last_clean":"2024-09-11T05:35:35.944376+0000","last_became_active":"2024-09-11T05:35:20.631241+0000","last_became_peered":"2024-09-11T05:35:20.631241+0000","last_unstale":"2024-09-11T05:35:35.944376+0000","last_undegraded":"2024-09-11T05:35:35.944376+0000","last_fullsized":"2024-09-11T05:35:35.944376+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:15.796354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"140'467","reported_seq":6364,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944331+0000","last_change":"2024-09-11T05:35:22.635052+0000","last_active":"2024-09-11T05:35:35.944331+0000","last_peered":"2024-09-11T05:35:35.944331+0000","last_clean":"2024-09-11T05:35:35.944331+0000","last_became_active":"2024-09-11T05:35:22.632436+0000","last_became_peered":"2024-09-11T05:35:22.632436+0000","last_unstale":"2024-09-11T05:35:35.944331+0000","last_undegraded":"2024-09-11T05:35:35.944331+0000","last_fullsized":"2024-09-11T05:35:35.944331+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:45.444932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027050960000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6977,"num_read_kb":16019,"num_write":349,"num_write_kb":6385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":1715668,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":102,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819877+0000","last_change":"2024-09-11T05:35:20.638832+0000","last_active":"2024-09-11T05:35:35.819877+0000","last_peered":"2024-09-11T05:35:35.819877+0000","last_clean":"2024-09-11T05:35:35.819877+0000","last_became_active":"2024-09-11T05:35:20.638478+0000","last_became_peered":"2024-09-11T05:35:20.638478+0000","last_unstale":"2024-09-11T05:35:35.819877+0000","last_undegraded":"2024-09-11T05:35:35.819877+0000","last_fullsized":"2024-09-11T05:35:35.819877+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:12.803640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"147'1631","reported_seq":8207,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361298+0000","last_change":"2024-09-11T05:35:10.631545+0000","last_active":"2024-09-11T05:35:36.361298+0000","last_peered":"2024-09-11T05:35:36.361298+0000","last_clean":"2024-09-11T05:35:36.361298+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:35:36.361298+0000","last_undegraded":"2024-09-11T05:35:36.361298+0000","last_fullsized":"2024-09-11T05:35:36.361298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1631,"log_dups_size":0,"ondisk_log_size":1631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:07.737928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026555530000000002,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":15252,"num_read_kb":37939,"num_write":2291,"num_write_kb":19413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":325,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361624+0000","last_change":"2024-09-11T05:34:44.768103+0000","last_active":"2024-09-11T05:35:36.361624+0000","last_peered":"2024-09-11T05:35:36.361624+0000","last_clean":"2024-09-11T05:35:36.361624+0000","last_became_active":"2024-09-11T05:34:44.767862+0000","last_became_peered":"2024-09-11T05:34:44.767862+0000","last_unstale":"2024-09-11T05:35:36.361624+0000","last_undegraded":"2024-09-11T05:35:36.361624+0000","last_fullsized":"2024-09-11T05:35:36.361624+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:15:05.574617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"144'845","reported_seq":12664,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.363156+0000","last_change":"2024-09-11T05:35:27.700438+0000","last_active":"2024-09-11T05:35:36.363156+0000","last_peered":"2024-09-11T05:35:36.363156+0000","last_clean":"2024-09-11T05:35:36.363156+0000","last_became_active":"2024-09-11T05:35:27.699111+0000","last_became_peered":"2024-09-11T05:35:27.699111+0000","last_unstale":"2024-09-11T05:35:36.363156+0000","last_undegraded":"2024-09-11T05:35:36.363156+0000","last_fullsized":"2024-09-11T05:35:36.363156+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:45.051639+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0034996329999999998,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":15193,"num_read_kb":18227,"num_write":823,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"147'676","reported_seq":4374,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743567+0000","last_change":"2024-09-11T05:35:10.632354+0000","last_active":"2024-09-11T05:35:35.743567+0000","last_peered":"2024-09-11T05:35:35.743567+0000","last_clean":"2024-09-11T05:35:35.743567+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:35:35.743567+0000","last_undegraded":"2024-09-11T05:35:35.743567+0000","last_fullsized":"2024-09-11T05:35:35.743567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:36.049428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0073602759999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4311,"num_read_kb":22872,"num_write":719,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":210,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819683+0000","last_change":"2024-09-11T05:35:28.700422+0000","last_active":"2024-09-11T05:35:35.819683+0000","last_peered":"2024-09-11T05:35:35.819683+0000","last_clean":"2024-09-11T05:35:35.819683+0000","last_became_active":"2024-09-11T05:35:28.700119+0000","last_became_peered":"2024-09-11T05:35:28.700119+0000","last_unstale":"2024-09-11T05:35:35.819683+0000","last_undegraded":"2024-09-11T05:35:35.819683+0000","last_fullsized":"2024-09-11T05:35:35.819683+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:03.431125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"146'345","reported_seq":2882,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361248+0000","last_change":"2024-09-11T05:35:11.642354+0000","last_active":"2024-09-11T05:35:36.361248+0000","last_peered":"2024-09-11T05:35:36.361248+0000","last_clean":"2024-09-11T05:35:36.361248+0000","last_became_active":"2024-09-11T05:35:11.635099+0000","last_became_peered":"2024-09-11T05:35:11.635099+0000","last_unstale":"2024-09-11T05:35:36.361248+0000","last_undegraded":"2024-09-11T05:35:36.361248+0000","last_fullsized":"2024-09-11T05:35:36.361248+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:37:53.460954+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0054654079999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2061,"num_read_kb":16420,"num_write":311,"num_write_kb":9397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3451521,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.744863+0000","last_change":"2024-09-11T05:35:08.633295+0000","last_active":"2024-09-11T05:35:35.744863+0000","last_peered":"2024-09-11T05:35:35.744863+0000","last_clean":"2024-09-11T05:35:35.744863+0000","last_became_active":"2024-09-11T05:35:08.632954+0000","last_became_peered":"2024-09-11T05:35:08.632954+0000","last_unstale":"2024-09-11T05:35:35.744863+0000","last_undegraded":"2024-09-11T05:35:35.744863+0000","last_fullsized":"2024-09-11T05:35:35.744863+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:38:42.279949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"139'743","reported_seq":8668,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361154+0000","last_change":"2024-09-11T05:35:10.629926+0000","last_active":"2024-09-11T05:35:36.361154+0000","last_peered":"2024-09-11T05:35:36.361154+0000","last_clean":"2024-09-11T05:35:36.361154+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:35:36.361154+0000","last_undegraded":"2024-09-11T05:35:36.361154+0000","last_fullsized":"2024-09-11T05:35:36.361154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:51.136449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013315200000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":11851,"num_read_kb":20739,"num_write":676,"num_write_kb":6668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819620+0000","last_change":"2024-09-11T05:34:50.626273+0000","last_active":"2024-09-11T05:35:35.819620+0000","last_peered":"2024-09-11T05:35:35.819620+0000","last_clean":"2024-09-11T05:35:35.819620+0000","last_became_active":"2024-09-11T05:34:50.625970+0000","last_became_peered":"2024-09-11T05:34:50.625970+0000","last_unstale":"2024-09-11T05:35:35.819620+0000","last_undegraded":"2024-09-11T05:35:35.819620+0000","last_fullsized":"2024-09-11T05:35:35.819620+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:45.970895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"144'588","reported_seq":3895,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944239+0000","last_change":"2024-09-11T05:35:23.637690+0000","last_active":"2024-09-11T05:35:35.944239+0000","last_peered":"2024-09-11T05:35:35.944239+0000","last_clean":"2024-09-11T05:35:35.944239+0000","last_became_active":"2024-09-11T05:35:23.635903+0000","last_became_peered":"2024-09-11T05:35:23.635903+0000","last_unstale":"2024-09-11T05:35:35.944239+0000","last_undegraded":"2024-09-11T05:35:35.944239+0000","last_fullsized":"2024-09-11T05:35:35.944239+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:18:14.825205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002640187,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5913,"num_read_kb":15123,"num_write":618,"num_write_kb":14349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":103,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819741+0000","last_change":"2024-09-11T05:35:28.699062+0000","last_active":"2024-09-11T05:35:35.819741+0000","last_peered":"2024-09-11T05:35:35.819741+0000","last_clean":"2024-09-11T05:35:35.819741+0000","last_became_active":"2024-09-11T05:35:28.698723+0000","last_became_peered":"2024-09-11T05:35:28.698723+0000","last_unstale":"2024-09-11T05:35:35.819741+0000","last_undegraded":"2024-09-11T05:35:35.819741+0000","last_fullsized":"2024-09-11T05:35:35.819741+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743659+0000","last_change":"2024-09-11T05:35:22.637165+0000","last_active":"2024-09-11T05:35:35.743659+0000","last_peered":"2024-09-11T05:35:35.743659+0000","last_clean":"2024-09-11T05:35:35.743659+0000","last_became_active":"2024-09-11T05:35:22.636808+0000","last_became_peered":"2024-09-11T05:35:22.636808+0000","last_unstale":"2024-09-11T05:35:35.743659+0000","last_undegraded":"2024-09-11T05:35:35.743659+0000","last_fullsized":"2024-09-11T05:35:35.743659+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:42.605285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"147'674","reported_seq":21155,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944229+0000","last_change":"2024-09-11T05:35:23.638318+0000","last_active":"2024-09-11T05:35:35.944229+0000","last_peered":"2024-09-11T05:35:35.944229+0000","last_clean":"2024-09-11T05:35:35.944229+0000","last_became_active":"2024-09-11T05:35:23.635346+0000","last_became_peered":"2024-09-11T05:35:23.635346+0000","last_unstale":"2024-09-11T05:35:35.944229+0000","last_undegraded":"2024-09-11T05:35:35.944229+0000","last_fullsized":"2024-09-11T05:35:35.944229+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:03:59.781583+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0012007719999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":21937,"num_read_kb":27288,"num_write":631,"num_write_kb":9659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":357,"num_bytes_recovered":6098347,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"142'411","reported_seq":10435,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819648+0000","last_change":"2024-09-11T05:35:28.701354+0000","last_active":"2024-09-11T05:35:35.819648+0000","last_peered":"2024-09-11T05:35:35.819648+0000","last_clean":"2024-09-11T05:35:35.819648+0000","last_became_active":"2024-09-11T05:35:28.699365+0000","last_became_peered":"2024-09-11T05:35:28.699365+0000","last_unstale":"2024-09-11T05:35:35.819648+0000","last_undegraded":"2024-09-11T05:35:35.819648+0000","last_fullsized":"2024-09-11T05:35:35.819648+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:37.199627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003370732,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9328,"num_read_kb":19500,"num_write":336,"num_write_kb":14817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":8961432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"144'432","reported_seq":3813,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819680+0000","last_change":"2024-09-11T05:35:28.701794+0000","last_active":"2024-09-11T05:35:35.819680+0000","last_peered":"2024-09-11T05:35:35.819680+0000","last_clean":"2024-09-11T05:35:35.819680+0000","last_became_active":"2024-09-11T05:35:28.700107+0000","last_became_peered":"2024-09-11T05:35:28.700107+0000","last_unstale":"2024-09-11T05:35:35.819680+0000","last_undegraded":"2024-09-11T05:35:35.819680+0000","last_fullsized":"2024-09-11T05:35:35.819680+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:45.230792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003122947,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1794,"num_read_kb":9402,"num_write":412,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":10914094,"num_keys_recovered":66,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"139'324","reported_seq":2603,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.744872+0000","last_change":"2024-09-11T05:35:11.637663+0000","last_active":"2024-09-11T05:35:35.744872+0000","last_peered":"2024-09-11T05:35:35.744872+0000","last_clean":"2024-09-11T05:35:35.744872+0000","last_became_active":"2024-09-11T05:35:11.631665+0000","last_became_peered":"2024-09-11T05:35:11.631665+0000","last_unstale":"2024-09-11T05:35:35.744872+0000","last_undegraded":"2024-09-11T05:35:35.744872+0000","last_fullsized":"2024-09-11T05:35:35.744872+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:56:28.397445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040247640000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2267,"num_read_kb":23620,"num_write":305,"num_write_kb":16916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":14087582,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"146'409","reported_seq":3153,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743504+0000","last_change":"2024-09-11T05:35:11.640341+0000","last_active":"2024-09-11T05:35:35.743504+0000","last_peered":"2024-09-11T05:35:35.743504+0000","last_clean":"2024-09-11T05:35:35.743504+0000","last_became_active":"2024-09-11T05:35:11.630867+0000","last_became_peered":"2024-09-11T05:35:11.630867+0000","last_unstale":"2024-09-11T05:35:35.743504+0000","last_undegraded":"2024-09-11T05:35:35.743504+0000","last_fullsized":"2024-09-11T05:35:35.743504+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:13.877495+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0078972569999999995,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1985,"num_read_kb":12033,"num_write":383,"num_write_kb":5272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":320,"num_bytes_recovered":6119775,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"141'478","reported_seq":5937,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819734+0000","last_change":"2024-09-11T05:35:28.702740+0000","last_active":"2024-09-11T05:35:35.819734+0000","last_peered":"2024-09-11T05:35:35.819734+0000","last_clean":"2024-09-11T05:35:35.819734+0000","last_became_active":"2024-09-11T05:35:28.699897+0000","last_became_peered":"2024-09-11T05:35:28.699897+0000","last_unstale":"2024-09-11T05:35:35.819734+0000","last_undegraded":"2024-09-11T05:35:35.819734+0000","last_fullsized":"2024-09-11T05:35:35.819734+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:38.206892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039836639999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5865,"num_read_kb":13697,"num_write":403,"num_write_kb":10315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":13015515,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"140'401","reported_seq":2951,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361507+0000","last_change":"2024-09-11T05:35:10.629686+0000","last_active":"2024-09-11T05:35:36.361507+0000","last_peered":"2024-09-11T05:35:36.361507+0000","last_clean":"2024-09-11T05:35:36.361507+0000","last_became_active":"2024-09-11T05:35:05.630573+0000","last_became_peered":"2024-09-11T05:35:05.630573+0000","last_unstale":"2024-09-11T05:35:36.361507+0000","last_undegraded":"2024-09-11T05:35:36.361507+0000","last_fullsized":"2024-09-11T05:35:36.361507+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:55.457196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001163856,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2127,"num_read_kb":12622,"num_write":331,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":262196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"141'638","reported_seq":5213,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743414+0000","last_change":"2024-09-11T05:35:22.636513+0000","last_active":"2024-09-11T05:35:35.743414+0000","last_peered":"2024-09-11T05:35:35.743414+0000","last_clean":"2024-09-11T05:35:35.743414+0000","last_became_active":"2024-09-11T05:35:22.634192+0000","last_became_peered":"2024-09-11T05:35:22.634192+0000","last_unstale":"2024-09-11T05:35:35.743414+0000","last_undegraded":"2024-09-11T05:35:35.743414+0000","last_fullsized":"2024-09-11T05:35:35.743414+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:07.719785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005994961,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":6001,"num_read_kb":12376,"num_write":612,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":2111260,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"135'377","reported_seq":5505,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743356+0000","last_change":"2024-09-11T05:35:22.638949+0000","last_active":"2024-09-11T05:35:35.743356+0000","last_peered":"2024-09-11T05:35:35.743356+0000","last_clean":"2024-09-11T05:35:35.743356+0000","last_became_active":"2024-09-11T05:35:22.635431+0000","last_became_peered":"2024-09-11T05:35:22.635431+0000","last_unstale":"2024-09-11T05:35:35.743356+0000","last_undegraded":"2024-09-11T05:35:35.743356+0000","last_fullsized":"2024-09-11T05:35:35.743356+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:18.444306+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0045659699999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4943,"num_read_kb":12354,"num_write":293,"num_write_kb":4874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":3066244,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"141'664","reported_seq":2303,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819620+0000","last_change":"2024-09-11T05:35:28.703601+0000","last_active":"2024-09-11T05:35:35.819620+0000","last_peered":"2024-09-11T05:35:35.819620+0000","last_clean":"2024-09-11T05:35:35.819620+0000","last_became_active":"2024-09-11T05:35:28.701845+0000","last_became_peered":"2024-09-11T05:35:28.701845+0000","last_unstale":"2024-09-11T05:35:35.819620+0000","last_undegraded":"2024-09-11T05:35:35.819620+0000","last_fullsized":"2024-09-11T05:35:35.819620+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:54.507773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001942809,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2920,"num_read_kb":11034,"num_write":809,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":3434090,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"144'613","reported_seq":11190,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361155+0000","last_change":"2024-09-11T05:35:10.631369+0000","last_active":"2024-09-11T05:35:36.361155+0000","last_peered":"2024-09-11T05:35:36.361155+0000","last_clean":"2024-09-11T05:35:36.361155+0000","last_became_active":"2024-09-11T05:34:53.789002+0000","last_became_peered":"2024-09-11T05:34:53.789002+0000","last_unstale":"2024-09-11T05:35:36.361155+0000","last_undegraded":"2024-09-11T05:35:36.361155+0000","last_fullsized":"2024-09-11T05:35:36.361155+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:29.114608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002392473,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3076,"num_read_kb":7989,"num_write":738,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":6984484,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"144'563","reported_seq":6585,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819733+0000","last_change":"2024-09-11T05:35:28.698744+0000","last_active":"2024-09-11T05:35:35.819733+0000","last_peered":"2024-09-11T05:35:35.819733+0000","last_clean":"2024-09-11T05:35:35.819733+0000","last_became_active":"2024-09-11T05:35:28.696781+0000","last_became_peered":"2024-09-11T05:35:28.696781+0000","last_unstale":"2024-09-11T05:35:35.819733+0000","last_undegraded":"2024-09-11T05:35:35.819733+0000","last_fullsized":"2024-09-11T05:35:35.819733+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:24.791414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017107820000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6991,"num_read_kb":39098,"num_write":620,"num_write_kb":9927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":4472318,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":121,"num_read":220717,"num_read_kb":578588,"num_write":21850,"num_write_kb":315751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6659,"num_bytes_recovered":181815763,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19579,"ondisk_log_size":19579,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33176,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338664,"statfs":{"total":96636764160,"available":96602791936,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78176,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293664,"statfs":{"total":96636764160,"available":96556711936,"internally_reserved":0,"allocated":2629632,"data_stored":1571772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":103,"seq":442381631505,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":1984,"kb_used_omap":4,"kb_used_meta":31803,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4454,"internal_metadata":32566938},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51220,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320620,"statfs":{"total":96636764160,"available":96584314880,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69856,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301984,"statfs":{"total":96636764160,"available":96565231616,"internally_reserved":0,"allocated":2629632,"data_stored":1571772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51220,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320620,"statfs":{"total":96636764160,"available":96584314880,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:35:40.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:35:40.391 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:35:40.391 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:35:40.403 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-09-11T05:35:39.975025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":121,"num_read":220833,"num_read_kb":578688,"num_write":22011,"num_write_kb":318169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6665,"num_bytes_recovered":182406169,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19699,"ondisk_log_size":19699,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436552,"kb_used_data":17048,"kb_used_omap":15,"kb_used_meta":419312,"kb_avail":754538168,"statfs":{"total":773094113280,"available":772647084032,"internally_reserved":0,"allocated":17457152,"data_stored":9031892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15611,"internal_metadata":429376261},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.247381"},"pg_stats":[{"pgid":"3.1f","version":"147'611","reported_seq":7854,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361610+0000","last_change":"2024-09-11T05:35:22.638115+0000","last_active":"2024-09-11T05:35:36.361610+0000","last_peered":"2024-09-11T05:35:36.361610+0000","last_clean":"2024-09-11T05:35:36.361610+0000","last_became_active":"2024-09-11T05:35:22.637032+0000","last_became_peered":"2024-09-11T05:35:22.637032+0000","last_unstale":"2024-09-11T05:35:36.361610+0000","last_undegraded":"2024-09-11T05:35:36.361610+0000","last_fullsized":"2024-09-11T05:35:36.361610+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:31.476738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00245933,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7747,"num_read_kb":22584,"num_write":761,"num_write_kb":11145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":285,"num_bytes_recovered":4324286,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"139'296","reported_seq":3772,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361548+0000","last_change":"2024-09-11T05:35:10.630226+0000","last_active":"2024-09-11T05:35:36.361548+0000","last_peered":"2024-09-11T05:35:36.361548+0000","last_clean":"2024-09-11T05:35:36.361548+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:35:36.361548+0000","last_undegraded":"2024-09-11T05:35:36.361548+0000","last_fullsized":"2024-09-11T05:35:36.361548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:57:10.083669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014246319999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":3027,"num_read_kb":23842,"num_write":231,"num_write_kb":6198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"144'910","reported_seq":21667,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819869+0000","last_change":"2024-09-11T05:35:28.699205+0000","last_active":"2024-09-11T05:35:35.819869+0000","last_peered":"2024-09-11T05:35:35.819869+0000","last_clean":"2024-09-11T05:35:35.819869+0000","last_became_active":"2024-09-11T05:35:28.696723+0000","last_became_peered":"2024-09-11T05:35:28.696723+0000","last_unstale":"2024-09-11T05:35:35.819869+0000","last_undegraded":"2024-09-11T05:35:35.819869+0000","last_fullsized":"2024-09-11T05:35:35.819869+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:40.890246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003253822,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":16637,"num_read_kb":25385,"num_write":1112,"num_write_kb":7409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":6593091,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"147'601","reported_seq":7773,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743694+0000","last_change":"2024-09-11T05:35:22.638770+0000","last_active":"2024-09-11T05:35:35.743694+0000","last_peered":"2024-09-11T05:35:35.743694+0000","last_clean":"2024-09-11T05:35:35.743694+0000","last_became_active":"2024-09-11T05:35:22.636725+0000","last_became_peered":"2024-09-11T05:35:22.636725+0000","last_unstale":"2024-09-11T05:35:35.743694+0000","last_undegraded":"2024-09-11T05:35:35.743694+0000","last_fullsized":"2024-09-11T05:35:35.743694+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:53:13.907056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028264560000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9012,"num_read_kb":27646,"num_write":675,"num_write_kb":16439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":13219858,"num_keys_recovered":56,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"140'579","reported_seq":7861,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944261+0000","last_change":"2024-09-11T05:35:23.636456+0000","last_active":"2024-09-11T05:35:35.944261+0000","last_peered":"2024-09-11T05:35:35.944261+0000","last_clean":"2024-09-11T05:35:35.944261+0000","last_became_active":"2024-09-11T05:35:23.634303+0000","last_became_peered":"2024-09-11T05:35:23.634303+0000","last_unstale":"2024-09-11T05:35:35.944261+0000","last_undegraded":"2024-09-11T05:35:35.944261+0000","last_fullsized":"2024-09-11T05:35:35.944261+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:01.958896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049355689999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":7366,"num_read_kb":17763,"num_write":665,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":421,"num_bytes_recovered":7543883,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"136'445","reported_seq":5277,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743659+0000","last_change":"2024-09-11T05:35:22.638768+0000","last_active":"2024-09-11T05:35:35.743659+0000","last_peered":"2024-09-11T05:35:35.743659+0000","last_clean":"2024-09-11T05:35:35.743659+0000","last_became_active":"2024-09-11T05:35:22.636807+0000","last_became_peered":"2024-09-11T05:35:22.636807+0000","last_unstale":"2024-09-11T05:35:35.743659+0000","last_undegraded":"2024-09-11T05:35:35.743659+0000","last_fullsized":"2024-09-11T05:35:35.743659+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:29.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017105359999999999,"stat_sum":{"num_bytes":19,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":6,"num_read":5410,"num_read_kb":14252,"num_write":483,"num_write_kb":12836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":327,"num_bytes_recovered":4853026,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"139'1101","reported_seq":11036,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944244+0000","last_change":"2024-09-11T05:35:22.634971+0000","last_active":"2024-09-11T05:35:35.944244+0000","last_peered":"2024-09-11T05:35:35.944244+0000","last_clean":"2024-09-11T05:35:35.944244+0000","last_became_active":"2024-09-11T05:35:22.632741+0000","last_became_peered":"2024-09-11T05:35:22.632741+0000","last_unstale":"2024-09-11T05:35:35.944244+0000","last_undegraded":"2024-09-11T05:35:35.944244+0000","last_fullsized":"2024-09-11T05:35:35.944244+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:27.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030616850000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":13726,"num_read_kb":13435,"num_write":1662,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":1269861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"140'517","reported_seq":3166,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361418+0000","last_change":"2024-09-11T05:35:10.632188+0000","last_active":"2024-09-11T05:35:36.361418+0000","last_peered":"2024-09-11T05:35:36.361418+0000","last_clean":"2024-09-11T05:35:36.361418+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:35:36.361418+0000","last_undegraded":"2024-09-11T05:35:36.361418+0000","last_fullsized":"2024-09-11T05:35:36.361418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:44.971488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027595950000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":3338,"num_read_kb":10070,"num_write":595,"num_write_kb":6210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"139'1157","reported_seq":3344,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361628+0000","last_change":"2024-09-11T05:35:10.631584+0000","last_active":"2024-09-11T05:35:36.361628+0000","last_peered":"2024-09-11T05:35:36.361628+0000","last_clean":"2024-09-11T05:35:36.361628+0000","last_became_active":"2024-09-11T05:34:54.790407+0000","last_became_peered":"2024-09-11T05:34:54.790407+0000","last_unstale":"2024-09-11T05:35:36.361628+0000","last_undegraded":"2024-09-11T05:35:36.361628+0000","last_fullsized":"2024-09-11T05:35:36.361628+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1157,"log_dups_size":0,"ondisk_log_size":1157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:22.948505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022982459999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5158,"num_read_kb":28626,"num_write":1706,"num_write_kb":20682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":292,"num_bytes_recovered":48701806,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"142'286","reported_seq":3645,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.363325+0000","last_change":"2024-09-11T05:35:27.700408+0000","last_active":"2024-09-11T05:35:36.363325+0000","last_peered":"2024-09-11T05:35:36.363325+0000","last_clean":"2024-09-11T05:35:36.363325+0000","last_became_active":"2024-09-11T05:35:27.699049+0000","last_became_peered":"2024-09-11T05:35:27.699049+0000","last_unstale":"2024-09-11T05:35:36.363325+0000","last_undegraded":"2024-09-11T05:35:36.363325+0000","last_fullsized":"2024-09-11T05:35:36.363325+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:56.992530+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00066517799999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2863,"num_read_kb":14884,"num_write":221,"num_write_kb":7375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":1456269,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"141'725","reported_seq":3846,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743446+0000","last_change":"2024-09-11T05:35:10.633716+0000","last_active":"2024-09-11T05:35:35.743446+0000","last_peered":"2024-09-11T05:35:35.743446+0000","last_clean":"2024-09-11T05:35:35.743446+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:35:35.743446+0000","last_undegraded":"2024-09-11T05:35:35.743446+0000","last_fullsized":"2024-09-11T05:35:35.743446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:59.138792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079156780000000006,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5390,"num_read_kb":12737,"num_write":875,"num_write_kb":9766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"142'369","reported_seq":12008,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819737+0000","last_change":"2024-09-11T05:35:28.700196+0000","last_active":"2024-09-11T05:35:35.819737+0000","last_peered":"2024-09-11T05:35:35.819737+0000","last_clean":"2024-09-11T05:35:35.819737+0000","last_became_active":"2024-09-11T05:35:28.697994+0000","last_became_peered":"2024-09-11T05:35:28.697994+0000","last_unstale":"2024-09-11T05:35:35.819737+0000","last_undegraded":"2024-09-11T05:35:35.819737+0000","last_fullsized":"2024-09-11T05:35:35.819737+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:53.037666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015799760000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5068,"num_read_kb":14759,"num_write":300,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":7503668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819881+0000","last_change":"2024-09-11T05:34:50.627854+0000","last_active":"2024-09-11T05:35:35.819881+0000","last_peered":"2024-09-11T05:35:35.819881+0000","last_clean":"2024-09-11T05:35:35.819881+0000","last_became_active":"2024-09-11T05:34:50.627529+0000","last_became_peered":"2024-09-11T05:34:50.627529+0000","last_unstale":"2024-09-11T05:35:35.819881+0000","last_undegraded":"2024-09-11T05:35:35.819881+0000","last_fullsized":"2024-09-11T05:35:35.819881+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:35.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"147'703","reported_seq":4450,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944385+0000","last_change":"2024-09-11T05:35:22.635026+0000","last_active":"2024-09-11T05:35:35.944385+0000","last_peered":"2024-09-11T05:35:35.944385+0000","last_clean":"2024-09-11T05:35:35.944385+0000","last_became_active":"2024-09-11T05:35:22.632683+0000","last_became_peered":"2024-09-11T05:35:22.632683+0000","last_unstale":"2024-09-11T05:35:35.944385+0000","last_undegraded":"2024-09-11T05:35:35.944385+0000","last_fullsized":"2024-09-11T05:35:35.944385+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:50:23.986237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057885200000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5183,"num_read_kb":4253,"num_write":904,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":463,"num_bytes_recovered":1655489,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944376+0000","last_change":"2024-09-11T05:35:20.631589+0000","last_active":"2024-09-11T05:35:35.944376+0000","last_peered":"2024-09-11T05:35:35.944376+0000","last_clean":"2024-09-11T05:35:35.944376+0000","last_became_active":"2024-09-11T05:35:20.631241+0000","last_became_peered":"2024-09-11T05:35:20.631241+0000","last_unstale":"2024-09-11T05:35:35.944376+0000","last_undegraded":"2024-09-11T05:35:35.944376+0000","last_fullsized":"2024-09-11T05:35:35.944376+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:15.796354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"140'467","reported_seq":6364,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944331+0000","last_change":"2024-09-11T05:35:22.635052+0000","last_active":"2024-09-11T05:35:35.944331+0000","last_peered":"2024-09-11T05:35:35.944331+0000","last_clean":"2024-09-11T05:35:35.944331+0000","last_became_active":"2024-09-11T05:35:22.632436+0000","last_became_peered":"2024-09-11T05:35:22.632436+0000","last_unstale":"2024-09-11T05:35:35.944331+0000","last_undegraded":"2024-09-11T05:35:35.944331+0000","last_fullsized":"2024-09-11T05:35:35.944331+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:45.444932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027050960000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6977,"num_read_kb":16019,"num_write":349,"num_write_kb":6385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":1715668,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":102,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819877+0000","last_change":"2024-09-11T05:35:20.638832+0000","last_active":"2024-09-11T05:35:35.819877+0000","last_peered":"2024-09-11T05:35:35.819877+0000","last_clean":"2024-09-11T05:35:35.819877+0000","last_became_active":"2024-09-11T05:35:20.638478+0000","last_became_peered":"2024-09-11T05:35:20.638478+0000","last_unstale":"2024-09-11T05:35:35.819877+0000","last_undegraded":"2024-09-11T05:35:35.819877+0000","last_fullsized":"2024-09-11T05:35:35.819877+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:12.803640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"147'1631","reported_seq":8207,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361298+0000","last_change":"2024-09-11T05:35:10.631545+0000","last_active":"2024-09-11T05:35:36.361298+0000","last_peered":"2024-09-11T05:35:36.361298+0000","last_clean":"2024-09-11T05:35:36.361298+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:35:36.361298+0000","last_undegraded":"2024-09-11T05:35:36.361298+0000","last_fullsized":"2024-09-11T05:35:36.361298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1631,"log_dups_size":0,"ondisk_log_size":1631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:07.737928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026555530000000002,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":15252,"num_read_kb":37939,"num_write":2291,"num_write_kb":19413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":325,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361624+0000","last_change":"2024-09-11T05:34:44.768103+0000","last_active":"2024-09-11T05:35:36.361624+0000","last_peered":"2024-09-11T05:35:36.361624+0000","last_clean":"2024-09-11T05:35:36.361624+0000","last_became_active":"2024-09-11T05:34:44.767862+0000","last_became_peered":"2024-09-11T05:34:44.767862+0000","last_unstale":"2024-09-11T05:35:36.361624+0000","last_undegraded":"2024-09-11T05:35:36.361624+0000","last_fullsized":"2024-09-11T05:35:36.361624+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:15:05.574617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"144'845","reported_seq":12664,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.363156+0000","last_change":"2024-09-11T05:35:27.700438+0000","last_active":"2024-09-11T05:35:36.363156+0000","last_peered":"2024-09-11T05:35:36.363156+0000","last_clean":"2024-09-11T05:35:36.363156+0000","last_became_active":"2024-09-11T05:35:27.699111+0000","last_became_peered":"2024-09-11T05:35:27.699111+0000","last_unstale":"2024-09-11T05:35:36.363156+0000","last_undegraded":"2024-09-11T05:35:36.363156+0000","last_fullsized":"2024-09-11T05:35:36.363156+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:45.051639+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0034996329999999998,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":15193,"num_read_kb":18227,"num_write":823,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"147'676","reported_seq":4374,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743567+0000","last_change":"2024-09-11T05:35:10.632354+0000","last_active":"2024-09-11T05:35:35.743567+0000","last_peered":"2024-09-11T05:35:35.743567+0000","last_clean":"2024-09-11T05:35:35.743567+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:35:35.743567+0000","last_undegraded":"2024-09-11T05:35:35.743567+0000","last_fullsized":"2024-09-11T05:35:35.743567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:36.049428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0073602759999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4311,"num_read_kb":22872,"num_write":719,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":210,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819683+0000","last_change":"2024-09-11T05:35:28.700422+0000","last_active":"2024-09-11T05:35:35.819683+0000","last_peered":"2024-09-11T05:35:35.819683+0000","last_clean":"2024-09-11T05:35:35.819683+0000","last_became_active":"2024-09-11T05:35:28.700119+0000","last_became_peered":"2024-09-11T05:35:28.700119+0000","last_unstale":"2024-09-11T05:35:35.819683+0000","last_undegraded":"2024-09-11T05:35:35.819683+0000","last_fullsized":"2024-09-11T05:35:35.819683+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:03.431125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"146'345","reported_seq":2882,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361248+0000","last_change":"2024-09-11T05:35:11.642354+0000","last_active":"2024-09-11T05:35:36.361248+0000","last_peered":"2024-09-11T05:35:36.361248+0000","last_clean":"2024-09-11T05:35:36.361248+0000","last_became_active":"2024-09-11T05:35:11.635099+0000","last_became_peered":"2024-09-11T05:35:11.635099+0000","last_unstale":"2024-09-11T05:35:36.361248+0000","last_undegraded":"2024-09-11T05:35:36.361248+0000","last_fullsized":"2024-09-11T05:35:36.361248+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:37:53.460954+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0054654079999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2061,"num_read_kb":16420,"num_write":311,"num_write_kb":9397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3451521,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.744863+0000","last_change":"2024-09-11T05:35:08.633295+0000","last_active":"2024-09-11T05:35:35.744863+0000","last_peered":"2024-09-11T05:35:35.744863+0000","last_clean":"2024-09-11T05:35:35.744863+0000","last_became_active":"2024-09-11T05:35:08.632954+0000","last_became_peered":"2024-09-11T05:35:08.632954+0000","last_unstale":"2024-09-11T05:35:35.744863+0000","last_undegraded":"2024-09-11T05:35:35.744863+0000","last_fullsized":"2024-09-11T05:35:35.744863+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:38:42.279949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"139'743","reported_seq":8668,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361154+0000","last_change":"2024-09-11T05:35:10.629926+0000","last_active":"2024-09-11T05:35:36.361154+0000","last_peered":"2024-09-11T05:35:36.361154+0000","last_clean":"2024-09-11T05:35:36.361154+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:35:36.361154+0000","last_undegraded":"2024-09-11T05:35:36.361154+0000","last_fullsized":"2024-09-11T05:35:36.361154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:51.136449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013315200000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":11851,"num_read_kb":20739,"num_write":676,"num_write_kb":6668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819620+0000","last_change":"2024-09-11T05:34:50.626273+0000","last_active":"2024-09-11T05:35:35.819620+0000","last_peered":"2024-09-11T05:35:35.819620+0000","last_clean":"2024-09-11T05:35:35.819620+0000","last_became_active":"2024-09-11T05:34:50.625970+0000","last_became_peered":"2024-09-11T05:34:50.625970+0000","last_unstale":"2024-09-11T05:35:35.819620+0000","last_undegraded":"2024-09-11T05:35:35.819620+0000","last_fullsized":"2024-09-11T05:35:35.819620+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:45.970895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"144'588","reported_seq":3895,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944239+0000","last_change":"2024-09-11T05:35:23.637690+0000","last_active":"2024-09-11T05:35:35.944239+0000","last_peered":"2024-09-11T05:35:35.944239+0000","last_clean":"2024-09-11T05:35:35.944239+0000","last_became_active":"2024-09-11T05:35:23.635903+0000","last_became_peered":"2024-09-11T05:35:23.635903+0000","last_unstale":"2024-09-11T05:35:35.944239+0000","last_undegraded":"2024-09-11T05:35:35.944239+0000","last_fullsized":"2024-09-11T05:35:35.944239+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:18:14.825205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002640187,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5913,"num_read_kb":15123,"num_write":618,"num_write_kb":14349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":103,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819741+0000","last_change":"2024-09-11T05:35:28.699062+0000","last_active":"2024-09-11T05:35:35.819741+0000","last_peered":"2024-09-11T05:35:35.819741+0000","last_clean":"2024-09-11T05:35:35.819741+0000","last_became_active":"2024-09-11T05:35:28.698723+0000","last_became_peered":"2024-09-11T05:35:28.698723+0000","last_unstale":"2024-09-11T05:35:35.819741+0000","last_undegraded":"2024-09-11T05:35:35.819741+0000","last_fullsized":"2024-09-11T05:35:35.819741+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743659+0000","last_change":"2024-09-11T05:35:22.637165+0000","last_active":"2024-09-11T05:35:35.743659+0000","last_peered":"2024-09-11T05:35:35.743659+0000","last_clean":"2024-09-11T05:35:35.743659+0000","last_became_active":"2024-09-11T05:35:22.636808+0000","last_became_peered":"2024-09-11T05:35:22.636808+0000","last_unstale":"2024-09-11T05:35:35.743659+0000","last_undegraded":"2024-09-11T05:35:35.743659+0000","last_fullsized":"2024-09-11T05:35:35.743659+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:42.605285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"147'674","reported_seq":21155,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944229+0000","last_change":"2024-09-11T05:35:23.638318+0000","last_active":"2024-09-11T05:35:35.944229+0000","last_peered":"2024-09-11T05:35:35.944229+0000","last_clean":"2024-09-11T05:35:35.944229+0000","last_became_active":"2024-09-11T05:35:23.635346+0000","last_became_peered":"2024-09-11T05:35:23.635346+0000","last_unstale":"2024-09-11T05:35:35.944229+0000","last_undegraded":"2024-09-11T05:35:35.944229+0000","last_fullsized":"2024-09-11T05:35:35.944229+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:03:59.781583+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0012007719999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":21937,"num_read_kb":27288,"num_write":631,"num_write_kb":9659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":357,"num_bytes_recovered":6098347,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"142'411","reported_seq":10435,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819648+0000","last_change":"2024-09-11T05:35:28.701354+0000","last_active":"2024-09-11T05:35:35.819648+0000","last_peered":"2024-09-11T05:35:35.819648+0000","last_clean":"2024-09-11T05:35:35.819648+0000","last_became_active":"2024-09-11T05:35:28.699365+0000","last_became_peered":"2024-09-11T05:35:28.699365+0000","last_unstale":"2024-09-11T05:35:35.819648+0000","last_undegraded":"2024-09-11T05:35:35.819648+0000","last_fullsized":"2024-09-11T05:35:35.819648+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:37.199627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003370732,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9328,"num_read_kb":19500,"num_write":336,"num_write_kb":14817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":8961432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"144'432","reported_seq":3813,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819680+0000","last_change":"2024-09-11T05:35:28.701794+0000","last_active":"2024-09-11T05:35:35.819680+0000","last_peered":"2024-09-11T05:35:35.819680+0000","last_clean":"2024-09-11T05:35:35.819680+0000","last_became_active":"2024-09-11T05:35:28.700107+0000","last_became_peered":"2024-09-11T05:35:28.700107+0000","last_unstale":"2024-09-11T05:35:35.819680+0000","last_undegraded":"2024-09-11T05:35:35.819680+0000","last_fullsized":"2024-09-11T05:35:35.819680+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:45.230792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003122947,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1794,"num_read_kb":9402,"num_write":412,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":10914094,"num_keys_recovered":66,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"139'324","reported_seq":2603,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.744872+0000","last_change":"2024-09-11T05:35:11.637663+0000","last_active":"2024-09-11T05:35:35.744872+0000","last_peered":"2024-09-11T05:35:35.744872+0000","last_clean":"2024-09-11T05:35:35.744872+0000","last_became_active":"2024-09-11T05:35:11.631665+0000","last_became_peered":"2024-09-11T05:35:11.631665+0000","last_unstale":"2024-09-11T05:35:35.744872+0000","last_undegraded":"2024-09-11T05:35:35.744872+0000","last_fullsized":"2024-09-11T05:35:35.744872+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:56:28.397445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040247640000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2267,"num_read_kb":23620,"num_write":305,"num_write_kb":16916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":14087582,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"146'409","reported_seq":3153,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743504+0000","last_change":"2024-09-11T05:35:11.640341+0000","last_active":"2024-09-11T05:35:35.743504+0000","last_peered":"2024-09-11T05:35:35.743504+0000","last_clean":"2024-09-11T05:35:35.743504+0000","last_became_active":"2024-09-11T05:35:11.630867+0000","last_became_peered":"2024-09-11T05:35:11.630867+0000","last_unstale":"2024-09-11T05:35:35.743504+0000","last_undegraded":"2024-09-11T05:35:35.743504+0000","last_fullsized":"2024-09-11T05:35:35.743504+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:13.877495+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0078972569999999995,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1985,"num_read_kb":12033,"num_write":383,"num_write_kb":5272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":320,"num_bytes_recovered":6119775,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"141'478","reported_seq":5937,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819734+0000","last_change":"2024-09-11T05:35:28.702740+0000","last_active":"2024-09-11T05:35:35.819734+0000","last_peered":"2024-09-11T05:35:35.819734+0000","last_clean":"2024-09-11T05:35:35.819734+0000","last_became_active":"2024-09-11T05:35:28.699897+0000","last_became_peered":"2024-09-11T05:35:28.699897+0000","last_unstale":"2024-09-11T05:35:35.819734+0000","last_undegraded":"2024-09-11T05:35:35.819734+0000","last_fullsized":"2024-09-11T05:35:35.819734+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:38.206892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039836639999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5865,"num_read_kb":13697,"num_write":403,"num_write_kb":10315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":13015515,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"140'401","reported_seq":2951,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361507+0000","last_change":"2024-09-11T05:35:10.629686+0000","last_active":"2024-09-11T05:35:36.361507+0000","last_peered":"2024-09-11T05:35:36.361507+0000","last_clean":"2024-09-11T05:35:36.361507+0000","last_became_active":"2024-09-11T05:35:05.630573+0000","last_became_peered":"2024-09-11T05:35:05.630573+0000","last_unstale":"2024-09-11T05:35:36.361507+0000","last_undegraded":"2024-09-11T05:35:36.361507+0000","last_fullsized":"2024-09-11T05:35:36.361507+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:55.457196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001163856,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2127,"num_read_kb":12622,"num_write":331,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":262196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"141'638","reported_seq":5213,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743414+0000","last_change":"2024-09-11T05:35:22.636513+0000","last_active":"2024-09-11T05:35:35.743414+0000","last_peered":"2024-09-11T05:35:35.743414+0000","last_clean":"2024-09-11T05:35:35.743414+0000","last_became_active":"2024-09-11T05:35:22.634192+0000","last_became_peered":"2024-09-11T05:35:22.634192+0000","last_unstale":"2024-09-11T05:35:35.743414+0000","last_undegraded":"2024-09-11T05:35:35.743414+0000","last_fullsized":"2024-09-11T05:35:35.743414+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:07.719785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005994961,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":6001,"num_read_kb":12376,"num_write":612,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":2111260,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"135'377","reported_seq":5505,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743356+0000","last_change":"2024-09-11T05:35:22.638949+0000","last_active":"2024-09-11T05:35:35.743356+0000","last_peered":"2024-09-11T05:35:35.743356+0000","last_clean":"2024-09-11T05:35:35.743356+0000","last_became_active":"2024-09-11T05:35:22.635431+0000","last_became_peered":"2024-09-11T05:35:22.635431+0000","last_unstale":"2024-09-11T05:35:35.743356+0000","last_undegraded":"2024-09-11T05:35:35.743356+0000","last_fullsized":"2024-09-11T05:35:35.743356+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:18.444306+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0045659699999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4943,"num_read_kb":12354,"num_write":293,"num_write_kb":4874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":3066244,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"141'664","reported_seq":2303,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819620+0000","last_change":"2024-09-11T05:35:28.703601+0000","last_active":"2024-09-11T05:35:35.819620+0000","last_peered":"2024-09-11T05:35:35.819620+0000","last_clean":"2024-09-11T05:35:35.819620+0000","last_became_active":"2024-09-11T05:35:28.701845+0000","last_became_peered":"2024-09-11T05:35:28.701845+0000","last_unstale":"2024-09-11T05:35:35.819620+0000","last_undegraded":"2024-09-11T05:35:35.819620+0000","last_fullsized":"2024-09-11T05:35:35.819620+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:54.507773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001942809,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2920,"num_read_kb":11034,"num_write":809,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":3434090,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"144'613","reported_seq":11190,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361155+0000","last_change":"2024-09-11T05:35:10.631369+0000","last_active":"2024-09-11T05:35:36.361155+0000","last_peered":"2024-09-11T05:35:36.361155+0000","last_clean":"2024-09-11T05:35:36.361155+0000","last_became_active":"2024-09-11T05:34:53.789002+0000","last_became_peered":"2024-09-11T05:34:53.789002+0000","last_unstale":"2024-09-11T05:35:36.361155+0000","last_undegraded":"2024-09-11T05:35:36.361155+0000","last_fullsized":"2024-09-11T05:35:36.361155+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:29.114608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002392473,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3076,"num_read_kb":7989,"num_write":738,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":6984484,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"144'563","reported_seq":6585,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819733+0000","last_change":"2024-09-11T05:35:28.698744+0000","last_active":"2024-09-11T05:35:35.819733+0000","last_peered":"2024-09-11T05:35:35.819733+0000","last_clean":"2024-09-11T05:35:35.819733+0000","last_became_active":"2024-09-11T05:35:28.696781+0000","last_became_peered":"2024-09-11T05:35:28.696781+0000","last_unstale":"2024-09-11T05:35:35.819733+0000","last_undegraded":"2024-09-11T05:35:35.819733+0000","last_fullsized":"2024-09-11T05:35:35.819733+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:24.791414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017107820000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6991,"num_read_kb":39098,"num_write":620,"num_write_kb":9927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":4472318,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":121,"num_read":220717,"num_read_kb":578588,"num_write":21850,"num_write_kb":315751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6659,"num_bytes_recovered":181815763,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19579,"ondisk_log_size":19579,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33176,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338664,"statfs":{"total":96636764160,"available":96602791936,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78176,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293664,"statfs":{"total":96636764160,"available":96556711936,"internally_reserved":0,"allocated":2629632,"data_stored":1571772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":103,"seq":442381631505,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":1984,"kb_used_omap":4,"kb_used_meta":31803,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4454,"internal_metadata":32566938},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51220,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320620,"statfs":{"total":96636764160,"available":96584314880,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69856,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301984,"statfs":{"total":96636764160,"available":96565231616,"internally_reserved":0,"allocated":2629632,"data_stored":1571772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51220,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320620,"statfs":{"total":96636764160,"available":96584314880,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:35:40.405 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T05:35:40.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:35:40.680 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:35:40.681 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:35:40.692 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-09-11T05:35:39.975025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":121,"num_read":220833,"num_read_kb":578688,"num_write":22011,"num_write_kb":318169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6665,"num_bytes_recovered":182406169,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19699,"ondisk_log_size":19699,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436552,"kb_used_data":17048,"kb_used_omap":15,"kb_used_meta":419312,"kb_avail":754538168,"statfs":{"total":773094113280,"available":772647084032,"internally_reserved":0,"allocated":17457152,"data_stored":9031892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15611,"internal_metadata":429376261},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.247381"},"pg_stats":[{"pgid":"3.1f","version":"147'611","reported_seq":7854,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361610+0000","last_change":"2024-09-11T05:35:22.638115+0000","last_active":"2024-09-11T05:35:36.361610+0000","last_peered":"2024-09-11T05:35:36.361610+0000","last_clean":"2024-09-11T05:35:36.361610+0000","last_became_active":"2024-09-11T05:35:22.637032+0000","last_became_peered":"2024-09-11T05:35:22.637032+0000","last_unstale":"2024-09-11T05:35:36.361610+0000","last_undegraded":"2024-09-11T05:35:36.361610+0000","last_fullsized":"2024-09-11T05:35:36.361610+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:31.476738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00245933,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7747,"num_read_kb":22584,"num_write":761,"num_write_kb":11145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":285,"num_bytes_recovered":4324286,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"139'296","reported_seq":3772,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361548+0000","last_change":"2024-09-11T05:35:10.630226+0000","last_active":"2024-09-11T05:35:36.361548+0000","last_peered":"2024-09-11T05:35:36.361548+0000","last_clean":"2024-09-11T05:35:36.361548+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:35:36.361548+0000","last_undegraded":"2024-09-11T05:35:36.361548+0000","last_fullsized":"2024-09-11T05:35:36.361548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:57:10.083669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014246319999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":3027,"num_read_kb":23842,"num_write":231,"num_write_kb":6198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"144'910","reported_seq":21667,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819869+0000","last_change":"2024-09-11T05:35:28.699205+0000","last_active":"2024-09-11T05:35:35.819869+0000","last_peered":"2024-09-11T05:35:35.819869+0000","last_clean":"2024-09-11T05:35:35.819869+0000","last_became_active":"2024-09-11T05:35:28.696723+0000","last_became_peered":"2024-09-11T05:35:28.696723+0000","last_unstale":"2024-09-11T05:35:35.819869+0000","last_undegraded":"2024-09-11T05:35:35.819869+0000","last_fullsized":"2024-09-11T05:35:35.819869+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:40.890246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003253822,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":16637,"num_read_kb":25385,"num_write":1112,"num_write_kb":7409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":6593091,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"147'601","reported_seq":7773,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743694+0000","last_change":"2024-09-11T05:35:22.638770+0000","last_active":"2024-09-11T05:35:35.743694+0000","last_peered":"2024-09-11T05:35:35.743694+0000","last_clean":"2024-09-11T05:35:35.743694+0000","last_became_active":"2024-09-11T05:35:22.636725+0000","last_became_peered":"2024-09-11T05:35:22.636725+0000","last_unstale":"2024-09-11T05:35:35.743694+0000","last_undegraded":"2024-09-11T05:35:35.743694+0000","last_fullsized":"2024-09-11T05:35:35.743694+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:53:13.907056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028264560000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9012,"num_read_kb":27646,"num_write":675,"num_write_kb":16439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":13219858,"num_keys_recovered":56,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"140'579","reported_seq":7861,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944261+0000","last_change":"2024-09-11T05:35:23.636456+0000","last_active":"2024-09-11T05:35:35.944261+0000","last_peered":"2024-09-11T05:35:35.944261+0000","last_clean":"2024-09-11T05:35:35.944261+0000","last_became_active":"2024-09-11T05:35:23.634303+0000","last_became_peered":"2024-09-11T05:35:23.634303+0000","last_unstale":"2024-09-11T05:35:35.944261+0000","last_undegraded":"2024-09-11T05:35:35.944261+0000","last_fullsized":"2024-09-11T05:35:35.944261+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:01.958896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049355689999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":7366,"num_read_kb":17763,"num_write":665,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":421,"num_bytes_recovered":7543883,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"136'445","reported_seq":5277,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743659+0000","last_change":"2024-09-11T05:35:22.638768+0000","last_active":"2024-09-11T05:35:35.743659+0000","last_peered":"2024-09-11T05:35:35.743659+0000","last_clean":"2024-09-11T05:35:35.743659+0000","last_became_active":"2024-09-11T05:35:22.636807+0000","last_became_peered":"2024-09-11T05:35:22.636807+0000","last_unstale":"2024-09-11T05:35:35.743659+0000","last_undegraded":"2024-09-11T05:35:35.743659+0000","last_fullsized":"2024-09-11T05:35:35.743659+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:29.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017105359999999999,"stat_sum":{"num_bytes":19,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":6,"num_read":5410,"num_read_kb":14252,"num_write":483,"num_write_kb":12836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":327,"num_bytes_recovered":4853026,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"139'1101","reported_seq":11036,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944244+0000","last_change":"2024-09-11T05:35:22.634971+0000","last_active":"2024-09-11T05:35:35.944244+0000","last_peered":"2024-09-11T05:35:35.944244+0000","last_clean":"2024-09-11T05:35:35.944244+0000","last_became_active":"2024-09-11T05:35:22.632741+0000","last_became_peered":"2024-09-11T05:35:22.632741+0000","last_unstale":"2024-09-11T05:35:35.944244+0000","last_undegraded":"2024-09-11T05:35:35.944244+0000","last_fullsized":"2024-09-11T05:35:35.944244+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:27.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030616850000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":13726,"num_read_kb":13435,"num_write":1662,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":1269861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"140'517","reported_seq":3166,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361418+0000","last_change":"2024-09-11T05:35:10.632188+0000","last_active":"2024-09-11T05:35:36.361418+0000","last_peered":"2024-09-11T05:35:36.361418+0000","last_clean":"2024-09-11T05:35:36.361418+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:35:36.361418+0000","last_undegraded":"2024-09-11T05:35:36.361418+0000","last_fullsized":"2024-09-11T05:35:36.361418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:44.971488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027595950000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":3338,"num_read_kb":10070,"num_write":595,"num_write_kb":6210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"139'1157","reported_seq":3344,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361628+0000","last_change":"2024-09-11T05:35:10.631584+0000","last_active":"2024-09-11T05:35:36.361628+0000","last_peered":"2024-09-11T05:35:36.361628+0000","last_clean":"2024-09-11T05:35:36.361628+0000","last_became_active":"2024-09-11T05:34:54.790407+0000","last_became_peered":"2024-09-11T05:34:54.790407+0000","last_unstale":"2024-09-11T05:35:36.361628+0000","last_undegraded":"2024-09-11T05:35:36.361628+0000","last_fullsized":"2024-09-11T05:35:36.361628+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1157,"log_dups_size":0,"ondisk_log_size":1157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:22.948505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022982459999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5158,"num_read_kb":28626,"num_write":1706,"num_write_kb":20682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":292,"num_bytes_recovered":48701806,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"142'286","reported_seq":3645,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.363325+0000","last_change":"2024-09-11T05:35:27.700408+0000","last_active":"2024-09-11T05:35:36.363325+0000","last_peered":"2024-09-11T05:35:36.363325+0000","last_clean":"2024-09-11T05:35:36.363325+0000","last_became_active":"2024-09-11T05:35:27.699049+0000","last_became_peered":"2024-09-11T05:35:27.699049+0000","last_unstale":"2024-09-11T05:35:36.363325+0000","last_undegraded":"2024-09-11T05:35:36.363325+0000","last_fullsized":"2024-09-11T05:35:36.363325+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:56.992530+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00066517799999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2863,"num_read_kb":14884,"num_write":221,"num_write_kb":7375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":1456269,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"141'725","reported_seq":3846,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743446+0000","last_change":"2024-09-11T05:35:10.633716+0000","last_active":"2024-09-11T05:35:35.743446+0000","last_peered":"2024-09-11T05:35:35.743446+0000","last_clean":"2024-09-11T05:35:35.743446+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:35:35.743446+0000","last_undegraded":"2024-09-11T05:35:35.743446+0000","last_fullsized":"2024-09-11T05:35:35.743446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:59.138792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079156780000000006,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5390,"num_read_kb":12737,"num_write":875,"num_write_kb":9766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"142'369","reported_seq":12008,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819737+0000","last_change":"2024-09-11T05:35:28.700196+0000","last_active":"2024-09-11T05:35:35.819737+0000","last_peered":"2024-09-11T05:35:35.819737+0000","last_clean":"2024-09-11T05:35:35.819737+0000","last_became_active":"2024-09-11T05:35:28.697994+0000","last_became_peered":"2024-09-11T05:35:28.697994+0000","last_unstale":"2024-09-11T05:35:35.819737+0000","last_undegraded":"2024-09-11T05:35:35.819737+0000","last_fullsized":"2024-09-11T05:35:35.819737+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:53.037666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015799760000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5068,"num_read_kb":14759,"num_write":300,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":7503668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819881+0000","last_change":"2024-09-11T05:34:50.627854+0000","last_active":"2024-09-11T05:35:35.819881+0000","last_peered":"2024-09-11T05:35:35.819881+0000","last_clean":"2024-09-11T05:35:35.819881+0000","last_became_active":"2024-09-11T05:34:50.627529+0000","last_became_peered":"2024-09-11T05:34:50.627529+0000","last_unstale":"2024-09-11T05:35:35.819881+0000","last_undegraded":"2024-09-11T05:35:35.819881+0000","last_fullsized":"2024-09-11T05:35:35.819881+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:35.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"147'703","reported_seq":4450,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944385+0000","last_change":"2024-09-11T05:35:22.635026+0000","last_active":"2024-09-11T05:35:35.944385+0000","last_peered":"2024-09-11T05:35:35.944385+0000","last_clean":"2024-09-11T05:35:35.944385+0000","last_became_active":"2024-09-11T05:35:22.632683+0000","last_became_peered":"2024-09-11T05:35:22.632683+0000","last_unstale":"2024-09-11T05:35:35.944385+0000","last_undegraded":"2024-09-11T05:35:35.944385+0000","last_fullsized":"2024-09-11T05:35:35.944385+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:50:23.986237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057885200000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5183,"num_read_kb":4253,"num_write":904,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":463,"num_bytes_recovered":1655489,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944376+0000","last_change":"2024-09-11T05:35:20.631589+0000","last_active":"2024-09-11T05:35:35.944376+0000","last_peered":"2024-09-11T05:35:35.944376+0000","last_clean":"2024-09-11T05:35:35.944376+0000","last_became_active":"2024-09-11T05:35:20.631241+0000","last_became_peered":"2024-09-11T05:35:20.631241+0000","last_unstale":"2024-09-11T05:35:35.944376+0000","last_undegraded":"2024-09-11T05:35:35.944376+0000","last_fullsized":"2024-09-11T05:35:35.944376+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:15.796354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"140'467","reported_seq":6364,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944331+0000","last_change":"2024-09-11T05:35:22.635052+0000","last_active":"2024-09-11T05:35:35.944331+0000","last_peered":"2024-09-11T05:35:35.944331+0000","last_clean":"2024-09-11T05:35:35.944331+0000","last_became_active":"2024-09-11T05:35:22.632436+0000","last_became_peered":"2024-09-11T05:35:22.632436+0000","last_unstale":"2024-09-11T05:35:35.944331+0000","last_undegraded":"2024-09-11T05:35:35.944331+0000","last_fullsized":"2024-09-11T05:35:35.944331+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:45.444932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027050960000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6977,"num_read_kb":16019,"num_write":349,"num_write_kb":6385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":1715668,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":102,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819877+0000","last_change":"2024-09-11T05:35:20.638832+0000","last_active":"2024-09-11T05:35:35.819877+0000","last_peered":"2024-09-11T05:35:35.819877+0000","last_clean":"2024-09-11T05:35:35.819877+0000","last_became_active":"2024-09-11T05:35:20.638478+0000","last_became_peered":"2024-09-11T05:35:20.638478+0000","last_unstale":"2024-09-11T05:35:35.819877+0000","last_undegraded":"2024-09-11T05:35:35.819877+0000","last_fullsized":"2024-09-11T05:35:35.819877+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:12.803640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"147'1631","reported_seq":8207,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361298+0000","last_change":"2024-09-11T05:35:10.631545+0000","last_active":"2024-09-11T05:35:36.361298+0000","last_peered":"2024-09-11T05:35:36.361298+0000","last_clean":"2024-09-11T05:35:36.361298+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:35:36.361298+0000","last_undegraded":"2024-09-11T05:35:36.361298+0000","last_fullsized":"2024-09-11T05:35:36.361298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1631,"log_dups_size":0,"ondisk_log_size":1631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:07.737928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026555530000000002,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":15252,"num_read_kb":37939,"num_write":2291,"num_write_kb":19413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":325,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361624+0000","last_change":"2024-09-11T05:34:44.768103+0000","last_active":"2024-09-11T05:35:36.361624+0000","last_peered":"2024-09-11T05:35:36.361624+0000","last_clean":"2024-09-11T05:35:36.361624+0000","last_became_active":"2024-09-11T05:34:44.767862+0000","last_became_peered":"2024-09-11T05:34:44.767862+0000","last_unstale":"2024-09-11T05:35:36.361624+0000","last_undegraded":"2024-09-11T05:35:36.361624+0000","last_fullsized":"2024-09-11T05:35:36.361624+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:15:05.574617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"144'845","reported_seq":12664,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.363156+0000","last_change":"2024-09-11T05:35:27.700438+0000","last_active":"2024-09-11T05:35:36.363156+0000","last_peered":"2024-09-11T05:35:36.363156+0000","last_clean":"2024-09-11T05:35:36.363156+0000","last_became_active":"2024-09-11T05:35:27.699111+0000","last_became_peered":"2024-09-11T05:35:27.699111+0000","last_unstale":"2024-09-11T05:35:36.363156+0000","last_undegraded":"2024-09-11T05:35:36.363156+0000","last_fullsized":"2024-09-11T05:35:36.363156+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:45.051639+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0034996329999999998,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":15193,"num_read_kb":18227,"num_write":823,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"147'676","reported_seq":4374,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743567+0000","last_change":"2024-09-11T05:35:10.632354+0000","last_active":"2024-09-11T05:35:35.743567+0000","last_peered":"2024-09-11T05:35:35.743567+0000","last_clean":"2024-09-11T05:35:35.743567+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:35:35.743567+0000","last_undegraded":"2024-09-11T05:35:35.743567+0000","last_fullsized":"2024-09-11T05:35:35.743567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:36.049428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0073602759999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4311,"num_read_kb":22872,"num_write":719,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":210,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819683+0000","last_change":"2024-09-11T05:35:28.700422+0000","last_active":"2024-09-11T05:35:35.819683+0000","last_peered":"2024-09-11T05:35:35.819683+0000","last_clean":"2024-09-11T05:35:35.819683+0000","last_became_active":"2024-09-11T05:35:28.700119+0000","last_became_peered":"2024-09-11T05:35:28.700119+0000","last_unstale":"2024-09-11T05:35:35.819683+0000","last_undegraded":"2024-09-11T05:35:35.819683+0000","last_fullsized":"2024-09-11T05:35:35.819683+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:03.431125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"146'345","reported_seq":2882,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361248+0000","last_change":"2024-09-11T05:35:11.642354+0000","last_active":"2024-09-11T05:35:36.361248+0000","last_peered":"2024-09-11T05:35:36.361248+0000","last_clean":"2024-09-11T05:35:36.361248+0000","last_became_active":"2024-09-11T05:35:11.635099+0000","last_became_peered":"2024-09-11T05:35:11.635099+0000","last_unstale":"2024-09-11T05:35:36.361248+0000","last_undegraded":"2024-09-11T05:35:36.361248+0000","last_fullsized":"2024-09-11T05:35:36.361248+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:37:53.460954+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0054654079999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2061,"num_read_kb":16420,"num_write":311,"num_write_kb":9397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3451521,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.744863+0000","last_change":"2024-09-11T05:35:08.633295+0000","last_active":"2024-09-11T05:35:35.744863+0000","last_peered":"2024-09-11T05:35:35.744863+0000","last_clean":"2024-09-11T05:35:35.744863+0000","last_became_active":"2024-09-11T05:35:08.632954+0000","last_became_peered":"2024-09-11T05:35:08.632954+0000","last_unstale":"2024-09-11T05:35:35.744863+0000","last_undegraded":"2024-09-11T05:35:35.744863+0000","last_fullsized":"2024-09-11T05:35:35.744863+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:38:42.279949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"139'743","reported_seq":8668,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361154+0000","last_change":"2024-09-11T05:35:10.629926+0000","last_active":"2024-09-11T05:35:36.361154+0000","last_peered":"2024-09-11T05:35:36.361154+0000","last_clean":"2024-09-11T05:35:36.361154+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:35:36.361154+0000","last_undegraded":"2024-09-11T05:35:36.361154+0000","last_fullsized":"2024-09-11T05:35:36.361154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:51.136449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013315200000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":11851,"num_read_kb":20739,"num_write":676,"num_write_kb":6668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819620+0000","last_change":"2024-09-11T05:34:50.626273+0000","last_active":"2024-09-11T05:35:35.819620+0000","last_peered":"2024-09-11T05:35:35.819620+0000","last_clean":"2024-09-11T05:35:35.819620+0000","last_became_active":"2024-09-11T05:34:50.625970+0000","last_became_peered":"2024-09-11T05:34:50.625970+0000","last_unstale":"2024-09-11T05:35:35.819620+0000","last_undegraded":"2024-09-11T05:35:35.819620+0000","last_fullsized":"2024-09-11T05:35:35.819620+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:45.970895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"144'588","reported_seq":3895,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944239+0000","last_change":"2024-09-11T05:35:23.637690+0000","last_active":"2024-09-11T05:35:35.944239+0000","last_peered":"2024-09-11T05:35:35.944239+0000","last_clean":"2024-09-11T05:35:35.944239+0000","last_became_active":"2024-09-11T05:35:23.635903+0000","last_became_peered":"2024-09-11T05:35:23.635903+0000","last_unstale":"2024-09-11T05:35:35.944239+0000","last_undegraded":"2024-09-11T05:35:35.944239+0000","last_fullsized":"2024-09-11T05:35:35.944239+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:18:14.825205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002640187,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5913,"num_read_kb":15123,"num_write":618,"num_write_kb":14349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":103,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819741+0000","last_change":"2024-09-11T05:35:28.699062+0000","last_active":"2024-09-11T05:35:35.819741+0000","last_peered":"2024-09-11T05:35:35.819741+0000","last_clean":"2024-09-11T05:35:35.819741+0000","last_became_active":"2024-09-11T05:35:28.698723+0000","last_became_peered":"2024-09-11T05:35:28.698723+0000","last_unstale":"2024-09-11T05:35:35.819741+0000","last_undegraded":"2024-09-11T05:35:35.819741+0000","last_fullsized":"2024-09-11T05:35:35.819741+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743659+0000","last_change":"2024-09-11T05:35:22.637165+0000","last_active":"2024-09-11T05:35:35.743659+0000","last_peered":"2024-09-11T05:35:35.743659+0000","last_clean":"2024-09-11T05:35:35.743659+0000","last_became_active":"2024-09-11T05:35:22.636808+0000","last_became_peered":"2024-09-11T05:35:22.636808+0000","last_unstale":"2024-09-11T05:35:35.743659+0000","last_undegraded":"2024-09-11T05:35:35.743659+0000","last_fullsized":"2024-09-11T05:35:35.743659+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:42.605285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"147'674","reported_seq":21155,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944229+0000","last_change":"2024-09-11T05:35:23.638318+0000","last_active":"2024-09-11T05:35:35.944229+0000","last_peered":"2024-09-11T05:35:35.944229+0000","last_clean":"2024-09-11T05:35:35.944229+0000","last_became_active":"2024-09-11T05:35:23.635346+0000","last_became_peered":"2024-09-11T05:35:23.635346+0000","last_unstale":"2024-09-11T05:35:35.944229+0000","last_undegraded":"2024-09-11T05:35:35.944229+0000","last_fullsized":"2024-09-11T05:35:35.944229+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:03:59.781583+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0012007719999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":21937,"num_read_kb":27288,"num_write":631,"num_write_kb":9659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":357,"num_bytes_recovered":6098347,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"142'411","reported_seq":10435,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819648+0000","last_change":"2024-09-11T05:35:28.701354+0000","last_active":"2024-09-11T05:35:35.819648+0000","last_peered":"2024-09-11T05:35:35.819648+0000","last_clean":"2024-09-11T05:35:35.819648+0000","last_became_active":"2024-09-11T05:35:28.699365+0000","last_became_peered":"2024-09-11T05:35:28.699365+0000","last_unstale":"2024-09-11T05:35:35.819648+0000","last_undegraded":"2024-09-11T05:35:35.819648+0000","last_fullsized":"2024-09-11T05:35:35.819648+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:37.199627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003370732,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9328,"num_read_kb":19500,"num_write":336,"num_write_kb":14817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":8961432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"144'432","reported_seq":3813,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819680+0000","last_change":"2024-09-11T05:35:28.701794+0000","last_active":"2024-09-11T05:35:35.819680+0000","last_peered":"2024-09-11T05:35:35.819680+0000","last_clean":"2024-09-11T05:35:35.819680+0000","last_became_active":"2024-09-11T05:35:28.700107+0000","last_became_peered":"2024-09-11T05:35:28.700107+0000","last_unstale":"2024-09-11T05:35:35.819680+0000","last_undegraded":"2024-09-11T05:35:35.819680+0000","last_fullsized":"2024-09-11T05:35:35.819680+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:45.230792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003122947,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1794,"num_read_kb":9402,"num_write":412,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":10914094,"num_keys_recovered":66,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"139'324","reported_seq":2603,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.744872+0000","last_change":"2024-09-11T05:35:11.637663+0000","last_active":"2024-09-11T05:35:35.744872+0000","last_peered":"2024-09-11T05:35:35.744872+0000","last_clean":"2024-09-11T05:35:35.744872+0000","last_became_active":"2024-09-11T05:35:11.631665+0000","last_became_peered":"2024-09-11T05:35:11.631665+0000","last_unstale":"2024-09-11T05:35:35.744872+0000","last_undegraded":"2024-09-11T05:35:35.744872+0000","last_fullsized":"2024-09-11T05:35:35.744872+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:56:28.397445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040247640000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2267,"num_read_kb":23620,"num_write":305,"num_write_kb":16916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":14087582,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"146'409","reported_seq":3153,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743504+0000","last_change":"2024-09-11T05:35:11.640341+0000","last_active":"2024-09-11T05:35:35.743504+0000","last_peered":"2024-09-11T05:35:35.743504+0000","last_clean":"2024-09-11T05:35:35.743504+0000","last_became_active":"2024-09-11T05:35:11.630867+0000","last_became_peered":"2024-09-11T05:35:11.630867+0000","last_unstale":"2024-09-11T05:35:35.743504+0000","last_undegraded":"2024-09-11T05:35:35.743504+0000","last_fullsized":"2024-09-11T05:35:35.743504+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:34:13.877495+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0078972569999999995,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1985,"num_read_kb":12033,"num_write":383,"num_write_kb":5272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":320,"num_bytes_recovered":6119775,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"141'478","reported_seq":5937,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819734+0000","last_change":"2024-09-11T05:35:28.702740+0000","last_active":"2024-09-11T05:35:35.819734+0000","last_peered":"2024-09-11T05:35:35.819734+0000","last_clean":"2024-09-11T05:35:35.819734+0000","last_became_active":"2024-09-11T05:35:28.699897+0000","last_became_peered":"2024-09-11T05:35:28.699897+0000","last_unstale":"2024-09-11T05:35:35.819734+0000","last_undegraded":"2024-09-11T05:35:35.819734+0000","last_fullsized":"2024-09-11T05:35:35.819734+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:38.206892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039836639999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5865,"num_read_kb":13697,"num_write":403,"num_write_kb":10315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":13015515,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"140'401","reported_seq":2951,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361507+0000","last_change":"2024-09-11T05:35:10.629686+0000","last_active":"2024-09-11T05:35:36.361507+0000","last_peered":"2024-09-11T05:35:36.361507+0000","last_clean":"2024-09-11T05:35:36.361507+0000","last_became_active":"2024-09-11T05:35:05.630573+0000","last_became_peered":"2024-09-11T05:35:05.630573+0000","last_unstale":"2024-09-11T05:35:36.361507+0000","last_undegraded":"2024-09-11T05:35:36.361507+0000","last_fullsized":"2024-09-11T05:35:36.361507+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:55.457196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001163856,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2127,"num_read_kb":12622,"num_write":331,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":262196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"141'638","reported_seq":5213,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743414+0000","last_change":"2024-09-11T05:35:22.636513+0000","last_active":"2024-09-11T05:35:35.743414+0000","last_peered":"2024-09-11T05:35:35.743414+0000","last_clean":"2024-09-11T05:35:35.743414+0000","last_became_active":"2024-09-11T05:35:22.634192+0000","last_became_peered":"2024-09-11T05:35:22.634192+0000","last_unstale":"2024-09-11T05:35:35.743414+0000","last_undegraded":"2024-09-11T05:35:35.743414+0000","last_fullsized":"2024-09-11T05:35:35.743414+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:07.719785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005994961,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":6001,"num_read_kb":12376,"num_write":612,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":2111260,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"135'377","reported_seq":5505,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743356+0000","last_change":"2024-09-11T05:35:22.638949+0000","last_active":"2024-09-11T05:35:35.743356+0000","last_peered":"2024-09-11T05:35:35.743356+0000","last_clean":"2024-09-11T05:35:35.743356+0000","last_became_active":"2024-09-11T05:35:22.635431+0000","last_became_peered":"2024-09-11T05:35:22.635431+0000","last_unstale":"2024-09-11T05:35:35.743356+0000","last_undegraded":"2024-09-11T05:35:35.743356+0000","last_fullsized":"2024-09-11T05:35:35.743356+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:18.444306+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0045659699999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4943,"num_read_kb":12354,"num_write":293,"num_write_kb":4874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":3066244,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"141'664","reported_seq":2303,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819620+0000","last_change":"2024-09-11T05:35:28.703601+0000","last_active":"2024-09-11T05:35:35.819620+0000","last_peered":"2024-09-11T05:35:35.819620+0000","last_clean":"2024-09-11T05:35:35.819620+0000","last_became_active":"2024-09-11T05:35:28.701845+0000","last_became_peered":"2024-09-11T05:35:28.701845+0000","last_unstale":"2024-09-11T05:35:35.819620+0000","last_undegraded":"2024-09-11T05:35:35.819620+0000","last_fullsized":"2024-09-11T05:35:35.819620+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:54.507773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001942809,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2920,"num_read_kb":11034,"num_write":809,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":3434090,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"144'613","reported_seq":11190,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361155+0000","last_change":"2024-09-11T05:35:10.631369+0000","last_active":"2024-09-11T05:35:36.361155+0000","last_peered":"2024-09-11T05:35:36.361155+0000","last_clean":"2024-09-11T05:35:36.361155+0000","last_became_active":"2024-09-11T05:34:53.789002+0000","last_became_peered":"2024-09-11T05:34:53.789002+0000","last_unstale":"2024-09-11T05:35:36.361155+0000","last_undegraded":"2024-09-11T05:35:36.361155+0000","last_fullsized":"2024-09-11T05:35:36.361155+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:29.114608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002392473,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3076,"num_read_kb":7989,"num_write":738,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":6984484,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"144'563","reported_seq":6585,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819733+0000","last_change":"2024-09-11T05:35:28.698744+0000","last_active":"2024-09-11T05:35:35.819733+0000","last_peered":"2024-09-11T05:35:35.819733+0000","last_clean":"2024-09-11T05:35:35.819733+0000","last_became_active":"2024-09-11T05:35:28.696781+0000","last_became_peered":"2024-09-11T05:35:28.696781+0000","last_unstale":"2024-09-11T05:35:35.819733+0000","last_undegraded":"2024-09-11T05:35:35.819733+0000","last_fullsized":"2024-09-11T05:35:35.819733+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:24.791414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017107820000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6991,"num_read_kb":39098,"num_write":620,"num_write_kb":9927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":4472318,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":121,"num_read":220717,"num_read_kb":578588,"num_write":21850,"num_write_kb":315751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6659,"num_bytes_recovered":181815763,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19579,"ondisk_log_size":19579,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33176,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338664,"statfs":{"total":96636764160,"available":96602791936,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78176,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293664,"statfs":{"total":96636764160,"available":96556711936,"internally_reserved":0,"allocated":2629632,"data_stored":1571772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":103,"seq":442381631505,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":1984,"kb_used_omap":4,"kb_used_meta":31803,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4454,"internal_metadata":32566938},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51220,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320620,"statfs":{"total":96636764160,"available":96584314880,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69856,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301984,"statfs":{"total":96636764160,"available":96565231616,"internally_reserved":0,"allocated":2629632,"data_stored":1571772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51220,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320620,"statfs":{"total":96636764160,"available":96584314880,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:35:40.694 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T05:35:40.973 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:35:40.974 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":169,"fsid":"eb5ff116-0384-4170-94d3-d3ddcb9c254f","created":"2024-09-11T05:32:25.817911+0000","modified":"2024-09-11T05:35:35.740715+0000","last_up_change":"2024-09-11T05:34:28.684725+0000","last_in_change":"2024-09-11T05:35:19.644002+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T05:32:37.977484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T05:32:43.780723+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-11T05:32:53.728195+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":44,"snap_epoch":145,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef7487b-9326-4062-8fe4-ef39030252bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6819","nonce":4108497907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6821","nonce":4108497907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6825","nonce":4108497907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":4108497907},{"type":"v1","addr":"172.21.15.70:6823","nonce":4108497907}]},"public_addr":"172.21.15.70:6819/4108497907","cluster_addr":"172.21.15.70:6821/4108497907","heartbeat_back_addr":"172.21.15.70:6825/4108497907","heartbeat_front_addr":"172.21.15.70:6823/4108497907","state":["exists","up"]},{"osd":1,"uuid":"3e0d8348-6e1b-4d63-b0f1-c20d90d73760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6801","nonce":3979396531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6803","nonce":3979396531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6807","nonce":3979396531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3979396531},{"type":"v1","addr":"172.21.15.70:6805","nonce":3979396531}]},"public_addr":"172.21.15.70:6801/3979396531","cluster_addr":"172.21.15.70:6803/3979396531","heartbeat_back_addr":"172.21.15.70:6807/3979396531","heartbeat_front_addr":"172.21.15.70:6805/3979396531","state":["exists","up"]},{"osd":2,"uuid":"38bbb42f-85e2-4064-8f55-e0385aff07d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6811","nonce":4053894977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6813","nonce":4053894977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6817","nonce":4053894977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4053894977},{"type":"v1","addr":"172.21.15.70:6815","nonce":4053894977}]},"public_addr":"172.21.15.70:6811/4053894977","cluster_addr":"172.21.15.70:6813/4053894977","heartbeat_back_addr":"172.21.15.70:6817/4053894977","heartbeat_front_addr":"172.21.15.70:6815/4053894977","state":["exists","up"]},{"osd":3,"uuid":"e96ca529-f3b3-4f7e-bd59-1e9872a5efab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6827","nonce":2067624829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6829","nonce":2067624829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6833","nonce":2067624829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2067624829},{"type":"v1","addr":"172.21.15.70:6831","nonce":2067624829}]},"public_addr":"172.21.15.70:6827/2067624829","cluster_addr":"172.21.15.70:6829/2067624829","heartbeat_back_addr":"172.21.15.70:6833/2067624829","heartbeat_front_addr":"172.21.15.70:6831/2067624829","state":["exists","up"]},{"osd":4,"uuid":"dbbde660-d90e-4e02-9a01-16b0f76aa2b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":74,"up_from":103,"up_thru":156,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":4108789898},{"type":"v1","addr":"172.21.15.84:6817","nonce":4108789898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4108789898},{"type":"v1","addr":"172.21.15.84:6819","nonce":4108789898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4108789898},{"type":"v1","addr":"172.21.15.84:6823","nonce":4108789898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4108789898},{"type":"v1","addr":"172.21.15.84:6821","nonce":4108789898}]},"public_addr":"172.21.15.84:6817/4108789898","cluster_addr":"172.21.15.84:6819/4108789898","heartbeat_back_addr":"172.21.15.84:6823/4108789898","heartbeat_front_addr":"172.21.15.84:6821/4108789898","state":["exists","up"]},{"osd":5,"uuid":"2dc1a002-3ec0-4b4d-b84d-e684fa8a9131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6825","nonce":2732588656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6827","nonce":2732588656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6831","nonce":2732588656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2732588656},{"type":"v1","addr":"172.21.15.84:6829","nonce":2732588656}]},"public_addr":"172.21.15.84:6825/2732588656","cluster_addr":"172.21.15.84:6827/2732588656","heartbeat_back_addr":"172.21.15.84:6831/2732588656","heartbeat_front_addr":"172.21.15.84:6829/2732588656","state":["exists","up"]},{"osd":6,"uuid":"4fce6e45-c5f7-4e5f-86ea-3ab4eab3cd1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6801","nonce":372011645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6803","nonce":372011645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6807","nonce":372011645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":372011645},{"type":"v1","addr":"172.21.15.84:6805","nonce":372011645}]},"public_addr":"172.21.15.84:6801/372011645","cluster_addr":"172.21.15.84:6803/372011645","heartbeat_back_addr":"172.21.15.84:6807/372011645","heartbeat_front_addr":"172.21.15.84:6805/372011645","state":["exists","up"]},{"osd":7,"uuid":"5fef4450-317c-4e1f-b05b-80740b9538f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6809","nonce":583221652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6811","nonce":583221652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6815","nonce":583221652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":583221652},{"type":"v1","addr":"172.21.15.84:6813","nonce":583221652}]},"public_addr":"172.21.15.84:6809/583221652","cluster_addr":"172.21.15.84:6811/583221652","heartbeat_back_addr":"172.21.15.84:6815/583221652","heartbeat_front_addr":"172.21.15.84:6813/583221652","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.130019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.339373+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.204705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.075490+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.279790+0000","dead_epoch":76},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:35.287168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:34.320448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T05:32:34.838001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T05:35:41.987 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T05:35:41.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:35:42.123 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:42.123 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:35:42.123 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:42.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T05:35:42.410 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T05:35:42.423 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T05:35:42.423 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:35:42.545 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:42.545 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:35:42.545 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:42.555 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T05:35:42.833 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T05:35:42.846 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T05:35:42.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:35:42.968 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:42.969 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:35:42.969 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:42.979 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T05:35:43.257 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T05:35:43.270 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T05:35:43.270 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:35:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:43.393 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:35:43.393 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:43.403 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T05:35:43.679 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T05:35:43.692 INFO:tasks.ceph:Scrubbing osd.4 2024-09-11T05:35:43.693 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:35:43.816 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:35:43.817 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:43.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-11T05:35:44.104 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 4 to deep-scrub 2024-09-11T05:35:44.116 INFO:tasks.ceph:Scrubbing osd.5 2024-09-11T05:35:44.117 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:35:44.241 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:44.241 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:35:44.241 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:44.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-11T05:35:44.529 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 5 to deep-scrub 2024-09-11T05:35:44.542 INFO:tasks.ceph:Scrubbing osd.6 2024-09-11T05:35:44.543 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:35:44.665 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:44.665 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:35:44.665 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:44.676 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-11T05:35:44.954 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 6 to deep-scrub 2024-09-11T05:35:44.967 INFO:tasks.ceph:Scrubbing osd.7 2024-09-11T05:35:44.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-11T05:35:45.091 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T05:35:45.091 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T05:35:45.091 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T05:35:45.102 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-11T05:35:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 7 to deep-scrub 2024-09-11T05:35:45.394 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:35:45.674 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:35:45.675 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:35:45.686 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-09-11T05:35:43.975791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":121,"num_read":220833,"num_read_kb":578688,"num_write":22011,"num_write_kb":318169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6665,"num_bytes_recovered":182406169,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19699,"ondisk_log_size":19699,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436552,"kb_used_data":17048,"kb_used_omap":15,"kb_used_meta":419312,"kb_avail":754538168,"statfs":{"total":773094113280,"available":772647084032,"internally_reserved":0,"allocated":17457152,"data_stored":9031892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15611,"internal_metadata":429376261},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.240588"},"pg_stats":[{"pgid":"3.1f","version":"147'611","reported_seq":7854,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361610+0000","last_change":"2024-09-11T05:35:22.638115+0000","last_active":"2024-09-11T05:35:36.361610+0000","last_peered":"2024-09-11T05:35:36.361610+0000","last_clean":"2024-09-11T05:35:36.361610+0000","last_became_active":"2024-09-11T05:35:22.637032+0000","last_became_peered":"2024-09-11T05:35:22.637032+0000","last_unstale":"2024-09-11T05:35:36.361610+0000","last_undegraded":"2024-09-11T05:35:36.361610+0000","last_fullsized":"2024-09-11T05:35:36.361610+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:31.476738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00245933,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7747,"num_read_kb":22584,"num_write":761,"num_write_kb":11145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":285,"num_bytes_recovered":4324286,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"139'296","reported_seq":3772,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361548+0000","last_change":"2024-09-11T05:35:10.630226+0000","last_active":"2024-09-11T05:35:36.361548+0000","last_peered":"2024-09-11T05:35:36.361548+0000","last_clean":"2024-09-11T05:35:36.361548+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:35:36.361548+0000","last_undegraded":"2024-09-11T05:35:36.361548+0000","last_fullsized":"2024-09-11T05:35:36.361548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:57:10.083669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014246319999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":3027,"num_read_kb":23842,"num_write":231,"num_write_kb":6198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"144'910","reported_seq":21667,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819869+0000","last_change":"2024-09-11T05:35:28.699205+0000","last_active":"2024-09-11T05:35:35.819869+0000","last_peered":"2024-09-11T05:35:35.819869+0000","last_clean":"2024-09-11T05:35:35.819869+0000","last_became_active":"2024-09-11T05:35:28.696723+0000","last_became_peered":"2024-09-11T05:35:28.696723+0000","last_unstale":"2024-09-11T05:35:35.819869+0000","last_undegraded":"2024-09-11T05:35:35.819869+0000","last_fullsized":"2024-09-11T05:35:35.819869+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:40.890246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003253822,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":16637,"num_read_kb":25385,"num_write":1112,"num_write_kb":7409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":6593091,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"147'601","reported_seq":7774,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743741+0000","last_change":"2024-09-11T05:35:22.638770+0000","last_active":"2024-09-11T05:35:35.743741+0000","last_peered":"2024-09-11T05:35:35.743741+0000","last_clean":"2024-09-11T05:35:35.743741+0000","last_became_active":"2024-09-11T05:35:22.636725+0000","last_became_peered":"2024-09-11T05:35:22.636725+0000","last_unstale":"2024-09-11T05:35:35.743741+0000","last_undegraded":"2024-09-11T05:35:35.743741+0000","last_fullsized":"2024-09-11T05:35:35.743741+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028264560000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9012,"num_read_kb":27646,"num_write":675,"num_write_kb":16439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":13219858,"num_keys_recovered":56,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"140'579","reported_seq":7861,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944261+0000","last_change":"2024-09-11T05:35:23.636456+0000","last_active":"2024-09-11T05:35:35.944261+0000","last_peered":"2024-09-11T05:35:35.944261+0000","last_clean":"2024-09-11T05:35:35.944261+0000","last_became_active":"2024-09-11T05:35:23.634303+0000","last_became_peered":"2024-09-11T05:35:23.634303+0000","last_unstale":"2024-09-11T05:35:35.944261+0000","last_undegraded":"2024-09-11T05:35:35.944261+0000","last_fullsized":"2024-09-11T05:35:35.944261+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:01.958896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049355689999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":7366,"num_read_kb":17763,"num_write":665,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":421,"num_bytes_recovered":7543883,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"136'445","reported_seq":5278,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743708+0000","last_change":"2024-09-11T05:35:22.638768+0000","last_active":"2024-09-11T05:35:35.743708+0000","last_peered":"2024-09-11T05:35:35.743708+0000","last_clean":"2024-09-11T05:35:35.743708+0000","last_became_active":"2024-09-11T05:35:22.636807+0000","last_became_peered":"2024-09-11T05:35:22.636807+0000","last_unstale":"2024-09-11T05:35:35.743708+0000","last_undegraded":"2024-09-11T05:35:35.743708+0000","last_fullsized":"2024-09-11T05:35:35.743708+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017105359999999999,"stat_sum":{"num_bytes":19,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":6,"num_read":5410,"num_read_kb":14252,"num_write":483,"num_write_kb":12836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":327,"num_bytes_recovered":4853026,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"139'1101","reported_seq":11036,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944244+0000","last_change":"2024-09-11T05:35:22.634971+0000","last_active":"2024-09-11T05:35:35.944244+0000","last_peered":"2024-09-11T05:35:35.944244+0000","last_clean":"2024-09-11T05:35:35.944244+0000","last_became_active":"2024-09-11T05:35:22.632741+0000","last_became_peered":"2024-09-11T05:35:22.632741+0000","last_unstale":"2024-09-11T05:35:35.944244+0000","last_undegraded":"2024-09-11T05:35:35.944244+0000","last_fullsized":"2024-09-11T05:35:35.944244+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:27.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030616850000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":13726,"num_read_kb":13435,"num_write":1662,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":1269861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"140'517","reported_seq":3166,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361418+0000","last_change":"2024-09-11T05:35:10.632188+0000","last_active":"2024-09-11T05:35:36.361418+0000","last_peered":"2024-09-11T05:35:36.361418+0000","last_clean":"2024-09-11T05:35:36.361418+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:35:36.361418+0000","last_undegraded":"2024-09-11T05:35:36.361418+0000","last_fullsized":"2024-09-11T05:35:36.361418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:44.971488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027595950000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":3338,"num_read_kb":10070,"num_write":595,"num_write_kb":6210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"139'1157","reported_seq":3344,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361628+0000","last_change":"2024-09-11T05:35:10.631584+0000","last_active":"2024-09-11T05:35:36.361628+0000","last_peered":"2024-09-11T05:35:36.361628+0000","last_clean":"2024-09-11T05:35:36.361628+0000","last_became_active":"2024-09-11T05:34:54.790407+0000","last_became_peered":"2024-09-11T05:34:54.790407+0000","last_unstale":"2024-09-11T05:35:36.361628+0000","last_undegraded":"2024-09-11T05:35:36.361628+0000","last_fullsized":"2024-09-11T05:35:36.361628+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1157,"log_dups_size":0,"ondisk_log_size":1157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:22.948505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022982459999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5158,"num_read_kb":28626,"num_write":1706,"num_write_kb":20682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":292,"num_bytes_recovered":48701806,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"142'286","reported_seq":3645,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.363325+0000","last_change":"2024-09-11T05:35:27.700408+0000","last_active":"2024-09-11T05:35:36.363325+0000","last_peered":"2024-09-11T05:35:36.363325+0000","last_clean":"2024-09-11T05:35:36.363325+0000","last_became_active":"2024-09-11T05:35:27.699049+0000","last_became_peered":"2024-09-11T05:35:27.699049+0000","last_unstale":"2024-09-11T05:35:36.363325+0000","last_undegraded":"2024-09-11T05:35:36.363325+0000","last_fullsized":"2024-09-11T05:35:36.363325+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:56.992530+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00066517799999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2863,"num_read_kb":14884,"num_write":221,"num_write_kb":7375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":1456269,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"141'725","reported_seq":3847,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743491+0000","last_change":"2024-09-11T05:35:10.633716+0000","last_active":"2024-09-11T05:35:35.743491+0000","last_peered":"2024-09-11T05:35:35.743491+0000","last_clean":"2024-09-11T05:35:35.743491+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:35:35.743491+0000","last_undegraded":"2024-09-11T05:35:35.743491+0000","last_fullsized":"2024-09-11T05:35:35.743491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079156780000000006,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5390,"num_read_kb":12737,"num_write":875,"num_write_kb":9766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"142'369","reported_seq":12008,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819737+0000","last_change":"2024-09-11T05:35:28.700196+0000","last_active":"2024-09-11T05:35:35.819737+0000","last_peered":"2024-09-11T05:35:35.819737+0000","last_clean":"2024-09-11T05:35:35.819737+0000","last_became_active":"2024-09-11T05:35:28.697994+0000","last_became_peered":"2024-09-11T05:35:28.697994+0000","last_unstale":"2024-09-11T05:35:35.819737+0000","last_undegraded":"2024-09-11T05:35:35.819737+0000","last_fullsized":"2024-09-11T05:35:35.819737+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:53.037666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015799760000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5068,"num_read_kb":14759,"num_write":300,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":7503668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819881+0000","last_change":"2024-09-11T05:34:50.627854+0000","last_active":"2024-09-11T05:35:35.819881+0000","last_peered":"2024-09-11T05:35:35.819881+0000","last_clean":"2024-09-11T05:35:35.819881+0000","last_became_active":"2024-09-11T05:34:50.627529+0000","last_became_peered":"2024-09-11T05:34:50.627529+0000","last_unstale":"2024-09-11T05:35:35.819881+0000","last_undegraded":"2024-09-11T05:35:35.819881+0000","last_fullsized":"2024-09-11T05:35:35.819881+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:35.181067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"147'703","reported_seq":4450,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944385+0000","last_change":"2024-09-11T05:35:22.635026+0000","last_active":"2024-09-11T05:35:35.944385+0000","last_peered":"2024-09-11T05:35:35.944385+0000","last_clean":"2024-09-11T05:35:35.944385+0000","last_became_active":"2024-09-11T05:35:22.632683+0000","last_became_peered":"2024-09-11T05:35:22.632683+0000","last_unstale":"2024-09-11T05:35:35.944385+0000","last_undegraded":"2024-09-11T05:35:35.944385+0000","last_fullsized":"2024-09-11T05:35:35.944385+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:50:23.986237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057885200000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5183,"num_read_kb":4253,"num_write":904,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":463,"num_bytes_recovered":1655489,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944376+0000","last_change":"2024-09-11T05:35:20.631589+0000","last_active":"2024-09-11T05:35:35.944376+0000","last_peered":"2024-09-11T05:35:35.944376+0000","last_clean":"2024-09-11T05:35:35.944376+0000","last_became_active":"2024-09-11T05:35:20.631241+0000","last_became_peered":"2024-09-11T05:35:20.631241+0000","last_unstale":"2024-09-11T05:35:35.944376+0000","last_undegraded":"2024-09-11T05:35:35.944376+0000","last_fullsized":"2024-09-11T05:35:35.944376+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:15.796354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"140'467","reported_seq":6364,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944331+0000","last_change":"2024-09-11T05:35:22.635052+0000","last_active":"2024-09-11T05:35:35.944331+0000","last_peered":"2024-09-11T05:35:35.944331+0000","last_clean":"2024-09-11T05:35:35.944331+0000","last_became_active":"2024-09-11T05:35:22.632436+0000","last_became_peered":"2024-09-11T05:35:22.632436+0000","last_unstale":"2024-09-11T05:35:35.944331+0000","last_undegraded":"2024-09-11T05:35:35.944331+0000","last_fullsized":"2024-09-11T05:35:35.944331+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:45.444932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027050960000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6977,"num_read_kb":16019,"num_write":349,"num_write_kb":6385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":1715668,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":102,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819877+0000","last_change":"2024-09-11T05:35:20.638832+0000","last_active":"2024-09-11T05:35:35.819877+0000","last_peered":"2024-09-11T05:35:35.819877+0000","last_clean":"2024-09-11T05:35:35.819877+0000","last_became_active":"2024-09-11T05:35:20.638478+0000","last_became_peered":"2024-09-11T05:35:20.638478+0000","last_unstale":"2024-09-11T05:35:35.819877+0000","last_undegraded":"2024-09-11T05:35:35.819877+0000","last_fullsized":"2024-09-11T05:35:35.819877+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:12.803640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"147'1631","reported_seq":8207,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361298+0000","last_change":"2024-09-11T05:35:10.631545+0000","last_active":"2024-09-11T05:35:36.361298+0000","last_peered":"2024-09-11T05:35:36.361298+0000","last_clean":"2024-09-11T05:35:36.361298+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:35:36.361298+0000","last_undegraded":"2024-09-11T05:35:36.361298+0000","last_fullsized":"2024-09-11T05:35:36.361298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":1631,"log_dups_size":0,"ondisk_log_size":1631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:07.737928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026555530000000002,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":15252,"num_read_kb":37939,"num_write":2291,"num_write_kb":19413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":325,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361624+0000","last_change":"2024-09-11T05:34:44.768103+0000","last_active":"2024-09-11T05:35:36.361624+0000","last_peered":"2024-09-11T05:35:36.361624+0000","last_clean":"2024-09-11T05:35:36.361624+0000","last_became_active":"2024-09-11T05:34:44.767862+0000","last_became_peered":"2024-09-11T05:34:44.767862+0000","last_unstale":"2024-09-11T05:35:36.361624+0000","last_undegraded":"2024-09-11T05:35:36.361624+0000","last_fullsized":"2024-09-11T05:35:36.361624+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:15:05.574617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"144'845","reported_seq":12664,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.363156+0000","last_change":"2024-09-11T05:35:27.700438+0000","last_active":"2024-09-11T05:35:36.363156+0000","last_peered":"2024-09-11T05:35:36.363156+0000","last_clean":"2024-09-11T05:35:36.363156+0000","last_became_active":"2024-09-11T05:35:27.699111+0000","last_became_peered":"2024-09-11T05:35:27.699111+0000","last_unstale":"2024-09-11T05:35:36.363156+0000","last_undegraded":"2024-09-11T05:35:36.363156+0000","last_fullsized":"2024-09-11T05:35:36.363156+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:45.051639+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0034996329999999998,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":15193,"num_read_kb":18227,"num_write":823,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"147'676","reported_seq":4375,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743768+0000","last_change":"2024-09-11T05:35:10.632354+0000","last_active":"2024-09-11T05:35:35.743768+0000","last_peered":"2024-09-11T05:35:35.743768+0000","last_clean":"2024-09-11T05:35:35.743768+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:35:35.743768+0000","last_undegraded":"2024-09-11T05:35:35.743768+0000","last_fullsized":"2024-09-11T05:35:35.743768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0073602759999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4311,"num_read_kb":22872,"num_write":719,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":210,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819683+0000","last_change":"2024-09-11T05:35:28.700422+0000","last_active":"2024-09-11T05:35:35.819683+0000","last_peered":"2024-09-11T05:35:35.819683+0000","last_clean":"2024-09-11T05:35:35.819683+0000","last_became_active":"2024-09-11T05:35:28.700119+0000","last_became_peered":"2024-09-11T05:35:28.700119+0000","last_unstale":"2024-09-11T05:35:35.819683+0000","last_undegraded":"2024-09-11T05:35:35.819683+0000","last_fullsized":"2024-09-11T05:35:35.819683+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:03.431125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"146'345","reported_seq":2882,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361248+0000","last_change":"2024-09-11T05:35:11.642354+0000","last_active":"2024-09-11T05:35:36.361248+0000","last_peered":"2024-09-11T05:35:36.361248+0000","last_clean":"2024-09-11T05:35:36.361248+0000","last_became_active":"2024-09-11T05:35:11.635099+0000","last_became_peered":"2024-09-11T05:35:11.635099+0000","last_unstale":"2024-09-11T05:35:36.361248+0000","last_undegraded":"2024-09-11T05:35:36.361248+0000","last_fullsized":"2024-09-11T05:35:36.361248+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:37:53.460954+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0054654079999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2061,"num_read_kb":16420,"num_write":311,"num_write_kb":9397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3451521,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.744863+0000","last_change":"2024-09-11T05:35:08.633295+0000","last_active":"2024-09-11T05:35:35.744863+0000","last_peered":"2024-09-11T05:35:35.744863+0000","last_clean":"2024-09-11T05:35:35.744863+0000","last_became_active":"2024-09-11T05:35:08.632954+0000","last_became_peered":"2024-09-11T05:35:08.632954+0000","last_unstale":"2024-09-11T05:35:35.744863+0000","last_undegraded":"2024-09-11T05:35:35.744863+0000","last_fullsized":"2024-09-11T05:35:35.744863+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:38:42.279949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"139'743","reported_seq":8668,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361154+0000","last_change":"2024-09-11T05:35:10.629926+0000","last_active":"2024-09-11T05:35:36.361154+0000","last_peered":"2024-09-11T05:35:36.361154+0000","last_clean":"2024-09-11T05:35:36.361154+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:35:36.361154+0000","last_undegraded":"2024-09-11T05:35:36.361154+0000","last_fullsized":"2024-09-11T05:35:36.361154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:51.136449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013315200000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":11851,"num_read_kb":20739,"num_write":676,"num_write_kb":6668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819620+0000","last_change":"2024-09-11T05:34:50.626273+0000","last_active":"2024-09-11T05:35:35.819620+0000","last_peered":"2024-09-11T05:35:35.819620+0000","last_clean":"2024-09-11T05:35:35.819620+0000","last_became_active":"2024-09-11T05:34:50.625970+0000","last_became_peered":"2024-09-11T05:34:50.625970+0000","last_unstale":"2024-09-11T05:35:35.819620+0000","last_undegraded":"2024-09-11T05:35:35.819620+0000","last_fullsized":"2024-09-11T05:35:35.819620+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:45.970895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"144'588","reported_seq":3895,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944239+0000","last_change":"2024-09-11T05:35:23.637690+0000","last_active":"2024-09-11T05:35:35.944239+0000","last_peered":"2024-09-11T05:35:35.944239+0000","last_clean":"2024-09-11T05:35:35.944239+0000","last_became_active":"2024-09-11T05:35:23.635903+0000","last_became_peered":"2024-09-11T05:35:23.635903+0000","last_unstale":"2024-09-11T05:35:35.944239+0000","last_undegraded":"2024-09-11T05:35:35.944239+0000","last_fullsized":"2024-09-11T05:35:35.944239+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:18:14.825205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002640187,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5913,"num_read_kb":15123,"num_write":618,"num_write_kb":14349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":103,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819741+0000","last_change":"2024-09-11T05:35:28.699062+0000","last_active":"2024-09-11T05:35:35.819741+0000","last_peered":"2024-09-11T05:35:35.819741+0000","last_clean":"2024-09-11T05:35:35.819741+0000","last_became_active":"2024-09-11T05:35:28.698723+0000","last_became_peered":"2024-09-11T05:35:28.698723+0000","last_unstale":"2024-09-11T05:35:35.819741+0000","last_undegraded":"2024-09-11T05:35:35.819741+0000","last_fullsized":"2024-09-11T05:35:35.819741+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:44.569039+0000","last_clean_scrub_stamp":"2024-09-11T05:32:44.569039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743722+0000","last_change":"2024-09-11T05:35:22.637165+0000","last_active":"2024-09-11T05:35:35.743722+0000","last_peered":"2024-09-11T05:35:35.743722+0000","last_clean":"2024-09-11T05:35:35.743722+0000","last_became_active":"2024-09-11T05:35:22.636808+0000","last_became_peered":"2024-09-11T05:35:22.636808+0000","last_unstale":"2024-09-11T05:35:35.743722+0000","last_undegraded":"2024-09-11T05:35:35.743722+0000","last_fullsized":"2024-09-11T05:35:35.743722+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:38.540979+0000","last_clean_scrub_stamp":"2024-09-11T05:32:38.540979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"147'674","reported_seq":21155,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.944229+0000","last_change":"2024-09-11T05:35:23.638318+0000","last_active":"2024-09-11T05:35:35.944229+0000","last_peered":"2024-09-11T05:35:35.944229+0000","last_clean":"2024-09-11T05:35:35.944229+0000","last_became_active":"2024-09-11T05:35:23.635346+0000","last_became_peered":"2024-09-11T05:35:23.635346+0000","last_unstale":"2024-09-11T05:35:35.944229+0000","last_undegraded":"2024-09-11T05:35:35.944229+0000","last_fullsized":"2024-09-11T05:35:35.944229+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:03:59.781583+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0012007719999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":21937,"num_read_kb":27288,"num_write":631,"num_write_kb":9659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":357,"num_bytes_recovered":6098347,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"142'411","reported_seq":10435,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819648+0000","last_change":"2024-09-11T05:35:28.701354+0000","last_active":"2024-09-11T05:35:35.819648+0000","last_peered":"2024-09-11T05:35:35.819648+0000","last_clean":"2024-09-11T05:35:35.819648+0000","last_became_active":"2024-09-11T05:35:28.699365+0000","last_became_peered":"2024-09-11T05:35:28.699365+0000","last_unstale":"2024-09-11T05:35:35.819648+0000","last_undegraded":"2024-09-11T05:35:35.819648+0000","last_fullsized":"2024-09-11T05:35:35.819648+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:37.199627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003370732,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9328,"num_read_kb":19500,"num_write":336,"num_write_kb":14817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":8961432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"144'432","reported_seq":3813,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819680+0000","last_change":"2024-09-11T05:35:28.701794+0000","last_active":"2024-09-11T05:35:35.819680+0000","last_peered":"2024-09-11T05:35:35.819680+0000","last_clean":"2024-09-11T05:35:35.819680+0000","last_became_active":"2024-09-11T05:35:28.700107+0000","last_became_peered":"2024-09-11T05:35:28.700107+0000","last_unstale":"2024-09-11T05:35:35.819680+0000","last_undegraded":"2024-09-11T05:35:35.819680+0000","last_fullsized":"2024-09-11T05:35:35.819680+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:16:45.230792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003122947,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1794,"num_read_kb":9402,"num_write":412,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":10914094,"num_keys_recovered":66,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"139'324","reported_seq":2603,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.744872+0000","last_change":"2024-09-11T05:35:11.637663+0000","last_active":"2024-09-11T05:35:35.744872+0000","last_peered":"2024-09-11T05:35:35.744872+0000","last_clean":"2024-09-11T05:35:35.744872+0000","last_became_active":"2024-09-11T05:35:11.631665+0000","last_became_peered":"2024-09-11T05:35:11.631665+0000","last_unstale":"2024-09-11T05:35:35.744872+0000","last_undegraded":"2024-09-11T05:35:35.744872+0000","last_fullsized":"2024-09-11T05:35:35.744872+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:56:28.397445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040247640000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2267,"num_read_kb":23620,"num_write":305,"num_write_kb":16916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":14087582,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"146'409","reported_seq":3154,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743549+0000","last_change":"2024-09-11T05:35:11.640341+0000","last_active":"2024-09-11T05:35:35.743549+0000","last_peered":"2024-09-11T05:35:35.743549+0000","last_clean":"2024-09-11T05:35:35.743549+0000","last_became_active":"2024-09-11T05:35:11.630867+0000","last_became_peered":"2024-09-11T05:35:11.630867+0000","last_unstale":"2024-09-11T05:35:35.743549+0000","last_undegraded":"2024-09-11T05:35:35.743549+0000","last_fullsized":"2024-09-11T05:35:35.743549+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0078972569999999995,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1985,"num_read_kb":12033,"num_write":383,"num_write_kb":5272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":320,"num_bytes_recovered":6119775,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"141'478","reported_seq":5937,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819734+0000","last_change":"2024-09-11T05:35:28.702740+0000","last_active":"2024-09-11T05:35:35.819734+0000","last_peered":"2024-09-11T05:35:35.819734+0000","last_clean":"2024-09-11T05:35:35.819734+0000","last_became_active":"2024-09-11T05:35:28.699897+0000","last_became_peered":"2024-09-11T05:35:28.699897+0000","last_unstale":"2024-09-11T05:35:35.819734+0000","last_undegraded":"2024-09-11T05:35:35.819734+0000","last_fullsized":"2024-09-11T05:35:35.819734+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:38.206892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039836639999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5865,"num_read_kb":13697,"num_write":403,"num_write_kb":10315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":13015515,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"140'401","reported_seq":2951,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361507+0000","last_change":"2024-09-11T05:35:10.629686+0000","last_active":"2024-09-11T05:35:36.361507+0000","last_peered":"2024-09-11T05:35:36.361507+0000","last_clean":"2024-09-11T05:35:36.361507+0000","last_became_active":"2024-09-11T05:35:05.630573+0000","last_became_peered":"2024-09-11T05:35:05.630573+0000","last_unstale":"2024-09-11T05:35:36.361507+0000","last_undegraded":"2024-09-11T05:35:36.361507+0000","last_fullsized":"2024-09-11T05:35:36.361507+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:55.457196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001163856,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2127,"num_read_kb":12622,"num_write":331,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":262196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"141'638","reported_seq":5214,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743465+0000","last_change":"2024-09-11T05:35:22.636513+0000","last_active":"2024-09-11T05:35:35.743465+0000","last_peered":"2024-09-11T05:35:35.743465+0000","last_clean":"2024-09-11T05:35:35.743465+0000","last_became_active":"2024-09-11T05:35:22.634192+0000","last_became_peered":"2024-09-11T05:35:22.634192+0000","last_unstale":"2024-09-11T05:35:35.743465+0000","last_undegraded":"2024-09-11T05:35:35.743465+0000","last_fullsized":"2024-09-11T05:35:35.743465+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005994961,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":6001,"num_read_kb":12376,"num_write":612,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":2111260,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"135'377","reported_seq":5506,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.743423+0000","last_change":"2024-09-11T05:35:22.638949+0000","last_active":"2024-09-11T05:35:35.743423+0000","last_peered":"2024-09-11T05:35:35.743423+0000","last_clean":"2024-09-11T05:35:35.743423+0000","last_became_active":"2024-09-11T05:35:22.635431+0000","last_became_peered":"2024-09-11T05:35:22.635431+0000","last_unstale":"2024-09-11T05:35:35.743423+0000","last_undegraded":"2024-09-11T05:35:35.743423+0000","last_fullsized":"2024-09-11T05:35:35.743423+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0045659699999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4943,"num_read_kb":12354,"num_write":293,"num_write_kb":4874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":3066244,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"141'664","reported_seq":2303,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819620+0000","last_change":"2024-09-11T05:35:28.703601+0000","last_active":"2024-09-11T05:35:35.819620+0000","last_peered":"2024-09-11T05:35:35.819620+0000","last_clean":"2024-09-11T05:35:35.819620+0000","last_became_active":"2024-09-11T05:35:28.701845+0000","last_became_peered":"2024-09-11T05:35:28.701845+0000","last_unstale":"2024-09-11T05:35:35.819620+0000","last_undegraded":"2024-09-11T05:35:35.819620+0000","last_fullsized":"2024-09-11T05:35:35.819620+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:09:54.507773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001942809,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2920,"num_read_kb":11034,"num_write":809,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":3434090,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"144'613","reported_seq":11190,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:36.361155+0000","last_change":"2024-09-11T05:35:10.631369+0000","last_active":"2024-09-11T05:35:36.361155+0000","last_peered":"2024-09-11T05:35:36.361155+0000","last_clean":"2024-09-11T05:35:36.361155+0000","last_became_active":"2024-09-11T05:34:53.789002+0000","last_became_peered":"2024-09-11T05:34:53.789002+0000","last_unstale":"2024-09-11T05:35:36.361155+0000","last_undegraded":"2024-09-11T05:35:36.361155+0000","last_fullsized":"2024-09-11T05:35:36.361155+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:29.114608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002392473,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3076,"num_read_kb":7989,"num_write":738,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":6984484,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"144'563","reported_seq":6585,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:35.819733+0000","last_change":"2024-09-11T05:35:28.698744+0000","last_active":"2024-09-11T05:35:35.819733+0000","last_peered":"2024-09-11T05:35:35.819733+0000","last_clean":"2024-09-11T05:35:35.819733+0000","last_became_active":"2024-09-11T05:35:28.696781+0000","last_became_peered":"2024-09-11T05:35:28.696781+0000","last_unstale":"2024-09-11T05:35:35.819733+0000","last_undegraded":"2024-09-11T05:35:35.819733+0000","last_fullsized":"2024-09-11T05:35:35.819733+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:32:54.623194+0000","last_clean_scrub_stamp":"2024-09-11T05:32:54.623194+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:24.791414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017107820000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6991,"num_read_kb":39098,"num_write":620,"num_write_kb":9927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":4472318,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":121,"num_read":220717,"num_read_kb":578588,"num_write":21850,"num_write_kb":315751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6659,"num_bytes_recovered":181815763,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19579,"ondisk_log_size":19579,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542186,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33176,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338664,"statfs":{"total":96636764160,"available":96602791936,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542186,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542184,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78176,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293664,"statfs":{"total":96636764160,"available":96556711936,"internally_reserved":0,"allocated":2629632,"data_stored":1571772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":103,"seq":442381631506,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":1984,"kb_used_omap":4,"kb_used_meta":31803,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4454,"internal_metadata":32566938},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542184,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51220,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320620,"statfs":{"total":96636764160,"available":96584314880,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69856,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301984,"statfs":{"total":96636764160,"available":96565231616,"internally_reserved":0,"allocated":2629632,"data_stored":1571772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51220,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320620,"statfs":{"total":96636764160,"available":96584314880,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:35:45.692 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.692 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.692 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.692 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.692 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.692 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.692 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.693 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.693 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.693 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.693 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.693 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.693 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T05:32:44.569039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=44, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.693 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.693 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T05:32:44.569039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=44, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.693 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.694 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T05:32:44.569039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=44, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.694 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.694 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T05:32:44.569039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=44, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.694 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.694 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.694 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T05:32:44.569039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=44, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.694 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.694 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T05:32:44.569039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=44, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.695 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.695 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T05:32:44.569039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=44, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.695 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.695 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T05:32:44.569039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=44, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.695 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T05:32:38.540979+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=38, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.695 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.695 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.695 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.695 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.696 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.696 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.696 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.696 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.696 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.696 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.696 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.696 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-11T05:32:54.623194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=32, tm_sec=54, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=5, tm_min=35, tm_sec=40, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T05:35:45.696 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T05:36:05.698 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T05:36:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T05:36:05.992 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T05:36:06.004 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-09-11T05:36:05.981149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":121,"num_read":220833,"num_read_kb":578688,"num_write":22011,"num_write_kb":318169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6665,"num_bytes_recovered":182406169,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19828,"ondisk_log_size":19828,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436504,"kb_used_data":17048,"kb_used_omap":15,"kb_used_meta":419312,"kb_avail":754538216,"statfs":{"total":773094113280,"available":772647133184,"internally_reserved":0,"allocated":17457152,"data_stored":9031892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15611,"internal_metadata":429376261},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002974"},"pg_stats":[{"pgid":"3.1f","version":"169'617","reported_seq":7869,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:50.839945+0000","last_change":"2024-09-11T05:35:50.839975+0000","last_active":"2024-09-11T05:35:50.839945+0000","last_peered":"2024-09-11T05:35:50.839945+0000","last_clean":"2024-09-11T05:35:50.839945+0000","last_became_active":"2024-09-11T05:35:22.637032+0000","last_became_peered":"2024-09-11T05:35:22.637032+0000","last_unstale":"2024-09-11T05:35:50.839945+0000","last_undegraded":"2024-09-11T05:35:50.839945+0000","last_fullsized":"2024-09-11T05:35:50.839945+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'617","last_scrub_stamp":"2024-09-11T05:35:50.839864+0000","last_deep_scrub":"169'617","last_deep_scrub_stamp":"2024-09-11T05:35:50.839864+0000","last_clean_scrub_stamp":"2024-09-11T05:35:50.839864+0000","objects_scrubbed":6,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:16:16.208749+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.00245933,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7747,"num_read_kb":22584,"num_write":761,"num_write_kb":11145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":285,"num_bytes_recovered":4324286,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"169'304","reported_seq":3789,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:45.754539+0000","last_change":"2024-09-11T05:35:45.754576+0000","last_active":"2024-09-11T05:35:45.754539+0000","last_peered":"2024-09-11T05:35:45.754539+0000","last_clean":"2024-09-11T05:35:45.754539+0000","last_became_active":"2024-09-11T05:32:55.613949+0000","last_became_peered":"2024-09-11T05:32:55.613949+0000","last_unstale":"2024-09-11T05:35:45.754539+0000","last_undegraded":"2024-09-11T05:35:45.754539+0000","last_fullsized":"2024-09-11T05:35:45.754539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'304","last_scrub_stamp":"2024-09-11T05:35:45.754443+0000","last_deep_scrub":"169'304","last_deep_scrub_stamp":"2024-09-11T05:35:45.754443+0000","last_clean_scrub_stamp":"2024-09-11T05:35:45.754443+0000","objects_scrubbed":8,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:02:54.582389+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.0014246319999999999,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":3027,"num_read_kb":23842,"num_write":231,"num_write_kb":6198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"169'913","reported_seq":21679,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:48.972927+0000","last_change":"2024-09-11T05:35:48.972961+0000","last_active":"2024-09-11T05:35:48.972927+0000","last_peered":"2024-09-11T05:35:48.972927+0000","last_clean":"2024-09-11T05:35:48.972927+0000","last_became_active":"2024-09-11T05:35:28.696723+0000","last_became_peered":"2024-09-11T05:35:28.696723+0000","last_unstale":"2024-09-11T05:35:48.972927+0000","last_undegraded":"2024-09-11T05:35:48.972927+0000","last_fullsized":"2024-09-11T05:35:48.972927+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'913","last_scrub_stamp":"2024-09-11T05:35:48.972837+0000","last_deep_scrub":"169'913","last_deep_scrub_stamp":"2024-09-11T05:35:48.972837+0000","last_clean_scrub_stamp":"2024-09-11T05:35:48.972837+0000","objects_scrubbed":3,"log_size":913,"log_dups_size":0,"ondisk_log_size":913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:52:27.141206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.003253822,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":16637,"num_read_kb":25385,"num_write":1112,"num_write_kb":7409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":6593091,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"169'606","reported_seq":7787,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:45.490008+0000","last_change":"2024-09-11T05:35:45.490038+0000","last_active":"2024-09-11T05:35:45.490008+0000","last_peered":"2024-09-11T05:35:45.490008+0000","last_clean":"2024-09-11T05:35:45.490008+0000","last_became_active":"2024-09-11T05:35:22.636725+0000","last_became_peered":"2024-09-11T05:35:22.636725+0000","last_unstale":"2024-09-11T05:35:45.490008+0000","last_undegraded":"2024-09-11T05:35:45.490008+0000","last_fullsized":"2024-09-11T05:35:45.490008+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'606","last_scrub_stamp":"2024-09-11T05:35:45.489928+0000","last_deep_scrub":"169'606","last_deep_scrub_stamp":"2024-09-11T05:35:45.489928+0000","last_clean_scrub_stamp":"2024-09-11T05:35:45.489928+0000","objects_scrubbed":5,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:35:01.848647+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.0028264560000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9012,"num_read_kb":27646,"num_write":675,"num_write_kb":16439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":13219858,"num_keys_recovered":56,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"169'583","reported_seq":7874,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:48.672443+0000","last_change":"2024-09-11T05:35:48.672496+0000","last_active":"2024-09-11T05:35:48.672443+0000","last_peered":"2024-09-11T05:35:48.672443+0000","last_clean":"2024-09-11T05:35:48.672443+0000","last_became_active":"2024-09-11T05:35:23.634303+0000","last_became_peered":"2024-09-11T05:35:23.634303+0000","last_unstale":"2024-09-11T05:35:48.672443+0000","last_undegraded":"2024-09-11T05:35:48.672443+0000","last_fullsized":"2024-09-11T05:35:48.672443+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'583","last_scrub_stamp":"2024-09-11T05:35:48.672313+0000","last_deep_scrub":"169'583","last_deep_scrub_stamp":"2024-09-11T05:35:48.672313+0000","last_clean_scrub_stamp":"2024-09-11T05:35:48.672313+0000","objects_scrubbed":4,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:18:29.922483+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.0049355689999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":7366,"num_read_kb":17763,"num_write":665,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":421,"num_bytes_recovered":7543883,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"169'452","reported_seq":5293,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:44.513254+0000","last_change":"2024-09-11T05:35:44.513284+0000","last_active":"2024-09-11T05:35:44.513254+0000","last_peered":"2024-09-11T05:35:44.513254+0000","last_clean":"2024-09-11T05:35:44.513254+0000","last_became_active":"2024-09-11T05:35:22.636807+0000","last_became_peered":"2024-09-11T05:35:22.636807+0000","last_unstale":"2024-09-11T05:35:44.513254+0000","last_undegraded":"2024-09-11T05:35:44.513254+0000","last_fullsized":"2024-09-11T05:35:44.513254+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'452","last_scrub_stamp":"2024-09-11T05:35:44.513193+0000","last_deep_scrub":"169'452","last_deep_scrub_stamp":"2024-09-11T05:35:44.513193+0000","last_clean_scrub_stamp":"2024-09-11T05:35:44.513193+0000","objects_scrubbed":7,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:04.415844+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.0017105359999999999,"stat_sum":{"num_bytes":19,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":6,"num_read":5410,"num_read_kb":14252,"num_write":483,"num_write_kb":12836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":327,"num_bytes_recovered":4853026,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"169'1105","reported_seq":11049,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:45.645630+0000","last_change":"2024-09-11T05:35:45.645701+0000","last_active":"2024-09-11T05:35:45.645630+0000","last_peered":"2024-09-11T05:35:45.645630+0000","last_clean":"2024-09-11T05:35:45.645630+0000","last_became_active":"2024-09-11T05:35:22.632741+0000","last_became_peered":"2024-09-11T05:35:22.632741+0000","last_unstale":"2024-09-11T05:35:45.645630+0000","last_undegraded":"2024-09-11T05:35:45.645630+0000","last_fullsized":"2024-09-11T05:35:45.645630+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'1105","last_scrub_stamp":"2024-09-11T05:35:45.645518+0000","last_deep_scrub":"169'1105","last_deep_scrub_stamp":"2024-09-11T05:35:45.645518+0000","last_clean_scrub_stamp":"2024-09-11T05:35:45.645518+0000","objects_scrubbed":4,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:47.677279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0030616850000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":13726,"num_read_kb":13435,"num_write":1662,"num_write_kb":8537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":1269861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"169'521","reported_seq":3179,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:44.745915+0000","last_change":"2024-09-11T05:35:44.745949+0000","last_active":"2024-09-11T05:35:44.745915+0000","last_peered":"2024-09-11T05:35:44.745915+0000","last_clean":"2024-09-11T05:35:44.745915+0000","last_became_active":"2024-09-11T05:32:55.612186+0000","last_became_peered":"2024-09-11T05:32:55.612186+0000","last_unstale":"2024-09-11T05:35:44.745915+0000","last_undegraded":"2024-09-11T05:35:44.745915+0000","last_fullsized":"2024-09-11T05:35:44.745915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'521","last_scrub_stamp":"2024-09-11T05:35:44.745825+0000","last_deep_scrub":"169'521","last_deep_scrub_stamp":"2024-09-11T05:35:44.745825+0000","last_clean_scrub_stamp":"2024-09-11T05:35:44.745825+0000","objects_scrubbed":4,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:26.335818+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.0027595950000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":3338,"num_read_kb":10070,"num_write":595,"num_write_kb":6210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"169'1159","reported_seq":3355,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:47.834017+0000","last_change":"2024-09-11T05:35:47.834045+0000","last_active":"2024-09-11T05:35:47.834017+0000","last_peered":"2024-09-11T05:35:47.834017+0000","last_clean":"2024-09-11T05:35:47.834017+0000","last_became_active":"2024-09-11T05:34:54.790407+0000","last_became_peered":"2024-09-11T05:34:54.790407+0000","last_unstale":"2024-09-11T05:35:47.834017+0000","last_undegraded":"2024-09-11T05:35:47.834017+0000","last_fullsized":"2024-09-11T05:35:47.834017+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'1159","last_scrub_stamp":"2024-09-11T05:35:47.833910+0000","last_deep_scrub":"169'1159","last_deep_scrub_stamp":"2024-09-11T05:35:47.833910+0000","last_clean_scrub_stamp":"2024-09-11T05:35:47.833910+0000","objects_scrubbed":2,"log_size":1159,"log_dups_size":0,"ondisk_log_size":1159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:36.621268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022982459999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5158,"num_read_kb":28626,"num_write":1706,"num_write_kb":20682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":292,"num_bytes_recovered":48701806,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"169'288","reported_seq":3656,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:44.235549+0000","last_change":"2024-09-11T05:35:44.235606+0000","last_active":"2024-09-11T05:35:44.235549+0000","last_peered":"2024-09-11T05:35:44.235549+0000","last_clean":"2024-09-11T05:35:44.235549+0000","last_became_active":"2024-09-11T05:35:27.699049+0000","last_became_peered":"2024-09-11T05:35:27.699049+0000","last_unstale":"2024-09-11T05:35:44.235549+0000","last_undegraded":"2024-09-11T05:35:44.235549+0000","last_fullsized":"2024-09-11T05:35:44.235549+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'288","last_scrub_stamp":"2024-09-11T05:35:44.235429+0000","last_deep_scrub":"169'288","last_deep_scrub_stamp":"2024-09-11T05:35:44.235429+0000","last_clean_scrub_stamp":"2024-09-11T05:35:44.235429+0000","objects_scrubbed":2,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:56:13.593038+0000","scrub_duration":2,"objects_trimmed":2,"snaptrim_duration":0.00066517799999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2863,"num_read_kb":14884,"num_write":221,"num_write_kb":7375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":1456269,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"169'730","reported_seq":3860,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:44.091755+0000","last_change":"2024-09-11T05:35:44.091806+0000","last_active":"2024-09-11T05:35:44.091755+0000","last_peered":"2024-09-11T05:35:44.091755+0000","last_clean":"2024-09-11T05:35:44.091755+0000","last_became_active":"2024-09-11T05:32:55.612466+0000","last_became_peered":"2024-09-11T05:32:55.612466+0000","last_unstale":"2024-09-11T05:35:44.091755+0000","last_undegraded":"2024-09-11T05:35:44.091755+0000","last_fullsized":"2024-09-11T05:35:44.091755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'730","last_scrub_stamp":"2024-09-11T05:35:44.091661+0000","last_deep_scrub":"169'730","last_deep_scrub_stamp":"2024-09-11T05:35:44.091661+0000","last_clean_scrub_stamp":"2024-09-11T05:35:44.091661+0000","objects_scrubbed":5,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:14:13.066399+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.0079156780000000006,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5390,"num_read_kb":12737,"num_write":875,"num_write_kb":9766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"169'371","reported_seq":12019,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:49.935717+0000","last_change":"2024-09-11T05:35:49.935766+0000","last_active":"2024-09-11T05:35:49.935717+0000","last_peered":"2024-09-11T05:35:49.935717+0000","last_clean":"2024-09-11T05:35:49.935717+0000","last_became_active":"2024-09-11T05:35:28.697994+0000","last_became_peered":"2024-09-11T05:35:28.697994+0000","last_unstale":"2024-09-11T05:35:49.935717+0000","last_undegraded":"2024-09-11T05:35:49.935717+0000","last_fullsized":"2024-09-11T05:35:49.935717+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'371","last_scrub_stamp":"2024-09-11T05:35:49.935626+0000","last_deep_scrub":"169'371","last_deep_scrub_stamp":"2024-09-11T05:35:49.935626+0000","last_clean_scrub_stamp":"2024-09-11T05:35:49.935626+0000","objects_scrubbed":2,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:43:38.464835+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0015799760000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5068,"num_read_kb":14759,"num_write":300,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":7503668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:44.964831+0000","last_change":"2024-09-11T05:35:44.964852+0000","last_active":"2024-09-11T05:35:44.964831+0000","last_peered":"2024-09-11T05:35:44.964831+0000","last_clean":"2024-09-11T05:35:44.964831+0000","last_became_active":"2024-09-11T05:34:50.627529+0000","last_became_peered":"2024-09-11T05:34:50.627529+0000","last_unstale":"2024-09-11T05:35:44.964831+0000","last_undegraded":"2024-09-11T05:35:44.964831+0000","last_fullsized":"2024-09-11T05:35:44.964831+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:35:44.964731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:35:44.964731+0000","last_clean_scrub_stamp":"2024-09-11T05:35:44.964731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:48.920044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"169'706","reported_seq":4462,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:46.683180+0000","last_change":"2024-09-11T05:35:46.683216+0000","last_active":"2024-09-11T05:35:46.683180+0000","last_peered":"2024-09-11T05:35:46.683180+0000","last_clean":"2024-09-11T05:35:46.683180+0000","last_became_active":"2024-09-11T05:35:22.632683+0000","last_became_peered":"2024-09-11T05:35:22.632683+0000","last_unstale":"2024-09-11T05:35:46.683180+0000","last_undegraded":"2024-09-11T05:35:46.683180+0000","last_fullsized":"2024-09-11T05:35:46.683180+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'706","last_scrub_stamp":"2024-09-11T05:35:46.683086+0000","last_deep_scrub":"169'706","last_deep_scrub_stamp":"2024-09-11T05:35:46.683086+0000","last_clean_scrub_stamp":"2024-09-11T05:35:46.683086+0000","objects_scrubbed":3,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:33:35.551078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0057885200000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5183,"num_read_kb":4253,"num_write":904,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":463,"num_bytes_recovered":1655489,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:44.678413+0000","last_change":"2024-09-11T05:35:44.678463+0000","last_active":"2024-09-11T05:35:44.678413+0000","last_peered":"2024-09-11T05:35:44.678413+0000","last_clean":"2024-09-11T05:35:44.678413+0000","last_became_active":"2024-09-11T05:35:20.631241+0000","last_became_peered":"2024-09-11T05:35:20.631241+0000","last_unstale":"2024-09-11T05:35:44.678413+0000","last_undegraded":"2024-09-11T05:35:44.678413+0000","last_fullsized":"2024-09-11T05:35:44.678413+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:35:44.678306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:35:44.678306+0000","last_clean_scrub_stamp":"2024-09-11T05:35:44.678306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:58.279324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"169'471","reported_seq":6377,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:47.707598+0000","last_change":"2024-09-11T05:35:47.707652+0000","last_active":"2024-09-11T05:35:47.707598+0000","last_peered":"2024-09-11T05:35:47.707598+0000","last_clean":"2024-09-11T05:35:47.707598+0000","last_became_active":"2024-09-11T05:35:22.632436+0000","last_became_peered":"2024-09-11T05:35:22.632436+0000","last_unstale":"2024-09-11T05:35:47.707598+0000","last_undegraded":"2024-09-11T05:35:47.707598+0000","last_fullsized":"2024-09-11T05:35:47.707598+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'471","last_scrub_stamp":"2024-09-11T05:35:47.707481+0000","last_deep_scrub":"169'471","last_deep_scrub_stamp":"2024-09-11T05:35:47.707481+0000","last_clean_scrub_stamp":"2024-09-11T05:35:47.707481+0000","objects_scrubbed":4,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:47:10.900589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0027050960000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6977,"num_read_kb":16019,"num_write":349,"num_write_kb":6385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":1715668,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:45.930182+0000","last_change":"2024-09-11T05:35:45.930222+0000","last_active":"2024-09-11T05:35:45.930182+0000","last_peered":"2024-09-11T05:35:45.930182+0000","last_clean":"2024-09-11T05:35:45.930182+0000","last_became_active":"2024-09-11T05:35:20.638478+0000","last_became_peered":"2024-09-11T05:35:20.638478+0000","last_unstale":"2024-09-11T05:35:45.930182+0000","last_undegraded":"2024-09-11T05:35:45.930182+0000","last_fullsized":"2024-09-11T05:35:45.930182+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:35:45.930098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:35:45.930098+0000","last_clean_scrub_stamp":"2024-09-11T05:35:45.930098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:52:17.235717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052444199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"169'1637","reported_seq":8222,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:46.506650+0000","last_change":"2024-09-11T05:35:46.506717+0000","last_active":"2024-09-11T05:35:46.506650+0000","last_peered":"2024-09-11T05:35:46.506650+0000","last_clean":"2024-09-11T05:35:46.506650+0000","last_became_active":"2024-09-11T05:32:55.614584+0000","last_became_peered":"2024-09-11T05:32:55.614584+0000","last_unstale":"2024-09-11T05:35:46.506650+0000","last_undegraded":"2024-09-11T05:35:46.506650+0000","last_fullsized":"2024-09-11T05:35:46.506650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'1637","last_scrub_stamp":"2024-09-11T05:35:46.506547+0000","last_deep_scrub":"169'1637","last_deep_scrub_stamp":"2024-09-11T05:35:46.506547+0000","last_clean_scrub_stamp":"2024-09-11T05:35:46.506547+0000","objects_scrubbed":6,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:35.777948+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0026555530000000002,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":15252,"num_read_kb":37939,"num_write":2291,"num_write_kb":19413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":334,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:46.785726+0000","last_change":"2024-09-11T05:35:46.785748+0000","last_active":"2024-09-11T05:35:46.785726+0000","last_peered":"2024-09-11T05:35:46.785726+0000","last_clean":"2024-09-11T05:35:46.785726+0000","last_became_active":"2024-09-11T05:34:44.767862+0000","last_became_peered":"2024-09-11T05:34:44.767862+0000","last_unstale":"2024-09-11T05:35:46.785726+0000","last_undegraded":"2024-09-11T05:35:46.785726+0000","last_fullsized":"2024-09-11T05:35:46.785726+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:35:46.785638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:35:46.785638+0000","last_clean_scrub_stamp":"2024-09-11T05:35:46.785638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:19:55.886723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042334499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"169'852","reported_seq":12680,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:45.210003+0000","last_change":"2024-09-11T05:35:45.210044+0000","last_active":"2024-09-11T05:35:45.210003+0000","last_peered":"2024-09-11T05:35:45.210003+0000","last_clean":"2024-09-11T05:35:45.210003+0000","last_became_active":"2024-09-11T05:35:27.699111+0000","last_became_peered":"2024-09-11T05:35:27.699111+0000","last_unstale":"2024-09-11T05:35:45.210003+0000","last_undegraded":"2024-09-11T05:35:45.210003+0000","last_fullsized":"2024-09-11T05:35:45.210003+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'852","last_scrub_stamp":"2024-09-11T05:35:45.209921+0000","last_deep_scrub":"169'852","last_deep_scrub_stamp":"2024-09-11T05:35:45.209921+0000","last_clean_scrub_stamp":"2024-09-11T05:35:45.209921+0000","objects_scrubbed":7,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:38.776835+0000","scrub_duration":6,"objects_trimmed":1,"snaptrim_duration":0.0034996329999999998,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":15193,"num_read_kb":18227,"num_write":823,"num_write_kb":8806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"169'677","reported_seq":4384,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:43.095010+0000","last_change":"2024-09-11T05:35:43.095033+0000","last_active":"2024-09-11T05:35:43.095010+0000","last_peered":"2024-09-11T05:35:43.095010+0000","last_clean":"2024-09-11T05:35:43.095010+0000","last_became_active":"2024-09-11T05:32:55.611307+0000","last_became_peered":"2024-09-11T05:32:55.611307+0000","last_unstale":"2024-09-11T05:35:43.095010+0000","last_undegraded":"2024-09-11T05:35:43.095010+0000","last_fullsized":"2024-09-11T05:35:43.095010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'677","last_scrub_stamp":"2024-09-11T05:35:43.094943+0000","last_deep_scrub":"169'677","last_deep_scrub_stamp":"2024-09-11T05:35:43.094943+0000","last_clean_scrub_stamp":"2024-09-11T05:35:43.094943+0000","objects_scrubbed":1,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:14:35.602850+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0073602759999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4311,"num_read_kb":22872,"num_write":719,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"169'3","reported_seq":220,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:50.896269+0000","last_change":"2024-09-11T05:35:50.896301+0000","last_active":"2024-09-11T05:35:50.896269+0000","last_peered":"2024-09-11T05:35:50.896269+0000","last_clean":"2024-09-11T05:35:50.896269+0000","last_became_active":"2024-09-11T05:35:28.700119+0000","last_became_peered":"2024-09-11T05:35:28.700119+0000","last_unstale":"2024-09-11T05:35:50.896269+0000","last_undegraded":"2024-09-11T05:35:50.896269+0000","last_fullsized":"2024-09-11T05:35:50.896269+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'3","last_scrub_stamp":"2024-09-11T05:35:50.896184+0000","last_deep_scrub":"169'3","last_deep_scrub_stamp":"2024-09-11T05:35:50.896184+0000","last_clean_scrub_stamp":"2024-09-11T05:35:50.896184+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:17:02.921287+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"169'350","reported_seq":2896,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:49.855194+0000","last_change":"2024-09-11T05:35:49.855236+0000","last_active":"2024-09-11T05:35:49.855194+0000","last_peered":"2024-09-11T05:35:49.855194+0000","last_clean":"2024-09-11T05:35:49.855194+0000","last_became_active":"2024-09-11T05:35:11.635099+0000","last_became_peered":"2024-09-11T05:35:11.635099+0000","last_unstale":"2024-09-11T05:35:49.855194+0000","last_undegraded":"2024-09-11T05:35:49.855194+0000","last_fullsized":"2024-09-11T05:35:49.855194+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'350","last_scrub_stamp":"2024-09-11T05:35:49.855091+0000","last_deep_scrub":"169'350","last_deep_scrub_stamp":"2024-09-11T05:35:49.855091+0000","last_clean_scrub_stamp":"2024-09-11T05:35:49.855091+0000","objects_scrubbed":5,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:50.074369+0000","scrub_duration":5,"objects_trimmed":2,"snaptrim_duration":0.0054654079999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2061,"num_read_kb":16420,"num_write":311,"num_write_kb":9397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3451521,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:45.759447+0000","last_change":"2024-09-11T05:35:45.759469+0000","last_active":"2024-09-11T05:35:45.759447+0000","last_peered":"2024-09-11T05:35:45.759447+0000","last_clean":"2024-09-11T05:35:45.759447+0000","last_became_active":"2024-09-11T05:35:08.632954+0000","last_became_peered":"2024-09-11T05:35:08.632954+0000","last_unstale":"2024-09-11T05:35:45.759447+0000","last_undegraded":"2024-09-11T05:35:45.759447+0000","last_fullsized":"2024-09-11T05:35:45.759447+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:35:45.759360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:35:45.759360+0000","last_clean_scrub_stamp":"2024-09-11T05:35:45.759360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:02:04.172845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"169'747","reported_seq":8681,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:45.468738+0000","last_change":"2024-09-11T05:35:45.468786+0000","last_active":"2024-09-11T05:35:45.468738+0000","last_peered":"2024-09-11T05:35:45.468738+0000","last_clean":"2024-09-11T05:35:45.468738+0000","last_became_active":"2024-09-11T05:32:55.614541+0000","last_became_peered":"2024-09-11T05:32:55.614541+0000","last_unstale":"2024-09-11T05:35:45.468738+0000","last_undegraded":"2024-09-11T05:35:45.468738+0000","last_fullsized":"2024-09-11T05:35:45.468738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'747","last_scrub_stamp":"2024-09-11T05:35:45.468657+0000","last_deep_scrub":"169'747","last_deep_scrub_stamp":"2024-09-11T05:35:45.468657+0000","last_clean_scrub_stamp":"2024-09-11T05:35:45.468657+0000","objects_scrubbed":4,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:19.642624+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.0013315200000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":11851,"num_read_kb":20739,"num_write":676,"num_write_kb":6668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":106,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:43.938606+0000","last_change":"2024-09-11T05:35:43.938629+0000","last_active":"2024-09-11T05:35:43.938606+0000","last_peered":"2024-09-11T05:35:43.938606+0000","last_clean":"2024-09-11T05:35:43.938606+0000","last_became_active":"2024-09-11T05:34:50.625970+0000","last_became_peered":"2024-09-11T05:34:50.625970+0000","last_unstale":"2024-09-11T05:35:43.938606+0000","last_undegraded":"2024-09-11T05:35:43.938606+0000","last_fullsized":"2024-09-11T05:35:43.938606+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T05:35:43.938519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T05:35:43.938519+0000","last_clean_scrub_stamp":"2024-09-11T05:35:43.938519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:04.589126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"169'593","reported_seq":3909,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:49.710700+0000","last_change":"2024-09-11T05:35:49.710755+0000","last_active":"2024-09-11T05:35:49.710700+0000","last_peered":"2024-09-11T05:35:49.710700+0000","last_clean":"2024-09-11T05:35:49.710700+0000","last_became_active":"2024-09-11T05:35:23.635903+0000","last_became_peered":"2024-09-11T05:35:23.635903+0000","last_unstale":"2024-09-11T05:35:49.710700+0000","last_undegraded":"2024-09-11T05:35:49.710700+0000","last_fullsized":"2024-09-11T05:35:49.710700+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'593","last_scrub_stamp":"2024-09-11T05:35:49.710574+0000","last_deep_scrub":"169'593","last_deep_scrub_stamp":"2024-09-11T05:35:49.710574+0000","last_clean_scrub_stamp":"2024-09-11T05:35:49.710574+0000","objects_scrubbed":5,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:46:21.271695+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.002640187,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5913,"num_read_kb":15123,"num_write":618,"num_write_kb":14349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"169'2","reported_seq":113,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:47.941860+0000","last_change":"2024-09-11T05:35:47.941905+0000","last_active":"2024-09-11T05:35:47.941860+0000","last_peered":"2024-09-11T05:35:47.941860+0000","last_clean":"2024-09-11T05:35:47.941860+0000","last_became_active":"2024-09-11T05:35:28.698723+0000","last_became_peered":"2024-09-11T05:35:28.698723+0000","last_unstale":"2024-09-11T05:35:47.941860+0000","last_undegraded":"2024-09-11T05:35:47.941860+0000","last_fullsized":"2024-09-11T05:35:47.941860+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'2","last_scrub_stamp":"2024-09-11T05:35:47.941733+0000","last_deep_scrub":"169'2","last_deep_scrub_stamp":"2024-09-11T05:35:47.941733+0000","last_clean_scrub_stamp":"2024-09-11T05:35:47.941733+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:31.829584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"169'119","reported_seq":208,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:43.516413+0000","last_change":"2024-09-11T05:35:43.516444+0000","last_active":"2024-09-11T05:35:43.516413+0000","last_peered":"2024-09-11T05:35:43.516413+0000","last_clean":"2024-09-11T05:35:43.516413+0000","last_became_active":"2024-09-11T05:35:22.636808+0000","last_became_peered":"2024-09-11T05:35:22.636808+0000","last_unstale":"2024-09-11T05:35:43.516413+0000","last_undegraded":"2024-09-11T05:35:43.516413+0000","last_fullsized":"2024-09-11T05:35:43.516413+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'119","last_scrub_stamp":"2024-09-11T05:35:43.516341+0000","last_deep_scrub":"169'119","last_deep_scrub_stamp":"2024-09-11T05:35:43.516341+0000","last_clean_scrub_stamp":"2024-09-11T05:35:43.516341+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:58.545979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"169'676","reported_seq":21166,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:50.669412+0000","last_change":"2024-09-11T05:35:50.669449+0000","last_active":"2024-09-11T05:35:50.669412+0000","last_peered":"2024-09-11T05:35:50.669412+0000","last_clean":"2024-09-11T05:35:50.669412+0000","last_became_active":"2024-09-11T05:35:23.635346+0000","last_became_peered":"2024-09-11T05:35:23.635346+0000","last_unstale":"2024-09-11T05:35:50.669412+0000","last_undegraded":"2024-09-11T05:35:50.669412+0000","last_fullsized":"2024-09-11T05:35:50.669412+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'676","last_scrub_stamp":"2024-09-11T05:35:50.669311+0000","last_deep_scrub":"169'676","last_deep_scrub_stamp":"2024-09-11T05:35:50.669311+0000","last_clean_scrub_stamp":"2024-09-11T05:35:50.669311+0000","objects_scrubbed":2,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:15:38.636673+0000","scrub_duration":2,"objects_trimmed":2,"snaptrim_duration":0.0012007719999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":21937,"num_read_kb":27288,"num_write":631,"num_write_kb":9659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":357,"num_bytes_recovered":6098347,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"169'415","reported_seq":10448,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:51.911151+0000","last_change":"2024-09-11T05:35:51.911182+0000","last_active":"2024-09-11T05:35:51.911151+0000","last_peered":"2024-09-11T05:35:51.911151+0000","last_clean":"2024-09-11T05:35:51.911151+0000","last_became_active":"2024-09-11T05:35:28.699365+0000","last_became_peered":"2024-09-11T05:35:28.699365+0000","last_unstale":"2024-09-11T05:35:51.911151+0000","last_undegraded":"2024-09-11T05:35:51.911151+0000","last_fullsized":"2024-09-11T05:35:51.911151+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'415","last_scrub_stamp":"2024-09-11T05:35:51.911067+0000","last_deep_scrub":"169'415","last_deep_scrub_stamp":"2024-09-11T05:35:51.911067+0000","last_clean_scrub_stamp":"2024-09-11T05:35:51.911067+0000","objects_scrubbed":4,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:09.849088+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.003370732,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":9328,"num_read_kb":19500,"num_write":336,"num_write_kb":14817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":8961432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"169'434","reported_seq":3824,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:52.862495+0000","last_change":"2024-09-11T05:35:52.862532+0000","last_active":"2024-09-11T05:35:52.862495+0000","last_peered":"2024-09-11T05:35:52.862495+0000","last_clean":"2024-09-11T05:35:52.862495+0000","last_became_active":"2024-09-11T05:35:28.700107+0000","last_became_peered":"2024-09-11T05:35:28.700107+0000","last_unstale":"2024-09-11T05:35:52.862495+0000","last_undegraded":"2024-09-11T05:35:52.862495+0000","last_fullsized":"2024-09-11T05:35:52.862495+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'434","last_scrub_stamp":"2024-09-11T05:35:52.862381+0000","last_deep_scrub":"169'434","last_deep_scrub_stamp":"2024-09-11T05:35:52.862381+0000","last_clean_scrub_stamp":"2024-09-11T05:35:52.862381+0000","objects_scrubbed":2,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:28:51.240692+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.003122947,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":1794,"num_read_kb":9402,"num_write":412,"num_write_kb":8853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":10914094,"num_keys_recovered":66,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"169'330","reported_seq":2618,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:46.751101+0000","last_change":"2024-09-11T05:35:46.751134+0000","last_active":"2024-09-11T05:35:46.751101+0000","last_peered":"2024-09-11T05:35:46.751101+0000","last_clean":"2024-09-11T05:35:46.751101+0000","last_became_active":"2024-09-11T05:35:11.631665+0000","last_became_peered":"2024-09-11T05:35:11.631665+0000","last_unstale":"2024-09-11T05:35:46.751101+0000","last_undegraded":"2024-09-11T05:35:46.751101+0000","last_fullsized":"2024-09-11T05:35:46.751101+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'330","last_scrub_stamp":"2024-09-11T05:35:46.751018+0000","last_deep_scrub":"169'330","last_deep_scrub_stamp":"2024-09-11T05:35:46.751018+0000","last_clean_scrub_stamp":"2024-09-11T05:35:46.751018+0000","objects_scrubbed":6,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:51.722900+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.0040247640000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2267,"num_read_kb":23620,"num_write":305,"num_write_kb":16916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":14087582,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"169'412","reported_seq":3165,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:45.084320+0000","last_change":"2024-09-11T05:35:45.084362+0000","last_active":"2024-09-11T05:35:45.084320+0000","last_peered":"2024-09-11T05:35:45.084320+0000","last_clean":"2024-09-11T05:35:45.084320+0000","last_became_active":"2024-09-11T05:35:11.630867+0000","last_became_peered":"2024-09-11T05:35:11.630867+0000","last_unstale":"2024-09-11T05:35:45.084320+0000","last_undegraded":"2024-09-11T05:35:45.084320+0000","last_fullsized":"2024-09-11T05:35:45.084320+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'412","last_scrub_stamp":"2024-09-11T05:35:45.084237+0000","last_deep_scrub":"169'412","last_deep_scrub_stamp":"2024-09-11T05:35:45.084237+0000","last_clean_scrub_stamp":"2024-09-11T05:35:45.084237+0000","objects_scrubbed":3,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:51.329455+0000","scrub_duration":3,"objects_trimmed":4,"snaptrim_duration":0.0078972569999999995,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1985,"num_read_kb":12033,"num_write":383,"num_write_kb":5272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":320,"num_bytes_recovered":6119775,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"141'478","reported_seq":5946,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:53.907010+0000","last_change":"2024-09-11T05:35:53.907057+0000","last_active":"2024-09-11T05:35:53.907010+0000","last_peered":"2024-09-11T05:35:53.907010+0000","last_clean":"2024-09-11T05:35:53.907010+0000","last_became_active":"2024-09-11T05:35:28.699897+0000","last_became_peered":"2024-09-11T05:35:28.699897+0000","last_unstale":"2024-09-11T05:35:53.907010+0000","last_undegraded":"2024-09-11T05:35:53.907010+0000","last_fullsized":"2024-09-11T05:35:53.907010+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"141'478","last_scrub_stamp":"2024-09-11T05:35:53.906898+0000","last_deep_scrub":"141'478","last_deep_scrub_stamp":"2024-09-11T05:35:53.906898+0000","last_clean_scrub_stamp":"2024-09-11T05:35:53.906898+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:42:18.650649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0039836639999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5865,"num_read_kb":13697,"num_write":403,"num_write_kb":10315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":13015515,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"169'403","reported_seq":2962,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:48.835344+0000","last_change":"2024-09-11T05:35:48.835374+0000","last_active":"2024-09-11T05:35:48.835344+0000","last_peered":"2024-09-11T05:35:48.835344+0000","last_clean":"2024-09-11T05:35:48.835344+0000","last_became_active":"2024-09-11T05:35:05.630573+0000","last_became_peered":"2024-09-11T05:35:05.630573+0000","last_unstale":"2024-09-11T05:35:48.835344+0000","last_undegraded":"2024-09-11T05:35:48.835344+0000","last_fullsized":"2024-09-11T05:35:48.835344+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'403","last_scrub_stamp":"2024-09-11T05:35:48.835262+0000","last_deep_scrub":"169'403","last_deep_scrub_stamp":"2024-09-11T05:35:48.835262+0000","last_clean_scrub_stamp":"2024-09-11T05:35:48.835262+0000","objects_scrubbed":2,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:23:07.803552+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001163856,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2127,"num_read_kb":12622,"num_write":331,"num_write_kb":7381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":262196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"169'641","reported_seq":5225,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:46.043573+0000","last_change":"2024-09-11T05:35:46.043598+0000","last_active":"2024-09-11T05:35:46.043573+0000","last_peered":"2024-09-11T05:35:46.043573+0000","last_clean":"2024-09-11T05:35:46.043573+0000","last_became_active":"2024-09-11T05:35:22.634192+0000","last_became_peered":"2024-09-11T05:35:22.634192+0000","last_unstale":"2024-09-11T05:35:46.043573+0000","last_undegraded":"2024-09-11T05:35:46.043573+0000","last_fullsized":"2024-09-11T05:35:46.043573+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'641","last_scrub_stamp":"2024-09-11T05:35:46.043500+0000","last_deep_scrub":"169'641","last_deep_scrub_stamp":"2024-09-11T05:35:46.043500+0000","last_clean_scrub_stamp":"2024-09-11T05:35:46.043500+0000","objects_scrubbed":3,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:22:53.585555+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.005994961,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":6001,"num_read_kb":12376,"num_write":612,"num_write_kb":8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":2111260,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"169'380","reported_seq":5517,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:46.438692+0000","last_change":"2024-09-11T05:35:46.438729+0000","last_active":"2024-09-11T05:35:46.438692+0000","last_peered":"2024-09-11T05:35:46.438692+0000","last_clean":"2024-09-11T05:35:46.438692+0000","last_became_active":"2024-09-11T05:35:22.635431+0000","last_became_peered":"2024-09-11T05:35:22.635431+0000","last_unstale":"2024-09-11T05:35:46.438692+0000","last_undegraded":"2024-09-11T05:35:46.438692+0000","last_fullsized":"2024-09-11T05:35:46.438692+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'380","last_scrub_stamp":"2024-09-11T05:35:46.438626+0000","last_deep_scrub":"169'380","last_deep_scrub_stamp":"2024-09-11T05:35:46.438626+0000","last_clean_scrub_stamp":"2024-09-11T05:35:46.438626+0000","objects_scrubbed":3,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:31:02.982512+0000","scrub_duration":2,"objects_trimmed":1,"snaptrim_duration":0.0045659699999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4943,"num_read_kb":12354,"num_write":293,"num_write_kb":4874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":3066244,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"169'669","reported_seq":2317,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:54.932590+0000","last_change":"2024-09-11T05:35:54.932661+0000","last_active":"2024-09-11T05:35:54.932590+0000","last_peered":"2024-09-11T05:35:54.932590+0000","last_clean":"2024-09-11T05:35:54.932590+0000","last_became_active":"2024-09-11T05:35:28.701845+0000","last_became_peered":"2024-09-11T05:35:28.701845+0000","last_unstale":"2024-09-11T05:35:54.932590+0000","last_undegraded":"2024-09-11T05:35:54.932590+0000","last_fullsized":"2024-09-11T05:35:54.932590+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'669","last_scrub_stamp":"2024-09-11T05:35:54.932480+0000","last_deep_scrub":"169'669","last_deep_scrub_stamp":"2024-09-11T05:35:54.932480+0000","last_clean_scrub_stamp":"2024-09-11T05:35:54.932480+0000","objects_scrubbed":5,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:23.045416+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.001942809,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":2920,"num_read_kb":11034,"num_write":809,"num_write_kb":7591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":3434090,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"169'616","reported_seq":11202,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:47.535441+0000","last_change":"2024-09-11T05:35:47.535475+0000","last_active":"2024-09-11T05:35:47.535441+0000","last_peered":"2024-09-11T05:35:47.535441+0000","last_clean":"2024-09-11T05:35:47.535441+0000","last_became_active":"2024-09-11T05:34:53.789002+0000","last_became_peered":"2024-09-11T05:34:53.789002+0000","last_unstale":"2024-09-11T05:35:47.535441+0000","last_undegraded":"2024-09-11T05:35:47.535441+0000","last_fullsized":"2024-09-11T05:35:47.535441+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'616","last_scrub_stamp":"2024-09-11T05:35:47.535355+0000","last_deep_scrub":"169'616","last_deep_scrub_stamp":"2024-09-11T05:35:47.535355+0000","last_clean_scrub_stamp":"2024-09-11T05:35:47.535355+0000","objects_scrubbed":3,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:38:24.741711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002392473,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3076,"num_read_kb":7989,"num_write":738,"num_write_kb":8398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":6984484,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"169'568","reported_seq":6599,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T05:35:46.963820+0000","last_change":"2024-09-11T05:35:46.963874+0000","last_active":"2024-09-11T05:35:46.963820+0000","last_peered":"2024-09-11T05:35:46.963820+0000","last_clean":"2024-09-11T05:35:46.963820+0000","last_became_active":"2024-09-11T05:35:28.696781+0000","last_became_peered":"2024-09-11T05:35:28.696781+0000","last_unstale":"2024-09-11T05:35:46.963820+0000","last_undegraded":"2024-09-11T05:35:46.963820+0000","last_fullsized":"2024-09-11T05:35:46.963820+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'568","last_scrub_stamp":"2024-09-11T05:35:46.963730+0000","last_deep_scrub":"169'568","last_deep_scrub_stamp":"2024-09-11T05:35:46.963730+0000","last_clean_scrub_stamp":"2024-09-11T05:35:46.963730+0000","objects_scrubbed":5,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:15:12.160231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0017107820000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6991,"num_read_kb":39098,"num_write":620,"num_write_kb":9927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":4472318,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":121,"num_read":220717,"num_read_kb":578588,"num_write":21850,"num_write_kb":315751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6659,"num_bytes_recovered":181815763,"num_keys_recovered":238,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19704,"ondisk_log_size":19704,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542190,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59540,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312300,"statfs":{"total":96636764160,"available":96575795200,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78168,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293672,"statfs":{"total":96636764160,"available":96556720128,"internally_reserved":0,"allocated":2629632,"data_stored":1571772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":103,"seq":442381631510,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33808,"kb_used_data":1984,"kb_used_omap":4,"kb_used_meta":31803,"kb_avail":94338032,"statfs":{"total":96636764160,"available":96602144768,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4454,"internal_metadata":32566938},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59540,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312300,"statfs":{"total":96636764160,"available":96575795200,"internally_reserved":0,"allocated":2035712,"data_stored":981404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542188,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51216,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320624,"statfs":{"total":96636764160,"available":96584318976,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69848,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94301992,"statfs":{"total":96636764160,"available":96565239808,"internally_reserved":0,"allocated":2629632,"data_stored":1571772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542189,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51216,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320624,"statfs":{"total":96636764160,"available":96584318976,"internally_reserved":0,"allocated":2031616,"data_stored":981385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T05:36:06.007 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T05:36:06.300 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T05:36:06.301 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T05:36:06.301 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T05:36:06.301 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:36:06.348 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T05:36:06.348 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T05:36:06.348 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:36:06.392 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T05:36:06.392 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T05:36:06.393 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:36:06.432 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T05:36:06.432 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T05:36:06.433 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:36:06.510 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T05:36:06.510 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-11T05:36:06.510 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:36:06.541 INFO:tasks.ceph.osd.4:Stopped 2024-09-11T05:36:06.541 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-11T05:36:06.541 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:36:06.622 INFO:tasks.ceph.osd.5:Stopped 2024-09-11T05:36:06.622 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-11T05:36:06.622 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:36:06.701 INFO:tasks.ceph.osd.6:Stopped 2024-09-11T05:36:06.701 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-11T05:36:06.701 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:36:06.776 INFO:tasks.ceph.osd.7:Stopped 2024-09-11T05:36:06.776 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T05:36:06.776 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-11T05:36:06.776 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:36:06.802 INFO:tasks.ceph.mgr.y:Stopped 2024-09-11T05:36:06.802 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T05:36:06.802 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:36:06.843 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T05:36:06.844 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T05:36:06.844 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T05:36:06.844 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:36:06.856 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T05:36:06.856 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-11T05:36:06.857 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:36:06.908 INFO:tasks.ceph.mon.c:Stopped 2024-09-11T05:36:06.908 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T05:36:06.908 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T05:36:06.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-11T05:36:06.921 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T05:36:06.921 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T05:36:06.921 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-11T05:36:06.982 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T05:36:06.983 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T05:36:07.222 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T05:36:07.222 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T05:36:07.322 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T05:36:07.322 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T05:36:07.377 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T05:36:07.377 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T05:36:07.429 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi084.front.sepia.ceph.com 2024-09-11T05:36:07.429 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-11T05:36:07.538 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi084.front.sepia.ceph.com 2024-09-11T05:36:07.538 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-11T05:36:07.628 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi084.front.sepia.ceph.com 2024-09-11T05:36:07.628 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-11T05:36:07.686 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi084.front.sepia.ceph.com 2024-09-11T05:36:07.686 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-11T05:36:07.760 INFO:tasks.ceph:Archiving mon data... 2024-09-11T05:36:07.761 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900559/data/mon.a.tgz 2024-09-11T05:36:07.761 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-11T05:36:07.777 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.nDio02nTSf 2024-09-11T05:36:07.777 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nDio02nTSf 2024-09-11T05:36:07.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.nDio02nTSf 2024-09-11T05:36:08.017 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.nDio02nTSf is 387KB 2024-09-11T05:36:08.116 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.nDio02nTSf 2024-09-11T05:36:08.132 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900559/data/mon.c.tgz 2024-09-11T05:36:08.133 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-11T05:36:08.186 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.ZN0DFDPTA0 2024-09-11T05:36:08.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ZN0DFDPTA0 2024-09-11T05:36:08.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.ZN0DFDPTA0 2024-09-11T05:36:08.438 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.ZN0DFDPTA0 is 520KB 2024-09-11T05:36:08.535 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.ZN0DFDPTA0 2024-09-11T05:36:08.550 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900559/data/mon.b.tgz 2024-09-11T05:36:08.550 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-09-11T05:36:08.569 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.kRSNWzT2eZ 2024-09-11T05:36:08.570 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.kRSNWzT2eZ 2024-09-11T05:36:08.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.kRSNWzT2eZ 2024-09-11T05:36:08.841 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.kRSNWzT2eZ is 520KB 2024-09-11T05:36:08.939 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.kRSNWzT2eZ 2024-09-11T05:36:08.954 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T05:36:08.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T05:36:08.956 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T05:36:09.035 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T05:36:09.073 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T05:36:09.074 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T05:36:09.075 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900559/remote/smithi070/crash 2024-09-11T05:36:09.076 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T05:36:09.100 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900559/remote/smithi084/crash 2024-09-11T05:36:09.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T05:36:09.137 INFO:tasks.ceph:Compressing logs... 2024-09-11T05:36:09.138 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T05:36:09.145 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T05:36:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33134.log 2024-09-11T05:36:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-11T05:36:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33052.log 2024-09-11T05:36:09.223 INFO:teuthology.orchestra.run.smithi084.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33134.log.gz 2024-09-11T05:36:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33263.log 2024-09-11T05:36:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33052.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.33052.log.gz --verbose 2024-09-11T05:36:09.223 INFO:teuthology.orchestra.run.smithi084.stderr: -- /var/log/ceph/ceph-osd.4.log 2024-09-11T05:36:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33263.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T05:36:09.223 INFO:teuthology.orchestra.run.smithi084.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33263.log.gz 2024-09-11T05:36:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33223.log 2024-09-11T05:36:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33012.log 2024-09-11T05:36:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33223.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.42756.log 2024-09-11T05:36:09.224 INFO:teuthology.orchestra.run.smithi084.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33223.log.gz 2024-09-11T05:36:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33012.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-11T05:36:09.224 INFO:teuthology.orchestra.run.smithi084.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33012.log.gz 2024-09-11T05:36:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-11T05:36:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/objectstore_tool.42756.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T05:36:09.225 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T05:36:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T05:36:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33183.log 2024-09-11T05:36:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.33183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33183.log.gz 2024-09-11T05:36:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32972.log 2024-09-11T05:36:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-11T05:36:09.225 INFO:teuthology.orchestra.run.smithi084.stderr: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T05:36:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33092.log 2024-09-11T05:36:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.32972.log: /var/log/ceph/ceph-mon.b.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32972.log.gz 2024-09-11T05:36:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.33092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33092.log.gz 2024-09-11T05:36:09.225 INFO:teuthology.orchestra.run.smithi084.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T05:36:09.225 INFO:teuthology.orchestra.run.smithi084.stderr: 94.9% -- replaced with /var/log/ceph/objectstore_tool.42756.log.gz 2024-09-11T05:36:09.314 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T05:36:09.315 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57572.log 2024-09-11T05:36:09.315 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54023.log 2024-09-11T05:36:09.315 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59084.log 2024-09-11T05:36:09.315 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57572.log.gz 2024-09-11T05:36:09.315 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46833.log 2024-09-11T05:36:09.315 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54023.log.gz 2024-09-11T05:36:09.315 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59084.log.gz 2024-09-11T05:36:09.315 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39829.log 2024-09-11T05:36:09.315 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56283.log 2024-09-11T05:36:09.315 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46833.log.gz 2024-09-11T05:36:09.315 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54063.log 2024-09-11T05:36:09.315 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39829.log.gz 2024-09-11T05:36:09.315 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47092.log 2024-09-11T05:36:09.316 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56283.log.gz 2024-09-11T05:36:09.316 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55885.log 2024-09-11T05:36:09.316 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54063.log.gz 2024-09-11T05:36:09.316 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48134.log 2024-09-11T05:36:09.316 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47092.log.gz 2024-09-11T05:36:09.316 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55885.log.gz 2024-09-11T05:36:09.316 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58887.log 2024-09-11T05:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41894.log 2024-09-11T05:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48134.log.gz 2024-09-11T05:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58883.log 2024-09-11T05:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58887.log.gz 2024-09-11T05:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45118.log 2024-09-11T05:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41894.log.gz 2024-09-11T05:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58883.log.gz 2024-09-11T05:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59630.log 2024-09-11T05:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58884.log 2024-09-11T05:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45118.log.gz 2024-09-11T05:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41548.log 2024-09-11T05:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59630.log.gz 2024-09-11T05:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58885.log 2024-09-11T05:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58884.log.gz 2024-09-11T05:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41548.log.gz 2024-09-11T05:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59252.log 2024-09-11T05:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46469.log 2024-09-11T05:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58885.log.gz 2024-09-11T05:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56305.log 2024-09-11T05:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59252.log.gz 2024-09-11T05:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38957.log 2024-09-11T05:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46469.log.gz 2024-09-11T05:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56305.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.56305.log.gz -- 2024-09-11T05:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.43111.log 2024-09-11T05:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51854.log 2024-09-11T05:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38957.log.gz 2024-09-11T05:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42865.log 2024-09-11T05:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43111.log.gz 2024-09-11T05:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43847.log 2024-09-11T05:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51854.log.gz 2024-09-11T05:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42865.log.gz 2024-09-11T05:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38619.log 2024-09-11T05:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59840.log 2024-09-11T05:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43847.log.gz 2024-09-11T05:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57019.log 2024-09-11T05:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38619.log.gz 2024-09-11T05:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59168.log 2024-09-11T05:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59840.log.gz 2024-09-11T05:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57019.log.gz 2024-09-11T05:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55199.log 2024-09-11T05:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59168.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T05:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59168.log.gz 2024-09-11T05:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59672.log 2024-09-11T05:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55199.log.gz 2024-09-11T05:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57189.log 2024-09-11T05:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59672.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.57404.log -- replaced with /var/log/ceph/ceph-client.admin.59672.log.gz 2024-09-11T05:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T05:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57231.log 2024-09-11T05:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57189.log.gz 2024-09-11T05:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57404.log.gz 2024-09-11T05:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45926.log 2024-09-11T05:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40282.log 2024-09-11T05:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57231.log.gz 2024-09-11T05:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45926.log.gz 2024-09-11T05:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46185.log 2024-09-11T05:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57273.log 2024-09-11T05:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40282.log.gz 2024-09-11T05:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58748.log 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46185.log.gz 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46552.log 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57273.log.gz 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58748.log.gz 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40283.log 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46226.log 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46552.log.gz 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40283.log.gz 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50716.log 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53716.log 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46226.log.gz 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50716.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50716.log.gz 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39272.log 2024-09-11T05:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58547.log 2024-09-11T05:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53716.log.gz 2024-09-11T05:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39272.log.gz 2024-09-11T05:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log 2024-09-11T05:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37372.log 2024-09-11T05:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58547.log.gz 2024-09-11T05:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40143.log.gz 2024-09-11T05:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57782.log 2024-09-11T05:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58552.log 2024-09-11T05:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37372.log.gz 2024-09-11T05:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57782.log.gz 2024-09-11T05:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55568.log 2024-09-11T05:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51501.log 2024-09-11T05:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58552.log.gz 2024-09-11T05:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55568.log.gz 2024-09-11T05:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38952.log 2024-09-11T05:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42525.log 2024-09-11T05:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51501.log.gz 2024-09-11T05:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38952.log.gz 2024-09-11T05:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48662.log 2024-09-11T05:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39276.log 2024-09-11T05:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42525.log.gz 2024-09-11T05:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48662.log.gz 2024-09-11T05:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55865.log 2024-09-11T05:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54899.log 2024-09-11T05:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39276.log.gz 2024-09-11T05:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55865.log.gz 2024-09-11T05:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43968.log 2024-09-11T05:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41106.log 2024-09-11T05:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54899.log.gz 2024-09-11T05:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43968.log.gz 2024-09-11T05:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57320.log 2024-09-11T05:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57656.log 2024-09-11T05:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41106.log.gz 2024-09-11T05:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59126.log 2024-09-11T05:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57320.log.gz 2024-09-11T05:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39997.log 2024-09-11T05:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57656.log.gz 2024-09-11T05:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59126.log.gz 2024-09-11T05:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42404.log 2024-09-11T05:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40195.log 2024-09-11T05:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39997.log.gz 2024-09-11T05:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42404.log.gz 2024-09-11T05:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50439.log 2024-09-11T05:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.40195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57824.log 2024-09-11T05:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50439.log.gz 2024-09-11T05:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53512.log 2024-09-11T05:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55038.log 2024-09-11T05:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57824.log: 95.4% -- replaced with /var/log/ceph/ceph-client.0.40195.log.gz 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57824.log.gz 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53512.log.gz 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46653.log 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59588.log 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55038.log.gz 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46653.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.46653.log.gz 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45747.log 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60008.log 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59588.log.gz 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45747.log.gz 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39871.log 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60008.log.gz 2024-09-11T05:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47938.log 2024-09-11T05:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39871.log.gz 2024-09-11T05:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40679.log 2024-09-11T05:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58546.log 2024-09-11T05:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47938.log.gz 2024-09-11T05:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40679.log.gz 2024-09-11T05:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53611.log 2024-09-11T05:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58539.log 2024-09-11T05:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58546.log.gz 2024-09-11T05:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53611.log.gz 2024-09-11T05:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58209.log 2024-09-11T05:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52288.log 2024-09-11T05:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58539.log: 0.0% 93.7% -- replaced with /var/log/ceph/ceph-client.admin.58539.log.gz 2024-09-11T05:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T05:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58209.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.58209.log.gz 2024-09-11T05:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.47297.log 2024-09-11T05:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44332.log 2024-09-11T05:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52288.log.gz 2024-09-11T05:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44210.log 2024-09-11T05:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47297.log.gz 2024-09-11T05:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59420.log 2024-09-11T05:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44332.log.gz 2024-09-11T05:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44210.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.44210.log.gz 2024-09-11T05:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48301.log 2024-09-11T05:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58215.log 2024-09-11T05:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59420.log.gz 2024-09-11T05:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48301.log.gz 2024-09-11T05:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46363.log 2024-09-11T05:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57530.log 2024-09-11T05:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58215.log.gz 2024-09-11T05:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46363.log.gz 2024-09-11T05:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50014.log 2024-09-11T05:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58034.log 2024-09-11T05:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57530.log.gz 2024-09-11T05:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50014.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27275.log 2024-09-11T05:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50014.log.gz 2024-09-11T05:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46048.log 2024-09-11T05:36:09.333 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58034.log.gz 2024-09-11T05:36:09.333 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.tmp-client.admin.27275.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27275.log.gz 2024-09-11T05:36:09.333 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59756.log 2024-09-11T05:36:09.333 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51249.log 2024-09-11T05:36:09.333 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46048.log.gz 2024-09-11T05:36:09.333 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59756.log.gz 2024-09-11T05:36:09.333 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38563.log 2024-09-11T05:36:09.333 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57866.log 2024-09-11T05:36:09.333 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51249.log.gz 2024-09-11T05:36:09.333 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42686.log 2024-09-11T05:36:09.333 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38563.log.gz 2024-09-11T05:36:09.333 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49406.log 2024-09-11T05:36:09.333 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57866.log.gz 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54832.log 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42686.log.gz 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33462.log 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49406.log.gz 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54832.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.54832.log.gz 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49000.log 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54410.log 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33462.log.gz 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49000.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-mon.c.log 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49000.log.gz 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57614.log 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54410.log.gz 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52751.log 2024-09-11T05:36:09.334 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41208.log 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57614.log.gz 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33563.log 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52751.log.gz 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39610.log 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41208.log.gz 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38961.log 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33563.log.gz 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39610.log.gz 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59714.log 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53384.log 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38961.log.gz 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59714.log.gz 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50140.log 2024-09-11T05:36:09.335 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59462.log 2024-09-11T05:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53384.log.gz 2024-09-11T05:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50140.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.50140.log.gz /var/log/ceph/ceph-client.admin.45804.log 2024-09-11T05:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T05:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58886.log 2024-09-11T05:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59462.log.gz 2024-09-11T05:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45804.log.gz 2024-09-11T05:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57041.log 2024-09-11T05:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46711.log 2024-09-11T05:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58886.log.gz 2024-09-11T05:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55671.log 2024-09-11T05:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57041.log.gz 2024-09-11T05:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41024.log 2024-09-11T05:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46711.log.gz 2024-09-11T05:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55671.log.gz 2024-09-11T05:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47010.log 2024-09-11T05:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44848.log 2024-09-11T05:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41024.log.gz 2024-09-11T05:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47010.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.47010.log.gz -5 2024-09-11T05:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52605.log 2024-09-11T05:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59798.log 2024-09-11T05:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44848.log.gz 2024-09-11T05:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52858.log 2024-09-11T05:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52605.log.gz 2024-09-11T05:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49080.log 2024-09-11T05:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59798.log.gz 2024-09-11T05:36:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52858.log.gz 2024-09-11T05:36:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39612.log 2024-09-11T05:36:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39275.log 2024-09-11T05:36:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49080.log.gz 2024-09-11T05:36:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43948.log 2024-09-11T05:36:09.338 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39612.log.gz 2024-09-11T05:36:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58881.log 2024-09-11T05:36:09.338 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39275.log.gz 2024-09-11T05:36:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43948.log.gz 2024-09-11T05:36:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42151.log 2024-09-11T05:36:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57740.log 2024-09-11T05:36:09.338 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58881.log.gz 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42151.log.gz 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54453.log 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57698.log 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57740.log.gz 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54453.log.gzgzip 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59546.log 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57105.log 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57698.log.gz 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50957.log 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59546.log.gz 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43614.log 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57105.log.gz 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38959.log 2024-09-11T05:36:09.339 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50957.log.gz 2024-09-11T05:36:09.340 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39608.log 2024-09-11T05:36:09.340 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43614.log.gz 2024-09-11T05:36:09.340 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38959.log.gz 2024-09-11T05:36:09.340 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T05:36:09.340 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58204.log 2024-09-11T05:36:09.340 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39608.log.gz 2024-09-11T05:36:09.340 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50802.log 2024-09-11T05:36:09.340 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60050.log 2024-09-11T05:36:09.340 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58204.log.gz 2024-09-11T05:36:09.340 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44541.log 2024-09-11T05:36:09.340 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50802.log.gz 2024-09-11T05:36:09.340 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38960.log 2024-09-11T05:36:09.341 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60050.log.gz 2024-09-11T05:36:09.341 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58210.log 2024-09-11T05:36:09.341 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44541.log.gz 2024-09-11T05:36:09.341 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57446.log 2024-09-11T05:36:09.341 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38960.log.gz 2024-09-11T05:36:09.341 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49668.log 2024-09-11T05:36:09.341 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58210.log.gz 2024-09-11T05:36:09.341 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52331.log 2024-09-11T05:36:09.341 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57446.log.gz 2024-09-11T05:36:09.341 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44782.log 2024-09-11T05:36:09.341 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49668.log.gz 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42431.log 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52331.log.gz 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52710.log 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44782.log.gz 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45496.log 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42431.log.gz 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50077.log 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52710.log.gz 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57950.log 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45496.log.gz 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56717.log 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50077.log.gz 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42600.log 2024-09-11T05:36:09.342 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57950.log.gz 2024-09-11T05:36:09.343 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56717.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T05:36:09.343 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56717.log.gz 2024-09-11T05:36:09.343 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59378.log 2024-09-11T05:36:09.343 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42600.log.gz 2024-09-11T05:36:09.343 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40081.log 2024-09-11T05:36:09.343 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59378.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59378.log.gz 2024-09-11T05:36:09.343 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43681.log 2024-09-11T05:36:09.343 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40081.log.gz 2024-09-11T05:36:09.343 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39493.log 2024-09-11T05:36:09.343 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43681.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43681.log.gz 2024-09-11T05:36:09.343 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55313.log 2024-09-11T05:36:09.343 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39493.log.gz 2024-09-11T05:36:09.343 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45017.log 2024-09-11T05:36:09.344 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55313.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55313.log.gz 2024-09-11T05:36:09.344 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42922.log 2024-09-11T05:36:09.344 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45017.log.gz 2024-09-11T05:36:09.344 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58549.log 2024-09-11T05:36:09.344 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60092.log 2024-09-11T05:36:09.344 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42922.log.gz 2024-09-11T05:36:09.344 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48416.log 2024-09-11T05:36:09.344 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58549.log.gz 2024-09-11T05:36:09.344 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5/var/log/ceph/ceph-client.admin.60092.log: --verbose -- 0.0% /var/log/ceph/ceph-client.admin.39297.log 2024-09-11T05:36:09.344 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48416.log: -- replaced with /var/log/ceph/ceph-client.admin.60092.log.gz 2024-09-11T05:36:09.345 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48416.log.gz 2024-09-11T05:36:09.345 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39277.log 2024-09-11T05:36:09.345 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39297.log: gzip -5 0.0% --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-11T05:36:09.345 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39297.log.gz 2024-09-11T05:36:09.345 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57147.log 2024-09-11T05:36:09.345 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39277.log.gz 2024-09-11T05:36:09.345 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60132.log 2024-09-11T05:36:09.345 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mgr.y.log: gzip/var/log/ceph/ceph-client.admin.57147.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44625.log 2024-09-11T05:36:09.345 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57147.log.gz 2024-09-11T05:36:09.345 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60132.log.gz 2024-09-11T05:36:09.345 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58550.log 2024-09-11T05:36:09.345 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39260.log 2024-09-11T05:36:09.345 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44625.log.gz 2024-09-11T05:36:09.346 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58550.log.gz 2024-09-11T05:36:09.346 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49226.log 2024-09-11T05:36:09.346 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51556.log 2024-09-11T05:36:09.346 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39260.log.gz 2024-09-11T05:36:09.346 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49226.log.gz 2024-09-11T05:36:09.346 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47532.log 2024-09-11T05:36:09.346 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51556.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T05:36:09.346 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51556.log.gz 2024-09-11T05:36:09.346 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47532.log.gz 2024-09-11T05:36:09.346 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58551.log 2024-09-11T05:36:09.346 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58214.log 2024-09-11T05:36:09.347 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58551.log.gz 2024-09-11T05:36:09.347 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53157.log 2024-09-11T05:36:09.347 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58214.log.gz 2024-09-11T05:36:09.347 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41777.log 2024-09-11T05:36:09.347 INFO:teuthology.orchestra.run.smithi070.stderr: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T05:36:09.347 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53157.log.gz 2024-09-11T05:36:09.348 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39609.log 2024-09-11T05:36:09.348 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51144.log 2024-09-11T05:36:09.348 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41777.log.gz 2024-09-11T05:36:09.348 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39609.log.gz 2024-09-11T05:36:09.348 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38737.log 2024-09-11T05:36:09.348 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54213.log 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51144.log.gz 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38737.log.gz 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48709.log 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr:gzip/var/log/ceph/ceph-client.admin.54213.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38958.log 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54213.log.gz 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48709.log.gz 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39633.log 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44140.log 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38958.log.gz 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39633.log.gz 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51921.log 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59294.log 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44140.log.gz 2024-09-11T05:36:09.349 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51921.log.gz 2024-09-11T05:36:09.350 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38695.log 2024-09-11T05:36:09.350 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56668.log 2024-09-11T05:36:09.350 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59294.log.gz 2024-09-11T05:36:09.350 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38695.log.gz 2024-09-11T05:36:09.350 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49509.log 2024-09-11T05:36:09.350 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47879.log 2024-09-11T05:36:09.350 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56668.log.gz 2024-09-11T05:36:09.350 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49509.log.gz 2024-09-11T05:36:09.350 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58216.log 2024-09-11T05:36:09.350 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55438.log 2024-09-11T05:36:09.350 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47879.log.gz 2024-09-11T05:36:09.350 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58216.log.gz 2024-09-11T05:36:09.350 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56471.log 2024-09-11T05:36:09.351 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57362.log 2024-09-11T05:36:09.351 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55438.log.gz 2024-09-11T05:36:09.351 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56471.log.gz 2024-09-11T05:36:09.351 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47591.log 2024-09-11T05:36:09.351 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39913.log 2024-09-11T05:36:09.351 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57362.log.gz 2024-09-11T05:36:09.351 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47591.log.gz 2024-09-11T05:36:09.351 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40622.log 2024-09-11T05:36:09.351 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56222.log 2024-09-11T05:36:09.352 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39913.log.gz 2024-09-11T05:36:09.352 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40622.log.gz 2024-09-11T05:36:09.352 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45308.log 2024-09-11T05:36:09.352 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57488.log 2024-09-11T05:36:09.352 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56222.log.gz 2024-09-11T05:36:09.352 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45308.log.gz 2024-09-11T05:36:09.352 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53066.log 2024-09-11T05:36:09.352 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38779.log 2024-09-11T05:36:09.352 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57488.log.gz 2024-09-11T05:36:09.352 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53066.log.gz 2024-09-11T05:36:09.352 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45676.log 2024-09-11T05:36:09.352 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38779.log.gz 2024-09-11T05:36:09.352 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55502.log 2024-09-11T05:36:09.353 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40906.log 2024-09-11T05:36:09.353 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45676.log.gz 2024-09-11T05:36:09.353 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55502.log.gz 2024-09-11T05:36:09.353 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58538.log 2024-09-11T05:36:09.353 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40906.log.gz 2024-09-11T05:36:09.353 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45309.log 2024-09-11T05:36:09.353 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43279.log 2024-09-11T05:36:09.353 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58538.log.gz 2024-09-11T05:36:09.353 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45309.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50363.log 2024-09-11T05:36:09.353 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T05:36:09.353 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43279.log.gz 2024-09-11T05:36:09.353 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59336.log 2024-09-11T05:36:09.354 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39267.log 2024-09-11T05:36:09.354 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50363.log.gz 2024-09-11T05:36:09.354 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59336.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38956.log 2024-09-11T05:36:09.354 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T05:36:09.354 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39267.log.gz 2024-09-11T05:36:09.354 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59966.log 2024-09-11T05:36:09.354 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38956.log.gz 2024-09-11T05:36:09.354 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41206.log 2024-09-11T05:36:09.354 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43335.log 2024-09-11T05:36:09.354 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59966.log.gz 2024-09-11T05:36:09.354 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41206.log.gz 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38951.log 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43335.log.gz 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39955.log 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49808.log 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38951.log.gz 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39955.log.gz 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58212.log 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49808.log.gz 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59882.log 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39611.log 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58212.log.gz 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59882.log.gz 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44724.log 2024-09-11T05:36:09.355 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39611.log.gz 2024-09-11T05:36:09.356 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40281.log 2024-09-11T05:36:09.356 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42323.log 2024-09-11T05:36:09.356 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44724.log.gz 2024-09-11T05:36:09.356 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40281.log.gz 2024-09-11T05:36:09.356 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57992.log 2024-09-11T05:36:09.356 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44786.log 2024-09-11T05:36:09.356 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42323.log.gz 2024-09-11T05:36:09.356 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57992.log.gz 2024-09-11T05:36:09.356 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54757.log 2024-09-11T05:36:09.356 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44786.log.gz 2024-09-11T05:36:09.356 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52057.log 2024-09-11T05:36:09.356 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44930.log 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54757.log.gz 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52057.log.gz 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59504.log 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44930.log.gz 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44209.log 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38644.log 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59504.log.gz 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44209.log.gz 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49913.log 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38644.log.gz 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59924.log 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41504.log 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49913.log.gz 2024-09-11T05:36:09.357 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59924.log.gz 2024-09-11T05:36:09.358 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33160.log 2024-09-11T05:36:09.358 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41504.log.gz 2024-09-11T05:36:09.358 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53964.log 2024-09-11T05:36:09.358 INFO:teuthology.orchestra.run.smithi070.stderr:gzip/var/log/ceph/ceph-client.admin.33160.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55750.log 2024-09-11T05:36:09.358 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33160.log.gz 2024-09-11T05:36:09.358 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53964.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47418.log 2024-09-11T05:36:09.358 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53964.log.gz 2024-09-11T05:36:09.358 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55750.log.gz 2024-09-11T05:36:09.358 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44353.log 2024-09-11T05:36:09.358 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39254.log 2024-09-11T05:36:09.358 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47418.log.gz 2024-09-11T05:36:09.358 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44353.log.gz 2024-09-11T05:36:09.358 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58208.log 2024-09-11T05:36:09.359 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39254.log.gz 2024-09-11T05:36:09.359 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40039.log 2024-09-11T05:36:09.359 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59210.log 2024-09-11T05:36:09.359 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58208.log.gz 2024-09-11T05:36:09.359 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40039.log.gz 2024-09-11T05:36:09.359 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41043.log 2024-09-11T05:36:09.359 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59210.log.gz 2024-09-11T05:36:09.359 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58888.log 2024-09-11T05:36:09.359 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57908.log 2024-09-11T05:36:09.359 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41043.log.gz 2024-09-11T05:36:09.359 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58888.log.gz 2024-09-11T05:36:09.359 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49166.log 2024-09-11T05:36:09.359 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57908.log.gz 2024-09-11T05:36:09.360 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T05:36:09.360 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53383.log 2024-09-11T05:36:09.360 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49166.log.gz 2024-09-11T05:36:09.360 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54808.log 2024-09-11T05:36:09.360 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53383.log.gz 2024-09-11T05:36:09.360 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39613.log 2024-09-11T05:36:09.360 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54808.log.gz 2024-09-11T05:36:09.360 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41964.log 2024-09-11T05:36:09.360 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39613.log.gz 2024-09-11T05:36:09.360 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41964.log.gz 2024-09-11T05:36:09.361 INFO:teuthology.orchestra.run.smithi070.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-11T05:36:09.361 INFO:teuthology.orchestra.run.smithi070.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-11T05:36:09.362 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-11T05:36:09.375 INFO:teuthology.orchestra.run.smithi084.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-11T05:36:09.468 INFO:teuthology.orchestra.run.smithi070.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T05:36:11.131 INFO:teuthology.orchestra.run.smithi070.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T05:36:11.618 INFO:teuthology.orchestra.run.smithi084.stderr: 96.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-11T05:36:11.853 INFO:teuthology.orchestra.run.smithi084.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-11T05:36:11.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-11T05:36:12.538 INFO:teuthology.orchestra.run.smithi070.stderr: 95.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T05:36:12.885 INFO:teuthology.orchestra.run.smithi084.stderr: 95.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-11T05:36:12.886 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-09-11T05:36:12.887 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m3.690s 2024-09-11T05:36:12.887 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m8.690s 2024-09-11T05:36:12.887 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m0.391s 2024-09-11T05:36:13.504 INFO:teuthology.orchestra.run.smithi070.stderr: 95.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T05:36:14.488 INFO:teuthology.orchestra.run.smithi070.stderr: 95.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T05:36:14.490 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T05:36:14.490 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m5.333s 2024-09-11T05:36:14.490 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m14.743s 2024-09-11T05:36:14.490 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m0.766s 2024-09-11T05:36:14.490 INFO:tasks.ceph:Archiving logs... 2024-09-11T05:36:14.491 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900559/remote/smithi070/log 2024-09-11T05:36:14.492 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T05:36:16.523 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900559/remote/smithi084/log 2024-09-11T05:36:16.524 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T05:36:17.665 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T05:36:17.675 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T05:36:17.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T05:36:17.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T05:36:17.757 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T05:36:17.765 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T05:36:17.766 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T05:36:17.768 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T05:36:17.783 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-11T05:36:17.786 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-09-11T05:36:17.788 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T05:36:17.788 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-11T05:36:17.788 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 +140us[ +117us] +/- 50ms 2024-09-11T05:36:17.788 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 18 -1036us[-1036us] +/- 50ms 2024-09-11T05:36:17.788 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +707us[ +707us] +/- 74ms 2024-09-11T05:36:17.788 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:36:17.791 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T05:36:17.791 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-09-11T05:36:17.791 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 +135us[ +113us] +/- 49ms 2024-09-11T05:36:17.791 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 -1017us[-1017us] +/- 50ms 2024-09-11T05:36:17.792 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +690us[ +690us] +/- 74ms 2024-09-11T05:36:17.792 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T05:36:17.792 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T05:36:17.802 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T05:36:17.802 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T05:36:17.811 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T05:36:17.911 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T05:36:17.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T05:36:18.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:36:18.020 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T05:36:18.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:36:18.050 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T05:36:18.060 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T05:36:18.069 INFO:teuthology.task.internal:Duration was 634.789511 seconds 2024-09-11T05:36:18.069 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T05:36:18.078 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T05:36:18.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T05:36:18.081 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T05:36:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T05:36:18.130 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T05:36:18.529 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T05:36:18.529 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T05:36:18.530 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T05:36:18.591 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-09-11T05:36:18.592 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T05:36:18.629 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T05:36:18.629 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T05:36:18.634 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T05:36:18.696 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T05:36:18.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T05:36:18.701 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T05:36:18.851 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T05:36:18.861 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T05:36:18.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T05:36:18.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T05:36:18.912 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T05:36:18.927 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T05:36:18.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T05:36:18.951 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-09-11T05:36:18.974 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-09-11T05:36:19.012 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T05:36:19.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:36:19.028 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T05:36:19.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T05:36:19.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T05:36:19.078 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T05:36:19.078 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900559/remote/smithi070 2024-09-11T05:36:19.079 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T05:36:19.120 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900559/remote/smithi084 2024-09-11T05:36:19.120 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T05:36:19.153 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T05:36:19.153 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T05:36:19.156 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T05:36:19.203 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T05:36:19.215 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T05:36:19.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T05:36:19.224 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T05:36:19.224 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T05:36:19.227 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T05:36:19.239 INFO:teuthology.orchestra.run.smithi070.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 05:36 /home/ubuntu/cephtest 2024-09-11T05:36:19.258 INFO:teuthology.orchestra.run.smithi084.stdout: 266042 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 05:36 /home/ubuntu/cephtest 2024-09-11T05:36:19.259 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T05:36:19.271 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T05:36:19.294 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} duration: 634.7895114421844 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-11T05:36:19.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T05:36:19.379 INFO:teuthology.run:pass